Principal Consultant-Data Engineer
Tasks
- Analyze business and functional requirements
- Build and optimize data pipelines
- Convert user stories into technical requirements
- Coordinate with supporting teams
- Deploy changes to production with release management
- Design and implement Informatica ETL workflows
- Design and optimize batch and near real time pipelines
- Develop PL SQL procedures functions and packages
- Develop big data applications with Apache Hadoop and Apache Spark
- Ensure cloud data security and encryption
- Implement backup, disaster recovery, and business continuity
- Monitor and optimize cloud resource performance
- Participate in design reviews
- Perform ETL operations
- Perform data migration in cloud services
Perks/Benefits
- N/A
Skills/Tech-stack
Amazon Redshift | Amazon Web Services | Apache Hadoop | Apache Kafka | Apache Spark | Backup and Restore | Big Data | Business Continuity | Cassandra | Cloud Security | Cloud platform | Data Lakes | Data Warehousing | Dimensional Modeling | Disaster Recovery | ETL | Encryption | Google BigQuery | Google Cloud | Google Cloud Platform | Informatica | Microsoft Azure | MongoDB | MySQL | PL/SQL | PostgreSQL | Python | SQL | Snowflake | Web Services
Roles
Data Engineer | Engineer | Principal | Principal Data Engineer
Related jobs
-
Machine Learning Engineer INR 2500K-3000KAWS | Automation | Google Cloud | Java | Language ModelsCollaborative team environment | Continuous learning | Professional development opportunitiesEntry-level Full TimeBengaluru, India6h ago
-
PySpark Data Engineer INR 1500K-2000KApache Airflow | Apache Hadoop | Apache Hive | Apache Spark | HDFSSenior-level Full TimeJaipur, India6h ago
-
Mid-level Full TimeBangalore South, India6h ago
-
Senior-level Full TimeChennai City Corporation, India6h ago
-
Lead Consultant-Data Engineer INR 2040K-2400KAmazon Redshift | Amazon Web Services | Apache Hadoop | Apache Kafka | Apache SparkSenior-level Full TimeIndia-Bangalore7h ago
-
Amazon AWS | Amazon Redshift | Apache Hadoop | Apache Kafka | Apache SparkSenior-level Full TimeIndia-Bangalore7h ago
-
Lead Consultant - Lead Data Ops (Human-in-the-loop) INR 2000K-2040KAmazon Redshift | Amazon Web Services | Apache Hadoop | Apache Kafka | Apache SparkContinuous learning opportunities | Mentored career growth | MentorshipSenior-level Full TimeIndia-Bangalore7h ago
-
Lead Consultant - Security/Network SME INR 2040K-2400KAmazon Redshift | Amazon Web Services | Apache Hadoop | Apache Kafka | Apache SparkSenior-level Full TimeIndia-Bangalore7h ago
-
Lead Consultant - IAC Engineer INR 2486K-3380KAmazon Redshift | Amazon Web Services | Apache Hadoop | Apache Kafka | Apache SparkContinuous learning opportunities | MentorshipSenior-level Full TimeIndia-Bangalore7h ago
-
Mid-level Full TimeIN-TN-Chennai7h ago
-
Senior-level Full TimePune, Maharashtra, India7h ago
-
Staff Engineer, Data Analytics Engineering ( 6+ years Full Stack Developer - React, JavaScript, and Python / Node.js, AWS, SQL ) INR 2520K-4725KAI/ML | API Gateway | AWS Lambda | Amazon ECS | Amazon EKSSenior-level Full TimeBengaluru, KA, India7h ago
-
Analyst,Decision Intellingence INR 2000K-3000KAPI Development | AWS | Azure | Azure Cognitive | Azure Cognitive ServicesHybrid work | Travel opportunityMid-level Full TimeNew Delhi, India7h ago
-
API Gateway | AWS | Argo CD | Bash | CI/CDCharity matching | Corporate volunteering | Medical/Dental/Vision | Paid time off | Retirement planningMid-level Full TimeVadodara, GJ, IN8h ago
-
Software Engineer III - Databricks, Cloud Data Engineer INR 2000K-2400KAWS EMR | Agile | Apache Spark | Application development | Big DataSenior-level Full TimeHyderabad, Telangana, India8h ago
-
Software Engineer II - Databricks, Cloud Data Engineer INR 1500K-2500KAWS EMR | Agile | Apache Spark | Big Data | CI/CDMid-level Full TimeHyderabad, Telangana, India8h ago
-
Linguistic Engineer INR 2400K-3000KASR | Data Analysis | Data Infrastructure | Data Pipelines | DialogMid-level Full TimeHyderabad, India8h ago
-
Software Engineer III, AI/ML, Google Cloud INR 2500K-4500KC++ | Computer Vision | Data Structures | Data Structures and Algorithms | Language ModelsSenior-level Full TimeBengaluru, Karnataka, India8h ago
-
Senior AI/ML Engineer II INR 2500K-4500KAzure | C++ | Deep learning | Generative AI | Hugging FaceCareer advancement programs | Dental insurance | Employee assistance program | Flexible work options | Health insuranceSenior-level Full TimeBangalore, Karnataka, India9h ago
-
Senior-level Full TimeIndia9h ago
-
Data Engineer - Chennai / Bengaluru INR 2000K-2040KAgile Scrum | Apache Airflow | Apache Hive | Apache Kafka | Apache SupersetSenior-level Full TimeIndia9h ago
-
Senior-level Full TimeIndia9h ago
-
Associate Principal Engineer (India Office) INR 2000K-3000K.NET | Azure | Azure Data | Azure Data Factory | C SharpMid-level Full TimeBangalore, Karnataka, India9h ago
-
Executive - Python+SQL INR 264K-360KCI/CD | Data Cleansing | Data Denormalization | Data Modeling | Data NormalizationExecutive-level Full TimeGurgaon, Haryana, India10h ago
-
Mgr, DevOps Engineering - Moveworks INR 3222K-4725KAWS | AWS KMS | Ansible | CI/CD | CloudFormationSenior-level Full TimeBangalore, Karnataka, India10h ago