EY - GDS Consulting - AI And DATA - Data Engineer- Manager
Hyderabad, TG, IN, 500081
INR 2000K-3000K (estimate) Mid-level Full Time
Tasks
- Automate data workflow deployments
- Build and optimize ETL pipelines
- Conduct code reviews and enforce best practices
- Design enterprise data platforms on AWS
- Develop and maintain automated data pipelines
- Develop batch and streaming pipelines in Databricks
- Facilitate scrum ceremonies
- Implement scalable data modeling
- Lead technical design and implementation
- Manage mentor and upskill data engineering team
- Manage sprint planning and backlog grooming in Jira
- Monitor log and ensure data quality governance
- Translate technical concepts for non-technical stakeholders
Perks/Benefits
- Career development opportunities
- Coaching and feedback
- Discounts and offers
- Flexible working
- Health and well-being benefits
- Insurance
- Relocation support
- Savings plan
Skills/Tech-stack
AWS | AWS CloudFormation | AWS DynamoDB | AWS ECS | AWS EKS | AWS Glue | AWS Lambda | Amazon EMR | Amazon Redshift | Amazon S3 | Apache Airflow | Apache Spark | Athena | CI/CD | DAGs | Data Modeling | Data mesh | Databricks | Delta Lake | Docker | ETL | EventBridge | GitHub Actions | IAM | Iceberg | Inmon Method | Jenkins | Kafka | Kimball Method | Kinesis | Medallion Architecture | NoSQL | Prefect | PySpark | Redshift | SQL | Shell Scripting | Step Functions | Terraform | VPC
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Related jobs
-
Senior Data Engineer (Databricks) INR 1200K-2000KAWS Glue | AWS IAM | AWS Lambda | AWS S3 | AWS VPCSenior-level Full TimeMaharashtra, Pune, India6h ago
-
Mid-level Full TimeIndia-Bangalore7h ago
-
Manager, ML CV Ops Engineer INR 1000K-1400KAWS | Airflow | ArgoCD | Azure | CI/CDCareer growth | Mentorship | TrainingMid-level Full TimeIndia-Bangalore7h ago
-
Business Analyst - ML Engineer INR 2000K-2500KARIMA | Docker | Embeddings | Experimentation | FastAPIEntry-level Full TimeIndia-Gurugram7h ago
-
Software Engineer II - Python, Kubernetes, GenAI/ML INR 1000K-2000KAgile | Application Resiliency | CI/CD | Debugging | Development Life CycleMid-level Full TimeBengaluru, Karnataka, India7h ago
-
Senior-level Full TimeIN-KA-Bangalore7h ago
-
Mid-level Full TimeIN-KA-Bangalore7h ago
-
Senior-level Full TimeIN-TN-Chennai7h ago
-
Data & Analytics Cloud Manager/Architect INR 2500K-4000KAPIs | Automated retraining | BigQuery | CI/CD | Cloud AISenior-level Full TimeIndia7h ago
-
Software Engineer III - Databricks, SQL , Python INR 2500K-3900KApache Spark | Data Lake | Data Warehouse | Databricks | ETLSenior-level Full TimeBengaluru, Karnataka, India8h ago
-
Senior Lead Software Engineer - DataBricks, SQL INR 2000K-3300KAWS | Apache Spark | Data Lake | Data Warehouse | DatabricksSenior-level Full TimeBengaluru, Karnataka, India8h ago
-
Tech Lead/Senior Tech Lead - Embedded Software Development INR 1170K-2156KARM | C# | C++ | CAN | Code AnalysisSenior-level Full TimePUNE, MAHARASHTRA, India9h ago
-
(#1316 )- Python and Machine Learning Engineer INR 1800K-2500KClustering | Deep learning | Django | Flask | GitContinuous learningMid-level Full TimeAndhra Pradesh, Visakhapatnam, India9h ago
-
API Design | CRM | ERP | Function Calling | GeminiSenior-level Full TimeHyderabad, Telangana, India; Bengaluru, Karnataka, India9h ago
-
Data and Analytics Lead, Google Cloud INR 1200K-2000KApache | Apache Hive | Apache Spark | Big Data | Cloud adoptionSenior-level Full TimeBengaluru, Karnataka, India; Gurugram, Haryana, India9h ago
-
Data Engineer, YouTube INR 1500K-2000KApache Flume | Apache Spark | Cloud platform | Data Analysis | Data EngineeringMid-level Full TimeBengaluru, Karnataka, India9h ago
-
Data Engineer, Cross Play Intelligence INR 1500K-2000KAutomation | C++ | Data Analysis | Data Modeling | Data PreparationMid-level Full TimeBengaluru, Karnataka, India9h ago
-
AWS Data Engineer INR 1500K-2000KAWS Glue | AWS S3 | Amazon Athena | Amazon EMR | Apache SparkHybrid workMid-level Full TimeBengaluru, Karnataka, India9h ago
-
Assistant Vice President INR 1500K-6000KAgile | Apache Spark | Azure AI | Azure Data | Azure Data FactoryExecutive-level Full TimeNoida, Uttar Pradesh, India10h ago
-
AWS | Apache Kafka | Apache NiFi | Apache Spark | Batch ProcessingHybrid workMid-level Full TimeBengaluru, INDIA, India10h ago
-
Sr. SW Test Engineer (3-5 years of experience in Big Data Testing, Pyspark, ETL Testing, SQL) INR 1536K-2500KCI/CD | Data Quality | ETL | Hive | PySparkHybrid workSenior-level Full TimeBengaluru, INDIA, India10h ago
-
Software Engineer III – SQL, Python, Spark, AWS INR 2000K-3200KAWS Glue | Amazon S3 | Amazon Web Services | Apache Spark | Application ResiliencySenior-level Full TimeMumbai, Maharashtra, India11h ago
-
Senior Research Engineer - Applied AI/ML INR 2500K-3500KA/B | A/B Testing | AWS | Amazon SageMaker | Apache AirflowSenior-level Full TimeGurugram, India11h ago
-
Data Quality Manager INR 1300K-2000KAb Initio | Ataccama | Data Catalog | Data Cleansing | Data GovernanceMid-level Full TimeBengaluru, IN, 56010312h ago
-
Data Engineer III - Big Data, Java, Scala INR 2000K-2755KAWS | Agile | Apache Spark | Big Data | CI/CDSenior-level Full TimeBengaluru, Karnataka, India12h ago