EY - GDS Consulting - AI And DATA - Data Engineer- Manager 3
INR 2000K-3000K (estimate) Mid-level Full Time
Tasks
- Conduct Scrum ceremonies and manage Jira backlog
- Define long-term data strategy
- Design enterprise data platforms on AWS
- Develop and maintain automated data pipelines
- Ensure data governance and single source of truth
- Facilitate daily standups sprint planning and backlog grooming
- Implement data monitoring logging and data quality frameworks
- Lead scalable big data processing with PySpark
- Manage and mentor data engineering teams
- Perform code reviews and enforce software engineering best practices
- Translate technical concepts for non-technical stakeholders
Perks/Benefits
- N/A
Skills/Tech-stack
API Integration | AWS CloudFormation | AWS DynamoDB | AWS EMR | AWS EventBridge | AWS Glue | AWS Lambda | AWS S3 | AWS Step Functions | Airflow DAGs | Amazon Athena | Amazon ECS | Amazon EKS | Amazon Kinesis | Amazon Redshift | Amazon Web Services | Apache Airflow | Apache Airflow DAGS | Apache Iceberg | Apache Spark | Batch Processing | CI/CD | Data Governance | Data Lakehouse | Data Modeling | Data Quality | Data Warehousing | Data mesh | Database performance | Database performance tuning | Databricks | Delta Lake | Docker | ETL | Extract Transform Load | GitHub | GitHub Actions | IAM | Inmon methodology | Jenkins | Jira | Kafka | Kimball methodology | Logging | Medallion Architecture | Monitoring | Performance Tuning | Prefect | PySpark | Python | SQL | SQL window functions | Scrum | Shell Scripting | Step Functions | Streaming Data | Terraform | VPC | Web Services | Window Functions
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Related jobs
-
Senior Software Engineer, Google Distributed Cloud Appliance INR 500K-2000KArtificial Intelligence | C++ | CSS | Cloud Native | Cloud-native computingSenior-level Full TimeBengaluru, Karnataka, India2h ago
-
Senior-level Full TimeHyderabad, TS, IN2h ago
-
Assistant Manager INR 1500K-2000KAmazon Neptune | Apache Spark | Azure Cosmos | Azure Cosmos DB | CSIMid-level Full TimeIndia4h ago
-
GenAI & Python Developer INR 2500K-3000KAPI Development | Data Preprocessing | Data pipeline | Generative AI | GitAgile working environmentMid-level Full TimeNoida, Uttar Pradesh, India4h ago
-
Senior-level Full TimeIndia5h ago
-
AI Backend Engineer INR 1971K-4590KAnthropic API | Asynchronous programming | Cloud Run | Cloud platform | Compute EngineSenior-level Full TimeChennai, Tamil Nadu, India6h ago
-
Mid-level Full TimeBangalore, Karnataka, India6h ago
-
Senior - Dev-Data-Pipeline INR 2500K-4000KAWS | Azure | Cloud platform | Data Catalog | Data GovernanceSenior-level Full TimeMumbai, Maharashtra, India6h ago
-
Senior Applied AI Engineer - CPGR INR 2500K-4600KAWS Bedrock | Agent Orchestration | Azure AI | Data Engineering | Few-Shot LearningCompany equity (RSUs) | Comprehensive benefits | Counseling | Generous PTO | Gym subsidiesSenior-level Full TimeBangalore, India7h ago
-
Senior-level Full TimeBangalore7h ago
-
Mid-level Full TimeAhmedabad, Gujarat, India7h ago
-
Senior-level Full TimeMumbai, Maharashtra, India7h ago
-
Manager, Engineering - ERP DB Migration Squad INR 1519K-2500KCDC | Database Migration | Debezium | ETL | IndexingMid-level Full TimePune, India8h ago
-
Redshift consultant INR 1000K-1500KAWS Database | AWS Database Migration Service | AWS Glue | AWS database migration | Amazon AthenaMid-level Full TimeMumbai, Maharashtra, India8h ago
-
Shiva's Replacement (AWS) INR 1800K-2000KAWS | AWS Athena | AWS Glue | AWS Lambda | AWS Step FunctionsSenior-level Full TimeMumbai, Maharashtra, India8h ago
-
Senior Technical Program Manager INR 2516K-3100KAWS | Agile | Apache Spark | Azure | Change ControlSenior-level Full TimeRemote - India R8h ago
-
Staff Engineer - Database Reliability Engineering INR 2695K-2829KAWS | Amazon Aurora | Backup/Restore | Capacity Planning | CassandraSenior-level Full TimeHyderabad, India8h ago
-
Senior Data Analyst INR 3600K-5000KAbuse detection | Algorithms | Apache Airflow | Automation | Bot DetectionFlexible work schedule | Healthcare benefits | Internet reimbursement | Paid time off | Parental leaveSenior-level Full TimeBengaluru, Karnataka, India8h ago
-
Fullstack AI Engineer - Bengaluru INR 3000K-4000KJavaScript | LLM API | Language Models | Large Language Models | Machine LearningMid-level Full TimeBengaluru, Karnātaka, India9h ago
-
Senior Product Manager, Analytics INR 2520K-3500KAPIs | Analytics | Artificial Intelligence | Cloud Data | Cloud Data PlatformsSenior-level Full TimeIndia - Remote R9h ago
-
Senior-level Full TimeBangalore, KA, India9h ago
-
Mid-level Full TimeBengaluru, India9h ago
-
Senior-level Full TimeBengaluru, Karnataka10h ago
-
Pyspark Developer INR 2000K-3200KAWS | Azure | CI/CD | GCP | PySparkCareer guidance | Digital learning platform | Elder care | Flexible work | Health checksMid-level Full TimeGurgaon, IN11h ago
-
Senior-level Full TimeIN: Lilly Bengaluru, India13h ago