Technical Lead (AWS Data Engineering Lead)
DGS India - Mumbai - Goregaon Prism Tower
INR 1500K-2500K (estimate) Senior-level Full Time
Tasks
- Build batch and streaming data pipelines
- Build fault tolerant scalable data workflows
- Containerize data platform components with Docker
- Create schema design and partitioning strategies
- Define data governance and quality processes
- Design cloud data lakes and data warehouses
- Develop ETL components and utilities with Spark
- Implement CI/CD pipelines for data platforms
- Implement data workflow performance optimization
- Manage infrastructure as code with Terraform or CloudFormation
- Optimize query performance and production stability
- Perform SQL and Python data engineering for large datasets
- Write SQL transformations and analytics queries
Perks/Benefits
- N/A
Skills/Tech-stack
AWS Athena | AWS CloudFormation | AWS Glue | Agile | Amazon ECS | Amazon EKS | Amazon Redshift | Amazon S3 | Apache Kafka | Apache Spark | Batch Processing | CI/CD | Data Governance | Data Lake | Data Modeling | Data Quality | Data Warehouse | Docker | ETL | FinOps | Kinesis | Lakehouse | MSK | Metadata Management | Partitioning | PySpark | Python | Query Optimization | SQL | Schema Design | Streaming Data | Terraform
Education
Roles
Data Engineering | Data Engineering Lead | Engineering Lead | Lead | Technical Lead
Related jobs
-
AWS | AWS Kinesis | Agile | Apache Kafka | Cloud platformCloud certification support | Collaborative innovation environment | Inclusive diverse workplace | Mentoring and thought leadership opportunities | Professional developmentSenior-level Full TimeIndia6h ago
-
Lead Data Scientist INR 3000K-4200KAWS | Amazon Redshift | Azure | Decision Science | Discrete choiceAnnual leave | Employer pension contribution | Flexible benefits | Health cash plan | Income protectionSenior-level Full TimeHyderabad, International Tech Park, India11h ago
-
Agentic AI - Lead Engineer INR 2500K-5000KAgile | Anomaly Detection | CI/CD | Data Preprocessing | Data VisualizationSenior-level Full TimeChennai, Tamil Nadu, India23h ago
-
Senior-level Full TimeChennai, Tamil Nadu, India1d ago
-
Senior-level Full TimeHyderabad, Telangana, India1d ago
-
AWS | Alteryx | Amazon Redshift | Azure Synapse | Azure Synapse AnalyticsContinuous learning opportunities | Fully remote work | Professional growthSenior-level Full TimeIndia R1d ago
-
API Development | Airflow | Alerting | BigQuery | CI/CDMid-level Full TimePune, Maharashtra, India R1d ago
-
AWS | Apache Airflow | Apache Spark | Artificial Intelligence | CI/CDCareer development | Certification support | Collaborative environment | Inclusive culture | Knowledge sharingSenior-level Full TimeIndia1d ago
-
Senior-level Full TimePune, MH, India1d ago
-
Senior Consultant Specialist INR 3500K-5000KAmazon Web Services | Apache Spark | Artificial Intelligence | Cloud platform | Data AnalysisSenior-level Full TimeBangalore, Karnataka, India R1d ago
-
Lead Data Scientist INR 3200K-4800KAWS | Azure | Bitbucket | Databricks | Deep learningCharity match program | Collaborative team culture | Employee assistance program | Hybrid work flexibility | Medical insuranceSenior-level Full TimeGurgaon - Cyber Park, India1d ago
-
Data Analytics Lead INR 2771K-4064KDashboarding | Data Analysis | Excel | Power BI | PowerPointCharity match program | Collaborative culture | Employee assistance program | Medical insurance | Paid time offSenior-level Full TimeGurgaon - Cyber Park, India1d ago
-
Lead Software Engineer, ITC INR 2000K-4200KAPIs | AWS CloudFormation | Amazon EMR | Amazon Kinesis | Amazon Web ServicesSenior-level Full TimeINDIA TECHNOLOGY CENTER, India1d ago
-
Lead Analytics Consultant INR 2755K-4132KAdvanced Analytics | Artificial Intelligence | Automation | Business Intelligence | Dashboard DevelopmentSenior-level Full Time110384-IND-HYDERABAD-INTL HYD WF CENTRE BLK 2 …1d ago
-
Lead Engineer - Embedded SW Development INR 3000K-4460KAgile | Automated testing | C# | C++ | CANRelocation assistanceSenior-level Full TimeHyderabad TS IN 26, India1d ago
-
AI First Full Stack Tech Lead INR 3000K-5000KAPI Integration | Authentication | Azure OpenAI | CI/CD | CLMCareer development | Flexible work arrangement | Positive supportive team environmentSenior-level Full TimeBangalore–Embassy Business Hub, India1d ago
-
Senior Data Engineering Consultant-Data analytics, SQL, etc INR 3000K-4064KAI | Automation | Code platforms | Compliance | Data GovernanceSenior-level Full TimePrimary location: Noida, India1d ago
-
Senior-level Full TimePrimary location: Bengaluru, India1d ago
-
AI ML Engineer INR 3000K-6000KAWS | Azure | Cloud platform | Databricks | DataflowCareer development opportunities | Comprehensive benefits | Flexible work arrangements | Inclusion-focused cultureSenior-level Full TimePrimary location: Gurgaon, India1d ago
-
AI and Data Stewardship - Assistant Vice President 3 INR 4000K-6000KAI Governance | AI Registry | Business glossary | Change Management | Data CatalogExecutive-level Full TimePune - Baner, India1d ago
-
FFR - Lead Software Engineer – Backend & AI/ML & Cloud INR 3845K-5449KAPI Design | AWS | Artificial Intelligence | Azure | CI/CDCareer development time | Community resource groups | Disability insurance | Employee stock purchase program | Family leaveSenior-level Full TimeIndia, Hyderabad, DVS, SEZ-1 – Orion …1d ago
-
IN_Senior Associate_Data Analytics / Data Engineering_Digital Integration_Advisory_Gurgaon INR 2400K-4000K.NET | Agile | Azure | Azure Databricks | C#Flexible work programs | Mentorship | Wellbeing supportSenior-level Full TimeGurugram 10 C, India1d ago
-
Engineering Manager - Modern Data Pipeline INR 1500K-2100KAWS | Amazon DynamoDB | Amazon S3 | Docker | ElasticsearchCompany Wellness Days | Disability insurance | Discounted employee stock purchase program | Family leave | Flexible work accommodationsMid-level Full TimeIndia, Hyderabad, DVS, SEZ-1 – Orion …1d ago
-
Engineering Manager - Modern Data Pipeline INR 1500K-2100KAPI first | AWS | Amazon S3 | Data Lineage | Distributed SystemsCareer development learning and development time | Employee stock purchase program | Flexible work accommodations | Health insurance | Life and disability insuranceMid-level Full TimeIndia, Hyderabad, DVS, SEZ-1 – Orion …1d ago
-
Senior-BC sector-Health-Data Engineering-Digital Health Excellence Center-Germany-EU INR 3000K-4200KAWS | Azure | CI/CD | Docker | ELTSenior-level Full TimeBengaluru, KA, IN, 5600161d ago