Software Engineer III - AWS Data ETL
Mumbai, Maharashtra, India
INR 2000K-2400K (estimate) Senior-level Full Time
Tasks
- Build CI/CD automation
- Build ETL/ELT pipelines
- Define data platform architecture for batch and streaming
- Design data warehousing migrations
- Develop Spark based ETL frameworks
- Implement AWS data services workflows
- Implement Terraform infrastructure as code
- Integrate LLM and agentic models for data insight reporting
- Lead incident response root cause analysis
- Manage on prem to cloud data migration
- Own end to end data platform delivery
- Perform data profiling reconciliation lineage quality
- Set SLAs implement monitoring and alerting
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | AWS Glue | AWS Glue Catalog | AWS KMS | AWS Lake Formation | AWS Lambda | AWS Secrets | AWS Secrets Manager | AWS Step Functions | Amazon Athena | Amazon EventBridge | Amazon S3 | Apache Airflow | Apache Iceberg | Apache Spark | Avro | CI/CD | Cause analysis | Data Lineage | Data Migration | Data Quality | Data Reconciliation | Data Warehousing | Data profiling | Databricks | ELT | ETL | Encryption | GenAI | Glue Catalog | IAM | Incident Response | JSON | Java | LLM | Lake Formation | Monitoring and Alerting | Parquet | Python | Root Cause Analysis | Root cause | Secrets Manager | Snowflake | Spark Streaming | Step Functions | Terraform
Education
N/A
Roles
Engineer | Engineer III | Software Engineer | Software Engineer III
Related jobs
-
Senior DevOps Engineer INR 2000K-4000KAKS | Amazon Aurora | Amazon EMR | Amazon Redshift | Amazon S3Senior-level Full TimeBangalore, India3h ago
-
Technology Leader-Data Engineering-HO & SUPPORT-CVM CoE - Corporate Centre of Excellence INR 2000K-2600KAPI | CI/CD | Java | Jira | LinuxSenior-level Full TimeBangalore, Karnataka, India3h ago
-
Senior-level Full TimeIN-MH-Pune4h ago
-
Deputy Manager-Data Engineering INR 1500K-2500KAmazon Web Services | Azure | CI/CD | Cloud platform | ContainerizationMid-level Full TimeNoida, UP, India5h ago
-
Senior Software Engineer, Server AI Foundations, Core INR 2000K-4500KAgentic Frameworks | Agents | Agile Development | CI/CD | Cloud platformSenior-level Full TimeBengaluru, Karnataka, India5h ago
-
Assistant Manager - Cloud & AI Architect INR 2000K-3500KAI Foundry | Access Management | Active Directory | Agent Builder | Agent OrchestrationC level presentations | Client advisory | Mentoring junior resources | Professional developmentSenior-level Full TimeBangalore, Karnataka, India7h ago
-
Data Engineer - Senior INR 2000K-2800KAnomaly Detection | Apache Hive | Apache Kafka | Application Insights | AzureSenior-level Full TimePune, Maharashtra, India7h ago
-
AWS Data Engineer INR 1500K-2000KAWS | AWS Glue | Amazon Athena | Amazon EMR | Amazon S3Hybrid workMid-level Full TimeIndia7h ago
-
Senior-level Full TimePune, Maharashtra, India7h ago
-
Agile | Apache Spark | Data Architecture | Data Catalog | Data GovernanceSenior-level Full TimeBengaluru, Karnataka, India7h ago
-
Azure Data Engineer - Assistant Manager INR 1500K-2000KAnalysis Services | Apache Spark | Azure Analysis | Azure Analysis Services | Azure CosmosMid-level Full TimeBangalore, Karnataka, India7h ago
-
SAP Gen AI Developer ACON US Inv INR 1317K-2000KAI Core | AI Launchpad | Business Technology Platform | DevOps | DockerMid-level Full TimeBangalore, Karnataka, India7h ago
-
Azure Databricks INR 2400K-3900KApache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure DatabricksClient Customer Interactions | Health insurance | Learning aids | Meal vouchers | Unlimited growth potentialSenior-level Full TimeHyderabad, Telangana, India7h ago
-
Senior Research Engineer - Applied AI/ML INR 2000K-4170KA/B | A/B Testing | AWS | Amazon SageMaker | Apache AirflowHybrid workSenior-level Full TimeGurugram, India8h ago
-
Senior-level Full TimeHyderabad, India9h ago
-
Applied AI /ML INR 950K-1250KAlgorithms | Amazon Web Services | Azure | Computer Vision | Data MiningMid-level Full TimeHyderabad, Telangana, India9h ago
-
Lead Assistant Manager INR 2000K-3000KANSI SQL | Agile | Apache Spark | Azure Data | Azure Data FactorySenior-level Full TimePune, Maharashtra, India9h ago
-
AES - DE - Generative AI Prompt Engineers INR 2000K-3000KAnthropic API | Azure OpenAI | CI/CD | Code Analysis | CypressHybrid work modelMid-level Full TimePune, Maharashtra, India10h ago
-
Snowflake Data Engineer- Consultant INR 1500K-2700KAWS Athena | AWS Data | AWS Data Pipeline | AWS Glue | AWS LambdaCorporate social responsibility programs | Maternity leave | Networking opportunities | Paternity leave | Product and service discountsMid-level Full TimeBangalore, Karnataka, India10h ago
-
AI Engineer INR 1800K-3000KAPI Integration | Azure | Azure OpenAI | Chroma | DockerFast-learning culture | Flexible locationMid-level Full TimeNavi Mumbai, Maharashtra, India10h ago
-
Genetics Data Engineer INR 1500K-2500KAWS | Azure | BGEN | Bcftools | Biobank trusted research environmentsMid-level Full TimeBangalore, Karnataka, IN, 56003710h ago
-
Azure Data Engineer_Consultant INR 1500K-2000KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DatabricksMid-level Full TimeHyderabad, HYDERABAD, India10h ago
-
Lead Software Engineer - Applied AI Engineer (Agentic/ Gen AI) INR 2000K-3500KAPI Design | AWS | Accuracy Monitoring | Agentic architecture | CI/CDSenior-level Full TimeBengaluru, Karnataka, India11h ago
-
Java Spark Engineer INR 2000K-3500KAWS | Apache Spark | Azure | CI/CD | Cloud platformAgile team culture | Career growth opportunitiesSenior-level Full TimeIndia - Bengaluru11h ago
-
AI Engineer - Tieto Tech Consulting (m/f/d) INR 2200K-4200KAI Builder | AI Search | AI Solution | AI solution testing | Agent OrchestrationHybrid work model | Open culture | Professional growth | Work-life balanceMid-level Full TimeBangalore, India11h ago