AWS Data Engineer- Airflow
Tasks
- Design scalable ETL pipelines
- Develop ETL pipelines with AWS Glue
- Document data flows and processes
- Ensure data security and compliance
- Implement data validation and cleansing logic
- Migrate data to Amazon Redshift
- Monitor and troubleshoot data pipelines
- Optimize data ingestion and transformations
Perks/Benefits
- N/A
Skills/Tech-stack
AWS Glue | AWS Lambda | Amazon Redshift | Amazon S3 | Apache Hadoop | Apache Spark | Data Cleansing | Data Migration | Data Validation | ETL | PySpark
Education
N/A
Roles
Related jobs
-
Mid-level Full TimeIN-MH-Mumbai5h ago
-
Pyspark Developer INR 800K-1500KData Modeling | Dimensional Modeling | PySpark | Relational databases | SQLMid-level Full TimeIN-TN-Chennai5h ago
-
Software Engineer - AI/ML with Python INR 2500K-3500KAWS | Airflow | Amazon SageMaker | Apache Airflow | Apache SparkAccess to cutting-edge technologies | Collaborative work environment | In office 5 days per week | Professional development | Training and education opportunitiesSenior-level Full TimeBangalore - Karnataka, India - Kalyani …5h ago
-
MS Fabric / Azure Data Engineer ( 5- 7 yrs ) - Immediate Joiners INR 1500K-2500KAzure Data | Azure Data Factory | Azure Synapse | Azure Synapse Analytics | Data ArchitectureImmediate JoinersSenior-level Full TimeBengaluru, KA, India5h ago
-
AI Software Engineer III - Platform INR 2000K-4000KAPI Gateway | APIs | AWS EC2 | AWS Lambda | Amazon APISenior-level Full TimeHyderabad, Telangana, India8h ago
-
Azure Data Engineer INR 1500K-2500KAzure Data | Azure Data Factory | Azure Data Lake | Azure Functions | Azure SynapseMid-level Full TimeIndia9h ago
-
Mid-level Full TimeBengaluru, Karnataka, India10h ago
-
Associate Process Manager INR 800K-1500KAWS | Apache Airflow | Apache Hadoop | Apache Spark | AzureMid-level Full TimePune, Maharashtra, India10h ago
-
Agile | Amazon Redshift | Batch Processing | BigQuery | CI PipelineCollaborative global work environment | Cross-functional collaboration | Flexible working arrangements | Fully remote friendly | Inclusive cultureSenior-level Full TimeIndia R11h ago
-
Data Engineer INR 1753K-2250KAPI | Agile | Azure Automation | Azure Data | Azure Data FactoryHybrid workSenior-level Full TimeChennai, Tamil Nadu, India12h ago
-
API | Batch Processing | Data Compliance | Data Governance | Data ModelingContinuous learning | Flexible work hours | Health and wellness support | Inclusive work culture | Paid time offSenior-level Full TimeIndia12h ago
-
Sr.Research Engineer - Applied AI/ML INR 2000K-4170KAPI Design | Algorithms | Apache Spark | Conversational AI | Data AnalysisSenior-level Full TimeGurugram, India13h ago
-
Machine Learning Engineer INR 1400K-2000KApache Spark | Azure | Classification | Cloud platform | ClusteringMid-level Full TimeBengaluru, Karnataka, India17h ago
-
Specialist, SAP Data Analytics INR 2520K-3500KAgile | Analysis for Office | Analytics Cloud | Calculation views | Data ExtractorsFlexible work arrangements | Hybrid work modelSenior-level Full TimeIND - Telangana - Hyderabad (HITEC …17h ago
-
Apache Airflow | Apache Hive | Apache Spark | BigQuery | Cloud StorageFlexible workplace arrangements | Internal mobility | Learning and development programs | MentoringSenior-level Full TimeGurugram, India17h ago
-
Enterprise Data Engineer | Cloud Platforms, Big Data, Data Governance & Automation Support INR 3000K-4000KAWS | AWS Glue | Ansible | Azure | Azure DataFlexible workplace arrangements | Internal mobility | Learning and development programs | MentoringSenior-level Full TimePune - Hinjewadi (Ascendas), India17h ago
-
Data Engineering Delivery, AI Platform Leader INR 2520K-3380KApache Airflow | Apache Iceberg | Apache Spark | DBT | Data ContractsSenior-level Full TimeBengaluru - GS, India17h ago
-
AWS Redshift | Amazon S3 | Azure Synapse | Azure Synapse Analytics | CI/CDFlexible workplace arrangements | Internal mobility | Learning and development programs | MentoringSenior-level Full TimeBengaluru - EC-2 Gateway campus, India17h ago
-
Entry-level Full TimePune, Gera Commerzone SEZ, India17h ago
-
Mid-level Full TimePune, Gera Commerzone SEZ, India17h ago
-
Logistics Analytics and Network Design INR 800K-1500KContainerization | Cost modeling | Coupa | Data Guru | Data ModelingEmployee assistance programme | Health insurance | Professional developmentSenior-level Full TimeBuilding No: 12C, Floor 9,10,11, Building …17h ago
-
QA Automation Lead (Data Engineering)- India INR 1632K-2829KAsynchronous processing | CI/CD | Code review | Data Pipelines | Data QualityHybrid work options | Remote work optionsSenior-level Full TimeIndia R23h ago
-
Agentic AI Engineer - Assistant Vice President / Vice President INR 2400K-4000KAPI Integration | Agentic AI | Artificial Intelligence | Audit Logging | Context engineeringDental insurance | Health insurance | Paid time off | Remote work flexibilityExecutive-level Full TimeIN - Jaipur R23h ago
-
API Integration | Apache Airflow | BigQuery | Cloud Functions | Cloud StorageCareer growth | Certification support | Continuous learning | Flexible working hours | MentorshipSenior-level Contract Full TimeIndia R1d ago
-
AI Engineer - Remote INR 2200K-4500KAPIs | AWS | AWS Bedrock | AWS CloudFormation | Apache TomcatCareer development | Health benefits | Remote workSenior-level Full TimePune, MH, India R1d ago