AWS Data Engineer- Airflow
Tasks
- Design and maintain ETL pipelines
- Document data flows and processes
- Ensure data security and compliance
- Implement data validation and cleansing logic
- Migrate data from data lakes to Amazon Redshift
- Monitor and troubleshoot data pipelines
- Optimize data ingestion and transformation performance
Perks/Benefits
- N/A
Skills/Tech-stack
AWS Glue | AWS Lambda | Amazon Redshift | Amazon S3 | Apache Hadoop | Data Migration | Data Quality | Data Validation | PySpark
Education
N/A
Roles
Related jobs
-
Data Platform Operations Engineer (Databricks, DBT, Snowflake, AWS, Aurora) - Mumbai, MH - AS A INR 500K-1500KAWS | Amazon Aurora | Amazon S3 | Backup and Recovery | CDCMid-level Full TimeMumbai, MH7h ago
-
Amazon Aurora | Amazon RDS | Amazon S3 | Amazon Web Services | CI/CDMid-level Full TimeDahisar West, Mumbai City, Maharashtra7h ago
-
AWS Data Engineer- Gen AI INR 1500K-2500KAWS CDK | AWS Glue | AWS Step Functions | Amazon RDS | Amazon RedshiftSenior-level Full TimeIN-TN-Chennai10h ago
-
Entry-level Full TimeIndia10h ago
-
Senior-level Full TimePune, Maharashtra, India12h ago
-
Mid-level Full TimeIndia13h ago
-
CLOUD AMAZE - DW Architect (Practice) INR 1500K-2500KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DatabricksSenior-level Full TimeIndia16h ago
-
Senior-level Full TimeBengaluru, KA, India17h ago
-
Data Analyst Technical Lead (Alteryx) INR 3000K-4000KAPI Integration | Alteryx Designer | Alteryx Server | Data Cleansing | Data ReconciliationUK shiftSenior-level Full TimeNoida, UP, India17h ago
-
GCP Data Engineer INR 1500K-2000KAgile | Apache Airflow | Ascend.io | CI/CD | Cloud ComposerFlexible work model | Wellbeing cultureMid-level Full TimeHyderabad, India17h ago
-
Senior Software Engineer, Machine Learning INR 2500K-3500KA/B | A/B Testing | Amazon S3 | Apache Airflow | Apache SparkAccident insurance | Commuter benefits | Dental insurance | Disability insurance | Financial wellness supportSenior-level Full TimeBengaluru, India18h ago
-
Senior Data Engineer (Data Analytics),Hyderabad INR 3000K-4000KAPI | AWS | Agile | Amazon DynamoDB | Amazon RedshiftEqual opportunity employer | Fast track growth opportunitiesSenior-level Full TimeHyderabad - Phoenix Equinox Tower 2, …22h ago
-
Data Engineer - Fabric Pipelines / Orchestration INR 2040K-3000KApache Spark | Azure Synapse | Data Quality | Data Warehousing | Data integrationContract employment | Quarterly renewal | Remote workSenior-level Full TimeDelhi, DL, IN22h ago
-
Custom Software Engineer INR 2475K-3500KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure SynapseSenior-level Full TimeBengaluru, BDC11A, India22h ago
-
Business Intelligence Senior Specialist INR 1200K-2040KData Modeling | Data integration | ELT | ETL | GitHybrid workingSenior-level Full TimeBangalore, KA, IN22h ago
-
Lead Engineer Data Streaming INR 1600K-3000KAmazon Redshift | Ansible | Apache Kafka | CDC | CI/CDFlexible work environment | Internal mobility | Volunteering opportunities | Well-being programs | Work-life balanceSenior-level Full TimeKA Bangalore, India22h ago
-
Access Controls | Apache Airflow | Automation | Azure | Azure DataFlexibility programs | Inclusive benefits | Mentorship | Professional growth and learning | Wellbeing supportSenior-level Full TimeHyderabad - Salarpuria, India22h ago
-
Apache Airflow | Apache Hadoop | Azure Data | Azure Data Factory | Data FactoryFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeHyderabad - Salarpuria, India22h ago
-
AWS | Apache Airflow | Apache Hadoop | Apache Spark | AzureFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimePune, India22h ago
-
Senior-level Full TimePune, India22h ago
-
Software Engineer III - Data Engineering , ITC INR 1500K-2500KAPI Design | AWS CloudFormation | AWS EMR | AWS RDS | Apache AirflowSenior-level Full TimeINDIA TECHNOLOGY CENTER, India22h ago
-
Vice President - Principal Data Engineer INR 5000K-6612KAWS | Agile | Anomaly Detection | Azure | CI/CDComprehensive healthcare | Flexible time off | Hybrid work model | Retirement plan | Support for working parentsSenior-level Full TimeHA3-Gurugram - DLF Cyber City, India R22h ago
-
Senior Data Scientist-Contractor Job INR 3000K-5000KAPC | ARIMA | AWS | Anomaly Detection | AzureContractor roleSenior-level ContractIndore, MP, IN22h ago
-
IN-Manager_Azure DE_D&A_Advisory_Bangalore INR 1500K-2000KApache Spark | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure DatabricksFlexibility programs | Mentorship | Wellbeing supportMid-level Full TimeBengaluru Millenia, India22h ago
-
Efs Fcrm 169474 INR 1500K-2400KApache Spark | Azure DevOps | CI/CD | Data Partitioning | Data WarehousingMid-level Full TimeHyderabad, IND-TG, India1d ago