Data Engineer with Airflow
Tasks
- Assess legacy systems and recommend approaches
- Define migration patterns using AWS migration services
- Define migration strategy and roadmap
- Drive CI CD delivery in agile sprints
- Ensure data quality integrity performance and availability
- Implement post migration optimization and modernization
- Lead database migration to AWS
- Manage data engineering team
- Migrate databases data warehouses data lakes to AWS
- Oversee ETL extraction transformation validation reconciliation and cutover
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Agile | Airflow | Amazon Web Services | Automation | CI/CD | Data Lake | Data Quality | Data Reconciliation | Data Validation | Data Warehousing | ETL | Integration Services | Migration planning | Performance Tuning | SQL | SQL Server | SQL Server Integration Services | SQL Server integration | Server Integration Services | Web Services
Education
N/A
Related jobs
-
Senior-level Full TimeIN-TN-Chennai9h ago
-
Senior-level Full TimeIN-TN-Chennai9h ago
-
Senior-level Full TimeIN-TN-Chennai9h ago
-
PL/SQL Developer INR 1200K-2400KBackup & Recovery | CI/CD | Data Modeling | Data Quality | Database InternalsSenior-level Full TimeIN-TN-Chennai9h ago
-
Azure Data Engineer INR 1500K-2000KAzure Data | Azure Data Factory | Azure Data Lake | Azure Functions | Azure SynapseHybrid work modeSenior-level Full TimeNoida, Uttar Pradesh, India9h ago
-
Software Engineer III - (ADLC , Python) INR 3000K-4000KAWS | Agile | Architecture | CI/CD | Data VisualizationSenior-level Full TimeHyderabad, Telangana, India10h ago
-
Data Engineer, Global Affairs INR 1500K-2500KArtificial Intelligence | Big Data | C++ | Cloud platform | Data PipelinesMid-level Full TimeHyderabad, Telangana, India10h ago
-
Principal Engineer, Python fullstack (React+Genai) INR 3000K-5000KAPI Integration | AWS | Agent Orchestration | Azure | ComplianceSenior-level Full TimeRemote, India R10h ago
-
DE&A - Core - Big Data Engineering - Hadoop Ecosystem INR 3000K-4200KAPI | AWS | Apache Hadoop | Apache Spark | AzureSenior-level Full TimePune, Maharashtra, India11h ago
-
AES - DE - Generative AI Prompt Engineers INR 2000K-3500KAnthropic API | Azure OpenAI | CI/CD | Code Analysis | Cost controlsMid-level Full TimePune, Maharashtra, India11h ago
-
Data Engineer INR 704K-2000KAPIs | Batch Processing | CDP | Customer Data | Customer Data PlatformAgile culture | Documentation | Knowledge sharingMid-level Full TimeIndia11h ago
-
Principal Engineer, Machine Learning INR 4000K-5000KArtificial Intelligence | Computer Vision | Deep learning | Docker | Foundation ModelsSenior-level Full TimeRemote, India R12h ago
-
Associate Principal Engineer, Machine Learning INR 1800K-3300KAdversarial Networks | Agent Orchestration | Agent systems | Computer Vision | Deep learningMid-level Full TimeRemote, India R12h ago
-
Data Engineer INR 3000K-4000KAWS | Data Architecture | Data Governance | Data Modeling | Data MonitoringBike to work | Career progression | Educational assistance | Employee assistance program | Employee discountMid-level Full TimeBengaluru, KA, India12h ago
-
Senior-level Full Time Part Timebangalore, India12h ago
-
Mid-level Full TimeIndia12h ago
-
Lead Software Engineer - Java, Spring boot, AWS Cloud & AI/ML (REST APIs, System Design, SDLC) INR 3500K-5000KAI Assisted Development | API Gateway | AWS Athena | AWS Glue | AWS KinesisSenior-level Full TimeBengaluru, Karnataka, India14h ago
-
Consultant - Data Engineer INR 1500K-2000KAzure | Azure Databricks | Compliance | Data Modeling | Data SecurityMid-level Full TimeKochi, Kerala, India14h ago
-
Data Engineering II INR 1500K-2000KBigQuery | Cloud Composer | Cloud Storage | Data Governance | Data QualityMid-level Full TimeChennai, Tamil Nadu, India15h ago
-
GenAI LLM Python/Sr. Associate Director, Software Engineering INR 1500K-3000KAWS | Agent Orchestration | Agent systems | Azure | Cloud platformFlexible working | Inclusive and diverse environment | Professional development opportunitiesMid-level Full TimePune, Maharashtra, India R15h ago
-
Analyst-Data Science INR 2000K-3550KBig Data | Closed Loop | Closed Loop Decisioning | Data Analysis | Data ValidationNone Full TimeGurugram, HR, India16h ago
-
Associate Consultant_SQL_Python INR 1200K-1800KAlgorithms | Automation | C# | Data Structures | GitMid-level Full TimeChennai, IN, 60003216h ago
-
Mid-level Full TimeHyderabad, Telangana, India16h ago
-
SA1 / Sr. Engg - GTS - Build AI INR 2000K-2800KAngular | Apache Spark | Authentication | Authorization | Azure DataSenior-level Full TimeHyderabad, Telangana, India16h ago
-
Director-GTS - Build AI INR 1500K-6000KAWS | Adversarial Networks | Apache Kafka | Autogen | Autoregressive modelsExecutive-level Full TimeHyderabad, Telangana, India16h ago