Senior Software Engineer - Airflow
Tasks
- Build custom Airflow operators hooks sensors
- Conduct code reviews and technical mentoring
- Design deploy manage large scale Airflow environments
- Develop automated testing for DAGs
- Integrate Airflow with CDP services
- Maintain Infrastructure as Code for Airflow deployments
- Optimize Airflow schedulers and workers
- Secure workflows with IAM Kerberos and secret management
Perks/Benefits
- Continued Career Development
- Employee resource groups
- Flexible WFH
- Generous PTO
- Paid volunteer time
- Phone and internet reimbursement
- Wellness programs
- Work-life balance
Skills/Tech-stack
Apache Airflow | CI/CD | Docker | Dynamic Task Mapping | Git | GitHub Actions | Great Expectations | Hive | IAM | Impala | Infrastructure as Code | Jenkins | Kafka | Kerberos | Kubernetes | Kubernetes executors | MySQL | OpenLineage | PostgreSQL | Python | SQL | Secret management | Spark | Task Groups | Terraform | XCOM | YARN | “as-code”
Education
N/A
Related jobs
-
Sr. Snowflake Data Engineer - Risk Technology INR 2500K-4000KClustering keys | ELT | ETL | Micro-partitioning | PythonSenior-level Full TimePune, India4h ago
-
Senior AI Engineer INR 3125K-5000KAI Studio | AWS Bedrock | AWS SageMaker | Asynchronous programming | AutogenSenior-level Full TimeBangalore, Karnataka, IN6h ago
-
AI Engineer INR 2520K-3880KActive Learning | Azure Cognitive | Azure Cognitive Services | Azure OpenAI | Azure OpenAI ServiceFamily support | Learning and development opportunities | Life Coverage | Medical coverage | Relocation supportSenior-level Full TimeHyderabad, TS, India7h ago
-
Mid-level Full TimePUNE, MAHARASHTRA, India7h ago
-
Entry-level Full TimeBengaluru, KA, IN8h ago
-
Senior Applied AI Engineer INR 3384K-5000KAI orchestration | Context Management | Data Pipelines | Experimentation | Graph DatabasesDonation matching | Flexible PTO | Lunch stipend | Medical coverage | Team building eventsSenior-level Full TimeBengaluru, Karnataka, India8h ago
-
Staff Software Engineer(MLOps) INR 2857K-4500KAWS Athena | AWS DynamoDB | AWS Glue | AWS SageMaker | Apache AirflowHybrid work model | Mentorship cultureSenior-level Full TimeBangalore10h ago
-
Staff Engineer - Database Reliability Engineering INR 2695K-2829KAWS | Audit Logging | Aurora | Caching | CassandraSenior-level Full TimeChennai, TN, India12h ago
-
Mid-level Full TimePune, IN13h ago
-
Senior-level Full Time110380-IND-BENGALURU-INTL BLR Twr-1&2 CARNATION, India15h ago
-
Senior-level Full Time110380-IND-BENGALURU-INTL BLR Twr-1&2 CARNATION, India15h ago
-
Azure ML Engineer INR 1500K-2000KActive Directory | Application Insights | Azure DevOps | Azure Key Vault | Azure Machine LearningIn person collaboration flexibilityMid-level Full TimeIN319 - IND Bangalore Electronic City …15h ago
-
Azure Data Consultant INR 2516K-3100KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DatabricksSenior-level Full TimeBengaluru, KA, IN15h ago
-
Z2_Sr. Developer|Back-end technologies INR 2500K-4144KCI/CD | Caching | Data Management | Docker | ETLSenior-level Full TimeBangalore, KA, IN15h ago
-
AI and Applied Analytics Lead INR 2520K-4170KArtificial Intelligence | Azure AI | Azure Data | Azure Data Platform | Azure MLSenior-level Full TimeGurgaon, HR, IN, 12201015h ago
-
AI Enterprise | AI RMF | AWS | Audit trails | AzureCareer development | Coaching | Flexible workSenior-level Full TimeTrivandrum, KL, IN, 69558115h ago
-
Senior-level Full TimeBangalore, IN, 56211015h ago
-
Technical Lead Software Architect INR 2500K-4500KAPI Gateway | AWS | Agent systems | Agile | AuthenticationSenior-level Full TimeIN: Lilly Hyderabad, India15h ago
-
Senior-level Full TimeIN: Lilly Hyderabad, India15h ago
-
Expert Support Engineer - Snowflake INR 2000K-2400KAWS Glue | Access policies | Advanced SQL | Agile | Apache AirflowSenior-level Full TimeBangalore, India15h ago
-
Software Engineer INR 1200K-1800KAPI Gateway | AWS Lambda | AWS RDS | AWS RDS PostgreSQL | AWS SNSContinuous learning | Onsite work 5 days per week | Relocation available | Team collaborationMid-level Full TimeChennai, Tamil Nadu, India15h ago
-
Software Engineer INR 1200K-1800KAPI Gateway | AWS CloudFormation | AWS Lambda | AWS RDS | AWS RDS PostgreSQLOnsite work five days a week | Relocation assistanceMid-level Full TimeChennai, Tamil Nadu, India15h ago
-
Senior Software Engineer-Data Engineering INR 2520K-3880KAPI Gateway | AWS | AWS CloudFormation | AWS Glue | AWS LambdaSenior-level Full TimeBangalore, Karnataka, India15h ago
-
Senior Software Engineer INR 2500K-3200KAPIs | AWS | Azure | Database performance | Database performance tuningRelocation assistanceSenior-level Full TimeChennai, Tamil Nadu, India15h ago
-
Senior Analyst Data Engineering INR 2400K-2800KAzure Data | Azure Data Factory | Azure Data Lake | Azure Databricks | Azure DevOpsHybrid work | Mentoring supportSenior-level Full TimeIN025 Embassy Manyata Business Park, India15h ago