Senior Software Engineer - Airflow
Tasks
- Build custom Airflow operators hooks sensors
- Conduct code reviews and technical mentoring
- Design deploy manage large scale Airflow environments
- Develop automated testing for DAGs
- Integrate Airflow with CDP services
- Maintain Infrastructure as Code for Airflow deployments
- Optimize Airflow schedulers and workers
- Secure workflows with IAM Kerberos and secret management
Perks/Benefits
- Continued Career Development
- Employee resource groups
- Flexible WFH
- Generous PTO
- Paid volunteer time
- Phone and internet reimbursement
- Wellness programs
- Work-life balance
Skills/Tech-stack
Apache Airflow | CI/CD | Docker | Dynamic Task Mapping | Git | GitHub Actions | Great Expectations | Hive | IAM | Impala | Infrastructure as Code | Jenkins | Kafka | Kerberos | Kubernetes | Kubernetes executors | MySQL | OpenLineage | PostgreSQL | Python | SQL | Secret management | Spark | Task Groups | Terraform | XCOM | YARN | “as-code”
Education
N/A
Related jobs
-
Applied AI ML Lead INR 2475K-3465KApache Hive | Apache Spark | Keras | Language Processing | Machine LearningSenior-level Full TimeBengaluru, Karnataka, India5h ago
-
Lead Backend Engineer (MongoDB / NoSQL) INR 1600K-4000KAWS | Agile | Azure | CI/CD | Distributed SystemsSenior-level Full TimeIN-TN-Chennai6h ago
-
AES - DE -JAVA - Generative AI Application Developers INR 2535K-4000KAWS | Agile | Azure | CI/CD | DockerSenior-level Full TimeBangalore, Karnataka, India7h ago
-
Mid-level Full TimePune, Maharashtra, India7h ago
-
Senior-level Full TimeBengaluru, KA, India7h ago
-
BIOS | Block layer | C# | C++ | Distributed SystemsSenior-level Full TimeBengaluru, KA, India7h ago
-
Software Developer Lead (AWS, Java/Python) INR 2695K-4000KAWS | AWS CloudFormation | Amazon S3 | Amazon SNS | Amazon SQSSenior-level Full TimeHyderabad, India7h ago
-
Mid-level Full TimeGurgaon, Haryana, India7h ago
-
Lead AI Engineer #3008 INR 2500K-4500KAgent Orchestration | Azure | Deepgram | Fine Tuning | LLM ObservabilityFlexible working hours | Global exposure | Professional development | Rewards and recognition | Work-life balanceSenior-level Full TimeChennai, India8h ago
-
Analytics Solution- Associate INR 2040K-2755KAgile | Atlassian | Atoti | Change Data Capture | Continuous DeploymentSenior-level Full TimeBengaluru, Karnataka, India9h ago
-
Applied AI ML Associate Senior INR 1400K-2000KAgentic Frameworks | Amazon Web Services | Apache Airflow | Architectures | AzureMid-level Full TimeMumbai, Maharashtra, India9h ago
-
AI/ML Engineer (Associate) INR 900K-900KAWS SageMaker | Azure AI | C++ | Cloud platform | Computer VisionEntry-level Full Timecoimbatore, India10h ago
-
ROP - SE2/SSE - Azure Data INR 1500K-2400KApache Hadoop | Apache Kafka | Apache Spark | Azure | Azure ComputeOn-call rotationMid-level Full TimeBengaluru, KA, IN10h ago
-
Assoc. Manager, Platform Support Engineering INR 1000K-1500KAWS | Active Directory | Azure | Azure Active Directory | Azure DevOpsMid-level Full TimeGurgaon, Haryana, India10h ago
-
Lead Assistant Manager - Data Science INR 2500K-2800KBacktesting | Collections Performance | Collections performance analysis | Data Preprocessing | Delinquency predictionSenior-level Full TimeGurugram, Haryana, India10h ago
-
Mid-level Full TimePune, Maharashtra, India10h ago
-
Mid-level Full TimeBengaluru, Karnataka, India11h ago
-
Data Science AI Engineer, Advisor INR 950K-1400KAs-a-Service | C# | Cloud technologies | Database methodologies | Development LifecycleHybrid work environment | Work-life balanceMid-level Full TimeBangalore, KA, IN, 56010011h ago
-
AWS | AWS Glue | Advanced SQL | Airflow | Amazon EMRMid-level Full TimeHyderabad, Telangana, India11h ago
-
AI Engineer- Associate Consultant INR 1400K-2000KAWS | Agent Orchestration | Autonomous Agents | Azure | ClassificationContinuous learningMid-level Full TimeBangalore, Karnataka, India12h ago
-
Lead Software Engineer - Java, Big Data, Hybrid cloud INR 2050K-4000KAPIs | AWS | Agile | Apache Spark | Application ResiliencySenior-level Full TimeBengaluru, Karnataka, India R12h ago
-
Cloud AI/ML Engineer INR 2500K-4000KAWS | AWS Step Functions | Alerting | Amazon Bedrock | Amazon ECRSenior-level Full TimePune, India12h ago
-
Senior-level Full TimePune, India12h ago
-
Cloud Data Engineer INR 2000K-2755KAWS | AWS Athena | AWS Glue | AWS Lake Formation | AWS LambdaAgile team | Global collaboration | On-call rotationSenior-level Full TimePune, India12h ago
-
Cloud Data Platform Engineer (Snowflake + Databricks) INR 2755K-3500KAWS EMR | AWS Glue | AWS IAM | AWS Lambda | AWS S3Senior-level Full TimePune, India12h ago