Data Engineering Operations Lead
Tasks
- Coordinate upstream and downstream dependencies
- Define operational standards runbooks and on call procedures
- Design build test and deploy data solutions at scale
- Implement data governance and data quality monitoring
- Lead sprint planning and standups
- Lead technical delivery end-to-end
- Maintain ingestion pipelines to data lakes and warehouses
- Manage data ingestion workflows
- Manage real-time streaming pipelines
- Mentor junior engineers
- Monitor pipeline health
- Onboard new data sources
- Own data engineering operations
- Perform root cause analysis
- Resolve incidents and outages
- Triage pipeline failures
Perks/Benefits
- Annual leave
- Away from keyboard time
- Contributory pension scheme
- Diversity forums and networking groups
- Fitness Wellbeing Programmes
- Hybrid work
- Mindfulness app access
- Private health care
Skills/Tech-stack
Agile | Apache Airflow | Apache Hive | Apache Spark | BigQuery | CI/CD | Cloud Composer | Cloud Functions | Cloud Storage | DAG | Data Governance | Data Mart | Data Modeling | Data Pipelines | Data Quality | Data Warehouse | Data quality monitoring | Dataflow | Dataproc | Delta Lake | Design Patterns | ETL | Git | Incident Management | Lakehouse Architecture | OOP | Observability | On-Call | Pandas | Performance optimization | PubSub | PySpark | Python | Quality monitoring | Real Time | Real-time Streaming | SDLC | SQL | SQL Server | SSMS | SparkSQL | T-SQL | TDD
Education
Related jobs
-
AWS | Azure | CD pipelines | CI/CD | CI/CD pipelinesCareer growth | Flexible engagement | Fully remoteSenior-level Full TimeIndia R1d ago
-
Data Governance | Data Modeling | Data Quality | Data Security | Data WarehousingCareer growth | Collaborative environment | Continuous learning | Flexible day shift | Fully remote workSenior-level Full TimeIndia R1d ago
-
Software Development Engineer 4 INR 1500K-2800KAI Foundry | API Gateway | AWS Step Functions | Airflow | Amazon EventBridgeSenior-level Full TimeBangalore, India R1d ago
-
Sr. Data Engineer INR 2800K-4000KAgile | Apache Airflow | Apache Hive | Apache Spark | Batch ProcessingAnnual leave | Contributory pension scheme | Diversity forums | Hybrid work | Mindfulness app accessSenior-level Full TimePune, India R1d ago
-
Senior Computer Scientist 1 INR 2475K-3800KAI orchestration | CI/CD | Cloud Platforms | Docker | Integration TestingSenior-level Full TimeNoida, India R1d ago
-
Machine Learning Engineer 4 INR 2000K-3465KAlgorithms | C++ | Computer Vision | Data Structures | Deep learningSenior-level Full TimeNoida, India R1d ago
-
Solution Engineer (ETL, Cloud) INR 1500K-2400KAWS | Azure | Cassandra | DB2 | Data GovernanceWork from Anywhere cultureEntry-level Full TimeIndia R1d ago
-
Lead SQL Server Database Engineer INR 2542K-3500KAWS RDS | Agile | Always On | Always On Availability | Always On Availability GroupsFlexible hybrid work model | Health insurance | Life insurance | Paid time off | Pension and retirement benefitsSenior-level Full TimeHyderabad, India R1d ago
-
Agile | Amazon Redshift | Batch Processing | BigQuery | CI PipelineCollaborative global work environment | Cross-functional collaboration | Flexible working arrangements | Fully remote friendly | Inclusive cultureSenior-level Full TimeIndia R2d ago
-
Alpha Generation Applied AI Engineer, Vice President INR 2400K-6000KAgent Orchestration | Agile | Automated testing | CI/CD | ContainerizationComprehensive healthcare | Flexible time off | Hybrid work | Retirement plan | Support for working parentsExecutive-level Full TimeMU8-South (A) Wing, 7-10 Floor, Nesco … R2d ago
-
Machine Learning Engineer 3 INR 1000K-1890KAWS | Alerting | CI/CD | Computer Architecture | Disaster RecoveryMid-level Full TimeNoida, India R2d ago
-
QA Automation Lead (Data Engineering)- India INR 1632K-2829KAsynchronous processing | CI/CD | Code review | Data Pipelines | Data QualityHybrid work options | Remote work optionsSenior-level Full TimeIndia R2d ago
-
API Integration | Apache Airflow | BigQuery | Cloud Functions | Cloud StorageCareer growth | Certification support | Continuous learning | Flexible working hours | MentorshipSenior-level Contract Full TimeIndia R2d ago
-
Software Engineer INR 1294K-2000KAWS | Ataccama | Collibra | Continuous Delivery | Continuous integrationFlexible hybrid model | Health insurance | Life insurance | Paid time off | Pension/retirement benefitsMid-level Full TimeHyderabad, India R2d ago
-
Sr. Analytics Engineer - Data Warehouse (Hybrid, Bangalore) INR 3000K-4000KAWS EC2 | AWS S3 | AWS VPC | Airflow | AmplitudeSenior-level Full TimeBangalore, INDIA R2d ago
-
AI Engineer - Remote INR 2200K-4500KAWS DocumentDB | Apache Kafka | Apache Tomcat | CI/CD | CircleCIDistributed team collaboration | Performance-oriented culture | Professional mentoring | Remote workSenior-level Full TimeMumbai, MH, India R2d ago
-
AI Engineer - Remote INR 2200K-4500KAPIs | AWS | AWS Bedrock | AWS CloudFormation | Apache TomcatCareer development | Health benefits | Remote workSenior-level Full TimePune, MH, India R2d ago
-
AI Engineer - Remote INR 2200K-4500KAPIM | AWS Bedrock | Apache Tomcat | Azure AI | CI/CDDistributed team environment | Remote workSenior-level Full TimeNew Delhi, DL, India R2d ago
-
AI Engineer - Remote INR 2200K-4500KAWS Bedrock | AWS CloudFormation | Apache Kafka | Apache Tomcat | Azure AISenior-level Full TimeBengaluru, KA, India R2d ago
-
Cloud Services Engineer III INR 1500K-2750KAzure Automation | Azure SQL | Azure SQL Database | Azure SQL Managed Instance | Backup and RecoveryRemote workSenior-level Full TimeBangalore, Karnataka, India R2d ago
-
GCP Data & Analytics Engineer/Senior Consultant Specialist INR 2000K-3000KAI machine learning | Access Management | Batch Processing | BigQuery | Clickstream analyticsContinuous professional development | Flexible workingSenior-level Full TimeHyderabad, Telangana, India R2d ago
-
JAVA Data Engineering/Associate Director Software Engineering INR 1400K-2400KApache Beam | Apache Flink | Apache Kafka | Apache Spark | Data pipelineFlexible working | Professional developmentMid-level Full TimePune, Maharashtra, India R3d ago
-
AI/ML | Agentic AI | Apache Airflow | Apache Kafka | CI/CDMid-level Full TimeHyderabad, Telangana, India R3d ago
-
API | Automation | CMDB | CNAPP | CSPMEducation reimbursement | Health plans | In-office perks | Parental leave | Remote workSenior-level Full TimeRemote - India R3d ago
-
Applied AI Engineer INR 1800K-2500KAPI Integration | Access Control | Agent Orchestration | Anthropic API | CrewAIMid-level Full TimeHybrid in Bangalore, India R3d ago