Engineer Data Ops
Tasks
- Build Git based deployment pipelines
- Collect audit evidence and support compliance reviews
- Configure alerts and operational reporting
- Develop data quality tests and monitoring dashboards
- Execute operational runbooks and recovery procedures
- Identify cost and performance optimization opportunities
- Implement automated testing for data transformations
- Implement data contracts and schema standards
- Implement governance controls including tagging masking and access roles
- Investigate data anomalies
- Investigate pipeline operational issues
- Maintain data product documentation and SLAs
- Maintain orchestration workflows
- Monitor scheduled data pipelines
- Monitor warehouse utilization and query performance
- Participate in on-call incident response
- Promote code and configuration across environments
- Support cost management controls
- Support data product operations
- Support lineage documentation and metadata management
- Support root cause analysis and corrective actions
- Troubleshoot production issues
- Validate schema changes and perform impact assessments
Perks/Benefits
Skills/Tech-stack
Access Control | Airflow | CI/CD | DBT | Dagster | Data Catalog | Data Governance | Data Lineage | Data Quality | Data Transformation | Data masking | Git | Metadata Management | Orchestration | Role-Based Access | Role-Based Access Control | SQL | Snowflake | Terraform
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Lead Software Engineer INR 2500K-5000KAWS | Asynchronous programming | Authentication | Authorization | AutogenSenior-level Full TimeRemote, India R13h ago
-
Sr. AI Engineer - 2.00 pm to 11.00 pm IST (Remote, IND) INR 3242K-4580KAWS Bedrock | Alerting | Autogen | CI/CD | Configuration ManagementCompetitive vacation and holidays | Employee networks | Paid adoption leave | Paid parental leave | Paid time offSenior-level Full TimeIND MH Remote, India R17h ago
-
Spark, Scala, Hadoop & Quantexa/Senior Consultant Specialist INR 2000K-2800KApache Airflow | Apache Spark | CI/CD | DevOps | ElasticsearchFlexible working hours | On-call support | Shift workSenior-level Full TimeBangalore, Karnataka, India R1d ago
-
Assistant Director - Insights And Analytics INR 3000K-5199KCode reuse | Data Governance | Data Quality | Data Wrangling | Machine LearningExecutive-level Full TimeBangalore, Karnataka, India R1d ago
-
AWS CloudTrail | AWS CloudWatch | AWS Identity | AWS Identity and Access Management | AWS Key Management ServiceContinuous learning culture | Flexible working hours | Fully remote work | Professional growth | Supportive innovation focused environmentMid-level Full TimeIndia R1d ago
-
Senior-level Full TimeAhmedabad, Gujarat, India R1d ago
-
GCP, Bigquery, Airflow/Consultant Specialist INR 1500K-2500KApache Airflow | Apache Hadoop | Apache Kafka | Apache NiFi | BigQueryFlexible workingSenior-level Full TimeHyderabad, Telangana, India R1d ago
-
GCP Data Engineer/Associate Director, Data and Analytics INR 800K-2000KAgentic AI | Agile | Airflow | BigQuery | CI/CDMid-level Full TimeHyderabad, Telangana, India R1d ago
-
Apache Hadoop | Apache Spark | Azure Blob | Azure Blob Storage | Azure DataImmediate joinerMid-level Full TimeHyderabad, Telangana, India - Remote R1d ago
-
AVP, Data Engineer (L10) INR 4000K-5000KAPI | AWS | AWS Glue | Agile | Amazon EMRCareer advancement | Employee wellness programs | Flexible work hours | Upskilling opportunities | Work from homeExecutive-level Full TimeHyderabad IN, India R1d ago
-
Full Stack AI Developer INR 2500K-4500KAPI | Artificial Intelligence | C# | Cloud Computing | ContainersCareer growth opportunities | Collaborative culture | Purpose-driven work | Remote workSenior-level Full TimeIndia - Remote R1d ago
-
Principal Specialist- Data Science Customer Programs INR 2000K-2700KApache Spark | Data Governance | Data Ingestion | Data Lineage | Data ModelingFlexible work hours | Hybrid work environmentSenior-level Full TimeIN-KA-BENGALURU-NORTHGATE ~ Sy No 2/2 Venkatala … R1d ago
-
Engineering Lead,Microservices,Java Springboot /Sr. Associate Director, Technology Management INR 1500K-2400KApache Airflow | Apache Beam | Apache Flink | BigQuery | Cloud StorageMid-level Full TimePune, Maharashtra, India R2d ago
-
Senior-level Full TimeIndia, Bengaluru (Hybrid) R2d ago
-
Principal Engineer, Technical Architect INR 2000K-5000K.NET | API first | API-first design | Access Control | Agent OrchestrationSenior-level Full TimeRemote, India R2d ago
-
Principal Engineer, Technical Architect INR 2000K-5000K.NET | API Design | Access Control | Artificial Intelligence | Batch inferenceSenior-level Full TimeRemote, India R2d ago
-
Lead Data Engineer (Databricks) INR 2400K-3900KAWS Glue | AWS Redshift | Amazon S3 | Apache Spark | Automated testingSenior-level Full TimeHybrid (Bengaluru, Karnataka, IN) R2d ago
-
AI Agents | Amplitude | DBT | Databricks | LLMDirect visibility to senior leadership | Documentation and training support | Hybrid workSenior-level Full TimeBangalore, INDIA R2d ago
-
GCP, Airflow/CONSULTANT SPECIALIST INR 1500K-2500KAccess Control | Apache Airflow | Audit Logging | CI/CD | Cloud ComposerContinuous professional development | Flexible workingSenior-level Full TimePune, Maharashtra, India R2d ago
-
GCP, Airflow, Bigquery/Senior Consultant Specialist INR 1500K-2500KApache Airflow | Apache NiFi | CI/CD | Cloud Composer | Cloud DataflowContinuous professional development | Flexible workingSenior-level Full TimePune, Maharashtra, India R2d ago
-
Manager , Decision Systems Data INR 700K-1200KAgile | Apache Airflow | BigQuery | Bigtable | CI/CDCareer development | Supportive work environmentMid-level Full TimeBangalore, Karnataka, India R2d ago
-
Principal Engineer, Sitecore Architect (Optimizely) INR 4000K-6500KA/B | A/B Testing | A/B Testing Tools | ASP.NET MVC | ASP.Net CoreSenior-level Full TimeRemote, India R2d ago
-
Senior-level Full TimeBangalore, India R2d ago
-
Staff Software Engineer, Data (Employer of Record) INR 3715K-5449KAWS | AWS Glue | AWS Lambda | Agile | Amazon S3Flexible collaboration across time zones | Remote workSenior-level Full TimeIndia - Field R2d ago
-
Principal Data Engineer INR 2500K-4200KAnnotation Pipeline | Azure | CI/CD | Cloud Data | Cloud Data EngineeringSenior-level Full TimeRemote (India) R3d ago