Data Engineering Consultant
Primary location: Hyderabad, Telangana
INR 2500K-3380K (estimate) Senior-level Full Time
Tasks
- Collaborate with engineers and analysts to improve pipeline reliability
- Develop and maintain data monitoring dashboards
- Execute incident recovery including job reruns
- Identify anomalies and missing data
- Improve data process performance stability and maintainability
- Investigate job failures and pipeline delays
- Monitor data pipeline health
- Perform root cause analysis on data discrepancies
- Refactor SQL queries stored procedures and pipelines
- Support build test deploy monitor troubleshoot workflows
- Track pipeline execution and data refresh timing
- Validate data after recovery
Perks/Benefits
Skills/Tech-stack
Azure | Azure Data | Azure Data Factory | Azure Data Lake | Azure Synapse | Azure Synapse Analytics | Batch Processing | Data Factory | Data Lake | Data Pipeline Monitoring | Data Warehouse | Data pipeline | Databricks | Dimensional Modeling | ELT | ETL | Logging | Observability | Pipeline monitoring | Power BI | SQL | Scheduled Batch Processing | Snowflake | Snowflake Schema | Star Schema | Synapse Analytics
Education
Roles
Related jobs
-
Mid-level Full TimeBengaluru, Karnataka, India2h ago
-
Senior-level Full Timetelengana, India7h ago
-
Sr. Data Engineer INR 2700K-3900KAWS Lambda | AWS S3 | AWS SageMaker | AWS Step Functions | AlertingCommunity outreach programs | Employee Resource Group | Employee stock purchase program | Flexible benefits | Health and wellness incentivesSenior-level Full TimeBangalore, KA, IN, 5600767h ago
-
Staff Data and AI Engineer, Finance INR 2500K-3900KAnomaly Detection | Apache Spark | Business Intelligence | CI/CD | DashboardsSenior-level Full TimeBengaluru, India7h ago
-
Senior Data and AI Engineer - Finance INR 2000K-3584KAnomaly Detection | Apache Spark | CI/CD | Dashboards | Data ModelingSenior-level Full TimeBengaluru, India7h ago
-
Mid-level Full TimeBangalore, Karnataka, India7h ago
-
Lead Consultant_Python MachineLearning INR 1500K-2500KAWS | Apache Airflow | Apache Kafka | Apache Spark | AzureHybrid workSenior-level Full TimeBangalore, IN, 5600668h ago
-
Data Engineer INR 1500K-2500KAzure Data | Azure Data Lake | Azure Data Lake Storage | Azure Databricks | CI/CDSenior-level Full TimeChennai, IN, 6000328h ago
-
Senior Consultant_ETL QA INR 1500K-2500KAgile | Case design | Data Governance | Data Migration | Data Migration TestingHybrid workSenior-level Full TimeThane, IN, 4006048h ago
-
AI Engineer INR 3264K-5876KAIOps | AWS | Alert Correlation | Azure | CI/CDAgile working opportunities | Birthday off | Flexible working hours | Flexible working optionsMid-level Full TimeGurgaon8h ago
-
Senior-level Full TimePune, Maharashtra, India8h ago
-
Sr Software Engineer ( Python, AWS, AI) INR 2000K-3000KAI Agents | AWS Lambda | Agile | Amazon Web Services | CI/CDCross-functional team projects | Learning opportunities | Training coursesSenior-level Full TimeMumbai, India9h ago
-
APIs | AWS | Algorithms | Azure | CI/CDSenior-level Full TimeKolkata DN 57, India13h ago
-
Data Governance Engineer INR 980K-2000KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DevOpsAgile career development | Comprehensive benefits dependent on location | Inclusive workplace | Remote work flexibilityMid-level Full TimeIN - Hyderabad, India R13h ago
-
Associate AI/ML Engineer INR 2000K-3000KApache Hadoop | Apache Spark | CI/CD | Computer Vision | Data AnalysisMid-level Full TimeINDJZ03 - Pune - Weikfield IT …13h ago
-
MDG Data Engineer (SAP Master Data Governance) INR 1524K-2500KAsset Management | Business Partner | Business Rules | Change Request | DRFMid-level Full TimeRMZ Ecoworld 32, India15h ago
-
Associate, Data Analytics // Application Development INR 1000K-1800KAI Development | API Development | Airflow | Application Architecture | AutomationMid-level Full TimeGurgaon16h ago
-
Mid-level Full TimeGurgaon16h ago
-
Senior-level Full TimeGurgaon16h ago
-
Senior-level Full TimeHyderabad, IND-TG, India20h ago
-
Senior-level Full TimeHyderabad, IND-TG, India20h ago
-
Data Engineer INR 1500K-2500KAgile | BeautifulSoup | Browse AI | CSV | Data PipelinesHybrid work | Paid time offMid-level Full TimeHyderabad, India21h ago
-
Senior Automation Specialist INR 1500K-3000KAPI Integration | Access Controls | Alerting | Data Quality | MonitoringSenior-level Full TimeHyderabad, India23h ago
-
Software Engineer (ETL TESTER - DATA WAREHOUSING, DATA PROCESSING, SQL, UAT, SNOWFLAKE) INR 1000K-1500KAirflow | Azure Data | Azure Data Factory | Batch Processing | Control-MEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, TN, India23h ago
-
Mid-level Full TimeIN-AP-Hyderabad1d ago