Data Engineering Lead/Manager – Enterprise Integration & MDM (Azure + Databricks)
Hyderabad, TS, India
INR 1431K-2146K (estimate) Senior-level Full Time
Tasks
- Align source structures with MDM domain models
- Build batch ingestion pipelines
- Build reusable transformation components
- Collaborate on integration design alignment
- Configure pipeline orchestration and scheduling
- Design and implement MDM data feeds
- Design and implement data transformations
- Establish source system connectivity
- Implement CI/CD pipelines
- Implement automated data quality tests
- Implement data quality checks in pipelines
- Implement data validation rules
- Implement incremental load patterns
- Load reference datasets into MDM
- Manage source control and documentation
- Perform data profiling
- Test match merge survivorship rules
Perks/Benefits
- N/A
Skills/Tech-stack
Azure | Azure Data | Azure Data Factory | Azure Integration | Azure Integration Hub | CI/CD | Canonical Data | Canonical Data Model | DBT | Data Factory | Data Model | Data Modeling | Data Quality | Data Transformation | Data profiling | Databricks | Event Driven | Event-driven architecture | Integration Hub | JDBC | Lakehouse | ODBC | Python | REST APIs | SOAP/XML | SQL | Service Bus | Source Control | Unity Catalog
Education
N/A
Related jobs
-
Data Science Research Lead, Ads Insights and Measurement INR 2516K-3356KCausal Inference | Data models | Difference-in-differences | Differential Privacy | Fixed effectsSenior-level Full TimeBengaluru, Karnataka, India11h ago
-
Lead Software Engineer - Data Engineer INR 1500K-2400KABAC | AWS | AWS Glue | AWS Lambda | AWS Step FunctionsSenior-level Full TimeBengaluru, Karnataka, India12h ago
-
Assistant Manager - Technology INR 1500K-3500KChange Management | Cloud Migration | Data Modeling | Erwin | HadoopSenior-level Full TimeBengaluru, Karnataka, India16h ago
-
Mid-level Full TimeNoida, IN, 20130522h ago
-
Lead Agentic AI & Java Integration Engineer INR 2500K-4000KData Privacy | DeepEval | Distributed Systems | Embeddings | Event DrivenSenior-level Full TimeBangalore, KA, IN22h ago
-
Lead Agentic AI & Java Integration Engineer INR 2500K-4200KDeepEval | Distributed Systems | Embeddings | Event Driven | Event-driven architectureSenior-level Full TimeBangalore, KA, IN22h ago
-
Manager, IT Data Engineer INR 1800K-2500KAWS | Agile | Data Modeling | Data Pipelines | Data ProcessingMid-level Full TimeIndia - Bangalore - 5th floor, …22h ago
-
SMTS/LMTS - AI ML Engineers INR 2211K-3500KAI Trust Layer | AI trust | Benchmarking | Context engineering | Continuous Deployment1-on-1 coaching | Adoption Assistance | Fertility benefits | Generous parental leave | On-demand trainingSenior-level Full TimeIndia - Bangalore22h ago
-
AI & Intelligent Applications – Senior Manager INR 2000K-3500KABAC | AKS | AWS | Active Directory | Artificial IntelligenceSenior-level Full TimeIndia - Hyderabad - 12th FLOOR, …22h ago
-
Data Platform Operations Service Manager INR 1500K-2205KAI Platform | Agile | As-a-Service | Azure AI | Azure AI PlatformMid-level Full TimeBengaluru Campus 31, India22h ago
-
Payments Data Lead Engineer INR 3000K-4000KAgile | Automation | CI/CD | Cause analysis | Data EngineeringSenior-level Full TimePune, Gera Commerzone SEZ, India22h ago
-
Senior Manager, Commercial Analytics - CRMA - Life-sciences INR 2516K-3356KCRM Analytics | Conditional Formatting | Dashboard Development | Data Governance | Data ModelingFully remoteSenior-level Full TimeIND - Remote - Bangalore Based … R22h ago
-
Lead Risk Analytics Consultant INR 1800K-2200KCredit Risk | Credit risk modeling | Data Analysis | Data Engineering | Data PipelinesSenior-level Full Time111442-IND-BENGALURU-INTL BLR BLK B3 PETUNIA, India22h ago
-
Lead Software Engineer -Python Full Stack Developer - GEN AI INR 2475K-3500KAgent systems | Agile | Angular | Azure DevOps | CI/CDSenior-level Full Time110380-IND-BENGALURU-INTL BLR Twr-1&2 CARNATION, India22h ago
-
Manager Advanced Analytics and Insights (L09) INR 900K-1910KData Governance | Data Mining | Data Visualization | Excel | ForecastingCareer advancement | Employee well-being programs | Flexible work schedule | Upskilling opportunities | Work from homeMid-level Full TimeHyderabad IN, India22h ago
-
Director, Data Engineering Centre of Excellence (CoE) INR 1500K-6000KAWS | Airflow | Azure | CI/CD | DBTComprehensive healthcare | Flexible time off | Hybrid work model | Retirement plan | Support for working parentsExecutive-level Full TimeM11 - Commers III, 43, 44 … R22h ago
-
Java Technical Lead- Career INR 2156K-2829KAWS | Agile | Apache Airflow | Apache Beam | AzureHealthcare benefits | Hybrid work | Online learning platform | Paid time offSenior-level Full TimeIND-Trivandrum-Equifax Analytics-PEC, India22h ago
-
Data Product Owner INR 1500K-2146KAgile | Aha! | BigQuery | Cloud Computing | CollibraGuided career tracks | Healthcare package | Hybrid work setting | Online learning platform | Paid time offSenior-level Full TimeIND-Pune-Equifax Analytics-PEC, India22h ago
-
AVP, Analytics – Marketing Measurement Consulting (L11) INR 500K-700KAWS | Agile | Data Visualization | Linux | Microsoft ExcelCareer advancement | Flexible work hours | Health and wellness programs | Travel as needed | Upskilling opportunitiesExecutive-level Full TimeHyderabad IN, India22h ago
-
AVP, Analytics - Belk (L10) INR 240K-360KCustomer Segmentation | Data Analysis | Data Mining | Likelihood estimation | Machine LearningCareer advancement | Employee wellness programs | Flexible work hours | Upskilling opportunities | Work from homeExecutive-level Full TimeHyderabad IN, India22h ago
-
Sr Analyst II Data Engineering INR 1019K-1593KData Analysis | Data Engineering | Data Pipelines | Data Processing | Data QualityFlexible work arrangements | In person collaboration model | Wellbeing supportMid-level Full TimeIN319 - IND Bangalore Electronic City …22h ago
-
Lead Data Engineer INR 3000K-4000KAWS S3 | Amazon EKR | Amazon EMR | Apache Airflow | Azure DataCalm app subscription | Casual leave | Crche facility support | Employee assistance program | Flexible work hoursSenior-level Full TimeIndia22h ago
-
Biostatistical Programming Manager INR 2535K-4225KCDISC ADaM | CDISC SDTM | Clinical data | Clinical trials | DEFINECareer growth opportunities | Diversity and inclusion | Health benefits | Professional development | Work-life balanceSenior-level Full TimeIndia - Hyderabad22h ago
-
Engineering Manager INR 1500K-2500KAgile | Apache Spark | Data Engineering | ODBC | Open SourceFlexible paid time off | Remote team support | Stock grantsMid-level Full TimeIndia1d ago
-
Tech Lead - Gen AI with 6+ Years(Remote) INR 2500K-5000KAWS | Chatbot | Computer Vision | Dialogue flow | Distributed ComputingRemote workSenior-level Full TimeBengaluru, KA, India R1d ago