Manager - Data Engineer
INR 2400K-3200K (estimate) Senior-level Full Time
Tasks
- Architect cloud ETL ELT solutions
- Build metadata driven YAML ETL frameworks
- Design lakehouse lakehouse solutions
- Develop PySpark distributed data processing
- Develop curated data layers for analytics AI ML
- Drive data governance metadata management master data management
- Implement CI/CD pipelines and deployment automation
- Implement data quality validation monitoring logging
- Lead cloud modernization migration to Azure
- Optimize Spark and Databricks workloads
- Provide technical leadership mentoring and delivery governance
Perks/Benefits
- Daycare support
- Deferred compensation programs
- Flexible work schedules
- Leadership and training programs
- Parental leave support
- Pension plans
- Reward programs
Skills/Tech-stack
ARM Templates | Agile | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Databricks | Azure DevOps | Azure SQL | Azure Synapse | Azure Synapse Analytics | CI/CD | Data Factory | Data Lake Storage | Databricks Workflows | Delta Lake | Delta Live Tables | Delta Live) | Git | Infrastructure as Code | Lakehouse | Medallion Architecture | PySpark | Spark | Streaming Data | Synapse Analytics | Terraform | Unity Catalog | YAML | “as-code”
Education
Bachelor of Engineering | Bachelor of Technology | Master of Science | PhD
Related jobs
-
Senior AI and Machine Learning Engineer INR 3584K-4600KConvolutional Neural Networks | Data Mining | Data Preprocessing | Data Visualization | Decision TreesMentorship and guidance | Onsite work arrangement | Professional development programsSenior-level Full TimeBengaluru, Karnātaka, India23h ago
-
Senior AI and Machine Learning Engineer INR 3584K-4600KCalculus | Convolutional Neural Networks | Data Mining | Data Preprocessing | Data VisualizationCareer Development Programs | Flexible work options | Health & wellbeing programs | Inclusive work environmentSenior-level Full TimeBengaluru, Karnātaka, India23h ago
-
Principal Analytics Engineer- Azure data warehouse, ADF/Synapse, T-SQL, data pipeline design INR 2520K-3500KAnalysis Services | Azure | Azure Analysis | Azure Analysis Services | Azure DataHybrid work flexibility | Virtual work supportSenior-level Full TimeGurgaon - Cyber Park, India23h ago
-
Embedded Test Engineer INR 600K-1400KAgile | Debugging | Embedded Systems | Embedded firmware | Functional testingMid-level Full Time(HE)Office Commerzone, India23h ago
-
AI Engineer II (Remote) USD 39K-72KAWS | CI/CD | Docker | Embeddings | Entity recognitionRemote workMid-level Full TimeIndia, Remote R1d ago
-
Mid-level Full TimeIndia - Remote R1d ago
-
Sr. Lead Software Engineer - Data Engineer, AWS,AI INR 2000K-5000KAWS | Agile methodology | Apache Spark | Application Resiliency | Automated testingSenior-level Full TimeMumbai, Maharashtra, India1d ago
-
Senior-level Full TimeIN-TN-Chennai1d ago
-
Senior-level Full TimeIN-TN-Chennai1d ago
-
Senior-level Full TimeIN-TN-Chennai1d ago
-
Senior-level Full TimeIN-TN-Chennai1d ago
-
PL/SQL Developer INR 1200K-2400KBackup & Recovery | CI/CD | Data Modeling | Data Quality | Database InternalsSenior-level Full TimeIN-TN-Chennai1d ago
-
Agentic Data Delivery Lead INR 3000K-5000KAI Governance | AWS | Access Control | Agent systems | Apache HadoopSenior-level Full TimePune, Maharashtra, India1d ago
-
Azure Data Engineer INR 1500K-2000KAzure Data | Azure Data Factory | Azure Data Lake | Azure Functions | Azure SynapseHybrid work modeSenior-level Full TimeNoida, Uttar Pradesh, India1d ago
-
Software Engineer III - (ADLC , Python) INR 3000K-4000KAWS | Agile | Architecture | CI/CD | Data VisualizationSenior-level Full TimeHyderabad, Telangana, India1d ago
-
Senior AI Developer INR 2000K-4500KAWS | Angular | Azure | CI/CD | Computer VisionAnnual performance bonus | Communication Skills Training | Extended maternity leave | Family medical insurance | Flexible work scheduleSenior-level Full TimeHyderabad, Telangana, India1d ago
-
AES - DE - Generative AI Prompt Engineers INR 2000K-3500KAnthropic API | Azure OpenAI | CI/CD | Code Analysis | Cost controlsMid-level Full TimePune, Maharashtra, India1d ago
-
Sub Value Stream Technology Lead - Capital and Statistical Regulatory Reporting (CSRR) INR 3000K-4000KAgentic Frameworks | Agile | Automation | Best practices | Cause analysisCareer development | Diverse and inclusive culture | Remote and flexible collaborationSenior-level Full TimePune, Maharashtra, India R1d ago
-
Senior-level Full Time Part Timebangalore, India1d ago
-
AI Application Engineer INR 3000K-4408KAWS Lambda | AWS S3 | Amazon Bedrock | CI/CD | Cloud SecurityKnowledge sharing culture | Learning environmentMid-level Full TimeHybrid (Bengaluru, Karnataka, IN); Hybrid (Pune, … R1d ago
-
Lead Quality Development (SDET) Engineer-Gen AI INR 2000K-3300KAPI Testing | AWS | Azure | BDD | CI/CD5 days a week | Mentorship opportunities | Work from OfficeSenior-level Full TimeNoida, India1d ago
-
Mid-level Full TimeIndia1d ago
-
Lead Software Engineer - Java, Spring boot, AWS Cloud & AI/ML (REST APIs, System Design, SDLC) INR 3500K-5000KAI Assisted Development | API Gateway | AWS Athena | AWS Glue | AWS KinesisSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
Consultant - Data Engineer INR 1500K-2000KAzure | Azure Databricks | Compliance | Data Modeling | Data SecurityMid-level Full TimeKochi, Kerala, India1d ago
-
Junior Agentic AI Engineer (m/f/d) INR 300K-350KAI Foundry | AKS | API Wrappers | Azure AI | Azure AI FoundryAgile collaboration | Career development | Flexible working | International networking | Learning opportunitiesEntry-level Full TimeHyderabad, IN1d ago