Manager - Data Engineer
IN-KA-BENGALURU-NORTHGATE ~ Sy No 2/2 Venkatala Village ~ SY NO 2/2 VENKATALA VILLAGE, Yelahanka Hobli, India
INR 2400K-3200K (estimate) Senior-level Full Time
Tasks
- Architect cloud ETL ELT solutions
- Build metadata driven YAML ETL frameworks
- Design lakehouse lakehouse solutions
- Develop PySpark distributed data processing
- Develop curated data layers for analytics AI ML
- Drive data governance metadata management master data management
- Implement CI/CD pipelines and deployment automation
- Implement data quality validation monitoring logging
- Lead cloud modernization migration to Azure
- Optimize Spark and Databricks workloads
- Provide technical leadership mentoring and delivery governance
Perks/Benefits
- Daycare support
- Deferred compensation programs
- Flexible work schedules
- Leadership and training programs
- Parental leave support
- Pension plans
- Reward programs
Skills/Tech-stack
ARM Templates | Agile | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Databricks | Azure DevOps | Azure SQL | Azure Synapse | Azure Synapse Analytics | CI/CD | Data Factory | Data Lake Storage | Databricks Workflows | Delta Lake | Delta Live Tables | Delta Live) | Git | Infrastructure as Code | Lakehouse | Medallion Architecture | PySpark | Spark | Streaming Data | Synapse Analytics | Terraform | Unity Catalog | YAML | “as-code”
Education
Bachelor of Engineering | Bachelor of Technology | Master of Science | PhD
Related jobs
-
Senior Software Engineer (AI) INR 2000K-4500KAPI Design | AWS | Agent Frameworks | Aurora | CI/CDFamily wellbeing benefits | Health benefits | Paid time off | Wellbeing benefits | Work-life balanceSenior-level Full TimeHyderabad, India7h ago
-
Senior-level Full TimeIndia7h ago
-
Senior-level Full TimeIndia7h ago
-
Data Engineer INR 1800K-3000KAWS AppSync | Agentic Workflows | Amazon DynamoDB | Amazon S3 | FastAPIMid-level Full TimePune, Maharashtra, India8h ago
-
Amaze - Cloud Data Engineer INR 2500K-4800KAWS AI | Azure AI | Azure Data | Azure Data Factory | Data FactorySenior-level Full TimeIndia9h ago
-
Digital & GenAI Architect - Consulting INR 2000K-4000KAgent Framework | Artificial Intelligence | Azure Agent | Azure Agent Framework | CI/CDSenior-level Full TimeIndia9h ago
-
ML-Ops INR 2500K-4800KAsyncio | Benchmarking | CI/CD | CProfile | DjangoLeadership development | Training sessionsSenior-level Full TimeMumbai, Maharashtra, India9h ago
-
Gen AI Lead Developer INR 3000K-5000KAgent Orchestration | CI/CD | Data Governance | Distributed Systems | EmbeddingsSenior-level Full TimeIndia9h ago
-
Senior-level Full TimeIndia9h ago
-
Senior-level Full TimeIndia9h ago
-
Senior-level Full TimeIndia9h ago
-
Analytics Solutions - Associate INR 2040K-3380KAlteryx | Data Compliance | Data Governance | Data Modeling | Data QualityIn office days policy | Remote work optionSenior-level Full TimeBengaluru, Karnataka, India R9h ago
-
Agentic/AI engineers with Claude/code/LLM skills1 INR 2500K-4500KAWS | Azure | CI/CD | Containers | Data PipelinesSenior-level Full TimeIndia10h ago
-
AI Enablement Engineer INR 1500K-2500KAnthropic API | BigQuery | CI/CD | Cloud Run | ConfluenceContinuous learning culture | Training and developmentMid-level Full TimeBengaluru, India12h ago
-
AWS | AWS Lambda | AWS Secrets | AWS Secrets Manager | AgileSenior-level Full TimeMumbai, Maharashtra, India12h ago
-
Senior-level Full TimeIndia12h ago
-
SDE - III (Backend) INR 2800K-4200KAWS | Alerting | Azure | Bulkhead | CI/CDCollaborative culture | Leadership development | Learning and development programs | Multicultural team | Remote work optionSenior-level Full TimeIndia12h ago
-
Mid-level Full TimeIndia14h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Competitive salary | Flexible environment | Remote-friendly workMid-level Full TimeHyderabad, India15h ago
-
Bash | Data Ingestion | Data Processing | Docker | GCPAsynchronous culture | Friendly work environment | Hands-off managementMid-level Full TimePune, India15h ago
-
Senior Machine Learning Engineer, Ad Tech Engineering INR 2000K-3380KA/B | A/B Testing | B testing | CI/CD | Computer VisionCommuter benefits | Dental insurance | Disability insurance | Financial wellness support | HealthcareSenior-level Full TimeBengaluru, India19h ago
-
AI and Machine Learning Manager INR 1000K-1680KAgile | Data Analysis | Data Privacy | Data Security | Deep learningMid-level Full TimeBengaluru, Karnātaka, India19h ago
-
Senior AI and Machine Learning Engineer INR 2500K-4500KCalculus | Convolutional Neural Networks | Data Mining | Data Visualization | Decision TreesCareer Development Programs | Flexible work arrangements | Health and wellbeing benefitsSenior-level Full TimeBengaluru, Karnātaka, India19h ago
-
Senior AI and Machine Learning Engineer INR 2500K-4500KConvolutional Neural Networks | Data Mining | Data Preprocessing | Decision Trees | Deep learningHealth and wellbeing | Professional developmentSenior-level Full TimeBengaluru, Karnātaka, India19h ago
-
Mid-level Full TimeBangalore, KA, IN19h ago