Manager - Data Engineer
IN-KA-BENGALURU-NORTHGATE ~ Sy No 2/2 Venkatala Village ~ SY NO 2/2 VENKATALA VILLAGE, Yelahanka Hobli, India
INR 2000K-2800K (estimate) Senior-level Full Time
Tasks
- Architect cloud ETL ELT solutions
- Build PySpark distributed processing
- Create curated data layers for analytics reporting and AI ML
- Design lakehouse solutions
- Develop metadata driven YAML ETL frameworks
- Drive data governance and metadata management
- Implement CI/CD pipelines and deployment automation
- Implement data quality monitoring observability lineage
- Lead and mentor engineering teams
- Modernize and migrate data platforms to Azure
- Optimize Spark and Databricks workloads
Perks/Benefits
- Advancement programs
- Comprehensive benefits
- Daycare support
- Flexible work schedule
- Leadership and training programs
- Parental leave financial support
- Pension plans
Skills/Tech-stack
Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Databricks | Azure DevOps | Azure SQL | Azure Synapse | CI/CD | Data Factory | Data Governance | Data Lake Storage | Data Management | Data Modeling | Data Processing | Data Quality | Databricks Workflows | Delta Lake | Delta Live Tables | Delta Live) | Git | Infrastructure as Code | Lakehouse | Lineage | Logging | Master Data | Master Data Management | Medallion Architecture | Metadata Management | Monitoring | Observability | PySpark | Spark | Streaming Data | Streaming data processing | Terraform | Unity Catalog | YAML | “as-code”
Education
Related jobs
-
Apache Beam | Apache Flink | Apache Kafka | Apache Spark | Data ProcessingMid-level Full TimePune, Maharashtra, India R10h ago
-
Jr Data Engineer INR 360K-420KAWS Glue | Apache Airflow | Apache Flink | Apache Kafka | Apache SparkEntry-level Full TimeBangalore North, India12h ago
-
Senior-level Full TimeBangalore, IN12h ago
-
Senior Analyst INR 3000K-4000KAlteryx | Automation | Client Onboarding | Collibra | Data EnrichmentSenior-level Full TimeChandigarh, India12h ago
-
Senior-level Full TimeIN-KA-Bangalore13h ago
-
Senior Consultant INR 2000K-2700KAzure Data | Azure Data Lake | Azure Databricks | Azure Machine Learning | Data LakeSenior-level Full TimeIN-KA-Bangalore13h ago
-
Apprentice-IT INR 360K-562KAPI | Data Architecture | Data Governance | Data Modeling | Data QualityEntry-level ApprenticeshipPune, Maharashtra, IND, 41101413h ago
-
Mid-level Full TimeBangalore, Karnataka, India15h ago
-
Mid-level Full TimeBangalore, Karnataka, India15h ago
-
AI Data Engineer III INR 3000K-4000KAWS | Agile | Apache Airflow | CI/CD | DBTContinuous learning | Generous leave policies | Health insurance | Hybrid work policies | Wellness programsSenior-level Full TimeBengaluru, Karnataka, India15h ago
-
Senior Production Support Engineer - LoanIQ - Bangalore INR 3000K-5000KAPIs | Automation | Cause analysis | Incident Management | JavaSenior-level Full TimeIndia15h ago
-
Assistant Manager-KDNI INR 1500K-2000KAgile | Apache Spark | Azure | Azure Data | Azure Data FactoryMid-level Full TimeHyderabad, Telangana, India15h ago
-
Associate Director, Data and Analytics INR 2000K-3000KAIOps | AWS | Adversarial Attacks | Agentic Systems | Bias detectionMid-level Full TimeBangalore, Karnataka, India16h ago
-
Engineer - Embedded Automation QA INR 480K-1050KAPI Testing | Agile | Automation Framework | Azure DevOps | BACnetMid-level Full TimeHadapsar, Pune, Maharashtra, IND, 41101316h ago
-
Software Engineer I- Eng INR 300K-350KAWS | Agile | Automation | CI/CD | Cloud ComputingFlexible work arrangements | Health benefits | Mentorship | Paid time offEntry-level Full TimeNoida,UP,India R16h ago
-
Mid-level Full TimeHadapsar, Pune, Maharashtra, IND, 41101316h ago
-
Senior Data & Analytics Engineer INR 3000K-4000KAWS | Apache Spark | Azure | CI/CD | Cloud platformSenior-level Full TimeBangalore, Karnataka, IN17h ago
-
Senior AVP Enterprise Digital - Lead Data Management INR 2000K-4000KAlerting | Apache Spark | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeNoida, Uttar Pradesh, India17h ago
-
Sr. Specialist , Data Engineering INR 2520K-3380KAgile | Airflow | BigQuery | CI/CD | Cloud FunctionsRelocation assistanceSenior-level Full TimeMumbai, MH, IN17h ago
-
Consultant - AI Engineer INR 2500K-5000KAutogen | CI/CD | Cloud infrastructure | Containerization | CrewAISenior-level Full TimeBangalore, Karnataka, India18h ago
-
Software Engineering Manager (StorageGrid) INR 1800K-3500KAgile | CI/CD | Cloud infrastructure | Distributed Systems | HTTPSMid-level Full TimeBangalore, India Office (BANGALORE) R18h ago
-
Senior-level Full TimePune, Maharashtra, India18h ago
-
Lead-Affluent BIU & Analytics-AFFLUENT-Program & MIS INR 2500K-4400KA/B | A/B Testing | B testing | Clustering | Data GovernanceSenior-level Full TimeMumbai, Maharashtra, India19h ago
-
Lead Infrastructure Engineer - GenAI & CloudFormation INR 3000K-5000KAWS | Agentic AI | Automation | Bitbucket | ConfluenceSenior-level Full TimeHyderabad, Telangana, India19h ago
-
Lead Infrastructure Engineer - GenAI & CloudFormation INR 3000K-5000KAWS Lambda | Agentic AI | Amazon EC2 | Amazon ECS | Amazon Web ServicesSenior-level Full TimeHyderabad, Telangana, India19h ago