Data Engineer - Manager
Bangalore, Karnataka, India
INR 1500K-2500K (estimate) Mid-level Full Time
Tasks
- Architect enterprise data platforms
- Build data transformation pipelines
- Define architecture standards and patterns
- Design scalable data ingestion pipelines
- Develop reusable data engineering frameworks
- Ensure data quality, availability, and reliability
- Implement data security governance privacy controls
- Lead ETL ELT pipeline development and deployment
- Lead cloud migration to Databricks and Azure services
- Manage organizational change and scale engineering teams
- Mentor and guide data engineers
- Optimize Databricks workloads
- Oversee data product mindset and governed reusable data assets
- Provide proofs of concept and solution demos
Perks/Benefits
Skills/Tech-stack
Agile | Apache Spark | Avro | Azure | Azure Blob | Azure Blob Storage | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DevOps | Azure RBAC | Blob Storage | CI/CD | Data Factory | Data Governance | Data Lake Storage | Data Marts | Data Modeling | Data Privacy | Data Security | Data Warehousing | Databricks | Delta Lake | DevSecOps | ELT | ETL | IAM | Parquet | PySpark | SQL | Scala | Terraform
Education
Related jobs
-
Mid-level Full TimeBangalore, Karnataka, India3h ago
-
Azure Data Engineer Consultant INR 1500K-2000KAzure Blob | Azure Blob Storage | Azure Data | Azure Data Factory | Azure Data LakeCorporate social responsibility programs | Discounts on products and services | Maternity and paternity leave | Networking opportunities | VIRTUAL interviewMid-level Full TimeBangalore, Karnataka, India4h ago
-
Data Engineering Specialist INR 2000K-3000KAWS | Ab Initio | Apache NiFi | Apache Spark | BigQueryCareer development | Continuous training | Knowledge transfer sessionsSenior-level Full TimeBengaluru, IN, 5601035h ago
-
Data Analytics Professional INR 2500K-4000KAI Algorithms | Automation | Business Intelligence | Data Analysis | Data IntegrityEntry-level Full TimeBengaluru, IN, 5601035h ago
-
D&T Lead - Data Engineer INR 2000K-2800KAmazon Web Services | Azure | Batch Processing | Cloud Data | Cloud Data WarehouseSenior-level Full TimePune, IN6h ago
-
Sr. Machine learning /Data Scientist INR 3000K-4500KAWS Bedrock | AWS SageMaker | Apache Spark | Classification | ClusteringAccreditations | Bike to work | Educational assistance | Employee assistance program | Employee discount schemeSenior-level Full TimeMumbai, MH, India7h ago
-
Sr. Data Engineer INR 1500K-2400KApache Spark | Azure Data | Azure Data Services | CI/CD | Data IngestionSenior-level Full TimePune, Maharashtra, India8h ago
-
Consultant - Python Developer with Gen AI using AI Foundry INR 2000K-4000KAWS | Autogen | Azure | Claude | Cloud platformSenior-level Full TimeBangalore, Karnataka, India9h ago
-
Data Engineer -Azure Modern Data Platform INR 3000K-3500KAnalysis Services | Azure Data | Azure Data Factory | Azure Databricks | Azure SynapseSenior-level Full TimePune, MH, India9h ago
-
AI/ML Developer INR 1800K-2500KAzure | Cloud Computing | Cloud platform | Data Pipelines | Data PreprocessingMid-level Full Timebangalore, India9h ago
-
Senior Expert INR 2829K-3380KAWS | Algorithms | Azure | Cloud Computing | Data CleansingEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeVadodara, GJ, India9h ago
-
Senior Data Engineer (AWS & Snowflake) INR 1200K-2000KAWS | Airflow | Alation | Aurora Postgres | CDCSenior-level Full TimeIndia10h ago
-
Software Engineer II INR 2000K-2500KAWS EC2 | AWS RDS | AWS S3 | CI/CD | Data StructuresCross-functional team projects | Learning campus coursesMid-level Full TimeMumbai, India10h ago
-
Staff Data Engineer INR 2755K-4000KAWS | Apache Kafka | Apache Spark | Azure | CI/CDCell phone reimbursement | Healthcare | Internet reimbursement | Learning and development stipend | Travel opportunitiesSenior-level Full TimeBengaluru, India11h ago
-
Mid-level Full TimePune, IN14h ago
-
Senior Data Migration Engineer INR 2800K-4000KApache Airflow | Bulk Insert | CI/CD | Cx Oracle | DBTSenior-level Full TimeBangalore, KA, IN14h ago
-
AWS/Airflow Engineer INR 1500K-2400KApache Airflow | Apache Spark | Azure Data | Azure Data Factory | Azure DevOpsOn-call rotationEntry-level Full TimeBengaluru, KA, IN14h ago
-
Senior-level Full TimeBengaluru, KA, IN, 56001614h ago
-
CI/CD | Caching | Clustering | DBT | Data LakesFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeKolkata DN 57, India14h ago
-
IN-Senior Associate_AI Engineer_Data Analytics_Advisory_Mumbai INR 2000K-4500KA/B | A/B Testing | B testing | CI/CD | CloudFormationSenior-level Full TimeMumbai Goregaon, India14h ago
-
API | Agents | Apache Airflow | Apache Hadoop | Azure DataSenior-level Full TimeKolkata DN 57, India14h ago
-
.NET | .Net Core | API Management | ARM | ASP.NET MVCMid-level Full TimeBengaluru Millenia, India14h ago
-
Full Stack Data Engineer - Methods & Tools INR 1500K-3000KAWS | Angular | Azure | CSS | DockerEqual opportunity employment | Flexible working arrangementsMid-level Full TimeBangalore (Airbus), India14h ago
-
Software Engineer - AI/ML INR 1500K-2500KAgile | Artificial Intelligence | CI/CD | Cloud Platforms | Data AnalysisFamily-friendly benefits | Inclusive work environmentMid-level Full TimeIND-Tamil Nadu-Chennai-KLA, India14h ago
-
IN_Manager_ETL Informatica_Data & Analytics_Advisory_Mumbai INR 1500K-2000KETL | Informatica | Informatica PowerCenterFlexibility programmes | Inclusive benefits | Mentorship | Work-life supportMid-level Full TimeMumbai Shivaji Park, India14h ago