Data Engineering Manager
Bangalore, Karnataka, India
INR 1500K-2500K (estimate) Mid-level Full Time
Tasks
- Build data ingestion and processing pipelines
- Build metadata driven ingestion frameworks
- Design data pipelines
- Develop ETL workflows
- Develop data transformation logic
- Develop medallion architecture
- Implement data quality frameworks
- Implement data security and privacy measures
- Integrate data from multiple sources
- Manage Azure data engineering delivery
- Monitor and troubleshoot data flows
- Optimize data storage and processing performance
Perks/Benefits
- N/A
Skills/Tech-stack
ADLS | Access Management | Azure | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOps | Azure Functions | Azure RBAC | Azure Synapse | Azure Synapse Analytics | Big Data | Data Factory | Data Ingestion | Data Lake | Data Lake Storage | Data Processing | Data Quality | ETL | Git | IAM | Identity and Access Management | Identity and access | Medallion Architecture | Metadata Driven | Metadata Driven Ingestion | Microsoft Fabric | OneLake | Power BI | PySpark | Python | SCD Type 1 | SCD Type-2 | SQL | SQL Server | SparkSQL | Synapse Analytics | Type 1 | Type 2)
Education
Bachelor of Engineering | Bachelor of Science | Master of Science | PhD
Related jobs
-
Mid-level Full TimeIN-AP-Hyderabad7h ago
-
GCP Data Engineer - Associate Director INR 800K-2000KApache Airflow | Apache Kafka | Apache Spark | BigQuery | CI/CDMid-level Full TimeHyderabad, Telangana, India8h ago
-
AI Engineer INR 1500K-3000KAzure Databricks | Data Engineering | Data engineering pipelines | Embeddings | Engineering PipelinesMid-level Full TimeBengaluru, Karnataka, India9h ago
-
Software Engineer II,Python, Spark INR 1500K-2200KAWS | AWS Glue | AWS Glue Catalog | AWS KMS | AWS Lake FormationMid-level Full TimeMumbai, Maharashtra, India10h ago
-
AI QA Engineer - Bangalore, IND INR 2000K-3000KAPI Development | Claude | Docker | Embeddings | Evaluation FrameworksMid-level Full TimeIndia10h ago
-
Lead Software Engineer - Java/Python, AWS,LLM INR 3500K-5000KA/B | A/B Testing | AWS Lambda | Agentic AI | AgileSenior-level Full TimeMumbai, Maharashtra, India11h ago
-
Staff Engineer, Data Analytics Engineering INR 2500K-3500KAPIs | AWS Glue | AWS Lambda | AWS S3 | Amazon BedrockSenior-level Full TimeBengaluru, KA, India11h ago
-
Senior Associate - Data Science/Applied AI ML INR 1400K-2400KAnomaly Detection | Backtesting | Bias/fairness | CI/CD | ClassificationMid-level Full TimeMumbai, Maharashtra, India13h ago
-
Senior Associate - Data Science/Applied AI ML INR 1400K-2400KAnomaly Detection | Bias and fairness | CI/CD | Classification | ClusteringMid-level Full TimeMumbai, Maharashtra, India13h ago
-
Data Engineer (GCP) INR 1500K-2040KAPIs | Airflow | Authentication | Authorization | BigQueryAgile collaboration | Autonomy | Flexible environmentMid-level Full TimePune, Maharashtra, India13h ago
-
Senior-level Full Timetelengana, India13h ago
-
Associate Specialist - Cloud & Application Engineering INR 800K-1000KAWS | Azure | Cloud Data | Cloud Data Platforms | Cloud platformMid-level Full TimeMumbai, Maharashtra, India13h ago
-
Associate Principal Engineer, Data Engineer (Enterprise Data Architecture- Banking domain) INR 1500K-2500KArdoq | Cloud Data | Cloud Data Platforms | Collibra | Data ArchitectureMid-level Full TimeRemote, India R14h ago
-
Consultant - Python Developer with Gen AI INR 1500K-2500KAI Search | Agile | Azure OpenAI | CSS | DjangoMid-level Full TimeBangalore, Karnataka, India14h ago
-
Mid-level Full TimeBangalore, Karnataka, India14h ago
-
Product Manager (Vice President) - Fusion Data Platform INR 3000K-6000KAgent systems | Async Programming | Audit trails | Autogen | ChunkingExecutive-level Full TimeHyderabad, Telangana, India14h ago
-
Data Engineer INR 850K-1500KAirflow | Apache Spark | Cloud Computing | Data Modeling | Data WarehousingEasy public transit access | Generous paid leave | In office collaboration culture | Insurance and health benefitsMid-level Full TimeBengaluru14h ago
-
Mid-level Full TimeBengaluru, Karnataka, India14h ago
-
Senior Software Engineer, Data Engineering INR 3000K-4000KAWS | Apache Airflow | Apache Spark | Data Modeling | Data PipelinesAccident insurance | Commuter benefits | Dental benefits | Disability insurance | Financial wellness supportSenior-level Full TimeBengaluru, India16h ago
-
Senior Machine Learning Engineer - Advertising Engineering INR 2520K-3880KAttribution Modeling | C++ | Classification | Data Lake | Data PipelinesFlexible remote work on Fridays | Health and wellness support | Hybrid work schedule | Paid time offSenior-level Full TimeBengaluru, India16h ago
-
Senior-level Full TimeBengaluru, KA, India16h ago
-
Staff Product Manager - Enterprise Security, IAM & Data Platform INR 3000K-6000KAI/ML | Access Management | Agile | Customer Insight | Data platformSenior-level Full TimeBengaluru, India16h ago
-
Analytics Manager - Internal Audit INR 500K-805KArtificial Intelligence | Automation | Continuous Auditing | Dashboarding | Data analyticsEntry-level Full TimeHyderabad, India17h ago
-
Mid-level Full TimePune, Maharashtra, India17h ago
-
Manager, Professional Services INR 700K-2000KAWS | Apache Spark | Azure | Cassandra | Cloud platformAccident Coverage | Annual personal development fund | Business travel insurance | Employee provident fund | Equity awardsMid-level Full TimeRemote - India R20h ago