Data Engineering Manager
Bangalore, Karnataka, India
INR 1500K-2500K (estimate) Mid-level Full Time
Tasks
- Build data ingestion and processing pipelines
- Build metadata driven ingestion frameworks
- Design data pipelines
- Develop ETL workflows
- Develop data transformation logic
- Develop medallion architecture
- Implement data quality frameworks
- Implement data security and privacy measures
- Integrate data from multiple sources
- Manage Azure data engineering delivery
- Monitor and troubleshoot data flows
- Optimize data storage and processing performance
Perks/Benefits
- N/A
Skills/Tech-stack
ADLS | Access Management | Azure | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOps | Azure Functions | Azure RBAC | Azure Synapse | Azure Synapse Analytics | Big Data | Data Factory | Data Ingestion | Data Lake | Data Lake Storage | Data Processing | Data Quality | ETL | Git | IAM | Identity and Access Management | Identity and access | Medallion Architecture | Metadata Driven | Metadata Driven Ingestion | Microsoft Fabric | OneLake | Power BI | PySpark | Python | SCD Type 1 | SCD Type-2 | SQL | SQL Server | SparkSQL | Synapse Analytics | Type 1 | Type 2)
Education
Bachelor of Engineering | Bachelor of Science | Master of Science | PhD
Related jobs
-
Senior-level Full TimePune, India13h ago
-
Senior DevOps Engineer - Embedded Payments INR 3242K-4500KAPI Gateway | AWS | Aurora PostgreSQL | Bitbucket Pipelines | CloudWatchFlexible working arrangements | Mental health support | Paid parental leave | Volunteer daysSenior-level Full TimePune, MH, India R15h ago
-
AWS | Amazon Kinesis | Amazon Redshift | Apache Airflow | Apache BeamFree games | Hybrid work | Learning and growth opportunities | Medical insurance | Mental health supportEntry-level Full Time地点：Hyderabad, Telangana, India16h ago
-
Senior-level Full TimeIN-AP-Hyderabad17h ago
-
Senior-level Full TimeIN-TN-Chennai17h ago
-
Manager , Data and Analytics INR 700K-1500KAnalytics | Customer Analytics | Data Modeling | Data Normalization | Data QualityMid-level Full TimeBangalore, Karnataka, India17h ago
-
Mid-level Full TimeLocations: Hyderabad, Telangana, India17h ago
-
AWS CloudFormation | Amazon Kinesis | Amazon Redshift | Amazon Web Services | Apache AirflowCareer growth opportunities | Complimentary games | Family leave | Healthcare coverage | Mental wellbeing supportEntry-level Full TimeLocations: Hyderabad, Telangana, India17h ago
-
GBM - Public Dept-Bengaluru-Associate-Quantitative Engineering INR 1200K-2200KAutomation | C++ | Derivatives pricing | Equity Derivatives | Equity swapsMid-level Full TimeBengaluru, Karnataka, India17h ago
-
Associate Distinguished Engineer (Data Governance Framework, Data Catalog Implementation) INR 1300K-2000KBusiness glossary | Compliance | Data Architecture | Data Cataloging | Data ClassificationAwareness sessions | Continuous learning opportunities | Training programsMid-level Full TimeRemote, India R18h ago
-
Senior-level Full TimeMumbai, Maharashtra, India18h ago
-
Senior Engineering Manager INR 4000K-6000KCareer development | Data Ingestion | Debt management | Distributed Systems | Embedding-based retrievalSenior-level Full TimeBengaluru, Karnataka, India18h ago
-
Staff Software Engineer, AI/ML and Moma Agentic INR 2500K-5000KArtificial Intelligence | C# | C++ | Database technologies | Distributed SystemsMentorshipSenior-level Full TimeHyderabad, Telangana, India18h ago
-
Senior Staff Software Engineer, Google Cloud Storage INR 3200K-4000KArtificial Intelligence | Benchmarking | C++ | Cloud Storage | Distributed SystemsSenior-level Full TimeHyderabad, Telangana, India18h ago
-
AI Customer Engineer, Public Sector, Google Cloud INR 2500K-5000KAPI Gateway | Audit Logging | Business automation | Cloud Networking | Distributed tracingConference participation | Travel opportunitiesSenior-level Full TimeGurugram, Haryana, India18h ago
-
Assistant Director,TnO Analytics INR 4000K-5199KAudit Liaison | Control Testing | Dash | Data Governance | Data QualityExecutive-level Full TimeBangalore, Karnataka, India R18h ago
-
Data Engineer INR 1500K-2500KAmazon Web Services | Apache Spark | Azure | Cloud Computing | Cloud platformSenior-level Full TimeNoida, Uttar Pradesh, India19h ago
-
GCP, Bigquery, Airflow/Consultant Specialist INR 1500K-2500KAgile | Airflow | Apache Kafka | Apache NiFi | BigQuerySenior-level Full TimeHyderabad, Telangana, India R19h ago
-
GCP, Airflow/CONSULTANT SPECIALIST INR 1500K-2500KAccess Control | Apache Airflow | Apache NiFi | Audit Logging | BigQueryFlexible working | Opportunities for professional developmentSenior-level Full TimePune, Maharashtra, India R19h ago
-
Senior Manager of Software Engineering Analytics Platform INR 3000K-5000KAgile | Artificial Intelligence | CI/CD | Cloud Native | DatabricksSenior-level Full TimeHyderabad, Telangana, India19h ago
-
Senior Software Engineer INR 2475K-5000K.NET | Agile | Artificial Intelligence | Azure Functions | Cloud servicesSenior-level Full TimeIndia, Karnataka, Bangalore; India, Telangana, Hyderabad19h ago
-
Senior Engineer - Operational Excellence (AI Solutions) INR 2500K-5000KAI Agent | AI Foundry | AI agent workflows | AI guardrails | APIsSenior-level Full TimePune, Maharashtra, IND, 41101320h ago
-
Senior-level Full TimeHyderabad, TS, India20h ago
-
Software Engineer III - Python, AI ML, Cloud INR 3500K-5500KAgentic Frameworks | Amazon Web Services | Apache Airflow | Automated testing | AzureSenior-level Full TimeMumbai, Maharashtra, India20h ago
-
Senior-level Full TimeHyderabad, Telangana, India20h ago