Manager - Data Engineering
Tasks
- Build ETL/ELT workflows
- Collaborate with data architects and analytics teams
- Define data engineering best practices
- Design AI and ML ready data architecture
- Design data ingestion pipelines
- Develop data strategy and platform roadmap
- Ensure data governance, privacy, and security compliance
- Implement data transformation pipelines
- Implement validation rules and monitoring
- Implement version control CI CD performance tuning automation
- Integrate data from SAP and Salesforce
- Maintain and optimize Data Lake
- Maintain system performance and reliability
- Monitor data platform resource usage
- Oversee data lake migration and modernization
- Oversee data quality frameworks
- Own data lake architecture
- Provide technical guidance and mentorship
- Supervise data engineering team
- Support cloud cost optimization
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Automation | Azure | Azure Data | Azure Data Factory | BigQuery | CI/CD | Cloud Cost Optimization | Cost Optimization | Data Factory | Data Governance | Data Lakehouse | Data Modeling | Data Monitoring | Data Privacy | Data Quality | Data Security | Data Validation | Databricks | Dataflow | Dataproc | Dimensional Modeling | ELT | EMR | ETL | Event Hubs | GCP | Glue | Hadoop | Kafka | Metadata Management | Performance Tuning | Power BI | PySpark | Python | REST APIs | Redshift | Relational modeling | S3 | SQL | Snowflake Schema | Spark | Star Schema | Stream Analytics | Synapse | Version control
Education
Related jobs
-
Tech Lead - Java (Java, React, Kong) INR 1500K-3000KAPI Development | API Gateway | API Management | API Security | AgileSenior-level Full TimePune, IN, 4110573h ago
-
Program Manager - Inventory & Analytics INR 1000K-2500KBusiness Intelligence | Cross-Functional Collaboration | Cross-functional | Data Infrastructure | Data ModelingMid-level Full TimeBangalore South, India19h ago
-
APIs | Agent systems | Architecture Design | Data Engineering | Data ModelingEquipment support | Flexible working hours | Gifts and rewards | Lunch allowance | Medical insuranceSenior-level Full TimeIndia R20h ago
-
AI Data Engineer III INR 3000K-4000KAgile | Amazon Web Services | Apache Airflow | CI/CD | DBTComprehensive insurance | Education assistance program | Fitness benefits | Flexible working hours | Health checkupsSenior-level Full TimeBengaluru, Karnataka, India21h ago
-
Mid-level Full TimeBangalore, Karnataka, India R21h ago
-
Big Data Lead INR 1500K-2500KAWS S3 | Amazon ECS | Amazon IAM | Apache Airflow | CI/CDClient facing communication | Team collaborationSenior-level Full TimeIndia22h ago
-
Lead Software Engineer -Python or Java, big data INR 3000K-4500KAWS | AWS Lambda | Agile | Amazon EMR | Amazon Elastic Compute ServiceSenior-level Full TimeBengaluru, Karnataka, India22h ago
-
Manager,Regional Collections Analytics INR 850K-1250KArtificial Intelligence | Excel | Forecasting | Machine Learning | Predictive AnalyticsMid-level Full TimeBangalore, Karnataka, India R23h ago
-
Lead Software Engineer - AL/ML (Implementation Engineer) INR 4000K-5000KAWS | Azure | CI/CD | Distributed Systems | DjangoFlexible-hybrid work | Health insurance | Paid parental leave | Paid time offSenior-level Full TimeBengaluru23h ago
-
Assistant Director,Collections Analytics Lead ASP INR 2817K-4000KAML | Alteryx | BigQuery | Capacity Planning | Collections analyticsSenior-level Full TimeKolkata, West Bengal, India R23h ago
-
Senior Process Manager INR 2500K-5000KAI system architecture | AWS Bedrock | Autogen | Automation | Azure OpenAISenior-level Full TimePune, Maharashtra, India23h ago
-
AWS | Advanced Excel | Agile Development | Apache Hadoop | Apache SparkExecutive-level Full TimeKolkata, West Bengal, India R1d ago
-
Mid-level Full TimeKolkata, West Bengal, India R1d ago
-
Senior Specialist - AI Strategy (Mobility) INR 3000K-5000KAgentic AI | Agile delivery | Anomaly Detection | Artificial Intelligence | Cloud ArchitectureSenior-level Full TimePune, Maharashtra, IND, 411013 R1d ago
-
Senior-level Full TimePune City,India1d ago
-
Assistant Manager INR 1500K-2500KAssociation | Classification | Data Modeling | Data Warehousing | DatabricksMid-level Full TimeIndia1d ago
-
AI Governance | Airflow | Alerting | Anomaly Detection | Artifact RegistryMid-level Full TimePune, Maharashtra, India R1d ago
-
Lead Data Analyst INR 2817K-4064KAPI Integration | Dashboarding | Data Automation | Data Visualization | Data cleaningSenior-level Full TimeBengaluru1d ago
-
Business Analytics Manager - Dynamic Revenue Plus INR 1610K-2500KA/B | A/B Testing | B testing | Business Analytics | Commercial AnalyticsEmployee resource groups | Hybrid work model | Mental health and wellbeing initiatives | Paid birthday leave | Parental leaveMid-level Full TimePune R1d ago
-
Azure Databricks+ PySpark- Sr Technical Lead-Data Engg INR 1500K-2700KAzure Data | Azure Data Factory | Azure Data Lake | Azure Databricks | Data FactorySenior-level Full TimeINDIA - PUNE - BIRLASOFT OFFICE …1d ago
-
Data Analytics Specialist INR 2771K-4200KAPI | Agentic AI | Alteryx | Azure Data | Azure Data FactorySenior-level Full TimeGurgaon, HR, IN, 1220101d ago
-
AI Governance | Airflow | Alerting | Anomaly Detection | Artifact RegistryMid-level Full TimePune, MH, IN, 4110061d ago
-
A/B | A/B Testing | B testing | CI/CD | CloudFormationFlexibility | Hybrid work environment | Inclusive benefits | Mentorship | Wellbeing supportMid-level Full TimeMumbai Goregaon, India1d ago
-
IT Data & Analytics DevSecOps Manager INR 1000K-2000KAI Solutions | Agile | Amazon Web Services | Artificial Intelligence | AutomationOnsite work 3 days per weekMid-level Full TimeBangalore–Embassy Business Hub, India1d ago
-
Data Science Engagement Lead INR 2755K-4000KAWS | Agile | Artificial Intelligence | Azure | CI/CDCareer growth | Inclusive workplace | International collaboration | Training and development programmes | Work-life balanceSenior-level Full TimeSHELL CENTRE – CHENNAI, India1d ago