Technical Lead - Data Engineering
Tasks
- Collaborate with data scientists for production integration
- Deploy and manage machine learning models
- Design and implement medallion data lake architecture
- Enforce data security and compliance standards
- Integrate AI models into production environments
- Lead end to end delivery of data and AI projects
- Optimize PySpark and Databricks data pipelines
- Oversee ETL and ELT patterns
- Provide technical leadership and unblock engineering teams
- Translate business goals into technical roadmaps
Perks/Benefits
- N/A
Skills/Tech-stack
Azure | Azure Data | Azure Data Factory | Azure Storage | Data Factory | Data Ingestion | Data Lakehouse | Data Modeling | Data Warehousing | Databricks | Delta Lake | ELT | ETL | PySpark | Python | SQL | Snowflake
Education
N/A
Related jobs
-
AWS | Azure | Cloud platform | Deep learning | Generative AIContinuous learning and growth | Fully remote work | Technical excellence and experimentation cultureSenior-level Full TimeIndia R7h ago
-
Databricks Manager INR 2000K-3000KApache Spark | Data Modeling | Data Pipelines | Data Warehousing | DatabricksSenior-level Full TimeBangalore, Karnataka, India8h ago
-
Computer Scientist 2 ( Data Engineering + AI ) INR 2475K-3465KAWS | Apache Spark | Azure | CI/CD | DatabricksSenior-level Full TimeNoida, India R13h ago
-
VP - Data Engineering INR 1500K-6000KAgile | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageFlexible working | Home working arrangementsExecutive-level Full TimePune, India13h ago
-
API Testing | Agile | App Service | Azure App | Azure App ServiceHybrid workExecutive-level Full TimePune, India13h ago
-
Lead Engineer -.NET INR 2000K-4800K.NET | AI Coding Assistants | AI coding | ASP.NET Web | ASP.NET Web APISenior-level Full TimeBengaluru, KA, India21h ago
-
Data Science INR 2000K-3300KAgentic AI | Apache Airflow | CrewAI | Data Architecture | Data PipelinesSenior-level Full TimeIN-MH-Pune1d ago
-
DevOps Engineer INR 1500K-2500KAgile | Amazon Web Services | BI dashboarding | CI/CD | Cloud platformInternational collaboration | Occasional travel to EuropeMid-level Full TimePune, MH, India1d ago
-
Specialist - Data Engineering-Data Engineering INR 180K-200KAWS | Apache Kafka | Apache Spark | Data Modeling | Data QualityEntry-level Full TimeMumbai, Maharashtra, India1d ago
-
Lead Software Engineer - 260317-2 INR 2400K-4000KAWS | Apache Airflow | CI/CD | Cloud platform | Data ModelingSenior-level Full TimeBangalore, India1d ago
-
Data Analytics & Data Engineering Vice President INR 2000K-5800KAccess Control | Agile | Alteryx | Cloud Computing | ConfluenceExecutive-level Full TimeIndia1d ago
-
Lead Software Engineer INR 3000K-4500KAWS | CI/CD | DevOps | Docker | EMRCareer development opportunities | Comprehensive benefits | Continuous learning | Flexible working hours | Work-life balanceSenior-level Full TimeMumbai, India1d ago
-
Product & Program Lead - Analytics & Insights INR 3000K-4000KA/B | A/B Testing | APIs | Advanced Analytics | Analytics governanceSenior-level Full TimePune, IN1d ago
-
AWS | Apache Airflow | Azure Data | Azure Data Factory | Azure SynapseHybrid scheduleSenior-level Full TimeIND - Pune, Kalyani Nagar, India R1d ago
-
Technical Lead – Algorithm Developer INR 2475K-3500KAlgorithm validation | Anomaly Detection | Benchmarking | C plus plus | CNNSenior-level Full TimeBangalore,IND, India1d ago
-
Lead Analytics Consultant INR 1100K-2200KAlteryx | Binomial trees | Calypso | Capital Markets | Commodities derivativesSenior-level Full Time110380-IND-BENGALURU-INTL BLR Twr-1&2 CARNATION, India1d ago
-
Lead Consultant- AI Engineering INR 2000K-3465KAPIs | CI/CD | Calculus | Computer Vision | ContainerizationSenior-level Full TimeIndia - Chennai1d ago
-
Lead Analyst - Credit Data Solutions (Data Governance) INR 1890K-2700KBusiness Intelligence | Dashboards | Data Governance | Data Lineage | Data MappingSenior-level Full TimeIND - KA - Bangalore - …1d ago
-
Custom Software Engineer INR 1300K-2000KCloud Architecture | Data Modeling | Data Querying | Data Warehousing | ETLMid-level Full TimeBengaluru, BDC6F, India1d ago
-
Team Lead/Senior Specialist - AI INR 2500K-4800KAutogen | CI/CD | Cloud Platforms | Cost Optimization | CrewAISenior-level Full TimeIndia - Remote R1d ago
-
GRC Data Analyst Manager INR 945K-1500KAlerting | Automation | Cause analysis | Data Modeling | Data MonitoringMid-level Full TimeINDJZ03 - Pune - Weikfield IT …1d ago
-
Associate Director–Data Lake Operations INR 1500K-2700KADaM | AWS | Apache Spark | Big Data | CDISCMid-level Full TimeHyderabad, India1d ago
-
Mid-level Full TimeHyderabad, India1d ago
-
Data & AI Engineering Specialist INR 1000K-1820KAPI | Access Control | Amazon Web Services | Apache Airflow | Apache SparkHealthcare benefits | Hybrid work | Parental leave | Wellness programsMid-level Full TimeHyderabad, India1d ago
-
Manager - Data Science INR 1500K-3000KAirflow | CI | CI/CD | Dagster | Data QualityFlexible work options | Hybrid work environment | Professional development opportunities | Supportive leadersMid-level Full TimePune - Panchshil, India R1d ago