Lead Data Engineer
IND-Pune-Smartworks, India
INR 2000K-2800K (estimate) Senior-level Full Time
Tasks
- Align technical execution with engineering leadership
- Collaborate with data architects on technical roadmap
- Conduct code reviews and document technical solutions
- Conduct data quality ownership
- Design real time solutions with Scala and Spark
- Design scalable data platforms on Azure
- Develop data pipelines for batch and real-time ingestion
- Implement Lakehouse solutions
- Improve data governance and operational excellence
- Lead data engineering team
- Optimize data pipelines for reliability and performance
- Perform data transformation
- Review business use cases and identify gaps
Perks/Benefits
- N/A
Skills/Tech-stack
Analysis Services | Apache Hadoop | Apache Kafka | Apache Spark | Azure Analysis | Azure Analysis Services | Azure Data | Azure Data Factory | Azure Data Governance | Azure Data Lake | Azure Databricks | Azure Event | Azure Event Hubs | Azure Machine Learning | Azure SQL | Azure SQL Database | Azure Stream | Azure Stream Analytics | Azure Synapse | Azure Synapse Analytics | Data Factory | Data Governance | Data Lake | Data Modeling | Dimensional Modeling | Event Hubs | Machine Learning | Power BI | Python | Relational modeling | SQL Database | SQL Server | SSAS | SSIS | SSRS | Scala | Stored Procedures | Stream Analytics | Synapse Analytics | T-SQL
Education
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Forward Deployed Engineer, Generative AI, Google Cloud INR 2000K-4500KAPI Integration | Agent systems | Cloud platform | CrewAI | Generative AISenior-level Full TimeMumbai, Maharashtra, India1h ago
-
Azure Data Engineer Consultant INR 1500K-2000KAzure Blob | Azure Blob Storage | Azure Data | Azure Data Factory | Azure Data LakeCorporate social responsibility programs | Discounts on products and services | Maternity and paternity leave | Networking opportunities | VIRTUAL interviewMid-level Full TimeBangalore, Karnataka, India2h ago
-
Data Engineering Specialist INR 2000K-3000KAWS | Ab Initio | Apache NiFi | Apache Spark | BigQueryCareer development | Continuous training | Knowledge transfer sessionsSenior-level Full TimeBengaluru, IN, 5601034h ago
-
Data Analytics Professional INR 2500K-4000KAI Algorithms | Automation | Business Intelligence | Data Analysis | Data IntegrityEntry-level Full TimeBengaluru, IN, 5601034h ago
-
D&T Lead - Data Engineer INR 2000K-2800KAmazon Web Services | Azure | Batch Processing | Cloud Data | Cloud Data WarehouseSenior-level Full TimePune, IN5h ago
-
Sr. Machine learning /Data Scientist INR 3000K-4500KAWS Bedrock | AWS SageMaker | Apache Spark | Classification | ClusteringAccreditations | Bike to work | Educational assistance | Employee assistance program | Employee discount schemeSenior-level Full TimeMumbai, MH, India5h ago
-
Applied AI Engineer INR 1800K-2500KAPI Integration | Access Control | Agent Orchestration | Anthropic API | CrewAIMid-level Full TimeHybrid in Bangalore, India R6h ago
-
Sr. Data Engineer INR 1500K-2400KApache Spark | Azure Data | Azure Data Services | CI/CD | Data IngestionSenior-level Full TimePune, Maharashtra, India7h ago
-
Senior-level Full TimePune, Maharashtra, India7h ago
-
Data Engineer - Manager INR 1500K-2500KAgile | Apache Spark | Avro | Azure | Azure BlobCSR initiatives | Employee development programs | Networking opportunities | Parental leaveMid-level Full TimeBangalore, Karnataka, India7h ago
-
Consultant - Python Developer with Gen AI using AI Foundry INR 2000K-4000KAWS | Autogen | Azure | Claude | Cloud platformSenior-level Full TimeBangalore, Karnataka, India7h ago
-
Senior - Gen AI INR 3000K-4000KDeep learning | GenAI | Language Processing | Machine Learning | Natural LanguageSenior-level Full TimeBangalore, Karnataka, India7h ago
-
Data Engineer -Azure Modern Data Platform INR 3000K-3500KAnalysis Services | Azure Data | Azure Data Factory | Azure Databricks | Azure SynapseSenior-level Full TimePune, MH, India7h ago
-
AI/ML Developer INR 1800K-2500KAzure | Cloud Computing | Cloud platform | Data Pipelines | Data PreprocessingMid-level Full Timebangalore, India7h ago
-
Senior Expert INR 2829K-3380KAWS | Algorithms | Azure | Cloud Computing | Data CleansingEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeVadodara, GJ, India8h ago
-
Senior Data Engineer (AWS & Snowflake) INR 1200K-2000KAWS | Airflow | Alation | Aurora Postgres | CDCSenior-level Full TimeIndia8h ago
-
Software Engineer II INR 2000K-2500KAWS EC2 | AWS RDS | AWS S3 | CI/CD | Data StructuresCross-functional team projects | Learning campus coursesMid-level Full TimeMumbai, India9h ago
-
Staff Data Engineer INR 2755K-4000KAWS | Apache Kafka | Apache Spark | Azure | CI/CDCell phone reimbursement | Healthcare | Internet reimbursement | Learning and development stipend | Travel opportunitiesSenior-level Full TimeBengaluru, India9h ago
-
Senior Software Engineer, Machine Learning INR 2516K-3465KA/B | A/B Testing | AIOps | B testing | CPPFinancial wellness support | Healthcare | Mental health support | Remote work flexibility | Retirement plansSenior-level Full TimeBengaluru, India13h ago
-
Mid-level Full TimePune, IN13h ago
-
Senior Data Migration Engineer INR 2800K-4000KApache Airflow | Bulk Insert | CI/CD | Cx Oracle | DBTSenior-level Full TimeBangalore, KA, IN13h ago
-
AWS/Airflow Engineer INR 1500K-2400KApache Airflow | Apache Spark | Azure Data | Azure Data Factory | Azure DevOpsOn-call rotationEntry-level Full TimeBengaluru, KA, IN13h ago
-
Senior-level Full TimePune - Baner, India13h ago
-
Senior-level Full TimeBengaluru, KA, IN, 56001613h ago
-
CI/CD | Caching | Clustering | DBT | Data LakesFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeKolkata DN 57, India13h ago