Lead Data Engineer
INR 2400K-3500K (estimate) Senior-level Full Time
Tasks
- Build and manage data lakes warehouses and analytical systems
- Build proof-of-concepts
- Deploy data pipelines to production
- Design and develop data pipelines
- Implement automation observability and monitoring
- Implement security and data governance
- Lead data engineering team
- Manage version control and CI/CD pipelines
- Monitor performance and stability
- Optimize data pipeline cost and performance
- Perform data validation
- Set up alerting and runbooks
- Support end to end data architectures
- Test pipeline reliability and performance
- Triage incidents and adapt pipelines
Perks/Benefits
Skills/Tech-stack
Agile | Azure | Azure Data | Azure Data Factory | Azure Data Lake | Azure Databricks | Azure DevOps | Azure Key Vault | Azure SQL | Azure Synapse | Azure Synapse Analytics | Bitbucket | CI/CD | Column-Level Security | Data Factory | Data Governance | Data Lake | Data Modeling | DataOps | DevOps | Git | Jenkins | Key Vault | OLS | Performance Tuning | PySpark | RBAC | RLS | Row Level Security | SQL | Spark SQL | Stored Procedures | Synapse Analytics | T-SQL
Education
Bachelor of Engineering | Bachelor of Science | Bachelor of Science in Computer Science | Bachelor of Science in Data Analytics | Bachelor of Science in Information Technology
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Mid-level Full TimeHyderabad, IND-TG, India15h ago
-
Mid-level Full TimeHyderabad, IND-TG, India15h ago
-
Engineer - Digital & AI Solutions INR 346K-346KAWS | Azure | Big Data | Cloud platform | Computer VisionHybrid working | Inclusive culture | Learning and development programmesEntry-level Full TimeHyderabad, Telangana, India16h ago
-
AWS Glue | Amazon Redshift | Amazon S3 | Amazon Web Services | Apache AirflowCareer growth opportunities | Collaborative learning driven team culture | Flexible work environment | High ownership and autonomy | Remote-friendly work environmentSenior-level Full TimeIndia16h ago
-
Data & Analytics Engineer INR 1500K-2040KAutomated testing | CI/CD | CTE | Clustering | Common table expressionsChildcare reimbursement | Company-Paid Holidays | Flexible work schedule | Gratuity | Group term life insuranceMid-level Full TimeBengaluru17h ago
-
Senior Data Engineer INR 2516K-3356KAWS | Athena | CI/CD | DBT | DatabricksBonus opportunities | Employee well-being programs | Paid Holidays | Paid time off | Work-life balance programsSenior-level Full TimeRemote - India R17h ago
-
Senior-level Full TimePune City, India19h ago
-
Senior-level Full TimePune, Maharashtra, India19h ago
-
Data Engineer - Python AWS Databricks INR 1200K-2000KAWS | Agentic AI | Amazon Web Services | Cost Optimization | Data ArchitectureSenior-level Full TimeIN-MH-Pune19h ago
-
Senior Data Engineer INR 2000K-2400KAWS Glue | Amazon Redshift | Amazon S3 | Apache Airflow | Apache SparkSenior-level Full TimeHyderabad, Hyderabad, IN19h ago
-
Practice Customer Engineer, Data Analytics INR 1200K-2000KApache Spark | Batch Processing | C++ | Cloud platform | DNSSenior-level Full TimeBengaluru, Karnataka, India; Mumbai, Maharashtra, India20h ago
-
Practice Customer Engineer, Data Analytics INR 1200K-2000KApache Spark | C++ | DMZ | DNS | Data LakeEqual opportunity work environment | Travel as requiredSenior-level Full TimeMumbai, Maharashtra, India; Bengaluru, Karnataka, India20h ago
-
Data Engineer - SDE 1 INR 2000K-2755KAWS | Amazon EKS | Amazon MSK | Amazon S3 | Apache AirflowAccess to latest gadgets and tools | Birthday leave | Car Leasing | Comprehensive health insurance | Device leasingEntry-level Full TimeBengaluru21h ago
-
Senior-level Full Timebengaluru, India21h ago
-
Consultant - Python Developer with Gen AI INR 1500K-2000KAI Search | Agile | Azure OpenAI | CSS | DjangoMid-level Full TimeBangalore, Karnataka, India21h ago
-
Assistant Manager- AI Engineer with Cloude INR 2000K-3000KAWS | Autogen | Azure | Claude | Cloud platformLeadership opportunity | MentorshipMid-level Full TimeBangalore, Karnataka, India21h ago
-
AWS Data Engineer- Assistant Manager INR 1200K-2000KAWS Data | AWS Data Pipeline | AWS Glue | AWS Kinesis | AWS Lake FormationSenior-level Full TimeBangalore, Karnataka, India22h ago
-
GCP & Databricks Manager INR 1500K-2000KApache Spark | BigQuery | Bitbucket | Cloud Composer | Cloud DataflowMid-level Full TimeBangalore, Karnataka, India22h ago
-
Data Engineering Professional INR 2000K-2146KAgile methodologies | Artificial Intelligence | Cloud Computing | Data Engineering | Data ManagementSenior-level Full TimeBengaluru, IN, 56010322h ago
-
Staff Engineer, Data Analytics Engineering INR 3000K-3380KAI Engineering | AWS | Azure | Azure Data | Azure Data LakeSenior-level Full TimeBengaluru, KA, India22h ago
-
Sr Data Engineering - GCP INR 1500K-2040KAccess Control | Analytics engineering | BigQuery | CI/CD | Cloud RunSenior-level Full TimeHyderabad, TS, India23h ago
-
Senior-level Full TimeHyderabad, TS, India23h ago
-
Senior Data Engineering (GCP) INR 2000K-2040KAccess Control | Anomaly Detection | BigQuery | CI/CD | Cloud RunSenior-level Full TimeHyderabad, TS, India23h ago
-
Azure | Azure Data | Azure Data Factory | Azure Machine Learning | Azure SynapseCareer growth | Collaborative and inclusive work environment | Continuous learning | Innovation and experimentation opportunities | Remote work flexibilitySenior-level Full TimeIndia1d ago
-
Azure AI | Containerization | DevOps | GenAI | GoHybrid workSenior-level Full TimeBengaluru, INDIA, India1d ago