Lead - Data Engineer
INR 2000K-2800K (estimate) Senior-level Full Time
Tasks
- Automate deployments with CI CD using Azure DevOps
- Build and maintain data marts
- Build and optimize Delta Lake tables
- Design and implement data Lakehouse architecture
- Develop PySpark transformations
- Drive technical roadmap for data strategy
- Implement and manage Unity Catalog governance
- Model star schema dimensional data
- Optimize SQL queries for performance
- Orchestrate ETL ELT pipelines with Azure Data Factory
- Tune clusters and partitions
Perks/Benefits
- Guided career tracks
- Healthcare packages
- Hybrid work setting
- Online learning platform
- Organizational growth potential
- Paid time off
Skills/Tech-stack
ACID | Access Control | Azure Bicep | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOps | Azure Event | Azure Event Hubs | Azure IoT | Azure IoT Hubs | CI/CD | Change Data Capture | Cluster configuration | Column Level Masking | Data Capture | Data Factory | Data Governance | Data Lakehouse | Data Lineage | Databricks SQL | Debezium | Delta Lake | Delta Live Tables | Delta Live) | Dimensional Modeling | ELT | ETL | Event Hubs | Fine Grained Access | Fine-Grained Access Control | Infrastructure as Code | IoT Hubs | Liquid clustering | Partition Tuning | PySpark | Pytest | Row Level Security | SQL | Schema Enforcement | Star Schema | Structured Streaming | Terraform | Time Travel | Unit Testing | Unity Catalog | “as-code”
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Senior Data Engineer - Big Data & Automation INR 1500K-2500KAgile | Ansible | Apache Hive | Apache Spark | ArgoCDFlexible work policy | Work from homeSenior-level Full TimeIndia5h ago
-
Senior Data Engineer - ETL Framework INR 1500K-2500KApache Doris | Apache Hive | Apache Iceberg | Apache Spark | Apache TezFlexible work policy | Work from homeSenior-level Full TimeIndia5h ago
-
Lead Software Engineer - Java/Python, AWS, Spark INR 1500K-3000KAWS | AWS CloudFormation | AWS Step Functions | Airflow | Amazon S3Senior-level Full TimePune, Maharashtra, India7h ago
-
Consultant INR 1500K-2000KAzure | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageMid-level Full TimeBangalore, Karnataka, India7h ago
-
Executive-KDNI - Data & Analytics INR 1500K-5199KAWS | Azure | Dashboarding | Data Governance | Data ModelingExecutive-level Full TimeGurgaon, Haryana, India7h ago
-
Analytics Engineer - SQL & Data Visualization INR 1500K-2500KAgile | Cloud Data | Cloud Data Warehouse | Data Interpretation | Data ModelingMid-level Full TimeBengaluru, KA, India8h ago
-
Head of Data Operations INR 1500K-5199KAWS Glue | Amazon Redshift | Amazon S3 | Automation | Data StandardizationCollaborative culture | Multicultural team | Professional development programs | Remote workExecutive-level Full TimeIndia R8h ago
-
Head of Data Operations INR 1500K-5199KAWS Glue | Amazon Redshift | Amazon S3 | Data Modeling | LookMLLeadership development programs | Learning and development programs | Multicultural team environment | Professional growth | Remote workExecutive-level Full TimeIndia R8h ago
-
AES - DE - Generative AI Application Developers INR 2500K-4200KAWS | Agent Loops | Anthropic | Asynchronous programming | AutogenSenior-level Full TimePune, Maharashtra, India8h ago
-
Manager Software Engineer - RLE INR 1800K-2500KAmazon Web Services | Applied AI | Backend architecture | CI/CD | Cloud platformEquity grant | Food Credit | Housing bonus | Medical insurance | Performance bonusMid-level Full TimeIndia9h ago
-
AWS | Apache Spark | Databricks | GenAI | Hugging FaceFlexible work arrangements | Professional growth opportunitiesSenior-level Full TimeIndia9h ago
-
Applied AI ML Senior Associate INR 2500K-4500KAPIs | AWS Bedrock | Azure OpenAI | CI/CD | DatabricksSenior-level Full TimeBengaluru, Karnataka, India10h ago
-
Mid-level Full TimeChennai, Tamil Nadu, India10h ago
-
TC-CS-IAM-AI and Agentic AI Engineer- Senior INR 2000K-4800KAWS | Agile | Autogen | Azure | ClassificationSenior-level Full TimeBengaluru, KA, IN, 56004814h ago
-
Data Architect INR 2600K-3380KAgile | Architecture governance | Architecture standards | Behavior-Driven Development | CI/CDDiversity and inclusion | Remote WorkingSenior-level Full Timehyderabad, India14h ago
-
Senior-level Full TimeBangalore, India14h ago
-
Data Analyst/PowerBI Engineer INR 1628K-2500KData Modeling | ETL | Microsoft Excel | Microsoft Fabric | Power BISenior-level Full TimeHyderabad, Telangana, India - Remote R14h ago
-
Senior Data Engineer INR 3000K-4000KAmazon Redshift | BigQuery | DBT | Data Modeling | Data WarehousingGlobal opportunities | Inclusive onboarding | Supportive work culture | Wellness programSenior-level Full TimeMumbai, Maharashtra, India14h ago
-
Data Engineer – Databricks INR 1500K-2500KAWS | AWS Glue | Amazon Redshift | Apache Spark | DatabricksSenior-level Full TimePune IN (Office: 5th & 6th …14h ago
-
Software Engineer II - Data Engineer - Data & ML Engineering INR 980K-1820KAPI Development | AWS | AWS CloudFormation | AWS Glue | AWS Lake FormationMid-level Full TimeHyderabad, India14h ago
-
Senior-level Full TimeIndia GCC-Puppalaguda Village14h ago
-
Staff Software Engineer/Data Scientist INR 2500K-5000KA/B | A/B Testing | AI Services | AWS Bedrock | AWS SageMakerSenior-level Full TimeIndia GCC-Puppalaguda Village14h ago
-
Staff Software Engineer/Data Scientist INR 2500K-5000KA/B | A/B Testing | B testing | Bias Mitigation | CI/CDSenior-level Full TimeIndia GCC-Puppalaguda Village14h ago
-
Staff Software Engineer/Data Scientist INR 2500K-5000KA/B | A/B Testing | AI Services | AWS SageMaker | Agentic AISenior-level Full TimeIndia GCC-Puppalaguda Village14h ago
-
Staff Software Engineer/Data Scientist INR 2500K-5000KA/B | A/B Testing | AI Services | AWS Bedrock | AWS SageMakerSenior-level Full TimeIndia GCC-Puppalaguda Village14h ago