Lead Data Engineer
Tasks
- Analyze and resolve real time data issues end to end
- Build Delta Lake tables
- Collaborate across scrum teams for data requirements
- Create unit tests for data pipelines
- Determine data needs with product owners and business representatives
- Develop ETL/ELT pipelines
- Implement data governance with Unity Catalog
Perks/Benefits
- N/A
Skills/Tech-stack
ACID | ADLS Gen2 | Access Control | Azure Data | Azure Data Factory | Azure Databricks | Azure SQL | Azure Storage | Data Factory | Data Lineage | Delta Lake | DevOps | Integration Services SSIS | Microsoft TFS | PySpark | SQL | SQL Server | SQL Server Integration Services | SQL Server Integration Services (SSIS) | SQL Server integration | Schema evolution | Spark | T-SQL | Unit Testing | Unity Catalog | Visual Studio
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Senior-level Full TimeHyderabad, India1d ago
-
Data Engineer Platform and Tools – Google Cloud Platform (GCP) INR 1500K-2500KAirflow | BigQuery | CI/CD | Cloud Build | Cloud ComposerSenior-level Full TimeHyderabad, India2d ago
-
Senior-level Full TimeHyderabad India - Block B2d ago
-
Staff Database Platform Engineer INR 2500K-4200KAWS IAM | AWS RDS | Amazon EC2 | Amazon S3 | AnsibleSenior-level Full TimeIN - India - Bangalore2d ago
-
Apache Beam | Apache Cassandra | Apache Flink | Apache Kafka | Apache SparkSenior-level Full TimeBangalore, India2d ago
-
Agentic AI Engineer - Assistant Manager INR 2000K-5000KAWS | Azure | C++ | CI/CD | DockerEmployee networks | Flexible work/life support | Inclusive development opportunities | Paid volunteer daysSenior-level Full TimeBangalore, India2d ago
-
AI Data & Knowledge Engineer - Assistant Vice President INR 4000K-6000KAirflow | Big Data | Big data architecture | CI/CD | Data ArchitectureEmployee networks | Flexible work/life support | Inclusive development opportunities | Paid volunteer daysExecutive-level Full TimeHyderabad, India2d ago
-
Spclst , Data Engineering INR 1163K-2558KAWS EMR | AWS Glue | AWS IAM | AWS Lake | AWS Lake FormationMid-level Full TimeIND - Telangana - Hyderabad (Hitec …2d ago
-
Mid-level Full TimeHaryana, India R2d ago
-
Continuous integration | Development Lifecycle | Git | JavaScript | LaravelCo-working space | Mentorship | Modern equipment | Training programs | Trial dayMid-level Full TimeChennai, Hybrid R2d ago
-
Associate - Analytics Solution INR 1000K-1500KAgile | Alteryx | Artificial Intelligence | Confluence | Data GovernanceMid-level Full TimeBengaluru, Karnataka, India2d ago
-
Senior Data Scientist - AI Engineering INR 3264K-5000KAWS | AWS Bedrock | Agentic AI | Anthropic Claude | Automated RegressionCareer growth | Company-sponsored certifications | Innovation time | Mentorship | SnacksSenior-level Full TimeHyderabad, TS, India2d ago
-
Advanced Engineer - Data Engineer INR 2475K-3465KAWS | Amazon Redshift | Apache Hadoop | Apache Spark | AzureAccess to cutting-edge technologies | Collaborative work environment | Professional growth and developmentSenior-level Full TimeBangalore - Karnataka, India - Kalyani …2d ago
-
Data Engineer _ ALM - MTCR INR 1500K-3000KApache Hive | Apache Spark | Apache YARN | Bitbucket | CDEHybrid workSenior-level Full TimeIndia - Pune R2d ago
-
Senior Analytics Engineer INR 3600K-5000KAI Agents | AI Evaluation | AI Foundry | API Development | Agent OrchestrationSenior-level Full TimeIndia2d ago
-
Data Engineer INR 302K-480KAgile | Apache Airflow | Cloud Composer | Cloud Storage | Cloud platformEntry-level Full TimeIN-MH-Pune2d ago
-
Senior-level Full TimeIN-TN-Chennai2d ago
-
Senior Software Engineer INR 1492K-3000KAutomated testing | Azure Data | Azure Data Factory | Azure Databricks | Azure Machine LearningGrowth mindset culture | Hybrid work modelSenior-level Full TimeIndia, Telangana, Hyderabad R2d ago
-
Senior Data Management Professional – Process Automation & Data Operations, Company Financials Data , Pune INR 2800K-4000KCI/CD | Cause analysis | Data Governance | Data Monitoring | Data ObservabilityPlatinum customer supportSenior-level Full TimePune2d ago
-
Software Engineer (AI/ML) INR 500KAttention Mechanisms | Distributed Computing | Domain Adaptation | Embeddings | Entity recognitionEmployee assistance program | Group term life insurance | Learning and development opportunities | Maternity leave | Medical insuranceMid-level Full TimeBengaluru, Onsite2d ago
-
Staff Software Engineer - India INR 4000K-5000KAPI Development | AWS | Agentic AI | Azure | Cloud infrastructureCareer growth | High visibility and impact | Open Source contributionSenior-level Full TimeBengaluru R2d ago
-
CDP,Snowflake,SQL,Java, API, AWS - (6-9 Yrs) - CHN INR 2000K-3000KAPI Integration | AWS | Audience Management | Customer Data | Customer Data PlatformSenior-level Full TimeIndia2d ago
-
Senior Software Engineer - Platform INR 3500K-5000KAWS | Apache Kafka | Azure | CI/CD | Cloud platformSenior-level Full TimeIndia (Bengaluru)2d ago
-
Support Engineer INR 1500K-2000KAlerting | Azure Data | Azure Data Factory | BI Gateway | Data FactoryEntry-level Full TimeChennai, Tamil Nadu, India2d ago
-
Senior QA Engineer INR 2500K-5000KAI-assisted testing | API Testing | Authentication | CI/CD | Case designSenior-level Full TimeBengaluru2d ago