Lead Engineer – Data Engineering
Tasks
- Build data ingestion pipelines
- Design data pipelines
- Ensure Data reliability
- Ensure data integrity
- Implement data governance workflows
- Implement data lineage tracking
- Implement data quality best practices
- Implement data storage pipelines
- Maintain data transformation pipelines
- Mentor data engineers
- Optimize data processing cost efficiency
- Optimize data processing performance
- Optimize data processing scalability
- Resolve data pipeline incidents
- Translate requirements into engineering solutions
- Troubleshoot production data issues
Perks/Benefits
- N/A
Skills/Tech-stack
Automation | Cloud Platforms | Data Governance | Data Lineage | Data Modeling | Data Quality | Data integration | Database systems | Distributed Systems | ELT | ETL
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Data Engineer | Data Engineering | Data Engineering Lead | Engineer | Engineering Lead | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Microsoft Fabric Data Engineer - India INR 1500K-2400KApache Spark | Azure Cognitive | Azure Cognitive Search | Azure Data | Azure Data FactoryMid-level Full TimeNew Delhi, India2h ago
-
DE&A - Core - Project Management - Project Management INR 3000K-4000KAWS | Apache Airflow | Apache Spark | Azure | CCPASenior-level Full TimePune, Maharashtra, India3h ago
-
Mid-level Full TimeBengaluru, Karnataka, India4h ago
-
Associate Consultant - Technology Solutions Delivery INR 800K-1000KActive Directory | Agile | Amazon Web Services | Artificial Intelligence | Automation24 7 systems escalation availabilityMid-level Full TimeNoida, Uttar Pradesh, India5h ago
-
Mid-level Full TimePune, Maharashtra, India7h ago
-
AWS | AWS Glue | AWS IAM | AWS Lambda | Amazon EMRMid-level Full TimeHyderabad, Telangana, India8h ago
-
Senior-level Full Timetelengana, India9h ago
-
Sr. Data Engineer INR 2700K-3900KAWS Lambda | AWS S3 | AWS SageMaker | AWS Step Functions | AlertingCommunity outreach programs | Employee Resource Group | Employee stock purchase program | Flexible benefits | Health and wellness incentivesSenior-level Full TimeBangalore, KA, IN, 5600769h ago
-
Staff Data and AI Engineer, Finance INR 2500K-3900KAnomaly Detection | Apache Spark | Business Intelligence | CI/CD | DashboardsSenior-level Full TimeBengaluru, India10h ago
-
Senior Data and AI Engineer - Finance INR 2000K-3584KAnomaly Detection | Apache Spark | CI/CD | Dashboards | Data ModelingSenior-level Full TimeBengaluru, India10h ago
-
Senior Manager, Finance Data and AI INR 2500K-3900KAnomaly Detection | Apache Spark | CI/CD | Dashboards | Data LakeSenior-level Full TimeBengaluru, India10h ago
-
Assistant Manager - AWS Data Engineering INR 1500K-2541KAWS Data | AWS Data Pipeline | Amazon Web Services | Data Modeling | Data pipelineMid-level Full TimeHyderabad, Telangana, India10h ago
-
Lead Consultant_Python MachineLearning INR 1500K-2500KAWS | Apache Airflow | Apache Kafka | Apache Spark | AzureHybrid workSenior-level Full TimeBangalore, IN, 56006610h ago
-
Data Engineer INR 1500K-2500KAzure Data | Azure Data Lake | Azure Data Lake Storage | Azure Databricks | CI/CDSenior-level Full TimeChennai, IN, 60003210h ago
-
Senior Consultant_ETL QA INR 1500K-2500KAgile | Case design | Data Governance | Data Migration | Data Migration TestingHybrid workSenior-level Full TimeThane, IN, 40060410h ago
-
Business Analytics Lead (7-10 years) INR 3000K-4000KDashboarding | Data Analysis | Data Modeling | ETL | Product AnalyticsAccidental insurance | Adoption assistance program | Car lease | Critical illness insurance | Day-care Support ProgramSenior-level Full TimeBengaluru10h ago
-
Senior Technical Specialist - DBT INR 1500K-2500KAWS CloudFormation | Amazon QuickSight | Amazon Redshift | Apache Airflow | DBTSenior-level Full TimeMumbai, Maharashtra, India11h ago
-
Staff Data Engineer INR 2475K-3100KAWS | Agile | Amazon Redshift | Apache Airflow | CI/CDEducation assistance program | Fitness benefits | Flexible working hours | Health checkups | Hybrid work environmentSenior-level Full TimeBengaluru, Karnataka, India11h ago
-
AI Data Engineer III INR 2500K-3500KAWS | Agile | Amazon Redshift | Apache Airflow | CI/CDComprehensive insurance | Education assistance program | Fitness benefits | Flexible working hours | Health checkupsSenior-level Full TimeBengaluru, Karnataka, India11h ago
-
Engineering - Apprentice INR 350K-360KAI Agents | APIs | Data Modeling | Data Pipelines | Data WarehousingOn-site workEntry-level ApprenticeshipBengaluru, Karnataka, India16h ago
-
Data Governance Engineer INR 980K-2000KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DevOpsAgile career development | Comprehensive benefits dependent on location | Inclusive workplace | Remote work flexibilityMid-level Full TimeIN - Hyderabad, India R16h ago
-
Senior-level Full TimeIND - Chennai Office, India16h ago
-
Senior-level Full TimeBengaluru, Karnātaka, India16h ago
-
Data Engineer I INR 1500K-2500KABAP | Azure Data | Azure Data Factory | CDS Views | CI/CDAgile environment | Collaboration with architecture and development teams | Design documentation | Unit testing supportSenior-level Full TimeBengaluru, Karnataka, India16h ago
-
Senior Clinical Data Science Lead INR 1448K-2390KAudit Readiness | Clinical data | Clinical data management | Data Analysis | Data IntegrityDisability coverage | Employee Assistance programmes | Health and Wellbeing Programmes | Learning and development opportunities | Life assuranceSenior-level Full TimeIndia, Bangalore16h ago