Team Lead Data Engineer
Chennai, Tamil Nadu, India
INR 3000K-4000K (estimate) Senior-level Full Time
Tasks
- Build ETL/ELT workflows
- Collaborate with stakeholders on requirements
- Design data pipelines
- Develop data architecture using AWS services
- Enforce best practices for coding and version control
- Ensure data quality and reliability
- Implement CI CD and environment management
- Ingest cleanse and prepare datasets
- Monitor and troubleshoot data pipelines
- Optimize data transformation workflows
- Support data governance and documentation
Perks/Benefits
- N/A
Skills/Tech-stack
AWS IAM | AWS Lambda | AWS S3 | Agile | Amazon CloudWatch | Amazon EC2 | Amazon ECS | Apache Spark | CI/CD | Data Quality | Databricks | Delta Lake | ELT | ETL | GitHub Actions | PySpark | Python | SQL | Unity Catalog | Version control
Education
N/A
Related jobs
-
Data Engineer (GCP) INR 1500K-2040KAPIs | Airflow | Authentication | Authorization | BigQueryAgile collaboration | Autonomy | Flexible environmentMid-level Full TimePune, Maharashtra, India7h ago
-
Senior Software Engineer, Data Engineering INR 3000K-4000KAWS | Apache Airflow | Apache Spark | Data Modeling | Data PipelinesAccident insurance | Commuter benefits | Dental benefits | Disability insurance | Financial wellness supportSenior-level Full TimeBengaluru, India9h ago
-
Senior Machine Learning Engineer - Advertising Engineering INR 2520K-3880KAttribution Modeling | C++ | Classification | Data Lake | Data PipelinesFlexible remote work on Fridays | Health and wellness support | Hybrid work schedule | Paid time offSenior-level Full TimeBengaluru, India9h ago
-
Mid-level Full TimePune, Maharashtra, India11h ago
-
Manager, Professional Services INR 700K-2000KAWS | Apache Spark | Azure | Cassandra | Cloud platformAccident Coverage | Annual personal development fund | Business travel insurance | Employee provident fund | Equity awardsMid-level Full TimeRemote - India R14h ago
-
Technical specialist- Data Engineer, AS INR 2475K-3465KAgile | Airflow | Apache Beam | Apache Hadoop | Apache SparkAccident insurance | Best in class leave policy | Certification sponsorship | Childcare assistance reimbursement | Employee assistance programMid-level Full TimePune - Margarpatta, India14h ago
-
Technical specialist- Data Engineer, AS INR 2475K-3465KAgile | Airflow | Apache Beam | Apache Spark | Cause analysisAccident and term life insurance | Childcare assistance reimbursement | Employee assistance program | Flexible leave policy | Gender neutral parental leavesMid-level Full TimePune - Margarpatta, India14h ago
-
Data Platform Engineer INR 1000K-2000KAWS | Data Modeling | Data Warehouse | Data integration | ETLMid-level Full TimeBengaluru, BDC7A, India14h ago
-
Mid-level Full TimeBengaluru, BDC14A, India14h ago
-
Mid-level Full TimeKolkata, KDC1A, India14h ago
-
Mid-level Full TimeKolkata, KDC1A, India14h ago
-
Infra Tech Support Practitioner INR 1500K-2500KAKS | API Gateway | AWS | Ansible | Application Lifecycle ManagementMid-level Full TimeKolkata, KDC1A, India14h ago
-
Infra Tech Support Practitioner INR 1000K-1820KAKS | AWS CloudFormation | AWS Lambda | Amazon EC2 | Amazon RDSMid-level Full TimePune, PDC3C, India14h ago
-
Automation Excellence Senior Specialist INR 3700K-5572K.NET | AI Document Intelligence | AI Services | API | Access ManagementSenior-level Full TimeINBLR02 - Bangalore - Milesstone Buildcon, …14h ago
-
Data Engineer INR 1000K-2000KAWS | Agile | Azure | Cloudera | Data ModelingFlexible work options | Inclusive cultureMid-level Full TimeNoida, UP, IN14h ago
-
Data Engineer INR 1500K-2000KBuild tool | Data Build | Data Build Tool | Data Pipeline Architecture | Data QualityMid-level Full TimeHyderabad, HDC3B, India14h ago
-
Data Engineer INR 3000K-4000KAgile | Azure Data | Azure Data Factory | Bash | CollibraFlexible working options | Health and wellbeing services | Hybrid work | Workplace inclusionSenior-level Full TimeBengaluru, IN14h ago
-
Data Engineer INR 1500K-2000KBuild tool | Cloud Data | Cloud Data Storage | Data Build | Data Build ToolMid-level Full TimePune, PDC2C, India14h ago
-
Data Platform Engineer INR 1400K-2000KBig Data | Big data processing | Cloud Data | Cloud data platform | Data ProcessingMid-level Full TimePune, PDC3C, India14h ago
-
.NET Web | .NET Web API | AI Safety | AJAX | API DevelopmentGlobal team collaboration | Minimal office visits | Remote-first cultureEntry-level Full TimeIndia - Remote R14h ago
-
Database Administrator INR 500K-1500KAWS Relational Database Service | Ansible | Backup and Restore | CI/CD | CloudFormationMid-level Full TimeChennai, CDC2A, India14h ago
-
Database Administrator INR 500K-1500KAWS Relational Database Service | Ansible | Backup and Restore | CI/CD | CloudFormationMid-level Full TimeChennai, CDC2A, India14h ago
-
Database Administrator INR 500K-1500KAWS Relational Database Service | Ansible | Backup and Restore | CI/CD | CloudFormation24/7 shift rotation | Follow the sun operations | On-call rotationMid-level Full TimeChennai, CDC2A, India14h ago
-
Database Administrator INR 500K-1500KAWS Relational Database Service | Ansible | Backup and Restore | CI/CD | Capacity PlanningFollow the sun operations | On-call rotationMid-level Full TimeChennai, CDC2A, India14h ago
-
Database Administrator INR 500K-1500KAWS Relational Database Service | Ansible | CI/CD | CloudFormation | GitLab24 7 follow the sun operations | On-call rotationMid-level Full TimeChennai, CDC2A, India14h ago