Lead Data Engineer
Tasks
- Build data ingestion and transformation pipelines
- Conduct code and architecture reviews
- Design batch data pipelines
- Design real-time data pipelines
- Develop ETL/ELT frameworks
- Drive CI CD automated testing and observability
- Drive cost-optimization strategies
- Ensure data quality lineage observability governance
- Ensure high availability fault tolerance disaster recovery
- Implement infrastructure-as-code
- Implement secure data access controls
- Implement stream processing solutions
- Lead engineering mentorship and design guidance
- Operate cloud native data platforms
- Optimize data jobs performance scalability cost
Perks/Benefits
- N/A
Skills/Tech-stack
ARM Templates | AWS | Airflow | Amazon EMR | Amazon Redshift | Amazon S3 | Apache Flink | Apache Kafka | Apache Spark | Azure | Azure Data | Azure Data Lake | Azure Data Lake Storage | BigQuery | CI/CD | Cloud Storage | CloudFormation | Data Governance | Data Lake Storage | Data Lineage | Data Modeling | Data Warehousing | Databricks | Dimensional Modeling | Distributed Systems | Docker | Dynatrace | ELT | ETL | GDPR | GitHub Actions | Go | Google Cloud | Google Cloud Storage | IAM | JUnit | Java | Jenkins | Kubernetes | Observability | PCI DSS | Prometheus | Python | SQL | Snowflake | Snowflake Schema | Splunk | Star Schema | Terraform
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Data Engineer INR 2000K-3000K.NET | API Development | Data Ingestion | Data Modeling | Data TransformationSenior-level Full TimeBangalore North, India5h ago
-
Sr. Data Engineer INR 1500K-2400KAWS Glue | Amazon S3 | Apache Airflow | Apache Flink | Apache KafkaSenior-level Full TimeBangalore North, India6h ago
-
Specialist, Data Management & Quantitative Analysis II INR 1400K-2000KAmazon S3 | CI/CD | Dashboards | Data APIs | Data VisualizationFlexible benefits | Paid time off | Paid volunteer time | Training and demos | Wellbeing programsMid-level Full TimePune, MH, India6h ago
-
GenAI Engineer INR 2500K-4500KAWS Bedrock | Amazon Web Services | Azure OpenAI | ChromaDB | Efficient Fine TuningSenior-level Full TimeIN-TN-Chennai7h ago
-
Senior Software Engineer INR 1500K-2500KData Ingestion | Data Lineage | Data Quality | Data Scalability | Data TransformationSenior-level Full TimeIN-KA-Bangalore7h ago
-
Senior-level Full TimeIN-MH-Pune7h ago
-
Lead Data Engineer #3194 INR 3000K-5000KAccess Control | Code Repository | Compute Optimization | Data Governance | Data LineageFlexible working hours | Global collaboration | Learning and development programs | Opportunity for advanced tools and technologies | Performance rewards and recognitionSenior-level Full TimeChennai, India7h ago
-
Lead AI/ML Engineer INR 3000K-5000KAzure | Data Normalization | Data Preprocessing | Data cleaning | Deep learningCar lease | Career advancement opportunities | Certification programs | Corporate NPS | Dental insuranceSenior-level Full TimeBangalore, Karnataka, India7h ago
-
Assistant Manager - Cloud & AI Architect INR 3000K-5000KAI Foundry | Agentic AI | Ansible | Artifact management | AzureSenior-level Full TimeBangalore, Karnataka, India7h ago
-
Assistant Manager - Cloud & AI Architect INR 3000K-5000KAI Foundry | Agent Orchestration | Ansible | Artifact management | AzureBusiness development | Client advisory | Client relationship management | Growth mindset | MentorshipSenior-level Full TimeBangalore, Karnataka, India7h ago
-
Assistant Manager - Cloud & AI Architect INR 3000K-5000KAI Foundry | Agentic AI | Ansible | Artifact management | AzureSenior-level Full TimeBangalore, Karnataka, India7h ago
-
Databricks Developer / Data Architect INR 1500K-2500KAWS | Apache Airflow | Apache Spark | Azure | Azure DataSenior-level Full TimePune, Maharashtra, India8h ago
-
C# | C++ | Compilers | Consistency | Database InternalsEntry-level Full TimeBengaluru, Karnataka, India8h ago
-
Data Scientist - Senior INR 3000K-5000KAgile | Amazon Web Services | Anomaly Detection | Azure | Big DataSenior-level Full TimePune, Maharashtra, India9h ago
-
Digital Finance CoE - Azure Data Engineer - Executive INR 1500K-6000KAWS Glue | Azure | Azure Data | Azure Data Factory | Azure DatabricksExecutive-level Full TimeBangalore, Karnataka, India9h ago
-
Senior-level Full TimeIndia9h ago
-
Consultant - AI Engineer with Claude INR 2500K-5000KAWS | Autogen | Azure | Cloud platform | ContainerizationSenior-level Full TimeBangalore, Karnataka, India9h ago
-
Vice President - AI/ML Technical Developer INR 4000K-5199KAgentic Frameworks | Automated testing | Code review | Deployment | EvaluationExecutive-level Full TimeBengaluru, Karnataka, India10h ago
-
Group Manager - Data Engineering INR 1500K-2500KAgile | Apache Airflow | Apache Spark | BigQuery | CI/CDMid-level Full TimeGurgaon, HR, India11h ago
-
Quality Assurance Engineer III INR 1500K-2500KAgile | Apache Airflow | BigQuery | CI/CD | Cloud platformSenior-level Full TimeChennai, Tamil Nadu, India12h ago
-
AI/ML Engineer INR 1500K-2700KAzure | C++ | Deep learning | Generative AI | Hugging FaceCareer advancement programs | Continuous learning opportunities | Education reimbursement program | Employee assistance program | Employee stock purchase planMid-level Full TimeBangalore, Karnataka, India12h ago
-
2026 : Power Bi Senior Developer & Team Leader || Gurgaon INR 1632K-2500KDAX | DAX Studio | Data Modeling | Data Warehousing | ETLSenior-level Full TimeGurgaon, Haryana, India12h ago
-
Lead Software Engineer - Java/Python, AWS, Spark INR 1500K-3000KAWS Step Functions | Amazon S3 | Amazon Web Services | Apache Airflow | Apache SparkSenior-level Full TimePune, Maharashtra, India13h ago
-
Azure Senior Data Engineer INR 1500K-2800KADLS2 | Azure | Azure Data | Azure Data Factory | Azure DatabricksSenior-level Full TimeGurugram, Haryana, India13h ago
-
Applied AI Engineer – Engineering Intelligence INR 2000K-4500KAI Safety | API Integration | Agent Orchestration | Agent systems | AutogenEntry-level Full TimeChennai, Tamil Nadu, India13h ago