Lead Data Engineer
Tasks
- Advise clients on distributed storage and computing
- Apply test-driven development
- Collaborate with data scientists to deploy models
- Communicate data insights through visualization
- Create data processing pipelines
- Define project scope and goals
- Deploy support and operate data pipelines
- Design data architecture
- Develop and operate data pipelines
- Develop data models
- Ensure on time delivery with cross team collaboration
- Implement data governance
- Implement data security and privacy
- Implement end-to-end data solutions
- Incorporate data quality strategy
- Lead data engineering projects
- Lead team coding and solution implementation
Perks/Benefits
Skills/Tech-stack
Big Data | Continuous Delivery | Data Architecture | Data Engineering | Data Governance | Data Lake | Data Modeling | Data Pipelines | Data Privacy | Data Quality | Data Security | Data Visualization | Data schemas | Distributed Systems | NoSQL | SQL | Stakeholder management | System design | Test-Driven | Test-Driven Development
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Senior Software Engineer, Data Platform INR 2000K-4200KApache Pinot | Artifactory | Git | Go | JavaSenior-level Full TimeIndia (Remote) R4h ago
-
Python, Pyspark Developer INR 2800K-4000KAgile | AngularJS | Ansible | Big Data | BootstrapDevelopment courses | Digital wellbeing platform | Employee assistance programme | Flexible working | Life insuranceSenior-level Full TimeChennai, IN4h ago
-
Azure | Azure AD | Azure Data | Azure Data Factory | Azure Data LakeFlexible work arrangements | Healthcare benefits | Insurance | Paid time off | Professional training and developmentSenior-level Full TimeIndia R8h ago
-
Senior Agentic Engineer, AI Platform INR 3000K-5000KAPI Development | AWS | Agent Orchestration | Authentication | AutoscalingSenior-level Full TimeBengaluru R9h ago
-
Senior Data Engineer INR 3600K-5000KAWS | Apache Airflow | Apache Spark | Azure | CI/CDFinancial wellness support | Flexible remote work on Fridays | Hybrid work schedule | Mental health support | Paid time offSenior-level Full TimeBengaluru, India R14h ago
-
Senior Software Engineer, MLOps/SRE INR 2475K-3500KAerospike | Amazon Web Services | Apache Airflow | Apache Spark | CI/CD401k pension | Disability insurance | Financial wellness support | Healthcare benefits | Life insuranceSenior-level Full TimeBengaluru, India R14h ago
-
Associate Principal Engineer, AI Architect INR 1800K-3300KAPI Integration | AWS | Agent Orchestration | Azure | Backend architectureMid-level Full TimeRemote, India R17h ago
-
Associate Principal Engineer, AI Architect INR 1800K-3300KAPI Integration | AWS | Agent Orchestration | Azure | Backend DevelopmentMid-level Full TimeGurugram, India17h ago
-
Associate Principal Engineer, AI Architect INR 1800K-3300KAPIs | AWS | Agent Orchestration | Azure | Backend DevelopmentMid-level Full TimeHyderabad, India17h ago
-
Principal Engineer, AI Architect INR 2000K-5000KAWS | Agent Orchestration | Azure | Backend architecture | Claude CodeSenior-level Full TimeGurugram, India17h ago
-
Principal Engineer, AI Architect INR 2000K-5000KAWS | Agent Orchestration | Azure | Backend architecture | Cloud ComputingSenior-level Full TimeRemote, India R17h ago
-
Principal Engineer, Python fullstack (React+Genai) INR 2000K-5000KAWS | Agentic AI | Azure | CI/CD | ComplianceSenior-level Full TimeRemote, India R18h ago
-
Founding AI Data Engineer - Optexity (India) INR 900K-1300KData Engineering | Data pipeline | Language Models | Language Processing | Large Language ModelsDirect founder access | Equity | Full compute and dataEntry-level Full TimeBangalore18h ago
-
Data Science - Senior Architect (Healthcare & Life Sciences) INR 2500K-5000KAWS | Amazon SageMaker | CI/CD | Containerization | Data ModelingSenior-level Full TimeChennai, India19h ago
-
Sr. Data Engineer INR 1500K-2500KAgile | Azure Data | Azure Data Factory | Azure Data Lake | Azure DatabricksSenior-level Full TimePune City, India19h ago
-
Lead Data Engineer - Fabric INR 1400K-2700KAPI Integration | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure SynapseEmployee referral bonuses | Flexible work options | In-house technology training | Learning and development programs | Medical insuranceSenior-level Full TimePune City, India19h ago
-
Specialist - Data Platform Engineering INR 1500K-2500KAWS | Airflow | Apache Flink | Apache Kafka | Apache SparkMid-level Full TimeChennai, India20h ago
-
Senior-level Full TimeIndia21h ago
-
Lead Integration Engineer INR 1500K-3000KAWS EC2 | AWS IAM | AWS VPC | Amazon CloudWatch | Amazon MSKSenior-level Full TimePune - Maharashtra - India21h ago
-
Senior-level Full TimeBangalore - Karnataka - India21h ago
-
Senior-level Full TimeBangalore - Karnataka - India21h ago
-
GCP Data Engineer INR 2800K-4000KAirflow | Apache Spark | BigQuery | Cloud Composer | Cloud FunctionsSenior-level Full TimeIndia22h ago
-
Senior-level Full TimeIndia22h ago
-
GCP Data Engineer / Associate Director, Data and Analytics INR 1000K-2000KAgile | Artificial Intelligence | As-a-Service | Automated testing | CI/CDFlexible working | Inclusive work environment | Professional developmentMid-level Full TimeHyderabad, Telangana, India R1d ago
-
Database Engineer - PostGreSQL / MySQL INR 500K-1500KAutomation | Cassandra | Failover | High Availability | Incident ManagementExposure to modern database technologies | On-call rotation | SLA based operationsMid-level Full TimeNoida,Uttar Pradesh,India1d ago