Data Engineering Lead
Gurgaon, Haryāna, India
INR 2040K-3500K (estimate) Senior-level Full Time
Tasks
- Build ETL pipelines
- Build and deploy machine learning training and scoring models
- Build data lake solutions
- Collaborate with data scientists
- Collect functional requirements
- Collect non functional requirements
- Communicate with executive stakeholders
- Deliver technical training
- Design and build data anonymization pipelines
- Design and build data platforms
- Develop near real time streaming data hubs
- Develop web services
- Lead and manage data engineering projects
- Mentor and guide team members
- Perform quality checks
- Troubleshoot data engineering work
Perks/Benefits
- N/A
Skills/Tech-stack
APIs | Agile | Apache Airflow | Apache Spark | Azure | Bash | Business Intelligence | Data Architecture | Data Lake | Data Processing | Data Security | Data Warehousing | Databases | Distributed Programming | Docker | ETL | Git | Linux | Machine Learning | Monitoring | Object-Oriented | Object-oriented programming | Python | SQL | Security practices | Unix | Version control | Web Services
Education
N/A
Roles
Data Engineer | Data Engineering | Data Engineering Lead | Engineer | Engineering Lead | Lead
Related jobs
-
Senior-level Full TimeIndia8h ago
-
Agile | Alerting | Automation | CI/CD | ClusteringAgile environment | Professional growthSenior-level Full TimeIndia10h ago
-
AI Governance | AWS | Agentic Workflows | CI/CD | Cloud NativeSenior-level Full TimeAPAC - India - Bengaluru - …11h ago
-
API Development | Agent Orchestration | Agent alignment | Anthropic | Async ProgrammingSenior-level Full TimeBengaluru Millenia, India11h ago
-
AWS | Authentication | CI/CD | Docker | Exception HandlingEqual employment opportunity | Flexible work programs | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimePune, India11h ago
-
AWS | Authentication | CI/CD | Data Modeling | DockerFlexible work arrangements | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimePune, India11h ago
-
AWS | Apache Kafka | Azure | Bootstrap | CSSFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeChennai - Menon Eternity, India11h ago
-
Agile | Apache Spark | Azure Blob | Azure Blob Storage | Azure DataFlexibility programmes | Inclusive benefits | MentorshipSenior-level Full TimeBengaluru Millenia, India11h ago
-
Databricks and Splunk Engineer - Senior Associate INR 3264K-4500KAmazon Web Services | Analytics | Azure | Cloud Computing | Cyber ThreatEmployee networks | Flexible work/life support | Hybrid work schedule | Inclusive development opportunities | Paid volunteer daysSenior-level Full TimeBangalore, India R13h ago
-
Senior Software Engineer INR 2771K-4064KAngular | Apache Hadoop | Apache Hive | Apache Spark | DockerSenior-level Full TimeBangalore, India14h ago
-
HPC Systems Engineer INR 1800K-3000KAnsible | C# | Cause analysis | Configuration Management | DebuggingEvening and weekend maintenance participation | Rotating on-call | Vendor travelMid-level Full TimeMumbai15h ago
-
AI Integration Engineer – Digital Transformation (m/f/d) INR 2500K-3584KABAC | API Gateway | AWS Glue | AWS Lambda | AWS Secrets1 to 1 counselling | Discount vouchers | Hybrid work model | Language classes | Learning and developmentSenior-level Full TimeGurugram R20h ago
-
Senior-level Full TimeBangalore North, India20h ago
-
Senior-level Full TimeBangalore North, India20h ago
-
Senior-level Full TimeBangalore North, India20h ago
-
Data Engineer (ETL ODI) - AMS INR 1500K-2500KAPIs | Data Governance | Data Integrator | Data Modeling | Data QualityMid-level Full TimeBangalore North, India20h ago
-
Software Engineer INR 1200K-2500KAI Evaluation | Agile | Artifactory | Automated testing | Azure DevOpsEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, TN, India21h ago
-
Mid-level Full TimeGurugram - Haryana - India Pune …21h ago
-
Databricks Engineer - Lead / Manager INR 1500K-2800KApache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeHyderabad, TS, India22h ago
-
A1 / Analyst-GTS INR 360K-420KCNN | Data Preprocessing | Decision Tree | Deep learning | Dimensionality ReductionMentoring | Work reviewedEntry-level Full TimeHyderabad, Telangana, India22h ago
-
Advanced Engineer - AI/ML with Devops(GCP,AWS) INR 2500K-4200KAWS | Airflow | Amazon Web Services | Apache Spark | Artificial IntelligenceAccess to cutting-edge technologies | Collaborative work environment | Professional development | Training opportunitiesSenior-level Full TimeBangalore - Karnataka, India - Kalyani …23h ago
-
Sr AI Solutions Engineer (Generative AI & Agentic AI) INR 3242K-4062KAI Agent Builder | Agent Builder | Agent Orchestration | BigQuery | Claude APISenior-level Full TimePune, MH, India23h ago
-
Data Integration Engineer INR 2525K-4000KAnthropic | Azure OpenAI | Data Modeling | ETL | Function CallingMid-level Full TimeBengaluru, IN23h ago
-
Data Engineer INR 3000K-4000KAWS | Amazon Aurora | Automation | Azure | Data ManagementBike to work | Career development program | Educational assistance | Employee assistance program | Employee discountSenior-level Full TimeBengaluru, KA, India R1d ago
-
AI Development Strategy Lead INR 2500K-5000KAgent Orchestration | BI frameworks | Business Intelligence | C++ | Cloud DataSenior-level Full TimeBengaluru, Karnataka, India1d ago