Lead Data Engineer
Haryana, Gurugram, India
RemoteStar
Hire the best person for the job, no matter where they are. Hire the right way, hire remote.
Job Title: Lead Data Engineer
Job Location: Gurugram, Haryana, India
Employment Type: Full Time
Work Type: On-site 5 days a week
Role overview:
As a Team Lead of Data Engineering, you’ll drive the design, development, and optimization of our data engineering pipelines and services with a strong software engineering mindset.
You'll also play a pivotal role in fostering growth and collaboration within the team, mentoring junior colleagues, and refining processes to help us maintain excellence. If you’re excited to make a lasting impact both technically and as a team leader, we’d love to meet you.
Desired skills:
We are looking for candidates with a strong educational background in Mathematics, Computer Science, Engineering, Physics, or a related field, along with 8+ years of proven experience in Data Engineering, including data warehousing, ETL, automation, cloud technologies, or Software Engineering in datarelated areas. Every day, you will rely on these hard skills, so if you haven’t already mastered them yet, we expect you to become confident quickly:
● Very strong software engineering principles to write maintainable, scalable code, primarily in Python (experience with Rust or C# is a plus).
● Data processing and manipulation using Polars and Pandas, scaled via Apache Ray.
● Efficient use of various open-source data storage technologies such as S3, Apache Iceberg, DuckDB, Clickhouse, PostgreSQL, and others.
● Containerization and orchestration tools like Docker and Kubernetes, with automated deployments in cloud environments (AWS, Azure, GCP).
● Complex workflow orchestration using open-source tools such as Apache Airflow.
● Big data and distributed processing technologies, including Hadoop, Spark, and Kafka.
On the soft skills side, you will need:
● Experience leading and mentoring junior team members, fostering skill development, collaboration, and process improvements.
● Cross-functional collaboration experience, working with software engineers, data scientists, and ML engineers to deliver high-impact solutions.
Job Location: Gurugram, Haryana, India
Employment Type: Full Time
Work Type: On-site 5 days a week
Role overview:
As a Team Lead of Data Engineering, you’ll drive the design, development, and optimization of our data engineering pipelines and services with a strong software engineering mindset.
You'll also play a pivotal role in fostering growth and collaboration within the team, mentoring junior colleagues, and refining processes to help us maintain excellence. If you’re excited to make a lasting impact both technically and as a team leader, we’d love to meet you.
Desired skills:
We are looking for candidates with a strong educational background in Mathematics, Computer Science, Engineering, Physics, or a related field, along with 8+ years of proven experience in Data Engineering, including data warehousing, ETL, automation, cloud technologies, or Software Engineering in datarelated areas. Every day, you will rely on these hard skills, so if you haven’t already mastered them yet, we expect you to become confident quickly:
● Very strong software engineering principles to write maintainable, scalable code, primarily in Python (experience with Rust or C# is a plus).
● Data processing and manipulation using Polars and Pandas, scaled via Apache Ray.
● Efficient use of various open-source data storage technologies such as S3, Apache Iceberg, DuckDB, Clickhouse, PostgreSQL, and others.
● Containerization and orchestration tools like Docker and Kubernetes, with automated deployments in cloud environments (AWS, Azure, GCP).
● Complex workflow orchestration using open-source tools such as Apache Airflow.
● Big data and distributed processing technologies, including Hadoop, Spark, and Kafka.
On the soft skills side, you will need:
● Experience leading and mentoring junior team members, fostering skill development, collaboration, and process improvements.
● Cross-functional collaboration experience, working with software engineers, data scientists, and ML engineers to deliver high-impact solutions.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Job stats:
1
0
0
Categories:
Engineering Jobs
Leadership Jobs
Tags: Airflow AWS Azure Big Data Computer Science Data Warehousing Docker Engineering ETL GCP Hadoop Kafka Kubernetes Machine Learning Mathematics Open Source Pandas Physics Pipelines PostgreSQL Python Rust Spark
Region:
Asia/Pacific
Country:
India
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.
BI Developer jobsData Engineer II jobsStaff Data Scientist jobsSr. Data Engineer jobsPrincipal Data Engineer jobsBusiness Intelligence Analyst jobsStaff Machine Learning Engineer jobsPrincipal Software Engineer jobsData Science Manager jobsData Manager jobsData Science Intern jobsSoftware Engineer II jobsJunior Data Analyst jobsDevOps Engineer jobsData Analyst Intern jobsData Specialist jobsBusiness Data Analyst jobsSr. Data Scientist jobsLead Data Analyst jobsStaff Software Engineer jobsAI/ML Engineer jobsResearch Scientist jobsSenior Backend Engineer jobsData Engineer III jobsBI Analyst jobs
NLP jobsAirflow jobsOpen Source jobsEconomics jobsMLOps jobsTerraform jobsKPIs jobsKafka jobsLinux jobsNoSQL jobsJavaScript jobsComputer Vision jobsData Warehousing jobsGoogle Cloud jobsPhysics jobsRDBMS jobsPostgreSQL jobsGitHub jobsScikit-learn jobsBanking jobsHadoop jobsScala jobsStreaming jobsData warehouse jobsR&D jobs
Pandas jobsdbt jobsBigQuery jobsOracle jobsClassification jobsLooker jobsCX jobsReact jobsDistributed Systems jobsScrum jobsRAG jobsPySpark jobsRedshift jobsELT jobsRobotics jobsJira jobsPrompt engineering jobsMicroservices jobsIndustrial jobsGPT jobsSAS jobsTypeScript jobsNumPy jobsMySQL jobsModel training jobs