Lead Data Engineer
Haryana, Gurugram, India
RemoteStar
Hire the best person for the job, no matter where they are. Hire the right way, hire remote.
Job Title: Lead Data Engineer
Job Location: Gurugram, Haryana, India
Employment Type: Full Time
Work Type: On-site 5 days a week
Role overview:
As a Team Lead of Data Engineering, you’ll drive the design, development, and optimization of our data engineering pipelines and services with a strong software engineering mindset.
You'll also play a pivotal role in fostering growth and collaboration within the team, mentoring junior colleagues, and refining processes to help us maintain excellence. If you’re excited to make a lasting impact both technically and as a team leader, we’d love to meet you.
Desired skills:
We are looking for candidates with a strong educational background in Mathematics, Computer Science, Engineering, Physics, or a related field, along with 8+ years of proven experience in Data Engineering, including data warehousing, ETL, automation, cloud technologies, or Software Engineering in datarelated areas. Every day, you will rely on these hard skills, so if you haven’t already mastered them yet, we expect you to become confident quickly:
● Very strong software engineering principles to write maintainable, scalable code, primarily in Python (experience with Rust or C# is a plus).
● Data processing and manipulation using Polars and Pandas, scaled via Apache Ray.
● Efficient use of various open-source data storage technologies such as S3, Apache Iceberg, DuckDB, Clickhouse, PostgreSQL, and others.
● Containerization and orchestration tools like Docker and Kubernetes, with automated deployments in cloud environments (AWS, Azure, GCP).
● Complex workflow orchestration using open-source tools such as Apache Airflow.
● Big data and distributed processing technologies, including Hadoop, Spark, and Kafka.
On the soft skills side, you will need:
● Experience leading and mentoring junior team members, fostering skill development, collaboration, and process improvements.
● Cross-functional collaboration experience, working with software engineers, data scientists, and ML engineers to deliver high-impact solutions.
Job Location: Gurugram, Haryana, India
Employment Type: Full Time
Work Type: On-site 5 days a week
Role overview:
As a Team Lead of Data Engineering, you’ll drive the design, development, and optimization of our data engineering pipelines and services with a strong software engineering mindset.
You'll also play a pivotal role in fostering growth and collaboration within the team, mentoring junior colleagues, and refining processes to help us maintain excellence. If you’re excited to make a lasting impact both technically and as a team leader, we’d love to meet you.
Desired skills:
We are looking for candidates with a strong educational background in Mathematics, Computer Science, Engineering, Physics, or a related field, along with 8+ years of proven experience in Data Engineering, including data warehousing, ETL, automation, cloud technologies, or Software Engineering in datarelated areas. Every day, you will rely on these hard skills, so if you haven’t already mastered them yet, we expect you to become confident quickly:
● Very strong software engineering principles to write maintainable, scalable code, primarily in Python (experience with Rust or C# is a plus).
● Data processing and manipulation using Polars and Pandas, scaled via Apache Ray.
● Efficient use of various open-source data storage technologies such as S3, Apache Iceberg, DuckDB, Clickhouse, PostgreSQL, and others.
● Containerization and orchestration tools like Docker and Kubernetes, with automated deployments in cloud environments (AWS, Azure, GCP).
● Complex workflow orchestration using open-source tools such as Apache Airflow.
● Big data and distributed processing technologies, including Hadoop, Spark, and Kafka.
On the soft skills side, you will need:
● Experience leading and mentoring junior team members, fostering skill development, collaboration, and process improvements.
● Cross-functional collaboration experience, working with software engineers, data scientists, and ML engineers to deliver high-impact solutions.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Job stats:
1
0
0
Categories:
Engineering Jobs
Leadership Jobs
Tags: Airflow AWS Azure Big Data Computer Science Data Warehousing Docker Engineering ETL GCP Hadoop Kafka Kubernetes Machine Learning Mathematics Open Source Pandas Physics Pipelines PostgreSQL Python Rust Spark
Region:
Asia/Pacific
Country:
India
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.
Senior AI Engineer jobsSr. Data Engineer jobsData Engineer II jobsBI Developer jobsPrincipal Data Engineer jobsStaff Data Scientist jobsStaff Machine Learning Engineer jobsData Manager jobsData Science Manager jobsData Science Intern jobsPrincipal Software Engineer jobsBusiness Data Analyst jobsJunior Data Analyst jobsData Specialist jobsResearch Scientist jobsSoftware Engineer II jobsData Analyst Intern jobsLead Data Analyst jobsDevOps Engineer jobsSr. Data Scientist jobsAI/ML Engineer jobsData Engineer III jobsJunior Data Engineer jobsStaff Software Engineer jobsData Engineering Manager jobs
Git jobsEconomics jobsLinux jobsOpen Source jobsAirflow jobsKafka jobsPhysics jobsNoSQL jobsData Warehousing jobsHadoop jobsComputer Vision jobsJavaScript jobsGoogle Cloud jobsMLOps jobsKPIs jobsRDBMS jobsPostgreSQL jobsScala jobsScikit-learn jobsTerraform jobsBanking jobsGitHub jobsData warehouse jobsClassification jobsStreaming jobs
R&D jobsPandas jobsOracle jobsDistributed Systems jobsPySpark jobsBigQuery jobsScrum jobsCX jobsSAS jobsData Mining jobsReact jobsJira jobsRAG jobsLooker jobsMicroservices jobsdbt jobsRobotics jobsRedshift jobsIndustrial jobsMySQL jobsUnstructured data jobsJenkins jobsNumPy jobsE-commerce jobsGPT jobs