Data Platform Engineering Manager
Miami, FL
Gopuff
Gopuff delivers thousands of everyday items, at your door in 30 minutes. Get everyday value in your pocket. Instantly.Gopuff is seeking a Data Platform Engineering Manager to lead its Data Platform team. This individual will play a major role in shaping the team’s technical direction, leading the team that enables analytics, data science, and machine learning at scale. The candidate will bring strong data and cloud engineering expertise and leadership to influence Gopuff-wide data platforms and architecture. This position will involve a combination of hands-on engineering and people management. The ideal candidate will be an experienced engineering leader with an interest in both the technical and product management aspects of data engineering.
This role is hybrid (Tues-Thurs in office) in either Philadelphia, PA or Aventura, FL.
You Will:
- Lead and mentor a team of Data Platform Engineers to develop Gopuff’s central data platform, fostering a collaborative and innovative team culture
- Drive continuous improvement within the team by developing practices around professional development, performance management, and hiring
- Provide clear technical direction and support for the team, ensuring the successful execution of data platform projects and initiatives
- Collaborate with engineering and product leadership to translate business requirements into effective technical solutions
- Develop and promote best practices for data collection, storage, and processing that impact the company-wide data strategy across Gopuff’s data lake and warehouse
- Architect and implement large-scale data platforms that enable analytics, data science, and machine learning in a multi-cloud environment
- Partner with software and analytics engineering teams to establish data contracts and improve data quality at every stage of the data lifecycle
- Manage project timelines, resource allocation, and team performance, ensuring that deliverables are met on schedule and within scope
You Have:
- 5+ years of experience in a data engineering or cloud/infrastructure engineering role
- 3+ years of engineering management experience
- Experience collaborating with functional stakeholders and establishing a roadmap that aligns with business priorities
- Experience with organizational design, team development, hiring, and performance management
- Experience building batch data pipelines using DAG-based tools such as Dagster or Airflow
- Experience deploying applications and service to Kubernetes and using related tools in the Kubernetes ecosystem (i.e. Helm, ArgoCD, Istio)
- Experience implementing DevOps best practices within the data platform, including solutions for CI/CD, data observability, monitoring, and lineage
- Experience in producing and consuming topics to/from Apache Kafka, AWS Kinesis, or Azure Event Hubs
- Experience with Infrastructure as code tools such as Terraform
- Experience developing real-time data pipelines using frameworks such as Apache Beam, Flink, Storm, Spark Streaming, etc.
- Experience with data warehouses, data lakes, and their underlying infrastructure
- Proficiency in Python, SQL, RESTful API development
- Experience with cloud computing platforms such as Azure, AWS
- Experience with data governance, schema design, and schema evolution
And now, we’re assembling a team of motivated people to help us drive forward that vision to bring a new age of convenience and predictability to an unpredictable world.
Like what you’re hearing? Then join us on Team Blue.
Gopuff is an equal employment opportunity employer, committed to an inclusive workplace where we do not discriminate on the basis of race, sex, gender, national origin, religion, sexual orientation, gender identity, marital or familial status, age, ancestry, disability, genetic information, or any other characteristic protected by applicable laws. We believe in diversity and encourage any qualified individual to apply.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Airflow API Development APIs Architecture AWS Azure CI/CD Dagster Data governance Data pipelines Data quality Data strategy DevOps Engineering Flink Helm Kafka Kinesis Kubernetes Machine Learning Pipelines Python Spark SQL Streaming Terraform
Perks/benefits: Career development
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.