Data Engineer
Boston, MA
WHOOP
Monitor your sleep, strain, recovery, and health with the most advanced fitness and health wearable available today. WHOOP helps you discover data-driven insights for a healthier, more empowered life.WHOOP is seeking a dynamic Data Engineer who thrives on innovation and is ready to revolutionize our data operations. In this role, you'll design, build, and optimize scalable data pipelines and platforms that serve as the backbone of our data-driven insights. With a strong focus on crafting robust ETL/ELT processes and managing cutting-edge AWS infrastructure, you'll integrate modern data tools—including Snowflake, DBT, Kafka, and Spark—to elevate our analytical capabilities. If you're excited about harnessing AI to supercharge efficiency and drive breakthrough innovations, we want you to join our forward-thinking team and make a tangible impact on the future of our data ecosystem.
RESPONSIBILITIES:
- Write and maintain high-quality, reusable code in Python and Pyspark to develop and maintain ELTs and data pipelines.
- Utilize Kafka and Spark for real-time streaming and batch data processing.
- Implement and optimize data warehousing solutions using Snowflake.
- Create and manage transformation models with DBT to ensure consistent data quality and agile analytics.
- Architect and manage AWS infrastructure (e.g., EC2, S3, Lambda, RDS) to support scalable and secure data processing.
- Leverage AI tools to automate tasks, optimize workflows, and drive overall efficiency.
- Collaborate with cross-functional teams (data scientists, analysts, etc.) to understand and meet evolving data needs.
- Document processes and continuously seek improvements in the data platform.
QUALIFICATIONS:
- Bachelor’s degree in Computer Science, Engineering, or a related field; or equivalent practical experience.
- Experience designing and implementing ETL/ELT processes.
- Solid understanding of SQL and modern data warehousing concepts.
- Familiarity with AI tools like Copilot / ChatGPT and their use on driving efficiency in the software development life cycle.
- Proficiency using DBT for data modeling and transformation is a plus.
- Hands-on experience with Kafka and Spark for data processing is a plus.
- Knowledge of containerization, orchestration (e.g., Docker, Kubernetes), and infrastructure-as-code is a plus.
- Excellent problem-solving skills, strong communication abilities, and the capacity to work collaboratively in an agile environment.
Interested in the role, but don’t meet every qualification? We encourage you to still apply! At WHOOP, we believe there is much more to a candidate than what is written on paper, and we value character as much as experience. As we continue to build a diverse and inclusive environment, we encourage anyone who is interested in this role to apply.
WHOOP is an Equal Opportunity Employer and participates in E-verify to determine employment eligibility. It is unlawful in Massachusetts to require or administer a lie detector test as a condition of employment or continued employment. An employer who violates this law shall be subject to criminal penalties and civil liability.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Agile AWS ChatGPT Computer Science Copilot DataOps Data pipelines Data quality Data Warehousing dbt Docker EC2 ELT Engineering ETL GPT Kafka Kubernetes Lambda Pipelines PySpark Python SDLC Snowflake Spark SQL Streaming
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.