Senior Data Engineer

Location: Austin, TX | San Carlos, CA | Remote (US)

Position Summary

The Senior Data Engineer plays a crucial role in designing and developing enterprise-scale data engineering solutions, ensuring businesses have access to the data they need for informed decision-making. This position focuses on building robust data infrastructure capable of processing large-scale datasets while integrating machine learning capabilities into production data workflows.

Key Responsibilities

• Understand business requirements, processes, and data sources to design appropriate technical solutions

• Collaborate with business analysts to translate data requirements into logical data models and scalable architectures

• Design and implement highly scalable ETL processes and data transformations for >100 GB-scale data warehousing environments

• Develop and optimize SQL views, procedures, and functions across multiple database platforms

• Serve as subject matter expert in Structured Query Language (SQL) and database performance optimization

• Analyze and process complex data with large volumes using distributed computing frameworks

• Ensure the integrity and quality of data stored in data warehouses and data marts

• Build and maintain machine learning pipelines for model training, validation, and deployment

• Collaborate with data scientists and AI engineers to integrate AI/ML pipelines into data workflows

Required Qualifications

Education & Experience

• Bachelor's degree in Computer Science or equivalent experience

• 8+ years of overall software development experience, preferably building complex data solutions

• Minimum 5 years of experience working with several SQL platforms (Redshift, Athena, MySQL/Postgres, Snowflake, BigQuery)

• Minimum 3 years of experience working with PySpark and Iceberg tables / Parquet files

• Ability to lead a team of data engineers

Core Data Engineering Skills

• Big Data Processing: Extensive experience with Apache Spark and PySpark for large-scale data processing and 100+ GB scale data warehousing

• Modern Data Lakehouse: Proficiency with Apache Iceberg for managing large-scale table formats and data lake architectures

• Experienced with data warehouse applications

• Experience with data pipeline orchestration tools such as Apache Airflow

• Experienced with data visualization tools such as Power BI, Qlik Sense, Tableau, QuickSight, Looker, or similar

AI/ML Expertise Nice to have

• Familiarity with machine learning frameworks (e.g., TensorFlow, PyTorch) and libraries (e.g., scikit-learn)

• Experience implementing AI/ML models for data processing, predictive analytics, and anomaly detection

• Experienced in leveraging large language models (LLMs) during development (e.g. Cursor) and used within applications

• Ability to collaborate with data scientists and AI engineers to integrate AI/ML pipelines into data workflows

Additional Technical Skills

• Strong programming proficiency in Python and SQL

• Understanding of bioinformatics / genomics (e.g. secondary and tertiary analysis tooling) and file format standards (e.g. VCF, BAM, FASTQ)

• Experience with distributed computing and cluster management

• Understanding of data quality, governance, and monitoring practices

 

The pay range is listed and actual compensation packages are based on a wide array of factors unique to each candidate, including but not limited to skill set, years & depth of experience, certifications and specific office location. This may differ in other locations due to cost of labor considerations.Remote USA$103,200—$128,950 USD

OUR OPPORTUNITY

Natera™ is a global leader in cell-free DNA (cfDNA) testing, dedicated to oncology, women’s health, and organ health. Our aim is to make personalized genetic testing and diagnostics part of the standard of care to protect health and enable earlier and more targeted interventions that lead to longer, healthier lives.

The Natera team consists of highly dedicated statisticians, geneticists, doctors, laboratory scientists, business professionals, software engineers and many other professionals from world-class institutions, who care deeply for our work and each other. When you join Natera, you’ll work hard and grow quickly. Working alongside the elite of the industry, you’ll be stretched and challenged, and take pride in being part of a company that is changing the landscape of genetic disease management.

WHAT WE OFFER

Competitive Benefits - Employee benefits include comprehensive medical, dental, vision, life and disability plans for eligible employees and their dependents. Additionally, Natera employees and their immediate families receive free testing in addition to fertility care benefits. Other benefits include pregnancy and baby bonding leave, 401k benefits, commuter benefits and much more. We also offer a generous employee referral program!

For more information, visit www.natera.com.

Natera is proud to be an Equal Opportunity Employer. We are committed to ensuring a diverse and inclusive workplace environment, and welcome people of different backgrounds, experiences, abilities and perspectives. Inclusive collaboration benefits our employees, our community and our patients, and is critical to our mission of changing the management of disease worldwide.

All qualified applicants are encouraged to apply, and will be considered without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, age, veteran status, disability or any other legally protected status. We also consider qualified applicants regardless of criminal histories, consistent with applicable laws.

If you are based in California, we encourage you to read this important information for California residents. 

Link: https://www.natera.com/notice-of-data-collection-california-residents/

Please be advised that Natera will reach out to candidates with a @natera.com email domain ONLY. Email communications from all other domain names are not from Natera or its employees and are fraudulent. Natera does not request interviews via text messages and does not ask for personal information until a candidate has engaged with the company and has spoken to a recruiter and the hiring team. Natera takes cyber crimes seriously, and will collaborate with law enforcement authorities to prosecute any related cyber crimes.

For more information:
- BBB announcement on job scams 
- FBI Cyber Crime resource page