Senior Data Engineer - Data Platform
South San Francisco, California, USA
USD 180K-270K (estimate) Senior-level Full Time
Tasks
- Build batch and near real time orchestration patterns
- Create shared libraries and templates for dataset publishing
- Define data contracts metadata naming versioning lineage freshness quality checks
- Design cloud data ingestion services
- Diagnose distributed system bottlenecks
- Handle schema evolution partitioning and lifecycle management
- Improve query performance concurrency and storage efficiency
- Lead technical reviews and align teams on platform interfaces
- Manage lakehouse and warehouse tables
- Operate data transformation and validation pipelines
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Apache Airflow | Backfills | CI Checks | DBT | Data Contracts | Data Ingestion | Data Lineage | Data Observability | Data Quality | Data Transformation | Data Validation | Data orchestration | Distributed Systems | Idempotency | Infrastructure as Code | Kubernetes | Metadata Management | Partitioning | Performance Tuning | Prefect | Python | Retries | Rust | Schema evolution | Snowflake | Table management | Workload isolation | “as-code”
Education
N/A
Roles
Regions
Countries
States
Related jobs
-
Data Engineer III USD 124K-207KAmazon Web Services | Apache Spark | Cloud platform | Databricks | Google CloudAbility to obtain security clearance | Professional developmentSenior-level Full TimeRosslyn, Virginia, United States1h ago
-
Senior Data Engineer USD 179K-318KAI/ML | Apache Airflow | Big Data | Data Deduplication | Data MatchingHealth insurance | Holiday pay | Learning and development | Life insurance | Long-term disabilitySenior-level Full TimeUSA-VA-Chantilly2h ago
-
Data Lake Infrastructure & Data Analytics Research Engineer Graduate (AML-Ark-US) - 2027 Start USD 128K-256KAnalytics | Batch Processing | Data Engineering | Data Governance | Data LakeEntry-level Full TimeSan Jose, California, United States2h ago
-
Data Lake Infrastructure & Data Analytics Research Engineer Graduate (AML-Ark-US) - 2027 Start (PhD) USD 162K-316KBatch Processing | Data Engineering | Data Governance | Data Lake | Data QualityEntry-level Full TimeSan Jose, California, United States2h ago
-
Data Lake Infrastructure & Data Analytics Research Engineer Intern (AML-Ark-US) - 2027 Summer USD 128K-256KBatch Processing | Cloud Computing | Data Engineering | Data Governance | Data LakeDevelopment workshops | Industry exposure | Internship experience | Social eventsEntry-level InternshipSan Jose, California, United States2h ago
-
Data Lake Infrastructure & Data Analytics Research Engineer Intern (AML-Ark-US) - 2027 Summer USD 128K-256KBatch Processing | Data Engineering | Data Governance | Data Lakes | Data ModelingDevelopment workshops | Industry exposure | Internship experience | Learning programs | Social eventsEntry-level InternshipSeattle, Washington, United States2h ago
-
Data Lake Infrastructure & Data Analytics Research Engineer Graduate (AML-Ark-US) - 2027 Start USD 121K-243KApache Kafka | Apache Spark | Batch Processing | Cloud Computing | Data GovernanceEntry-level Full TimeSeattle, Washington, United States2h ago
-
Research Engineer, Data Lake Infrastructure & Data Analytics Graduate (AML-Ark-US) - 2027 Start (PhD) USD 153K-300KApache Flink | Apache Spark | Data Governance | Data Lake | Data QualityEntry-level Full TimeSeattle, Washington, United States2h ago
-
Apache Flink | Apache Hadoop | Apache Kafka | Apache Spark | Cloud DataEntry-level InternshipSan Jose, California, United States3h ago
-
Allocation Optimization | Auditability | Bin packing | CPLEX | Constraint ProgrammingSenior-level Full TimeMenlo Park, CA4h ago
-
API Integration | Access Control | Automated Evaluation | BigQuery | CassandraEquity compensation | Health insurance | Paid time off | Retirement planSenior-level Full TimeSunnyvale, CA, USA4h ago
-
Senior Software Engineer, AI/ML, Google Cloud Platforms USD 174K-252KC++ | Data Processing | Language Processing | ML Infrastructure | Machine LearningSenior-level Full TimeNew York, NY, USA; Sunnyvale, CA, …4h ago
-
Senior Data Application Engineer, Core USD 163K-236KCloud Data | Cloud data lakehouse | Data Contracts | Data Governance | Data LakehouseSenior-level Full TimeSan Jose, CA, USA4h ago
-
Software Engineer, GDC AI Applications and Agents USD 147K-210KAPIs | Cloud Computing | Data Structures | Data Structures and Algorithms | Distributed SystemsBenefits | Bonus target | EquityMid-level Full TimeSunnyvale, CA, USA4h ago
-
Staff Software Engineer, AI/ML Storage Infrastructure USD 207K-300KC++ | Compute Technologies | Data Structures | Data structures algorithms | Distributed SystemsEquity compensation | Health insurance | Paid time off | Professional development | Retirement planSenior-level Full TimeSan Jose, CA, USA4h ago
-
API Design | Autoscaling | Data analytics | Databases | Distributed ComputingSenior-level Full TimeSunnyvale, CA, USA4h ago
-
Cloud infrastructure | Distributed Systems | GPU | JAX | Machine LearningMid-level Full TimeUnited States R9h ago
-
LLM Application Engineer USD 130K-175KAPIs | Agent Frameworks | Databases | Distributed Systems | EvaluationMid-level Full TimeUnited States R10h ago
-
Staff Software Engineer AI/ML USD 163K-253KA/B | A/B Testing | Autogen | B testing | Batched Inference401k | Adoption support | Charitable giving match | Fertility care stipend | Flexible work environmentSenior-level Full TimeSan Jose, California, United States10h ago
-
Senior/Staff - Agent Platform (Cortex Code) USD 236K-309KApache Airflow | DBT | Data Analysis | Data Engineering | Data ModelingSenior-level Full TimeUS-CA-Menlo Park11h ago
-
Specialist Solutions Architect - Data Engineering & Warehousing (Digital Native Business) USD 180K-247KAWS | Anomaly Detection | Apache Kafka | Automated Ingestion | AzureConference presentations | Hackathons | Mentorship | Remote work | Training programsSenior-level Full TimeUnited States R12h ago
-
Machine Leaning Performance Engineer (Inference) USD 200K-300KC++ | CUBLAS | CUDA | CUDA C | CutlassFitness Events | Free meals | Hybrid work options | Paid time off | Volunteer opportunitiesMid-level Full TimeNew York R13h ago
-
Machine Learning Research Engineer USD 200K-300KAI Agents | API Design | Automation | Dask | Data pipelineHybrid work | Paid time off | Paid wellness expenses | Volunteer opportunities | Workshops and continuous learningMid-level Full TimeNew York R13h ago
-
Data Analytics Engineer USD 115K-165KAgile | DAX | Data Warehousing | Dimensional Modeling | ELT401k match | Dental insurance | Fashion discount | Flex Spending Account | Health insuranceMid-level Full TimeEdina, MN, US13h ago
-
AC power | Altium Designer | Analog Signal | Analog signal conditioning | Bare MetalIn-person position | US DoD Security Clearance SponsorshipSenior-level Full TimeAustin, TX, US14h ago