Senior Data Engineer - Data Platform
South San Francisco, California, USA
USD 180K-270K (estimate) Senior-level Full Time
Tasks
- Build batch and near real time orchestration patterns
- Create shared libraries and templates for dataset publishing
- Define data contracts metadata naming versioning lineage freshness quality checks
- Design cloud data ingestion services
- Diagnose distributed system bottlenecks
- Handle schema evolution partitioning and lifecycle management
- Improve query performance concurrency and storage efficiency
- Lead technical reviews and align teams on platform interfaces
- Manage lakehouse and warehouse tables
- Operate data transformation and validation pipelines
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Apache Airflow | Backfills | CI Checks | DBT | Data Contracts | Data Ingestion | Data Lineage | Data Observability | Data Quality | Data Transformation | Data Validation | Data orchestration | Distributed Systems | Idempotency | Infrastructure as Code | Kubernetes | Metadata Management | Partitioning | Performance Tuning | Prefect | Python | Retries | Rust | Schema evolution | Snowflake | Table management | Workload isolation | “as-code”
Education
N/A
Roles
Regions
Countries
States
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R12d ago
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R25d ago
-
Associate Cloud Data Engineer II USD 78K-97KAgile | Airflow | Apache Beam | BigQuery | Cloud ComposerOnsite workMid-level Full TimeAda, MI, United States, 493554h ago
-
Staff Software Engineer USD 114K-178KAI Safety | AWS | AWS Bedrock | Agentic Systems | AirflowHealth insurance | Paid time off | Retirement contributionsSenior-level Full TimeSt. Louis, Missouri, US, 63103-23555h ago
-
ML Infrastructure Engineer USD 180K-440KAnsible | C++ | CUDA | Configuration Management | Data Pipelines401k retirement plan | Dental coverage | Disability insurance | Employee discounts | Life insuranceSenior-level Full TimePalo Alto, California, United States7h ago
-
Senior Cell Modeling & Analytics Engineer USD 140K-175K3D Modeling | Circuit modeling | D Q D V | Data Analysis | Data Visualization401k plan | Equity opportunities | Flexible time off | Medical, dental, and vision coverageSenior-level Full TimeBroomfield, Colorado or Burlingame, California9h ago
-
Airflow Design | Analysis Techniques | Availability | Compute Integration | Cooling systemsOnsite work | Travel required | Valid Driver License | Work long hours and weekendsSenior-level Full TimeBastrop, TX11h ago
-
Forward Deployed AI Engineer (GenAI, AWS) USD 175K-200KAWS | AWS CDK | AWS Neptune | Amazon ECS | Amazon SageMakerRemote-friendly cultureSenior-level Full TimeNew Jersey11h ago
-
Staff Data Engineer USD 200K-260KApache Airflow | Apache Beam | Apache Spark | BigQuery | DBT401k plan | Dental insurance | Disability insurance | Equity | Flexible time offSenior-level Full TimeSunnyvale, CA11h ago
-
[C] Data Engineer, Safeguards USD 380K-485KAccess Control | Amazon Kinesis | Amazon Redshift | Apache Airflow | Apache SparkFlexible work schedule | Flexible working hours | Generous vacation | Parental leaveSenior-level Full TimeSan Francisco, CA | New York …12h ago
-
Embedded Test Automation Engineer USD 130K-150KAPIs | CI/CD | Cloud Databases | Disk partitioning | Embedded Linux401k match | Health, dental, and vision insurance | Paid Holidays | Paid parental leave | Paid sick timeSenior-level Full TimeHayward, CA12h ago
-
Lead Machine Learning Engineer USD 172K-276KAmazon Web Services | Azure | CI/CD | Cloud platform | DatabricksLearning and development programs | Mentorship and coachingSenior-level Full TimeChicago, Illinois, USA R13h ago
-
Robotics Engineer USD 170K-221KC++ | Camera Object Detection | Computer Vision | Gazebo | Isaac Sim401k matching | Background check clearance | Dental insurance | Drug Test Clearance | Life insuranceEntry-level Contract Full TimeSunnyvale, California13h ago
-
Jr. Software Engineer, Robot Systems USD 120K-135KBash | C++ | Computer Vision | Docker | Git401k plan | Commuter benefits | Dental insurance | Employee assistance program | Flexible PTOEntry-level Full TimeSeattle, WA13h ago
-
Imagery Product Engineer II- AI/Deep Learning USD 79K-133KAmazon AWS | C# | CI/CD | Databricks | Deep learning401k | Dental insurance | Health insurance | Life insurance | Paid HolidaysMid-level Full TimeRedlands, CA13h ago
-
Solution Engineer USD 165K-216KAnalytics | Cloud Computing | Data Lake | Data Warehousing | Data fabricSenior-level Full TimeUS-FL-Remote R13h ago
-
Software Engineer, ML Data USD 180K-230KAWS | Apache Hive | Apache Spark | ClickHouse | GolangDental insurance | Equity | Health insurance | Hybrid work | Team gatherings once per quarterSenior-level Full TimeSan Francisco Bay Area14h ago
-
Senior-level Full TimeSan Francisco, California, United States14h ago
-
Senior-level Full TimeNew York, New York, United States14h ago
-
Solution Engineer USD 138K-181KAI machine learning | Analytics | Cloud Computing | Data Warehouse | ETLSenior-level Full TimeUS-CO-Denver14h ago
-
Solution Engineer USD 138K-181KData Warehousing | Generative AI | Language Models | Language Processing | Large Language ModelsMid-level Full TimeFins Only-US-CA-San Mateo14h ago
-
Accelerator programming | Caching | Command Line | Command-line Tools | Data PipelinesCompetitive benefits | Flexible working hours | Generous vacation | Optional equity donation matching | Parental leaveSenior-level Full TimeSan Francisco, CA | New York …14h ago
-
AI Software Engineer USD 127K-175KAPI Development | Agent Orchestration | Agent runtimes | Agent systems | C++Dental insurance | Employee assistance program | Flexible Paid Vacation | Flexible paid sick leave | Flexible spending accountEntry-level Full TimeSan Francisco, CA14h ago
-
Senior Data Engineer USD 126K-180KAmazon Kinesis | Apache Airflow | Apache Beam | Apache Flink | Apache Spark401k match | Bonus | Equity grant | Flexible time off | Health plansSenior-level Full TimeNew York, New York; Miami, Florida; … R14h ago
-
Senior Analytics Engineer USD 126K-180KAutomation | BI reporting | DBT | Data Modeling | Data Quality401k with company matching | Bonus | Equity grant | Flexible time off | Health plansSenior-level Full TimeNew York, New York; Miami, Florida; … R14h ago