Backend Engineer (Data pipeline)
Sunnyvale, CA; San Mateo, CA; San Mateo, CA; San Bruno, CA; San Bruno, CA; San Bruo, CA
A USD 120K-150K (estimate) Mid-level Full Time
Tasks
- Design and implement low latency services
- Develop data feeds ingestion and orchestration
- Lead end to end service implementations
- Migrate legacy Hive Spark Airflow pipelines to public cloud
- Troubleshoot production issues
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Airflow | Apache Hive | Apache Spark | Backend Development | BigQuery | Cloud Migration | Cloud platform | Data Engineering | Data pipeline | Dataflow | Google Cloud | Google Cloud Platform | Low Latency | Orchestration
Education
N/A
Roles
Regions
Countries
States
Related jobs
-
Analytics and Insights Engineer III USD 131K-218KApache Spark | Data Governance | Data Modeling | Data Pipelines | Data QualitySenior-level Full TimeRichmond, Virginia, United States1d ago
-
Staff Software Engineer, AI/ML, Google Cloud Security USD 207K-300KAgentic AI | Artificial Intelligence | Cloud Security | Cloud platform | Data ProcessingSenior-level Full TimeReston, VA, USA; New York, NY, …1d ago
-
Senior Software Engineer, Google Cloud Dataproc USD 174K-252KApache Hive | Apache Spark | C++ | Data Warehouse | Data Warehouse InternalsSenior-level Full TimeSunnyvale, CA, USA1d ago
-
Agentic Orchestration | C++ | Data Onboarding | Data Pipeline Engineering | Data pipelineSenior-level Full TimeSan Jose, CA, USA1d ago
-
Principal Hardware Robotics Engineer, Data Centers USD 275K-382KActuator control | Embedded Systems | FPGA | Haptic feedback | Human-in-the-loopSenior-level Full TimeSunnyvale, CA, USA1d ago
-
Software Engineer, Applied AI USD 173K-250KABAC | Agentic Frameworks | Apache Airflow | Audit trails | BIMDental insurance | Generous PTO | Health insurance | Retirement or Pension Plan | Vision insuranceMid-level Full TimeSan Francisco, CA1d ago
-
Staff Data Engineer USD 147K-184KAmazon Kinesis | Amazon Web Services | Apache Airflow | Apache Iceberg | Apache SparkDental insurance coverage | Health insurance coverage | Paid parental leave | Paid vacation | Relocation assistanceSenior-level Full TimeBerkeley, CA1d ago
-
Associate, Client Intelligence (Data Scientist) USD 98K-132KAWS | Apache Spark | Azure | Big Data | Cloud platformEmployee resource groups | Matching gift program | Professional development | Sustainability and Climate Change Initiatives | Volunteerism programMid-level Full TimeNew York, NY, US, 100011d ago
-
API Gateway | AWS Lambda | AWS Step Functions | Amazon SQS | Apache Airflow401k matching | Employee stock options | Health benefits | Hybrid work onsite 2 to 3 days per week | Paid time offExecutive-level Full TimeNew York, United States R1d ago
-
Staff Tech Lead, Machine Learning Engineer, Perception USD 251K-310KC plus plus | Computer Vision | Data pipeline | JAX | Machine LearningAnnual bonus | Company benefits program | Equity incentive planSenior-level Full TimeMountain View, California, United States; San …1d ago
-
Staff Data Engineer USD 162K-224KAmazon Managed Workflows for Apache Airflow | Apache Airflow | Apache Druid | Apache Iceberg | CCPA401k employer match | Annual WIN bonus | Flexible vacation | Mental health resources | Paid HolidaysSenior-level Full TimeU.S. Remote R1d ago
-
AI Engineer USD 143K-210KAPI Integration | Audit trails | Authentication | CI/CD | Cost Optimization401k match | Casual work environment | Catered lunch | Comprehensive health insurance | Disability insuranceMid-level Full TimeLivingston, NJ / New York, NY …1d ago
-
Data Engineer USD 150K-250KAWS | Business Intelligence | DBT | Data Governance | Data LineageGrowth opportunities | Ownership | Startup environmentMid-level Full TimeSan Francisco1d ago
-
Site Reliability Engineer - Data, Apple Ads USD 170K-264KAWS | Apache Flink | Apache Iceberg | Apache Kafka | Apache SparkEntry-level Full TimeAustin1d ago
-
AI Software Development Engineer USD 118K-181KASR | AWS | Agentic AI | C# | C++Hybrid work location | Visa sponsorship not availableMid-level Full TimeUS,CA,San Jose1d ago
-
Senior AI Data Science Engineer USD 142K-200KAirflow | Annotation Workflow | Anomaly Detection | Cloud Data | Cloud Data PlatformsSenior-level Full TimeSunnyvale, CA, United States1d ago
-
Apache Spark | CI/CD | Deep learning | Fine Tuning | GoSenior-level Full TimeSeattle1d ago
-
AWS | Azure | Data Structures | Data Structures and Algorithms | Distributed ComputingSenior-level Full TimeSunnyvale1d ago
-
Data Platform SRE, AI & Data Platforms (AiDP) USD 170K-256KAWS | Apache Airflow | Apache Iceberg | Apache Spark | Cloud platformMid-level Full TimeAustin1d ago
-
Cybersecurity AI Developer-Senior USD 124K-171KApache Airflow | Data Engineering | Data analytics | DevSecOps | KubernetesHealth insurance | Paid time off | Professional development | TS SCI polygraph security clearanceSenior-level Full TimeAnnapolis Junction, Maryland, United States1d ago
-
Senior Data Engineer (B2B) USD 105K-135KAutomated testing | BigQuery | DBT | Data Modeling | Data Quality401k matching | Annual class pass credits | Dental insurance | Extended holiday break | Flexible schedulesSenior-level Full TimeRemote, United States R1d ago
-
Connected Services Analytics & AI Enablement Lead USD 129K-192KAI Agents | Cloud Computing | Data Engineering | Data Governance | Data QualityDental insurance | Disability insurance | Life insurance | Medical insurance | Paid time offSenior-level Full TimeAuburn Hills, MI, United States1d ago
-
Senior Software Engineer, Data Platform USD 168K-297KAWS | Anomalo | Apache Airflow | Apache Iceberg | BuildkiteFlexible time off | Medical insurance | Modern family planning | Remote work | Retirement savings plansSenior-level Full TimeBay Area, CA, United States of … R1d ago
-
IAA - Principal Data Engineer USD 171K-256KAzure | Azure Synapse | Azure Synapse Analytics | CI/CD | Data GovernanceHybrid work schedule | Onsite expectation 2 days per weekSenior-level Full TimeChicago, IL (Hybrid) R1d ago
-
Lead Business Intelligence Engineer USD 92K-140KAgile | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeWestchester, IL, United States1d ago