Backend Engineer (Data pipeline)
Sunnyvale, CA; San Mateo, CA; San Mateo, CA; San Bruno, CA; San Bruno, CA; San Bruo, CA
A USD 120K-150K (estimate) Mid-level Full Time
Tasks
- Design and implement low latency services
- Develop data feeds ingestion and orchestration
- Lead end to end service implementations
- Migrate legacy Hive Spark Airflow pipelines to public cloud
- Troubleshoot production issues
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Airflow | Apache Hive | Apache Spark | Backend Development | BigQuery | Cloud Migration | Cloud platform | Data Engineering | Data pipeline | Dataflow | Google Cloud | Google Cloud Platform | Low Latency | Orchestration
Education
N/A
Roles
Regions
Countries
States
Related jobs
-
Cloud Analytic Software Engineer USD 135K-182KAWS | Apache Spark | CI/CD | Cloud platform | Distributed Systems401k matching | Birthday day off | Career support | Employee and family events | Flexible work scheduleMid-level Full TimeTysons, VA; Aurora, CO; Chantilly, VA; …1h ago
-
Cloud Analytic Software Engineer USD 135K-206KAWS | Apache Spark | CI/CD | Cloud platform | Distributed SystemsBirthday day off | Flexible work schedule | Paid leave | Paid training | Referral programMid-level Full TimeHonolulu, HI; Aurora, CO; Chantilly, VA; …1h ago
-
Cloud Analytic Software Engineer USD 150K-235KAmazon Web Services | Apache Spark | CI/CD | Cloud platform | Data StreamingBirthday day off | Employee Family Events | Flexible work schedule | Paid leave | Paid trainingMid-level Full TimeAnnapolis Junction, MD; Aurora, CO; Chantilly, …1h ago
-
ActiveMQ | Agile | Amazon Web Services | Apache Beam | Apache CassandraMid-level Full TimeSan Mateo, CA; Irving, TX; Sunnyvale, …2h ago
-
Senior-level Full TimeSan Bruno, CA; San Bruo, CA; …2h ago
-
API | Amazon Web Services | Amazon Web Services (AWS) | Apache HDFS | Apache SparkRemote workMid-level Full TimeRemote, US; Sunnyvale, CA; Dallas, TX R2h ago
-
Adobe Analytics | Airflow | Apache Hive | Apache Spark | Data LineageSenior-level Full TimeSan Bruo, CA; San Bruno, CA; …2h ago
-
Mid-level Full TimeAtlanta, GA; San Bruno, CA; Dallas …2h ago
-
Mid-level Full TimeSunnyvale, CA; San Bruno, CA; Dallas …2h ago
-
Apache Drill | Apache HBase | Apache Hadoop | Apache Hive | Apache SparkMid-level Full TimeSunnyvale, Ca; San Bruno, CA; Dallas …2h ago
-
Apache Spark | Avro | Azure Data | Azure Data Factory | Azure Data LakeRemote work optionMid-level Full TimeDallas / Philadelphia, USA; Bangalore, India; …2h ago
-
AWS | Amazon S3 | Angular | Anomaly Detection | Apache AirflowMid-level Full TimeIrving, TX; Sunnyvale, CA; Sunnyvale, CA; …2h ago
-
Apache Airflow | Apache Drill | Apache Hive | Apache Spark | ElasticsearchMid-level Full TimeCarlsbad, CA; San Bruno, CA; Dallas …2h ago
-
Mid-level Full TimeSan Bruno, CA; Sunnyvale, CA; Sunnyvale, …2h ago
-
Mid-level Full TimeSunnyvale, CA; San Bruno, CA; Dallas …2h ago
-
Mid-level Full TimeSunnyvale, CA; San Bruno, CA; Dallas …2h ago
-
Apache Hadoop | Apache Hive | Apache Pig | Apache Spark | Business ObjectsMid-level Full TimeDallas, TX; San Bruno, CA; Dallas …2h ago
-
Apache Kafka | Apache NiFi | Apache Spark | Big Data | Big Data PipelinesMid-level Full TimeSunnyvale, CA; Sunnyvale, CA; Bentonville, AR; …2h ago
-
Mid-level Full TimeSan Bruno, CA; San Bruno, CA; …2h ago
-
Senior-level Full TimeSunnyvale, CA; Palo Alto, CA; St. … R2h ago
-
Azure | Cloud platform | Confluence | Continuous Deployment | Continuous integrationMid-level Full TimeDallas, TX; San Bruno, CA; Dallas …2h ago
-
Apache Kafka | Apache NiFi | Apache Spark | Big Data | Cloud platformMid-level Full TimeSunnyvale, CA; Sunnyvale, CA; Sunnyvale, CA; …2h ago
-
Apache Kafka | Apache Maven | Apache Spark | Apache Storm | Cloud platformMid-level Full TimeSunnyvale, CA; Palo Alto, CA; St. … R2h ago
-
Cloud platform | Data Quality | Google Cloud | Google Cloud Platform | HadoopEntry-level Full TimeSan Bruno, CA; Sunnyvale, CA; San …2h ago
-
Apache Kafka | Apache Spark | Azure SQL | Cassandra | Continuous DeploymentEntry-level Full TimeSunnyvale, CA; Palo Alto, CA; St. … R2h ago