Software Engineer, Data Infrastructure
San Francisco, California, Unites States
USD 160K-220K Senior-level Full Time
Tasks
- Architect scalable open table format layer
- Build distributed data-processing pipelines
- Define data contracts schemas and integration patterns
- Design real time data integration platform
- Establish data infrastructure best practices tooling and patterns
- Optimize performance, reliability, and cost
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Airflow | Apache Flink | Apache Iceberg | Apache Kafka | Apache Spark | Compaction | Data Lake | Kubernetes | Partitioning | Python | S3 | Scala | Schema evolution | Streaming Data | Time Travel
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Regions
Countries
States
Related jobs
-
Featured Feat. Applied AI Engineer - Bay Area USD 211K-263KArtificial Intelligence | C plus plus | C# | Embeddings | Feature Engineering401k | Comprehensive health and wellness benefits | Learning and development opportunities | Unlimited time offMid-level Full TimeHQ (San Francisco)25d ago
-
Senior Machine Learning Engineer (Computer Vision & AI) USD 149K-198KAgile Development | Anomaly Detection | Azure | CUDA | Cloud ComputingTraining opportunitiesSenior-level Full TimeAUBURN HILLS HQ R&D, MI, US7h ago
-
Bash | Data Processing | Docker | GCP | Infrastructure as CodeAsynchronous culture | Company impact on learning accessibility | Flexible management approach | Remote-friendlyMid-level Full TimeBellevue, WA, USA7h ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerAsynchronous culture | Bonus | Equity | Friendly atmosphere | Remote-friendlyMid-level Full TimeDenver, CO, USA7h ago
-
Bash | Cloud platform | Data Pipelines | Data Processing | DockerAsynchronous culture | Career growth | Competitive compensation | Friendly work environment | Remote workMid-level Full TimePalo Alto, CA, USA7h ago
-
Bash | Data Ingestion | Data Processing | Docker | GCPMid-level Full TimeLos Angeles, CA, USA7h ago
-
Bash | Cloud platform | Data Pipelines | Data Processing | DockerAsynchronous culture | Entrepreneurial environment | Flexible management approach | Remote-friendly, distributed teamMid-level Full TimeKirkland, WA, USA7h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Career growth | Competitive benefits | Remote-friendly | Supportive managementMid-level Full TimeSan Jose, CA, USA7h ago
-
Bash | Cloud platform | Data Processing | Docker | GCPAsynchronous culture | Flexible management | Remote-friendlyMid-level Full TimeCupertino, CA, USA7h ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerAsynchronous culture | Bonuses | Equity | Friendly laid-back atmosphere | Hand off managementMid-level Full TimeOakland, CA, USA7h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Flexible management approach | Friendly work environment | Opportunity for major impactMid-level Full TimeSilver Spring, MD, USA7h ago
-
Bash | Data Ingestion | Data Processing | Docker | GCPAsynchronous culture | Bonus | Equity | Flexible work environment | Remote workMid-level Full TimeMadison, WI, USA7h ago
-
Bash | Cloud platform | Data Processing | Data pipeline | DockerAsynchronous work culture | Flexible management approach | Remote-friendly, distributed teamMid-level Full TimeRaleigh, NC, USA7h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Remote-friendly environment | Supportive teamMid-level Full TimeChapel Hill, NC, USA7h ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerAsynchronous work culture | Bonus | Equity | Remote-friendly environmentMid-level Full TimeNashville, TN, USA7h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous work culture | Bonus | Equity | Friendly atmosphere | Remote-friendlyMid-level Full TimeOrlando, FL, USA7h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Flat management structure | Flexible remote workMid-level Full TimeJacksonville, FL, USA7h ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerAsynchronous culture | Laid-back atmosphere | Remote-firstMid-level Full TimeJersey City, NJ, USA7h ago
-
Bash | Cloud platform | Data Processing | Docker | GCPAsynchronous culture | Friendly atmosphere | Hands-off management | Opportunity to make impactMid-level Full TimePittsburgh, PA, USA7h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Remote-friendly environmentMid-level Full TimeAlexandria, VA, USA7h ago
-
Bash | Cloud platform | Data Ingestion | Data Ingestion Pipelines | Data ProcessingAsynchronous culture | Flexible management | Remote-friendly | Supportive teamMid-level Full TimeFresno, CA, USA7h ago
-
Bash | Cloud infrastructure | Cloud platform | Data Ingestion | Data ProcessingAsynchronous culture | Flexible management | Mission driven product impact | Portfolio and LinkedIn submission | Remote-friendlyMid-level Full TimeBoise, ID, USA7h ago
-
Bash | Data Processing | Docker | GCP | LinuxAsynchronous culture | Bonus | Competitive salary | Equity | Remote workMid-level Full TimeEl Paso, TX, USA7h ago
-
Bash | Data Processing | Docker | GCP | LinuxAsynchronous work culture | Friendly work environment | Portfolio opportunityMid-level Full TimeChampaign, IL, USA7h ago
-
Bash | Data Processing | Docker | GCP | Infrastructure as CodeAsynchronous culture | Bonus opportunities | Equity opportunities | Flexible remote work | Friendly work environmentMid-level Full TimeDayton, OH, USA7h ago