Software Engineer, Machine Learning Infrastructure - Generative AI
San Francisco, CA; Sunnyvale, CA; Seattle, WA
USD 137K-299K Mid-level Full Time
Tasks
- Build generative AI inference and fine tuning infrastructure
- Build observability and reliability tooling
- Create data pipelines for model training and evaluation
- Design scalable model serving and batch inference systems
- Develop backend APIs and services
- Implement GPU autoscaling and utilization
- Integrate LLM gateway agent gateway and guardrails
- Optimize latency throughput and cost of GPU inference
- Support production operations with monitoring and incident response
Perks/Benefits
Skills/Tech-stack
APIs | AWQ | AWS | Autoscaling | Backend Development | Batch inference | DPO | Data Pipelines | Debugging | Distributed Systems | FP8 | Fine Tuning | GCP | GPTQ | GPU Utilization | GPU autoscaling | INT8 | Incident Response | KV cache | Kubernetes | Latency optimization | LoRA | Machine Learning | Machine Learning Infrastructure | Model Serving | Monitoring | Observability | Python | Quantization | RAG | SFT | SGLang | TensorRT-LLM | Throughput Optimization | Tracing | VLLM | Vector Databases
Education
Regions
Countries
States
Related jobs
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R8d ago
-
SOFTWARE DATA ENGINEER - Enterprise Infrastructure - 5+ yrs of Experience - TS/SCI w/Poly clearance is required - ES A USD 168K-172KCloud Security | Cloud infrastructure | Linux | Network Automation | OpenStack401k retirement plan | Dental insurance | Health insurance | Life insurance | Long-term disabilityMid-level Full TimeLaurel, United States2h ago
-
Big Data | Data Modeling | Email Marketing | Graph Processing | Machine LearningEntry-level Full TimeSeattle, Washington, United States3h ago
-
AI Agents | Alerting | Automation | Capacity Planning | Change ManagementBlameless post incident review process | Mentorship | Rotational on call coverageSenior-level Full TimeSan Jose, California, United States3h ago
-
Senior Data Engineer USD 187K-321KAWS | Airflow | Apache Spark | Batch Processing | Data Modeling401k matching | Flexible work schedule | Health and wellness supportSenior-level Full TimeAustin, Texas15h ago
-
Senior Data Engineer USD 148K-361KAirflow | Apache Spark | Data Modeling | Data Quality | HDFS401k | Commuter benefits | Dental insurance | Disability benefits | Equity awardsSenior-level Full TimeSan Jose, California15h ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerMid-level Full TimeAustin, TX, USA15h ago
-
Bash | Data Processing | Docker | GCP | LinuxAsynchronous culture | Flexible remote work environment | Supportive entrepreneurial teamMid-level Full TimeAtlanta, GA, USA15h ago
-
Bash | Cloud infrastructure | Data Processing | Docker | GCPAsynchronous culture | Entrepreneurial team | Remote workMid-level Full TimeNew York, NY, USA15h ago
-
Bash | Cloud platform | Data Pipelines | Data Processing | DockerAsynchronous culture | Bonus | Equity | Laid-back atmosphere | Remote-friendlyMid-level Full TimeBoston, MA, USA15h ago
-
Bash | Cloud platform | Docker | Google Cloud | Google Cloud PlatformAsynchronous culture | Bonus | Equity | Flexible work environment | Laid-back atmosphereMid-level Full TimePortland, OR, USA15h ago
-
Bash | Cloud infrastructure | Docker | GCP | Infrastructure as CodeAsynchronous culture | Remote-friendlyMid-level Full TimeTempe, AZ, USA15h ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerAsynchronous culture | Competitive benefits | Laid-back atmosphere | Remote-friendlyMid-level Full TimeLas Vegas, NV, USA15h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Bonus | Equity | Friendly work environmentMid-level Full TimeFrisco, TX, USA15h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Bonuses | Equity | Friendly work environmentMid-level Full TimeMinneapolis, MN, USA15h ago
-
Bash | Data Processing | Docker | GCP | Infrastructure as CodeAsynchronous culture | Bonus | Equity | Flexible team environmentMid-level Full TimeRaleigh, NC, USA15h ago
-
Bash | Cloud platform | Data Pipelines | Docker | Google CloudAsynchronous culture | Flexible management approach | Friendly work environment | Opportunity to make impact | Remote/distributed teamMid-level Full TimeKansas City, MO, USA15h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Entrepreneurial environment | Opportunity impact | Remote/distributed workMid-level Full TimeCincinnati, OH, USA15h ago
-
Bash | Data Processing | Docker | GCP | Infrastructure as CodeAsynchronous culture | Laid-back atmosphere | Portfolio support | Remote-friendlyMid-level Full TimeDetroit, MI, USA15h ago
-
Bash | Cloud infrastructure | Data Processing | Docker | GCPAsynchronous culture | Friendly laid-back atmosphereMid-level Full TimeEvanston, IL, USA15h ago
-
Bash | Cloud platform | Data Processing | Docker | GCPAsynchronous culture | Competitive benefits | Equity bonus | Remote-friendlyMid-level Full TimeRichmond, VA, USA15h ago
-
Bash | Data Processing | Docker | GCP | Infrastructure as CodeAsynchronous work culture | Entrepreneurial environment | Hands-off management | Remote-friendly, distributed teamMid-level Full TimeBakersfield, CA, USA15h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous work culture | Friendly atmosphere | Handsoff managementMid-level Full TimeFort Collins, CO, USA15h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Friendly laid-back atmosphereMid-level Full TimeCollege Station, TX, USA15h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous work culture | Flexible priorities | Remote-friendly environment | Supportive teamMid-level Full TimeBirmingham, AL, USA15h ago