Software Engineer, Machine Learning Infrastructure - Generative AI
San Francisco, CA; Sunnyvale, CA; Seattle, WA
USD 137K-299K Mid-level Full Time
Tasks
- Build generative AI inference and fine tuning infrastructure
- Build observability and reliability tooling
- Create data pipelines for model training and evaluation
- Design scalable model serving and batch inference systems
- Develop backend APIs and services
- Implement GPU autoscaling and utilization
- Integrate LLM gateway agent gateway and guardrails
- Optimize latency throughput and cost of GPU inference
- Support production operations with monitoring and incident response
Perks/Benefits
Skills/Tech-stack
APIs | AWQ | AWS | Autoscaling | Backend Development | Batch inference | DPO | Data Pipelines | Debugging | Distributed Systems | FP8 | Fine Tuning | GCP | GPTQ | GPU Utilization | GPU autoscaling | INT8 | Incident Response | KV cache | Kubernetes | Latency optimization | LoRA | Machine Learning | Machine Learning Infrastructure | Model Serving | Monitoring | Observability | Python | Quantization | RAG | SFT | SGLang | TensorRT-LLM | Throughput Optimization | Tracing | VLLM | Vector Databases
Education
Regions
Countries
States
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R15d ago
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R28d ago
-
AUTOSAR | C++ | CAN | Embedded Software | Embedded SystemsSenior-level Full TimeAllen Park, United States10h ago
-
Staff Product Engineer USD 160K-240KAWS | DSP | Data Pipelines | FFmpeg | Generative AI401k access | Dental insurance | Flexible PTO | Health insurance | Paid mealsSenior-level Full TimeSan Francisco, CA, US10h ago
-
SOFTWARE DATA ENGINEER - AI/ML/LLM - 2+ yrs of Experience - TS/SCI w/Poly clearance is required - ES - 062526-4 A USD 142K-146KArtificial Intelligence | Data Engineering | Data Modeling | Language Models | Large Language Models401k | Dental insurance | Medical insurance | Paid time off | Vision insuranceMid-level Full TimeFort George G Meade, United States10h ago
-
Senior Software Engineer - Analytics Platform USD 160K-240KApache Arrow | Apache Kafka | Asynchronous frameworks | C plus plus | DockerSenior-level Full TimeNew York11h ago
-
Senior-level Full TimeHuntsville, United States12h ago
-
Data Engineer Junior USD 81K-125KAccess Management | Apache Airflow | Apache Spark | Automated testing | Data GovernanceEntry-level Full TimeSan Antonio, TX, United States12h ago
-
Data Engineer Junior USD 81K-125KAccess Management | Anomaly Detection | Apache Airflow | Apache Spark | Automated testingEntry-level Full TimeFairfax, VA, United States12h ago
-
.NET | Agile | Amazon Web Services | Angular | C#Travel opportunitiesMid-level Full TimeGilbert, Arizona, United States; Lake Mary, …12h ago
-
Data Engineer II USD 97K-162KAWS | Access Management | Agile | Artificial Intelligence | Cloud NetworkingMid-level Full TimeJersey City, New Jersey, United States12h ago
-
Applied AI Engineer II - Encore Program USD 102K-188K.NET | AWS | AWS Bedrock | Angular | AnthropicHybrid work 3 days per week | Mentorship | Professional growth | Travel 10 percentMid-level Full TimeDallas, Texas, United States; Hermitage, Tennessee, …12h ago
-
.NET | AWS | Agile | Angular | AzureSenior-level Full TimeGilbert, Arizona, United States; Lake Mary, …12h ago
-
Machine Learning Engineer, Contextual Targeting USD 184K-337KDeep learning | Language Models | Large Language Models | Machine Learning | Multimodal LearningEntry-level Full TimeSan Jose, California, United States13h ago
-
Senior Agent Engineer, Google Cloud, Applied AI USD 174K-253KAudio generation | BigQuery | CI/CD | Cloud Storage | Computer VisionBenefits | Bonus | EquitySenior-level Full TimeSunnyvale, CA, USA; Kirkland, WA, USA13h ago
-
Agentic development | Artificial Intelligence | Build Automation | CI/CD | Cloud infrastructureMid-level Full TimeSunnyvale, CA, USA13h ago
-
Abuse detection | Algorithms | Artificial Intelligence | Authentication | AuthorizationSenior-level Full TimeKirkland, WA, USA13h ago
-
C++ | Debugging | GPU | Java | LLMSenior-level Full TimeNew York, NY, USA; Cambridge, MA, …13h ago
-
Senior Software Engineer, AI/ML, Google Ads USD 174K-253KC++ | Data Processing | Data Structures | Data structures algorithms | DebuggingSenior-level Full TimeMountain View, CA, USA13h ago
-
Senior Software Engineer, Database Internals, AlloyDB USD 174K-253KC# | C++ | Code optimization | Compute | Concurrency ControlEntry-level Full TimeSunnyvale, CA, USA; Kirkland, WA, USA13h ago
-
Software Engineer, On-Device Machine Learning USD 147K-211KAndroid | Android NDK | Android Studio | Core ML | Data ProcessingMid-level Full TimeSunnyvale, CA, USA14h ago
-
Staff Software Engineer, Agentic Data and Evals USD 207K-301KAlgorithms | C++ | CSS | Data Storage | Data StructuresSenior-level Full TimeSunnyvale, CA, USA14h ago
-
Research Engineer, Safety Oversight, DeepMind USD 174K-253KAutomated Evaluation | Classification | Data Analysis | Data Pipelines | Data QualityMid-level Full TimeMountain View, CA, USA14h ago
-
Machine Learning Engineer (all genders) EUR 63K-69KDeep learning | Machine Learning | NumPy | Pandas | PyTorchCorporate benefits discounts | Health and wellbeing | Hybrid work flexibility | Inclusive work environment | Job ticketsEntry-level Full TimeFrankfurt a.M., Hessen, DE16h ago
-
Machine Learning Engineer (alle Geschlechter) EUR 63K-69KData Analysis | Data Pipelines | Deep learning | Machine Learning | Model DevelopmentCoaching and mentoring | Company Childcare Support | Family support programs | Flexible working hours | Health checksEntry-level Full TimeFrankfurt a.M., Hessen, DE16h ago