Senior Software Engineer, Machine Learning Infrastructure
Tasks
- Build and operate production ML and AI infrastructure
- Build evaluation infrastructure for LLMs
- Create benchmarks and quality measurement pipelines
- Develop and scale LLM platform
- Develop fine tuning and reinforcement learning pipelines
- Enable batching and autoscaling
- Establish ML infrastructure best practices
- Implement GPU serving for inference
- Implement observability for LLM systems
- Improve reliability and scalability of ML platform
- Integrate LLM providers and manage orchestration
- Optimize inference infrastructure for open and fine tuned models
- Partner with AI Data Science and Product teams to productionize models
- Support post training workflows
Perks/Benefits
- 401k match
- Equity
- Fertility benefits
- Flexible PTO
- Learning stipend
- Medical/Dental/Vision
- Mental health support
- Paid parental leave
- Remote work support
- Wellness stipend
Skills/Tech-stack
AWS | Airflow | Apache Beam | Apache Spark | Autoscaling | Benchmarking | BigQuery | Bigtable | CI/CD | Dataflow | Docker | Embeddings | Feature Engineering | Feature Stores | Fine Tuning | GCP | GPU Inference | GPU serving | Go | Inference Batching | Kubernetes | LLM orchestration | ML observability | Machine Learning | Model Serving | Observability | Performance optimization | Provider APIs | PyTorch | Python | Quality Regression Testing | RLHF | Ray | Redis | Regression testing | Reinforcement Learning | Reward Modeling | Streaming Data | Terraform | Training pipelines | Triton | TypeScript | VLLM | Vertex AI
Education
N/A
Regions
Countries
States
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R23d ago
-
Data Engineer USD 91K-114KANSI SQL | API | Amazon Redshift | Apigee | Azure401k with company match | Bereavement leave | Employee assistance program | Employee discount program | Family planning benefitsMid-level Full TimeRemote - Nationwide, United States R18h ago
-
Senior Data Engineer USD 111K-139KAPI Integration | Amazon Redshift | Apigee | Azure | BI Publisher401k match | Bereavement leave | Dental insurance | Employee assistance program | Employee discountsSenior-level Full TimeRemote - Nationwide, United States R18h ago
-
Data Platform Engineer-Solutions Delivery USD 125K-174KAPI Integration | API Management | APIs | Azure API | Azure API Management401k matching | Company holidays | Employee purchase program | Medical/Dental/Vision | Paid time offSenior-level Full TimeMerriam, KS, United States19h ago
-
Staff Full Stack Engineer USD 195K-315KAWS | DSP | FFmpeg | LLM | Machine Learning401k access | Company-sponsored fitness classes | Dental insurance | FSA | HSASenior-level Full TimeSan Francisco21h ago
-
Full Stack Engineer USD 165K-225KAWS | DSP | FFmpeg | LLM | Machine Learning401k access | Company sponsored classes | FSA and HSA Access | Health, dental and vision coverage | Meals and snacksEntry-level Full TimeSan Francisco21h ago
-
Software Engineer, Platform USD 165K-225KAWS | Asynchronous processing | CI/CD | Data Pipelines | Debugging401k access | Company-sponsored fitness classes | FSA and HSA Access | Health, dental and vision coverage | Meals providedEntry-level Full TimeSan Francisco21h ago
-
Staff Product Engineer USD 195K-315KAWS | DSP | FFmpeg | Generative AI | LLM401k access | Company-sponsored fitness classes | FSA HSA access | Health, dental, vision coverage | Onsite meals and snacksSenior-level Full TimeSan Francisco21h ago
-
Staff Software Engineer, Platform USD 195K-315KAPI Design | AWS | Asynchronous processing | Backend Development | CI/CD401k | Dental insurance | FSA | Fitness classes | HSASenior-level Full TimeSan Francisco21h ago
-
Senior Machine Learning Research Engineer USD 210K-360KAPI Development | Audio Processing | Cloud Computing | Data Pipelines | Deep learning401k | Dental insurance | FSA | Gym classes | HSASenior-level Full TimeSan Francisco21h ago
-
Product Engineer USD 165K-225KAWS | DSP | FFmpeg | Full Stack | Full-Stack Development401k access | Company-sponsored fitness classes | Dental insurance | FSA | HSAEntry-level Full TimeSan Francisco21h ago
-
Access Control | Azure | Azure Backup | Azure CLI | Azure DataHybrid work | Remote workSenior-level ContractSaint Paul, United States21h ago
-
Data Scientist Associate USD 77K-80KAPIs | Access Control | Artificial Intelligence | Audit Logging | BenchmarkingOnsite work locationMid-level Full TimeUniversity21h ago
-
Mid-level Full TimeUS-IL-Chicago22h ago
-
API | Airflow | Amazon Web Services | Apache Spark | AzureLearning and development | Mentorship | Travel opportunitiesEntry-level Full TimeAtlanta, Georgia, United States; Boston, Massachusetts, …22h ago
-
databricks engineer - Delivery Senior Consultant, Data Engineering and Conversion Solutions USD 124K-213KAPI | Agile | Data Governance | Data Modeling | Data QualityHybrid work model | Travel 10 percentSenior-level Full TimeLake Mary, Florida, United States22h ago
-
Cyber Data Scientist, Analytics and Insights USD 102K-171KCloud Computing | Data Modeling | Data Pipelines | Jira | Machine LearningMid-level Full TimeHuntsville, Alabama, United States22h ago
-
Research Engineer, Computer Vision USD 147K-208KAR/VR | Algorithm Development | Artificial Intelligence | C++ | Computer VisionSenior-level Full TimeSunnyvale, CA23h ago
-
Data Engineer, Product Analytics (University Grad) USD 173K-196KCompliance | Data Modeling | Data Quality | Data Security | Data TransformationCareer growth | Skill developmentNone Full TimeMenlo Park, CA | New York, …1d ago
-
Staff Software Engineer, AI Engines 3P TPU Inference USD 207K-300KData Processing | Debugging | Distributed Computing | Fine Tuning | GPUSenior-level Full TimeMountain View, CA, USA1d ago
-
Software Engineer, AI/ML, Google Search Ads USD 147K-210KAlgorithms | C++ | Code review | Data Processing | Data StorageMid-level Full TimeMountain View, CA, USA1d ago
-
C++ | Computer Vision | Concurrency | Data Structures | Data Structures and AlgorithmsBonuses | Equity | Health insurance | Paid time off | Parental leaveSenior-level Full TimeSan Jose, CA, USA1d ago
-
Senior Staff Software Engineer, AI/ML, Google Ads USD 262K-364KC++ | Data Processing | Data Structures | Data structures algorithms | DebuggingSenior-level Full TimeMountain View, CA, USA1d ago
-
Applied Machine Learning | C++ | Concurrency | Distributed Systems | GoSenior-level Full TimeSan Jose, CA, USA1d ago
-
Staff Software Engineer, AI/ML GenAI, Google Cloud USD 207K-300KComputer Vision | Data Processing | Debugging | Distributed Systems | Fine TuningSenior-level Full TimeSunnyvale, CA, USA1d ago