Senior Software Engineer, Model Serving
Tasks
- Build model container builds and deployment workflows
- Design and implement core systems and APIs
- Develop runtime systems for routing and caching
- Drive architectural decisions for performance and throughput
- Establish code quality testing and operational readiness best practices
- Implement observability and intelligent autoscaling
- Improve latency availability and cost effectiveness
- Mentor engineers through design reviews
Perks/Benefits
- N/A
Skills/Tech-stack
Algorithms | Autoscaling | CPU | Caching | Data Structures | Deep learning | Distributed Systems | GPU | High Throughput | Inference Systems | Low Latency | Machine Learning | Observability | Routing | System design
Education
N/A
Regions
Countries
States
Related jobs
-
Tech Lead Manager, Large Language Models & Generative AI USD 308K-696KArtificial Intelligence | Deep learning | Information Retrieval | Intent Recognition | Language ModelsSenior-level Full TimeSan Jose, California, United States4h ago
-
Senior Software Engineer, AI Coding Tools USD 244K-588KDeep learning | Distributed Training | Fine Tuning | GPU Computing | Inference OptimizationSenior-level Full TimeSan Jose, California, United States4h ago
-
Adversarial Training | Computer Vision | Dataset curation | Distributed Training | GPU ComputingEntry-level Full TimeMenlo Park, CA5h ago
-
Partner Engineering GenAI - US USD 136K-203KAPIs | C++ | Claude | Cloud Computing | Data integrationSenior-level Full TimeMenlo Park, CA | Seattle, WA …5h ago
-
Computer Science Research - US - IC5 USD 166K-244KDeep learning | Image to Video Generation | Image-to-video | Information Extraction | Language ModelsKnowledge sharing | Mentoring | Open source contributions | Research collaborationMid-level Full TimeBellevue, WA | Menlo Park, CA5h ago
-
API Design | Agentic Workflows | C# | C++ | Code reviewSenior-level Full TimeRedmond, WA5h ago
-
AI Specialist - Product and Applied Research USD 180K-200KC++ | Computer Vision | Crawling | Data Mining | Data RegressionMid-level Full TimeMenlo Park, CA | New York, …5h ago
-
Software Engineer, Databases (Technical Leadership) USD 161K-297KAI Tooling | Automation | Consensus Protocols | Data Integrity | Database InternalsSenior-level Full TimeBellevue, WA | Menlo Park, CA5h ago
-
Senior-level Full TimeMenlo Park, CA5h ago
-
Staff Machine Learning Engineer, Inference Team USD 207K-300KData Processing | Debugging | Fine Tuning | Inference Serving | Language ProcessingSenior-level Full TimeSunnyvale, CA, USA; Kirkland, WA, USA5h ago
-
Senior Software Engineer, AI/ML, Platforms and Devices USD 174K-252KC++ | Data Processing | Data Structures | Data Structures and Algorithms | DebuggingBonus | Equity | Health insurance | Learning and development | Paid time offSenior-level Full TimeMountain View, CA, USA; United States5h ago
-
Staff Software Engineer, AI/ML GenAI, Google Cloud USD 207K-300KComputer Vision | Data Preparation | Data Processing | Debugging | Distributed ComputingSenior-level Full TimeSunnyvale, CA, USA; San Francisco, CA, …5h ago
-
C++ | Data Processing | Data Structures | Data Structures and Algorithms | DebuggingSenior-level Full TimeKirkland, WA, USA; New York, NY, …6h ago
-
Full Stack AI Software Engineer USD 216K-283KAPI contracts | AWS | Azure | Classification | Data PipelinesAdoption leave | Commuter benefits | Dental insurance | Disability insurance | Equity ESPPExecutive-level Full TimeSan Mateo, CA, United States10h ago
-
Machine Learning Engineer, AI Agent Platform USD 110K-230KAPI Development | Benchmarking | Distributed Systems | Evaluation | LLM orchestrationHealth insurance | Paid time off | Parental leaveSenior-level Full TimeBay Area15h ago
-
Entry-Level AI / ML Software Engineer USD 60K-74KAgile | Algorithms | Code review | Data Structures | Deep learningEntry-level Full TimeHopkins, MN, United States17h ago
-
Senior, Data Scientist (Machine Learning Engineer) USD 117K-234KAirflow | Azure | Batch inference | CI/CD | CNNSenior-level Full Time(USA) Crossman Respect Building CA SUNNYVALE …17h ago
-
MLOps Engineer II USD 105K-189KAWS | AWS CDK | AWS CloudFormation | AWS Lambda | AWS Step FunctionsSenior-level Full TimeInnovation Point, United States17h ago
-
Data Engineer II USD 103K-155KAPI Integration | Analysis Services | Anomaly Detection | Anomaly detection models | Apache Spark401k match | Employee discounts | Employee recognition programs | Employee stock purchase plan | Employer Paid Long Term Disability InsuranceMid-level Full TimeLA - Other Support - Louisiana, …17h ago
-
Senior Machine Learning Engineer USD 134K-168KA/B | A/B Testing | B testing | CI/CD | DatabricksGaming license requiredSenior-level Full TimeRemote - US, United States R17h ago
-
CI/CD | Computer Vision | Data Pipelines | Deep learning | DockerOnsite workEntry-level Full TimeSan Francisco, CA1d ago
-
Deep learning | Fine Tuning | Language Models | Language Processing | Large Language ModelsOnsite workMid-level Full TimeSan Francisco, CA1d ago
-
AI Agents | Artificial Intelligence | Data Analysis | JavaScript | Machine LearningOnsite work | Travel opportunitiesEntry-level Full TimeNew York, NY1d ago
-
Senior AI/ML Engineer USD 155K-210KCI/CD | Cloud Architecture | Distributed Systems | Docker | EmbeddingsEquity participation | Paid Company Holidays | Professional development opportunities | Unlimited PTO | Weekly in-office cateringSenior-level Full TimeLeawood, KS, US1d ago
-
Senior Software Engineer - Agentic AI USD 145K-195KAWS | Azure | Cloud Computing | Distributed Systems | Docker401k matching | Health insurance | Hybrid work arrangement | Paid time off | Relocation assistanceSenior-level Full TimeBoston, Massachusetts, United States - Remote R1d ago