Staff Software Engineer, Model Serving
Tasks
- Build model container builds and deployment workflows
- Define technical roadmap and long term architecture
- Design and implement core systems and APIs
- Develop routing caching observability and runtime systems
- Establish code quality testing and operational readiness best practices
- Improve latency availability and cost effectiveness
- Influence cross organizational technical discussions
- Mentor engineers through design reviews and technical guidance
- Optimize performance throughput autoscaling and operational efficiency
- Translate customer needs into reliable performant systems
Perks/Benefits
- N/A
Skills/Tech-stack
APIs | Algorithms | Autoscaling | CPU | Caching | Data Structures | Deployment Workflows | Distributed Systems | GPU | Inference Systems | Low Latency | Observability | Reliability | Routing | Scalability | Scheduling | System design
Education
N/A
Roles
Regions
Countries
States
Related jobs
-
Compiler | Emulation | Firmware debugging | Machine Learning | Memory bandwidthMid-level Full TimeSan Jose, California, United States3h ago
-
C++ | CPU | Diffusion Models | GPU | InferenceSenior-level Full TimeMountain View, CA, USA4h ago
-
Senior Data Cloud Blackbelt Manager, Data and AI USD 234K-325KAI/ML | AI/ML workflow | Agentic Frameworks | BigQuery | Cloud ArchitectureSenior-level Full TimeSunnyvale, CA, USA4h ago
-
AI Engineering Manager for Banking Technology USD 156K-234KAPI Design | Angular | Anthropic | Antigravity | CI/CD401k | Accident insurance | Disability insurance | Life insurance | Medical, dental & vision coverageMid-level Full Time6400 LAS COLINAS BLVD IRVING, United …15h ago
-
Agentic AI | CI/CD | Cloud ML | Cloud ML platforms | Container Orchestration401k | Dental insurance | Employee discount | Health insurance | Life insuranceSenior-level Full Time7000 Target Pkwy N,NCD-0375 Brooklyn Park,MN …15h ago
-
Senior Software Engineer, Data USD 150K-200KAWS Lambda | AWS Step Functions | Airflow | Amazon Athena | Amazon S3401k | Bagel Thursdays | Flexible PTO | Hybrid work | Medical, dental & vision coverageSenior-level Full TimeCharlotte, NC22h ago
-
Senior-level Full TimeCarlsbad, California, United States; Scottsdale, Arizona, …22h ago
-
Apache Airflow | Apache Hive | Apache Iceberg | Apache Kafka | Apache SparkFully remote work option | International hiring | Long term contractor optionEntry-level Full TimeUnited States R1d ago
-
Cloud Engineer/Software Developer USD 135K-206KAWS | AWS SageMaker | CI/CD | CloudFormation | CloudWatchCompany-sponsored events | Flexible work environment | Matching 401k | On-call support | Paid life and disabilityMid-level Full TimeSt. Louis, MO1d ago
-
Staff Data Engineer USD 200K-250KAirflow | Anomaly Detection | Automated Monitoring | CI/CD | Change Data CaptureAccess to industry-leading technology | FSA option | Flexible paid time off | Fully covered healthcare | One Medical accessSenior-level Full TimeSan Francisco1d ago
-
Platform Engineer - Generative AI USD 120K-160KAPI Design | Caching | Continuous Deployment | Fine Tuning | Flask401k | Dental insurance | Health insuranceMid-level Full TimeNew York, San Francisco, Munich or …1d ago
-
Staff Product Support Engineer - Hadoop Operations USD 132K-206KAmazon EMR | Apache NiFi | Apache Spark | Apache YARN | BashApple equipment | Flexible PTO | Health, dental, and vision benefits | Vendor discountsSenior-level Full TimeCalifornia1d ago
-
Sr. Back-End Software Engineer - Machine Learning USD 150K-250KC++ | Computer Vision | Distributed Systems | Language Processing | Linux401k matching | Commuter benefits | Dependent Family Medical Premium Coverage | Employee referral program | Flexible spending accountsSenior-level Full TimeSanta Clara, CA1d ago
-
Staff AI engineer USD 125K-170KAI Evaluation | AWS | Agent Orchestration | Caching | Data PipelinesFlexible working hours | Hybrid work culture | Unlimited time offSenior-level Full TimeSan Francisco1d ago
-
Space Operations Engineer (Embedded Software) USD 100K-160KAPIs | ARM | C# | C++ | Communication ProtocolsMid-level Full TimeSan Francisco, CA1d ago
-
Software Engineer, Applied AI USD 130K-500KAPIs | AWS | Cloud Computing | Go | Google CloudDental insurance | Free gym membership | Health insurance | Housing assistance | Laundry reimbursementSenior-level Full TimeSan Francisco1d ago
-
C++ | Cloud Storage | Data Analysis | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeSunnyvale, CA, USA; Seattle, WA, USA2d ago
-
Staff Software Engineer, AI/ML, Google Cloud USD 207K-300KAlgorithms | Audio Processing | Cross-Functional Collaboration | Cross-functional | Data ProcessingBonus | Equity | Health insurance | Paid time off | Retirement planSenior-level Full TimeSunnyvale, CA, USA2d ago
-
Algorithms | Artificial Intelligence | C# | C++ | Code reviewSenior-level Full TimeMountain View, CA, USA2d ago
-
ML Infrastructure Engineer USD 145K-165KAWS | Amazon Elastic Kubernetes Service | Amazon SageMaker | BigQuery | CD pipelinesHealth benefits | Paid time off | Remote work optionMid-level Full TimeBoston, MA R2d ago
-
Senior-level Full TimeNew York2d ago
-
Agentic AI Developer USD 140K-200KAgent Framework | Asynchronous programming | Autonomous Agents | Azure Cognitive | Azure Cognitive SearchMid-level Full TimeSan Francisco, CA, United States2d ago
-
Senior Data Engineer, Solutions Architecture USD 110K-145KAPIs | AWS | Access Control | Amazon S3 | AnthropicAutonomous work | Company-provided meals and events | Hybrid work environmentSenior-level Full TimeSan Francisco, California, United States2d ago
-
Senior Data Platform Engineer USD 150K-180KAWS | Containerization | Data Management | Data Processing | Data StructuresGenerous time away from work | Health care insurance | Life insurance | Recognition program | Retirement savings plansSenior-level Full TimeAustin, TX2d ago
-
AI Engineer USD 136K-219KAPI Development | Agentic Frameworks | Behavioral Testing | Cloud Computing | Deep learningSenior-level Full TimeUnited States2d ago