Model Serving Engineer
Tasks
- Build high-performance inference services
- Configure caching strategies
- Design inference serving platforms
- Enable autoscaling and capacity planning
- Implement incident response
- Implement request routing and batching
- Operate low latency high throughput systems
- Optimize GPU utilization
- Provide end-to-end observability
Perks/Benefits
Skills/Tech-stack
Autoscaling | C++ | Capacity Planning | Distributed Systems | GPU Architecture | Go | Kubernetes | Latency optimization | Metrics | Observability | Performance Engineering | Python | Rust | Structured Logging | TensorRT-LLM | Throughput Optimization | Tracing | VLLM
Education
Roles
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R26d ago
-
Data Governance | Data Modeling | Docker | ETL | JSON401k match | Fully paid medical | Paid time off | Training supportSenior-level Full TimeColumbia, MD R1h ago
-
Data Governance | Data Modeling | Data Quality | Data schemas | Docker401k match | Fully paid medical | Paid time off | Training supportSenior-level Full TimeSan Antonio, TX R1h ago
-
Data Engineer USD 110K-144KAPI Development | Azure | Data Security | Distributed Computing | DockerMid-level Full TimeChicago, Ill; Remote, Remote; Remote, Remote; … R2h ago
-
Technical Solutions Architect II -- Data Engineer USD 150K-180KAmazon Redshift | Apache Airflow | Apache Kafka | Azure Data | Azure Data Factory401k matching | Dental insurance | Employee assistance program | Health insurance | Medical leaveMid-level Full TimeRemote - Nationwide, United States R3h ago
-
Mid-level Full TimeChicago, IL; Chicago, Il; Chicago, IL; … R3h ago
-
Mid-level Full TimeChicago, IL; Chicago, IL; Chicago, IL R3h ago
-
Apache Spark | Distributed Systems | Documentation | Hadoop | Java401k | Dental insurance | Disability insurance | Flexible vacation policy | Free coffeeSenior-level Full TimeBoston, MA; Boston, MA; Boston, MA; … R3h ago
-
API Design | Continuous integration | Data Modeling | Deployment | MicroservicesCollaborative work environment | Fully remote option | Training and mentoringSenior-level Full TimeWalpole, MA; Boston, MA; Boston, MA; … R3h ago
-
Edge Computing AI Engineer USD 100K-105KC++ | DSP | Edge inference | Embedded Systems | Federated LearningCareer growth | Remote workMid-level Full TimeUnited States - Remote R19h ago
-
Hadoop Big Data Developer USD 100K-150KAWS EMR | Airflow | Apache Atlas | Apache Flink | Apache HudiCareer growth | Direct W2 employment | Remote workSenior-level Full TimeUnited States - Remote R19h ago
-
Machine Learning Data Engineer USD 80K-100KApache Beam | CI/CD | Data Lineage | Data Modeling | Data QualityDirect W2 employment | Remote workSenior-level Full TimeUnited States - Remote R19h ago
-
Data Platform Engineer USD 100K-150KAutoscaling | C++ | Capacity Planning | Distributed Systems | FinOpsRemote workSenior-level Full TimeUnited States - Remote R19h ago
-
Storage Engineer USD 100K-170KAnsible | Automation | CSI | Capacity Planning | CephCareer growth | Remote workSenior-level Full TimeUnited States - Remote R19h ago
-
Robot Application Developer USD 100K-150KC++ | Computer Vision | Control Systems | Gazebo | IMUCareer growth | Remote workSenior-level Full TimeUnited States - Remote R19h ago
-
Kafka Platform Engineer USD 130K-180KAWS MSK | Access Control | Access Control Lists | Access Control Lists ACLs | AnsibleSenior-level Full TimeUnited States - Remote R19h ago
-
Sr. Data Engineer USD 137K-254KAccess Control | Data Modeling | Data Sharing | Data Transformation | Data extractionEmployee assistance program | Fitness reimbursement | Flexible vacation | Flexible work hours | Mental health daysSenior-level Full TimeUnited States of America, McLean, Virginia R19h ago
-
AWS | Azure | Cloud platform | Direct Preference Optimization | Fine TuningComprehensive benefits package | Remote work | Travel to enterprise customers | Visa sponsorship possibleMid-level Full TimeSan Mateo R21h ago
-
Lead AI Engineer- GTM Systems USD 131K-176KAWS Bedrock | AWS Lambda | Agent coordination | Async event-driven architecture | Async/event-drivenNo relocation assistance not provided | Remote workSenior-level Full TimeRemote - US R22h ago
-
Lead AI Engineer USD 198K-261KAgentic Frameworks | CI/CD | Cloud Computing | Containers | Fine TuningSenior-level Full TimeUSA, USA R22h ago
-
A/B | A/B Testing | AWS | AWS SageMaker | Apache Spark401k employer match | Commuter benefit | Dental insurance | Dependent Care Flexible Spending Account FSA | Flexible time offSenior-level Full TimeLos Angeles, California, United States; San … R23h ago
-
Senior Data Scientist, Applied ML USD 154K-200KAWS | Airflow | Apache Spark | DVC | Data Transformation401k employer contribution | Employer-paid life insurance | Flexible Remote Friendly Work Options | Generous paid holidays | Health Savings Account employer contributionSenior-level Full TimeAustin, Texas | Remote R1d ago
-
Staff Engineer Tech Lead Manager, ML Acceleration USD 172K-229KAWS | Azure | C++ | Cloud Computing | Distributed Systems401k match | Dental insurance | Health savings account | Life insurance | Medical insuranceSenior-level Full TimeRemote U.S. R1d ago
-
Sr Machine Learning Engineer I USD 150K-241KAutomated retraining | Bayesian Filter | CI/CD | Data Association | Extended KalmanDiscretionary paid time off | Emotional and mental wellness support | Employee resource groups | Fitness programs | Learning and development programsSenior-level Full TimeSeattle, Washington, United States R1d ago
-
AWS | Apache Kafka | Apache Spark | Azure | Cloud platformSenior-level Full TimeFlorida; Remote - Massachusetts; Remote - … R1d ago