Model Serving Engineer
Tasks
- Build model serving systems
- Configure autoscaling and capacity planning
- Design inference platforms
- Ensure end-to-end observability
- Implement request routing and batching
- Manage caching strategies
- Operate high throughput low latency services
- Optimize GPU utilization
- Respond to incidents and outages
- Support external facing model APIs
Perks/Benefits
- N/A
Skills/Tech-stack
Autoscaling | C++ | Capacity Planning | Distributed Systems | FinOps | GPU Architecture | Go | Kubernetes | Metrics | Observability | Performance Engineering | Python | Rust | Structured Logging | TensorRT-LLM | Tracing | VLLM
Education
Roles
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R20d ago
-
APIs | Docker | Git | Kubernetes | MLOpsRemote workEntry-level Full TimeMorrisville, North Carolina, États-Unis d’Amérique R4h ago
-
Computer Vision Expert USD 160K-220KComputer Vision | Deep learning | Evaluation metrics | Image Generation | Image RecognitionFlexible schedule | Fully remote | Independent contractorMid-level Full TimeUnited States - Remote R17h ago
-
Machine Learning & NLP Expert USD 160K-220KAutomated Evaluation | Benchmarking | Embedding Models | Feature Engineering | Hugging FaceFlexible schedule | Fully remote | Independent contractor | Part-timeMid-level Full TimeUnited States - Remote R17h ago
-
Senior Machine Learning Engineer, Shield USD 211K-263KAnomaly Detection | Apache Spark | BigQuery | Cloud platform | DataflowSenior-level Full TimeRedwood City, CA, United States R17h ago
-
Forward Deployed AI Solutions Engineer USD 105K-132KAPIs | Auditability | Authentication | Command Line | Command-line Interface401k benefits | Baby bonding leave | Commuter benefits | Disability coverage | Employee referral programMid-level Full TimeUS Remote R20h ago
-
Apache Superset | Big Data | Data Modeling | Data Quality | Data VisualizationExecutive-level Full TimeUnited States R20h ago
-
Staff Forward Deployed AI Solutions Engineer USD 152K-190KAPIs | Auditability | Auth | CLI | Cloud platform401k | Commuter benefits | Dental insurance | Disability insurance | Fertility care benefitsSenior-level Full TimeUS Remote R20h ago
-
Machine Learning Engineer USD 115K-150KBig Data | C++ | Data Aggregation | Data Preprocessing | Data ValidationDental insurance | Medical insurance | Retirement benefits | Telecommuting permitted | Vision insuranceNone Full TimeUnited States R20h ago
-
Data Curator USD 70K-88KAutomation | Business Analytics | Data Processing | Data Quality | Data ValidationMid-level Full TimeHybrid, US R20h ago
-
Senior-level Full TimeUS - Remote R21h ago
-
Sr. Bioinformatics Scientist USD 150K-189KAWS | AWS Batch | AWS Lambda | Analytical validation | BioinformaticsSenior-level Full TimeRemote ; South San Francisco, California, … R22h ago
-
Senior Data Platform Engineer USD 170K-230KAWS Lambda | Amazon EKS | Amazon EMR | Amazon Redshift | Amazon S3401k matching | Company events | Flexible paid time off | Health insurance | Home office stipendSenior-level Full TimeUnited States R22h ago
-
AI Developer - Model Creation & Full Stack USD 130K-145KAWS | Angular | Azure Databricks | CI/CD | Cloud platformRemote workMid-level Full TimeWork from home, VA, United States R23h ago
-
Senior Full Stack AI Developer USD 125K-185KApplication development | Batch | Cloud Engineering | Continuous Delivery | Continuous integrationHealth benefits | Remote workSenior-level Full TimeFairfax, VA, United States R23h ago
-
Senior Data Engineer (Remote) USD 120K-150KData Architecture | Data Lake | Data Modeling | Data Quality | Data RefreshEqual opportunity employer | Remote workSenior-level Full TimeUnited States R1d ago
-
Senior-level Full TimeRemote - US R1d ago
-
Analytics Engineer USD 110K-140KDBT | Data Modeling | ETL | Git | Python401k company match | Career advancement | Full medical, dental, and vision coverage | Gym membership stipend | Leadership trainingMid-level Full TimeColumbia, MO (Headquarters) R1d ago
-
Principal Data Engineer USD 220K-260KAirflow | Amazon EKS | Apache Spark | Astronomer | BigQuery401k employer matching | Comprehensive health benefits | Employee stock purchase program | Offsite team retreats | Parental leaveSenior-level Full TimeUS Remote R1d ago
-
Generative AI/LLM Engineer USD 105K-125KAPI Development | AWS | Azure | Chroma | Continuous DeploymentOnsite work with flexible remote daysMid-level Full TimeFrisco, TX, United States R1d ago
-
.NET | C# | CI/CD | Data Ingestion | Database partitioningCareer growth | Hybrid work model | In-office collaboration days | Remote work daysSenior-level Full TimeUSA - Atlanta, GA R1d ago
-
AI Forward Deployed Engineer | $120K-$150K + Hybrid + Equity | AI-Based Outage Intelligence Company A USD 120K-150KAI workflows | API Integration | Automation | Backend Development | Production EngineeringCompetitive salary | Equity | Hybrid work environment | Unlimited PTOMid-level Full TimeKing of Prussia, PA, United States R1d ago
-
Senior Data Engineer USD 155K-175KApache Airflow | Argo CD | CI/CD | Data Integrity | Data ModelingAnnual bonus program | Comprehensive benefits package | Hybrid work environmentSenior-level Full TimeUnited States - Remote R1d ago
-
Senior Data Engineer USD 165K-165KCloud Native | Data Contracts | Data Governance | Data Lineage | Data ModelingCross regional team | Mission-driven | Remote-firstSenior-level Full TimeUnited States R1d ago
-
Entry-level Full TimeUnited States - Remote R1d ago