Model Serving Engineer
Tasks
- Build high performance serving systems
- Configure autoscaling for serving workloads
- Design inference platforms
- Enable end to end observability
- Implement caching strategies
- Manage incident response
- Operate request routing and batching
- Optimize GPU utilization
Perks/Benefits
Skills/Tech-stack
Autoscaling | Batching | C++ | Caching | Capacity Planning | Distributed tracing | GPU Architecture | Go | Kubernetes | Machine Learning | Machine Learning Inference | Metrics | Model Quantization | Performance Engineering | Python | Request Routing | Rust | Structured Logging | TensorRT-LLM | VLLM
Education
Roles
Related jobs
-
Senior Database Engineer USD 140K-160KAWS | Aurora | CI/CD | Database security | Flyway401k retirement plan | Employee assistance program | Health spending account | Life insurance | Long-term disabilitySenior-level ContractFoster City, California, USA R13h ago
-
Senior AI Engineer USD 130K-200KAI Foundry | Agent workflows | Anthropic Claude | Anthropic Claude SDK | Azure AI401k retirement plan | Employee assistance program | Health spending account | Life insurance | Long-term disabilitySenior-level ContractOmaha, Nebraska, USA R13h ago
-
Senior-level Full TimeTel Aviv-Jaffa, Tel Aviv District, IL R15h ago
-
API Integration | APIs | Agent systems | Apache Spark | AutomationInternal talks | Learning platform | Remote days | Sports classes | Wellness benefitsEntry-level Full TimeBrooklyn, United States R20h ago
-
Senior Data Analytics Engineer USD 145K-206KAWS | CRM | DBT | Data Model | Data Modeling401k match | Disability insurance | Employee assistance program | Flexible spending account | Health Savings Account contributionSenior-level Full TimeBRIC, United States R1d ago
-
C++ | Configuration Management | Data Analysis | Data pipeline | Data pipeline managementPaid time off | Relocation assistanceSenior-level Full TimeUS-AL-HUNTSVILLE-401 ~ 401 Jan Davis Dr … R1d ago
-
C plus plus | Configuration Control | Data Analysis | Hardware-in-the-loop | IntegrationRelocation assistanceSenior-level Full TimeUS-AL-HUNTSVILLE-401 ~ 401 Jan Davis Dr … R1d ago
-
C++ | Defense radar | Discrimination | Hardware-in-the-loop | LinuxRelocation assistanceMid-level Full TimeUS-AL-HUNTSVILLE-401 ~ 401 Jan Davis Dr … R1d ago
-
Sr. Data Engineer USD 114K-185KAgile | Amazon Web Services | Apache Spark | Azure | Cloud platform401k retirement savings plan | CVS store discount | Disability benefits | Education assistance | Employee stock purchase planSenior-level Full TimeIrving-750 West John Carpenter, United States R1d ago
-
Data Engineer USD 116K-206KAWS Lambda | Airflow | Amazon Web Services | Apache Airflow | DatabricksSenior-level Full TimePA - West Chester, 1354 Boot … R1d ago
-
Data Scientist II USD 95K-142KAirflow | CI/CD | Data Governance | Data Validation | Data Visualization401k | Employee stock purchase plan | Paid time off | Parental leave | Tuition assistanceSenior-level Full TimeRemote, United States R1d ago
-
Senior Solutions Architect, Financial Services Banking USD 184K-287KApache Spark | C++ | CUDA | Dask | Deep learningSenior-level Full TimeUS, NY, Remote R1d ago
-
Software Engineer, AI Engineering and Enablement USD 96K-117KAPI Gateway | AWS | Agile | Automated testing | CI/CD401k plan | Disability insurance | Employee Assistance Program (EAP) | Flexible working schedule | Global shutdownMid-level Full TimeSeattle 400 Dexter - WA, United … R1d ago
-
SIEM Data Engineer USD 90K-157KApache Kafka | CIM | Cribl Stream | Data Enrichment | Data NormalizationMid-level Full TimeQuincy, Massachusetts, United States R1d ago
-
Agile | C# | C++ | CI/CD | Communication Protocols401k match | Child and elder care services | Dental insurance | Disability coverage | Employee assistance programSenior-level Full TimeUS-IA-CEDAR RAPIDS-137 ~ 855 35Th St … R1d ago
-
Engineer 3, Machine Learning-5125 USD 126K-165KAgile | Amazon Web Services | Apache Airflow | Apache Spark | CI/CDRemote work one day per weekEntry-level Full TimeDC - Washington, 1325 G ST … R1d ago
-
Senior ML Engineer, ML compute USD 155K-395KAmazon Web Services | C++ | Cloud platform | Distributed Systems | GPU OptimizationEmployee assistance program | Flexible spending account | Health savings account | Health, dental, vision insurance | Life insuranceSenior-level Full TimeGM Automation - Sunnyvale - GM … R1d ago
-
Senior-level Full TimeUnited States - Remote R1d ago
-
AI Research Engineer USD 80K-100KAccelerator hardware | Data Science | Deep learning | Distributed Training | JAXRemote workSenior-level Full TimeUnited States - Remote R1d ago
-
Analytics Engineer USD 105K-140KAirbyte | Airflow | Amazon Redshift | CI/CD | DBT401k | Dental insurance | Health insurance | Life insurance | Long-term disabilityMid-level Full TimeMiami, FL R1d ago
-
Staff Applied Scientist, 3D - Firefly Foundry USD 164K-313K3D Graphics | Animation | Computer Vision | Coordinate systems | Data PipelinesSenior-level Full TimeSan Jose, United States R1d ago
-
AI Data Engineer USD 80K-100KApache Beam | Apache Spark | CI/CD | Code review | Data LineageRemote workSenior-level Full TimeUnited States - Remote R1d ago
-
LLM Engineer USD 72K-100KBenchmarking | DPO | Distributed Training | Evaluation methodology | FSDPCareer growth | Code review feedback | Mentorship | Remote workMid-level Full TimeUnited States - Remote R1d ago
-
Principal Machine Learning Engineer USD 206K-379KAPI Design | CUDA | Diffusion Models | Distributed Systems | GPU schedulingSenior-level Full TimeSan Jose, United States R1d ago
-
Prompt Engineer USD 76K-99KAgent systems | Agentic Workflows | Embeddings | Evaluation Pipelines | Fine TuningCareer growth | Direct W2 employment | Remote workMid-level Full TimeUnited States - Remote R1d ago