Inference Engineer
Tasks
- Build and operate production model serving systems
- Design architecture decisions and engineering standards
- Improve scalability and operational maturity
- Investigate resolve performance reliability and capacity issues
- Maximize GPU utilization with predictable performance
- Monitor alert and maintain reliable inference services
- Optimize inference infrastructure for throughput latency scalability cost
Perks/Benefits
Skills/Tech-stack
API Development | Alerting | Batching | Caching | Cloud infrastructure | Distributed Systems | GPU Computing | GPU scheduling | High Throughput | Inference Server | Kubernetes | Latency optimization | Low Latency | Machine Learning | Model Serving | Monitoring | NVIDIA Triton | NVIDIA Triton Inference | NVIDIA Triton Inference Server | Performance Tuning | Quantization | Scalability | TensorRT-LLM | Token Throughput | Triton Inference Server | VLLM
Education
N/A
Related jobs
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R25d ago
-
Associate Cloud Data Engineer II USD 78K-97KAgile | Airflow | Apache Beam | BigQuery | Cloud ComposerOnsite workMid-level Full TimeAda, MI, United States, 493552h ago
-
Staff Software Engineer USD 114K-178KAI Safety | AWS | AWS Bedrock | Agentic Systems | AirflowHealth insurance | Paid time off | Retirement contributionsSenior-level Full TimeSt. Louis, Missouri, US, 63103-23552h ago
-
Senior Cell Modeling & Analytics Engineer USD 140K-175K3D Modeling | Circuit modeling | D Q D V | Data Analysis | Data Visualization401k plan | Equity opportunities | Flexible time off | Medical, dental, and vision coverageSenior-level Full TimeBroomfield, Colorado or Burlingame, California7h ago
-
Artificial Intelligence | Automation | LLM integrations | Langchain | Language ModelsContractor | Fully remoteSenior-level ContractLos Angeles R9h ago
-
Forward Deployed AI Engineer (GenAI, AWS) USD 175K-200KAWS | AWS CDK | AWS Neptune | Amazon ECS | Amazon SageMakerRemote-friendly cultureSenior-level Full TimeNew Jersey9h ago
-
Staff Data Engineer USD 200K-260KApache Airflow | Apache Beam | Apache Spark | BigQuery | DBT401k plan | Dental insurance | Disability insurance | Equity | Flexible time offSenior-level Full TimeSunnyvale, CA9h ago
-
Lead Machine Learning Engineer USD 172K-276KAmazon Web Services | Azure | CI/CD | Cloud platform | DatabricksLearning and development programs | Mentorship and coachingSenior-level Full TimeChicago, Illinois, USA R10h ago
-
Robotics Engineer USD 170K-221KC++ | Camera Object Detection | Computer Vision | Gazebo | Isaac Sim401k matching | Background check clearance | Dental insurance | Drug Test Clearance | Life insuranceEntry-level Contract Full TimeSunnyvale, California11h ago
-
Solution Engineer USD 138K-181KAI machine learning | Analytics | Cloud Computing | Data Warehouse | ETLSenior-level Full TimeUS-CO-Denver12h ago
-
Solution Engineer USD 138K-181KData Warehousing | Generative AI | Language Models | Language Processing | Large Language ModelsMid-level Full TimeFins Only-US-CA-San Mateo12h ago
-
AI Software Engineer USD 127K-175KAPI Development | Agent Orchestration | Agent runtimes | Agent systems | C++Dental insurance | Employee assistance program | Flexible Paid Vacation | Flexible paid sick leave | Flexible spending accountEntry-level Full TimeSan Francisco, CA12h ago
-
Lead Algorithm & Signal Processing Engineer USD 157K-220KAdaptive Signal Processing | Bayesian Methods | C plus plus | Deep learning | Electronic WarfareTop Secret clearanceSenior-level Full TimeDayton, OH12h ago
-
Lead Algorithm & Signal Processing Engineer USD 157K-220KAdaptive Signal Processing | C++ | Deep learning | Electronic Warfare | Graph Neural NetworksSenior-level Full TimeWoburn, MA12h ago
-
Senior Applied Scientist USD 170K-286KApache Spark | C++ | Computer Vision | Data Processing | Edge inferenceComprehensive health insurance | Parental leave | Professional development stipend | Remote work | Travel up to 5 percentSenior-level Full TimeRemote - US R12h ago
-
Cleared AI/ML Engineer USD 114K-159KAWS | Airflow | Azure | Cloud platform | Continuous integrationSenior-level Full TimeChantilly, VA13h ago
-
Applied AI Inference Engineer USD 250K-300KC++ | CUDA | Docker | GPU | Kubernetes401k match | Cell phone stipend | Commuter benefits | Daily meals allowance | Emergency assistanceSenior-level Full TimeSan Francisco, CA - US13h ago
-
AI Ops Engineer USD 122K-191KAgent Development Kit | Agile | CI/CD | Cloud platform | DockerCareer coaching | Employee assistance programme | Flexible working hours | Global career opportunities | Hybrid workEntry-level Full TimeColorado, United States13h ago
-
AI Integrations Staff Engineer USD 150K-230KAI Models | Agent Harness | Agent SDK | Back-end | Back-end development401k contribution | Company retreats | Dental insurance | Employee referral program | EquitySenior-level Full TimeRemote R14h ago
-
Senior Data Engineer - Modern Data & AI Platforms USD 156K-204KAI machine learning | AWS | Cortex | DBT | Data GovernanceRemote work | Weekend and after hours release supportSenior-level Full TimeKansas City, MO, United States14h ago
-
Principal Algorithm & Signal Processing Engineer USD 206K-284KAI machine learning | Adaptive Signal Processing | C# | C++ | Electronic WarfareSecurity clearance supportSenior-level Full TimeDayton, OH15h ago
-
Principal Algorithm & Signal Processing Engineer USD 206K-284KAI machine learning | Adaptive Signal Processing | C# | C++ | Electronic WarfareSenior-level Full TimeWoburn, MA15h ago
-
Staff Data Engineer USD 200K-240KAPI Integration | AWS | Airbyte | CDC | DBT401k | Career advancement | Health Insurance Coverage 100 Percent | Hybrid office attendance | Hybrid workSenior-level Full TimeNew York City15h ago
-
Associate Director, Data Engineering USD 130K-150KCI/CD | Data Engineering | Data Governance | Data Lakehouse | Data Lineage401k employer match | Career growth | Dental insurance | Generous PTO | Inclusive cultureMid-level Full TimeSeattle15h ago
-
A/B | A/B Testing | Access Control | B testing | ExperimentationSenior-level Full TimeChicago, IL, United States16h ago