Inference Engineer
Tasks
- Build and operate production model serving systems
- Design architecture decisions and engineering standards
- Improve scalability and operational maturity
- Investigate resolve performance reliability and capacity issues
- Maximize GPU utilization with predictable performance
- Monitor alert and maintain reliable inference services
- Optimize inference infrastructure for throughput latency scalability cost
Perks/Benefits
Skills/Tech-stack
API Development | Alerting | Batching | Caching | Cloud infrastructure | Distributed Systems | GPU Computing | GPU scheduling | High Throughput | Inference Server | Kubernetes | Latency optimization | Low Latency | Machine Learning | Model Serving | Monitoring | NVIDIA Triton | NVIDIA Triton Inference | NVIDIA Triton Inference Server | Performance Tuning | Quantization | Scalability | TensorRT-LLM | Token Throughput | Triton Inference Server | VLLM
Education
N/A
Related jobs
-
Staff Officer (Data Science) USD 128K-128KData Preprocessing | Data Visualization | Data integration | Deep learning | Feature EngineeringSenior-level Full TimeUnited States of America-Norfolk3h ago
-
Deep learning | Entity recognition | Flink | Graph Embedding | HadoopEntry-level InternshipSeattle, Washington, United States4h ago
-
Apache Spark | Deep learning | Entity recognition | Flink | Graph EmbeddingCommunity building events | Industry expert collaboration | Professional development eventsEntry-level InternshipSan Jose, California, United States4h ago
-
BERT | C++ | Deep learning | Distributed Training | Domain AdaptationMid-level Full TimeSan Jose, California, United States4h ago
-
C++ | Computer Vision | Deep learning | Distributed Training | Domain AdaptationMid-level Full TimeSan Jose, California, United States4h ago
-
C++ | Deep learning | Distributed Training | Domain Adaptation | FlinkMid-level Full TimeSeattle, Washington, United States4h ago
-
Senior Machine Learning Engineer(NLP/CV/Multimodal), TikTok E-commerce Knowledge Graph USD 136K-237KApache Spark | BERT | C++ | Computer Vision | Data MiningSenior-level Full TimeSeattle, Washington, United States4h ago
-
Algorithm Design | C# | C++ | Data Structures | Deep learningSenior-level Full TimeSan Jose, California, United States4h ago
-
Applied Machine Learning | C++ | Communication | Large-scale | Large-scale SystemsSenior-level Full TimeSan Jose, California, United States4h ago
-
AWS ECS | Agile | Amazon Web Services | CI/CD | DockerBackup childcare | Financial coaching | Health care coverage | Mental health support | On-site wellness centersMid-level Full TimePlano, TX, United States4h ago
-
AWS Glue | Amazon RDS | Amazon Redshift | Amazon S3 | Artificial Intelligence401k matching | Certification programs | Disability insurance | Employee resource groups | Fertility coverageEntry-level Full TimeRichmond, VA, United States R4h ago
-
Clustering | Computer Vision | Data Processing | Debugging | Distributed ComputingMid-level Full TimePittsburgh, PA, USA5h ago
-
Software Engineer, IT Infrastructure USD 174K-252KAlloyDB | Artificial Intelligence | C# | C++ | Cloud BigtableMid-level Full TimeFremont, CA, USA5h ago
-
C++ | Data Analysis | Data Pipelines | Data Structures | Data structures algorithmsSenior-level Full TimeNew York, NY, USA; Kirkland, WA, …5h ago
-
Senior Artificial Intelligence/Machine Learning Engineer USD 125K-188KAPI Integration | Agentic AI | Alerting | Artificial Intelligence | Automated testingCompany-paid certifications | Conference attendance | Healthcare | Internal mobility | Language coursesSenior-level Full TimeUnited States8h ago
-
Senior Machine Learning Engineer USD 155K-200KC++ | Data Engineering | Data Ingestion | Data Retrieval | Data Storage401k employer contributions | All-hands meetings | Healthcare coverage | Team Member Appreciation AwardsSenior-level Full TimeFremont, CA14h ago
-
AWS | Azure | C# | C++ | Cloud PlatformsHousing assistance | Mentorship | Professional development | Relocation support | Remote workNone Full TimeEvendale, United States16h ago
-
Software Engineer, Data Flywheel Platform USD 283K-335KAirflow | Dagster | Data orchestration | Databricks | Distributed SystemsSenior-level Full TimeSunnyvale21h ago
-
AI Platform | AI platform deployment | API Integration | Domain Knowledge | Generative AISenior-level Full TimeNew York , New York , …1d ago
-
Senior MLOps Engineer USD 165K-250KAI Pipelines | AI endpoints | API Development | Audit Logs | AutoscalingContinuous learning opportunities | Flexible working arrangements | Health equity mission impact | Remote or hybrid optionsSenior-level Full TimeUnited States - Remote R1d ago
-
Senior Machine Learning Engineer (2256) USD 118K-148KData Pipelines | Data Privacy | Data Quality | Docker | GDPR401k | Dependent care | Discounted tickets and entertainment perks program | Flexible work schedules | Medical insuranceSenior-level Full TimeNew York, New York, United States1d ago
-
Data Engineer (2258) USD 119K-150KAWS | Azure | Data Quality | Data Security | Data Visualization401k | Dependent care | Discounted tickets | Entertainment Perks Programs | Flexible work schedulesMid-level Full TimeNew York, New York, United States R1d ago
-
Software Engineer USD 120K-170KApache Flink | Apache Kafka | Apache Spark | Cassandra | Deep learning401k | Health insurance | PTOEntry-level Full TimeMountain View, California, United States1d ago
-
Sr Technology Engineer -Disaster Recovery USD 104K-186KAWS | Agile | BIA | Backup and Recovery | Business ContinuitySenior-level Full TimeBethpage, NY, USA1d ago
-
Artificial Intelligence | C# | C++ | CAD | Design of ExperimentsHealth insurance | Paid time off | Recovery BenefitsSenior-level Full TimeCosta Mesa, California, United States1d ago