Inference Optimization Engineer
Tasks
- Build inference optimization platform
- Collaborate with engineering and product teams
- Create automated optimization loop
- Deliver LLM performance improvements to production
- Develop reusable optimization tools and libraries
- Optimize LLM inference performance
- Profile inference workloads end to end
- Publish technical content on LLM inference optimization
- Translate customer insights into optimization strategy
Perks/Benefits
- 401k matching
- Flexible paid time off
- Health insurance
- Remote work
- Team meetups
- Team onsites
- Travel opportunities
Skills/Tech-stack
ASIC | Cloud Computing | Distributed Systems | GPU Programming | Kubernetes | Language Models | Large Language Models | Machine Learning | Optimization | Performance Engineering | Profiling
Education
N/A
Related jobs
-
Senior Machine Learning Engineer USD 150K-225KAIOps | AWS | Azure | Data Analysis | Data Visualization401k match | Career growth opportunities | Dental insurance | Employee resource groups | Flexible paid time offSenior-level Full TimeRemote, United States4h ago
-
Lead AI Engineer-Machine Learning USD 110K-198KAWS | Agile | Azure | CI/CD | Cloud platform401k match | Dental insurance | Disability insurance | Growth opportunities | Holiday paySenior-level Full TimeParsippany, NJ, United States4h ago
-
Lead AI Engineer USD 180K-280KAWS SageMaker | Azure Machine Learning | CI/CD | ColBERT | DockerChildcare benefits | Onsite gym | Tuition assistanceSenior-level Full TimeQuincy, MA, United States4h ago
-
Data Engineer CAD 100K-170KAWS | Apache Airflow | Azure | BigQuery | Cloud Computing401k | Asynchronous work culture | Autonomy | Company paid life insurance | Disability coverageMid-level Full TimeRemote - US or Canada R6h ago
-
DataOps Engineer USD 95K-125KAmazon Web Services | Apache Airflow | Apache Hive | Apache Kafka | Apache NiFiMid-level Full TimeTbilisi, Georgia7h ago
-
Data Preparation | Data Visualization | Diagnostic Testing | Feature Engineering | Machine LearningActive Secret clearance or above | Security clearance providedMid-level Full TimeRosslyn, Virginia, United States8h ago
-
Senior Palantir AI and Data Science Engineer USD 107K-179KAnalytics products | Cloud Computing | Data Architecture | Data Pipelines | Data workflowsTravel opportunitiesSenior-level Full TimeRosslyn, Virginia, United States8h ago
-
CDN | Cost Optimization | Dashboards | Data Governance | Data ModelingEntry-level Full TimeSeattle, Washington, United States9h ago
-
3D Geometry | Animation | Computer Vision | Deep learning | Generative ModelsMid-level Full TimeSan Jose, California, United States9h ago
-
Software Engineer - AI Compute Infrastructure USD 148K-300KCI/CD | Deep learning | GPU Acceleration | Kubernetes | LLM InferenceSenior-level Full TimeSeattle, Washington, United States9h ago
-
Tech Lead Software Engineer - AI Compute Infrastructure USD 244K-450KC++ | CI/CD | Containerization | Distributed Systems | GPU AccelerationSenior-level Full TimeSan Jose, California, United States9h ago
-
Senior Software Engineer - AI Compute Infrastructure USD 202K-368KC++ | GPU Acceleration | Go | Kubernetes | Language ModelsSenior-level Full TimeSeattle, Washington, United States9h ago
-
LLM AIOps Development Engineer - Data Center Networking USD 162K-387KAnomaly Detection | Cause analysis | Data Processing | Data correlation | Deep learningExecutive-level Full TimeSan Jose, California, United States9h ago
-
Senior Software Engineer- Metadata Storage USD 218K-387KDeployment Automation | Distributed Systems | Distributed coordination | Distributed locking | Key-Value StorageSenior-level Full TimeSan Jose, California, United States9h ago
-
Senior Research Engineer / Scientist - Storage for LLM USD 207K-368KCUDA | Caching | Data Structures | Distributed Systems | Eviction PolicyConference attendance | Open source contributions | Research resourcesSenior-level Full TimeSeattle, Washington, United States R9h ago
-
LLM AIOps Development Engineer - Data Center Networking USD 207K-368KAPIs | Anomaly Detection | Cause analysis | Closed Loop | Closed-loop automationExecutive-level Full TimeSeattle, Washington, United States9h ago
-
Research Engineer / Scientist - Storage for LLM USD 153K-300KCUDA | Caching | Distributed Systems | Eviction policies | GPU ComputingConference attendance | Innovation-driven culture | Open source contributions | Research resourcesEntry-level Full TimeSeattle, Washington, United States R9h ago
-
Research Engineer - MSL FAIR Foundations USD 141K-208KBenchmarking | Code review | Data Pipelines | Deep learning | Distributed SystemsMid-level Full TimeMenlo Park, CA | Burlingame, CA …10h ago
-
Research Engineer, Monetization AI USD 117K-173KCo-design | Cold Start | Content Understanding | Continual Learning | Data AugmentationEntry-level Full TimeSunnyvale, CA | Bellevue, WA | …10h ago
-
Software Engineer (Technical Leadership) USD 213K-293KC++ | Data Classification | Data Mining | Data Modeling | Data RegressionSenior-level Full TimeBellevue, WA | Menlo Park, CA … R10h ago
-
Data Engineer, Product Analytics USD 181K-204KAlgorithm Optimization | Bias Mitigation | C# | C++ | Data GovernanceCareer growth opportunitiesSenior-level Full TimeSunnyvale, CA | Bellevue, WA | … R10h ago
-
Software Engineer, Systems ML USD 170K-251KAI infrastructure | C# | C++ | Co-design | Deep learningMid-level Full TimeSunnyvale, CA | Bellevue, WA | …10h ago
-
AI/HPC System Performance Engineer USD 102K-202KAlerting | Anomaly Detection | Artificial Intelligence | C# | C++Mid-level Full TimeMenlo Park, CA10h ago
-
Attention kernels | C++ | CUBLAS | CUDA | CUDNNSenior-level Full TimeBellevue, WA | Menlo Park, CA …10h ago
-
Production Engineering USD 177K-251KAI tools | Agent Orchestration | Bias Mitigation | C++ | Capacity PlanningOn-call rotationEntry-level Full TimeBellevue, WA | Menlo Park, CA …10h ago