Sr. Machine Learning Engineer, Foundation Models Inference - Cloud OS & Inference
Tasks
- Author GPU inference kernels
- Build foundation model inference systems
- Collaborate with research and external partners
- Deploy high throughput inference services
- Design systems architecture for inference
- Develop end to end inference tooling
- Improve performance and privacy guarantees
- Integrate model architectures into production
- Optimize inference efficiency
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | CUDA C++ | Cloud platform | Deep learning | Docker | GPU Programming | Google Cloud | Google Cloud Platform | High Throughput | High-Throughput Systems | Inference Optimization | JAX | Kubernetes | LLM Inference | Machine Learning | Multimodal | NVIDIA Triton | NVIDIA Triton Server | OpenAI Triton | PyTorch | SGLang | TGI | TPU Programming | TensorFlow | TensorRT-LLM | Transformers | Triton Server | VLLM
Education
Regions
Countries
States
Related jobs
-
C++ | Caffe | Deep and Wide | Deep learning | GBDTMid-level Full TimeSeattle, Washington, United States5h ago
-
C++ | Computer Vision | Data Mining | Deep learning | GoEntry-level Full TimeSan Jose, California, United States6h ago
-
Anti-Fraud | Anti-spam | C++ | Computer Vision | GoEntry-level InternshipSeattle, Washington, United States6h ago
-
Algorithms | C++ | Computer Vision | Data Mining | Data StructuresEntry-level Full TimeSeattle, Washington, United States6h ago
-
AWS Data Engineer USD 91K-155KAgile | Amazon Elastic Container Service | Amazon Web Services | Apache Airflow | Apache SparkRemote workSenior-level Full TimeMadrid, MD, Spain8h ago
-
Senior DevOps Engineer USD 124K-170KAWS | AWS CDK | AWS CloudFormation | Amazon CloudWatch | ArgoCDSenior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL11h ago
-
Research Engineer, Agentic Systems USD 175K-275KData sets | Evaluation Frameworks | Experimentation | Fine Tuning | Language Models401k employer match | Catered lunch | Commuter benefits | Dinner stipend | Generous PTO policyMid-level Full TimeUnion Square, New York City17h ago
-
Lead Infrastructure Engineer - Public Cloud Storage USD 119K-196KAccess Management | Block Storage | Cloud Compliance | Cloud Governance | Cloud Networking401k plan | Adoption reimbursement | Commuter benefits | Critical caregiving leave | Critical illness insuranceSenior-level Full Time111432-TX-Las Colinas Bldg A, Irving Campus, …18h ago
-
APIs | Agent Orchestration | Chunking | Cloud infrastructure | Context AssemblyDirect collaboration with founders | High ownership | In-office Flexibility | In-office collaboration | Remote workSenior-level Full TimeSan Francisco, CA; New York, New …18h ago
-
AI Engineering Specialist USD 110K-182KAPI Development | CI/CD | Cloud | Containers | Generative AISenior-level Full TimeCoral Springs, Florida, United States18h ago
-
Senior Software Engineer, Robotics Tracking and Fusion USD 190K-252KAnomaly Detection | Bayesian Filtering | Big Data | C# | C++Health benefits | Recovery BenefitsSenior-level Full TimeFort Collins, Colorado, United States19h ago
-
Senior Software Engineer, Robotics Tracking and Fusion USD 220K-292KAdaptive filtering | Anomaly Detection | Bayesian Filtering | C# | C++Senior-level Full TimeWashington, District of Columbia, United States19h ago
-
Senior Software Engineer, Robotics Tracking and Fusion USD 220K-292KAdaptive filtering | Anomaly Detection | Bayesian Filtering | C# | C++Competitive benefits | Employee assistance program | Health insurance | Recovery BenefitsSenior-level Full TimeWaltham, Massachusetts, United States19h ago
-
Software Engineer, Robotics Tracking and Fusion USD 165K-218KAnomaly Detection | Bayesian Filtering | C# | C++ | ClassificationHealth benefits | Paid time off | Recovery Benefits | Relocation assistance | U S Top Secret clearance supportMid-level Full TimeFort Collins, Colorado, United States20h ago
-
Software Engineer, Robotics Tracking and Fusion USD 191K-253KAnomaly Detection | Bayesian Filtering | Big Data | Big Data Pipelines | C#Employee benefits | Health and Recovery Support | Health benefits | Paid time offMid-level Full TimeWashington, District of Columbia, United States20h ago
-
Software Engineer, Robotics Tracking and Fusion USD 191K-253KAnomaly Detection | Bayesian Filtering | Big Data | Big Data Pipelines | C#Employee assistance | Flexible time off | Health benefits | Recovery supportMid-level Full TimeWaltham, Massachusetts, United States20h ago
-
Lead Machine Learning Engineer USD 139K-304KAI Services | Agile | Azure AI | Azure AI Services | Azure Container401k matching | Adoption Assistance | Childcare tuition discounts | Company bonus | Fertility benefitsSenior-level Full TimeAnn Arbor, MI, United States21h ago
-
Principal, AI Solutions USD 145K-200KAI Agents | Artificial Intelligence | Business Analysis | Change Management | Enterprise Architecture401k match | Flexible spending account | Health benefits | Long-term disability | Professional growth opportunitiesSenior-level Full TimeUS-Remote R1d ago
-
Senior Principal Machine Learning Engineer USD 220K-300KCo-design | Compiler optimization | Context modeling | Data Curation | Deep learningCounseling services | Dental insurance | Employee assistance program | Employee equity | Flexible spending accountSenior-level Full TimeSan Jose, California, United States1d ago
-
Site Reliability Engineer III - Machine Learning USD 185K-215K.NET | Argo CD | Black box monitoring | Black-box | C SharpSenior-level Full TimeWilmington, DE, United States1d ago
-
Agentic Workflows | Automation | Data integration | Enterprise Integration | GenAIMedical/Dental/Vision insurance | Unlimited PTO | Wellness stipendMid-level Full TimeSan Francisco, California, United States1d ago
-
AWS | Adversarial Machine Learning | Azure | Bias and fairness | C++401k profit sharing | Dental insurance | Education reimbursement | Employee referral incentive | Flexible spending accountsSenior-level Full TimeHuntsville, Alabama, United States1d ago
-
Consultant (LLM/AI Skillset) USD 110K-160KAPI Development | Agile | Language Models | Large Language Models | Machine LearningMid-level Full TimeDallas, Texas, United States1d ago
-
Agent systems | Enterprise Data | Fine Tuning | LLM Fine-tuning | Language ModelsRemote workSenior-level Full TimeAustin R1d ago
-
Robotics Field Engineer USD 90K-160KAWS | Data Visualization | Electromechanical troubleshooting | Grafana | Laboratory automation401k company match | Flexible PTO | Green card sponsorship | H1B sponsorship | Medical, dental, vision plansMid-level Full TimeLos Angeles1d ago