Software Engineer, Inference - Multi Modal
Tasks
- Collaborate with researchers and product engineers to deploy capabilities
- Design inference infrastructure for multimodal models
- Enable experimental research workflows for production
- Improve GPU utilization tensor parallelism and hardware abstraction layers
- Optimize systems for high throughput low latency delivery
Perks/Benefits
- N/A
Skills/Tech-stack
Distributed Systems | GPU | High Throughput | Inference | Language Models | Large Language Models | Low Latency | Machine Learning | Model Parallelism | Multimodal | Networking | Tensor Parallelism | TensorRT-LLM | VLLM
Education
N/A
Roles
Regions
Countries
States
Related jobs
-
Supply Chain Data Engineer Ii USD 94K-118KDBT | Data Governance | Data Modeling | Data Pipelines | Data Quality401k | Disability insurance | Employee stock purchase plan | Health insurance | Life insuranceMid-level Full TimeWayne, PA, US, 190875h ago
-
AI/ML Engineer 2 USD 101K-165KAI Agents | API Development | AWS | Azure | CI/CDDisability insurance | Family leave | Flexible spending accounts | Life and AD D Insurance | Medical/Dental/Vision insuranceSenior-level Full TimePhiladelphia, PA, US, 191036h ago
-
Senior Machine Learning Engineer USD 152K-250KAutomation | Distributed Training | Distributed inference | GPU | Go401k | Employee assistance program | Flexible PTO | Flexible spending account | Health savings account contributionsSenior-level Full TimeLas Vegas, Nevada1d ago
-
APIs | Agent workflows | Authentication | Debugging | Distributed SystemsSenior-level Full TimeNew York City1d ago
-
A/B | A/B Testing | Agentic coding | B testing | Context SummarizationSenior-level Full TimeSan Francisco1d ago
-
Applied AI Engineer - Bay Area USD 211K-263KArtificial Intelligence | C plus plus | C# | Embeddings | Feature Engineering401k | Comprehensive health and wellness benefits | Learning and development opportunities | Unlimited time offMid-level Full TimeHQ (San Francisco)1d ago
-
Sr. Platform Software Engineer – AI and Innovation USD 142K-200KAgile | Apollo GraphQL | Cloud Architecture | Continuous Delivery | Distributed SystemsSenior-level Full TimeOak Brook, IL, United States1d ago
-
SYSTEM ENGINEER - Computer Network Support - AI/ML - 15+ yrs of Experience - TS/SCI w/Poly clearance is required - ES A USD 205K-211KAgile Development | Artificial Intelligence | Confluence | Jira | LLM401k retirement plan | Dental insurance | Federal Holidays | Health insurance | Life insuranceMid-level Full TimeFort George G Meade, United States1d ago
-
Software Engineer, Machine Learning USD 213K-293KAI ethics | API Design | Agent Orchestration | Artificial Intelligence | Bias MitigationSenior-level Full TimeSunnyvale, CA | Remote, US | … R2d ago
-
Cloud Computing | Computer Vision | Data Processing | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeKirkland, WA, USA; Seattle, WA, USA2d ago
-
Senior Software Engineer, Data Cloud Frontier AI USD 174K-252KComputer Vision | Data Processing | Data Storage | Debugging | Distributed ComputingSenior-level Full TimeKirkland, WA, USA; Sunnyvale, CA, USA2d ago
-
Staff Software Engineer, AI/ML, Google Distributed Cloud USD 207K-300KAI-assisted coding | Agent Debugging | Assisted coding | Cloud platform | Cross-Functional CollaborationSenior-level Full TimeSunnyvale, CA, USA2d ago
-
C++ | Data Analysis | Data Structures | Data structures algorithms | Distributed ComputingSenior-level Full TimeMountain View, CA, USA2d ago
-
Staff Software Engineer, Core, AI/ML Quality USD 207K-300KData Processing | Debugging | Feedback Training | Fine Tuning | Language ModelsSenior-level Full TimeSan Jose, CA, USA2d ago
-
Senior Staff Software Engineer, Google Cloud Storage USD 262K-365KAlgorithms | Data Structures | Distributed Systems | Large-Scale System Design | Large-scaleSenior-level Full TimeCambridge, MA, USA; Raleigh, NC, USA2d ago
-
Artificial Intelligence | Audio generation | C++ | Computer Vision | Data PreparationSenior-level Full TimeSunnyvale, CA, USA; Kirkland, WA, USA2d ago
-
Staff Software Engineer, AI/ML GenAI, YouTube USD 207K-300KAlgorithms | Computer Vision | Data Processing | Data Structures | Distributed SystemsSenior-level Full TimeMountain View, CA, USA2d ago
-
Data Engineer II USD 106K-151KApache Spark | Data Analysis | Data Modeling | Data Pipelines | Data ProcessingSenior-level Full TimeBoulder, CO, USA; Atlanta, GA, USA2d ago
-
Senior Machine Learning Engineer USD 195K-303KA/B | A/B Testing | AI | B testing | Deep learningFinancial wellness support | Flexible remote work | Health and wellness support | Time offSenior-level Full TimeAustin, Texas2d ago
-
Senior Machine Learning Engineer USD 148K-361KA/B | A/B Testing | B testing | Deep learning | Discriminative modelsCommuter benefits | Disability benefits | Financial wellness support | Global mental health support | Health insuranceSenior-level Full TimeSan Jose, California2d ago
-
Senior Machine Learning Engineer, Search Assistant USD 361K-510KA/B | A/B Testing | Airflow | B testing | Bandit AlgorithmsDisability benefits | Equity awards | Health insurance | Life insurance | Paid time offSenior-level Full TimeSan Jose, California2d ago
-
Senior Robot Infrastructure Engineer USD 100K-300KAWS | Alerting | C plus plus | Cloud pipelines | EC2Senior-level Full TimeSan Francisco2d ago
-
Senior Forward Deployed AI Engineer, Enterprise USD 216K-270KA/B | A/B Testing | AWS | Agent systems | Artificial IntelligenceCommuter stipend | Health, dental, vision insurance | Learning and development stipend | Paid time off | Retirement benefitsSenior-level Full TimeSan Francisco, CA; New York, NY2d ago
-
Forward Deployed AI Engineer USD 110K-160KAI Agents | APIs | Artificial Intelligence | Cloud infrastructure | LLM401k employer match | Family building benefits | Flexible time off | Free OneMedical memberships | Healthcare plansEntry-level Full TimeNew York, NY, United States2d ago
-
Forward Deployed AI Engineer II USD 180K-230KAI Agents | APIs | Cloud infrastructure | Data Privacy | Evaluation401k match | Family building benefits fertility adoption surrogacy support | Flexible time off | Free OneMedical memberships | Healthcare plansMid-level Full TimeNew York, NY, United States2d ago