Machine Learning Engineer, Distributed vLLM

Boston, United States R

USD 136K-225K Mid-level Full Time

@ R...

Apply Save

Found 1d ago

Tasks

Collaborate with cross-functional teams
Conduct code reviews
Design new inference features and solutions
Develop and test distributed inference infrastructure
Develop and test inference optimization algorithms
Implement KV cache aware routing and scoring algorithms
Improve resource utilization fault tolerance and stability
Integrate vLLM and manage distributed inference workloads
Optimize memory utilization and request distribution
Participate in technical design discussions

Perks/Benefits

Skills/Tech-stack

Apply Save

Language: en Views:

0 Clicks:

0 Saves: 0

Related jobs

Senior AgileSec Analytics Platform Engineer lead - Hybrid USD 160K-200K

API Integration | AWS ACM | Agile | Alerting | Ansible

Cross-functional workshops | Hybrid work | Professional mentorship | Remote work flexibility

Senior-level Contract

Pittsburgh, United States R

6h ago
Associate Director, Biostatistics & AI USD 173K-217K

21 CFR | 21 CFR Part 11 | ADaM | Adaptive Design | Annex 11

401k employer match | Company provided life and disability | Comprehensive health care | Employee stock purchase program | Flex Spending Accounts

Mid-level Full Time

Remote - USA R

18h ago
Senior Computational Fluid Dynamics Engineer USD 100K-190K

ANSYS-FLUENT | Computational Fluid Dynamics | Data Preprocessing | Data postprocessing | Fluid Dynamics

401k | Bonuses | Equity | FSA | Flexible time off

Senior-level Full Time

Santa Clara, CA or Remote R

19h ago
Machine Learning Developer (Freelance) USD 180K

Data Analysis | Deep learning | GenAI | Langchain | Language Models

Freelance project-based work | Part-time hours | Project-based compensation

Mid-level Freelance

United States - Remote R

19h ago
Freelance Machine Learning Engineer USD 180K

LLMs | Langchain | MLOps | Machine Learning | NumPy

Freelance engagement | Part-time project-based work

Mid-level Freelance

United States - Remote R

19h ago
Machine Learning Developer (Freelance) USD 180K

Database operations | LLMs | Langchain | MLOps | Machine Learning

Paid per project | Part-time flexible schedule | Project based work

Mid-level Freelance

New York, United States - Remote R

19h ago
Machine Learning Developer (Freelance) USD 180K

Langchain | Language Models | Large Language Models | MLOps | NumPy

English proficiency support | Flexible workload during active phases | Part-time schedule | Project based work

Mid-level Freelance

Texas, United States - Remote R

19h ago
Freelance Machine Learning Engineer USD 180K

Langchain | Language Models | Large Language Models | MLOps | Machine Learning

Flexible weekly hours during active phases | Part-time availability | Project based work

Mid-level Freelance

New York, United States - Remote R

19h ago
Freelance Machine Learning Engineer USD 180K

Langchain | MLOps | Machine Learning | NumPy | Pandas

Project based work

Mid-level Freelance

Texas, United States - Remote R

19h ago
Lead Analytics Engineer (REMOTE) USD 83K-138K

BigQuery | Business Intelligence | CI/CD | Cloud Data | Cloud data warehousing

Inclusive culture | Remote work

Senior-level Full Time

Customer Support Center, United States R

19h ago
Staff AI Engineer, Internal Automation USD 62K-70K

Alerting | CI/CD | Docker | FastAPI | HubSpot

401k match | Dental insurance | Flexible PTO | Health insurance | Paid Holidays

Entry-level Full Time

Remote (United States) R

19h ago
Principal AI Engineer (Remote) USD 280K-330K

AWS | Agentic loops | Anthropic API | Data Pipelines | Distributed Systems

401k plan | Employee assistance program | Health benefits | Home office stipend | Paid parental leave

Senior-level Full Time

Remote - United States R

20h ago
Lead Software Engineer - Data Platform USD 150K-175K

APIs | AWS | CI/CD | Data Governance | Data Modeling

401k match | Company holidays | Dental insurance | Disability insurance | Employee assistance program

Senior-level Full Time

United States R

21h ago
Data Engineer - Remote A USD 110K-175K

Agile | Amazon RDS | Amazon S3 | Dashboards | Data Pipelines

Mid-level Full Time

Aliso Viejo, CA R

21h ago
Sr. Full Stack Engineer (Python, AWS & GenAI) USD 106K-221K

API Design | AWS | Agentic AI | Cloud Computing | GenAI

Senior-level Full Time

Washington, DC R

22h ago
Data Analytics - Associate USD 110K-150K

A/B | A/B Testing | B testing | DBT | Data Modeling

Employer-Matched Retirement Plan | Paid dental vision telemedicine | Parental leave | Remote work Friday flexibility | Subsidized healthcare

Senior-level Full Time

New York, New York, United States R

22h ago
Data Engineer USD 122K-180K

Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DevOps

401k with company match | Collaborative and independent work mix | Community outreach opportunities | Company paid disability and life insurance | Comprehensive medical, dental and vision coverage

Mid-level Full Time

Remote-US R

22h ago
Senior Manager, Machine Learning USD 220K-330K

Data Analysis | Decision engine | Experimentation | Feature Store | Forecasting

401k match | Dental insurance | Disability insurance | Health insurance | Life insurance

Senior-level Full Time

United States | Remote R

23h ago
AI Solutions Engineer USD 175K-222K

API Development | Agile Scrum | CI/CD | Cloud services | Containerization

401k | Education reimbursement | Flexible work schedule | Hybrid work schedule | Relocation assistance

Senior-level Full Time

Livermore, CA, United States R

1d ago
Senior AI Engineer USD 120K-180K

API Integration | Agent Orchestration | Agent systems | Autogen | Compliance checks

401k match | Career growth | Dental insurance | Employee resource groups | Health insurance

Senior-level Full Time

Remote, United States R

1d ago
Senior Cloud Database Engineer USD 144K-180K

AWS | AWS Step Functions | Amazon Aurora | CI/CD | Database Administration

Development dollars stipend | Employee stock purchase program | Financial coaching | Flexible time off | Free therapy sessions

Senior-level Full Time

Remote, USA R

1d ago
Senior Cloud Database Engineer USD 144K-180K

AWS | AWS Step Functions | Amazon Aurora | CI/CD | Database Administration

Financial coaching | Flexible time off | Free therapy sessions | Legal advice | Parental leave

Senior-level Full Time

Remote, USA R

1d ago
Senior DataOps Engineer- Remote US USD 130K-168K

AWS CloudFormation | Amazon EMR | Amazon Web Services | Ansible | Apache Airflow

401k contribution | Employee assistance program | Flexible Time Away From Work | Health & medical benefits | Learning programs

Senior-level Full Time

Remote US R

1d ago
Principal AI Platform Engineer USD 190K-225K

ACR | API Integration | Audit Logging | Azure | Azure DevOps

401k employer match | Career growth and professional development opportunities | Employee assistance program | Medical Dental Vision Coverage Options | Paid Holidays

Senior-level Full Time

Remote (United States) R

1d ago
Senior Machine Learning Engineer USD 135K-170K

Data Visualization | Deep learning | Experimental Design | Generative AI | Language Processing

401k match | Company holidays | Dental insurance | Disability insurance | Employee assistance program

Senior-level Full Time

United States R

1d ago

Machine Learning Engineer, Distributed vLLM

Tasks

Perks/Benefits

Skills/Tech-stack

Education

Roles

Regions

Countries

States

Cities

Related jobs