Senior Principal Machine Learning Engineer, vLLM
Tasks
- Benchmark profile and evaluate parallelization approaches
- Benchmark profile and evaluate quantization approaches
- Benchmark profile and evaluate sparsification approaches
- Build inference serving deployment pipelines
- Design inference optimization algorithms
- Evaluate performance for specific hardware and models
- Implement deep learning research productization
- Implement model compression algorithms
- Mentor and guide engineers
- Provide code reviews
Perks/Benefits
- Health insurance
- Health savings account
- Paid parental leave
- Paid time off
- Retirement 401k match
- Tuition reimbursement
Skills/Tech-stack
Computer Vision | Deep learning | GPU Acceleration | Gradient Computation | Graph theory | Inference Optimization | Language Models | Language Processing | Large Language Models | Linear Algebra | Machine Learning | Model Compression | Model Quantization | Model sparsification | Natural Language | Natural Language Processing | NumPy | Parallelization | Probability | PyTorch | Reinforcement Learning | Tensor math
Education
Regions
Countries
States
Cities
Related jobs
-
Anomaly Detection | Automated testing | Benchmarking | Computer Vision | Data Preparation401k | Education reimbursement program | Flexible schedules | Hybrid schedule | Relocation assistanceSenior-level Full TimeLivermore, CA, United States R11h ago
-
Design Optimization Engineer - Postdoctoral Researcher USD 122K-143KAdjoint method | C# | C++ | CUDA | Data Science401k | Education reimbursement program | Flexible schedule | Hybrid work schedule | Relocation assistanceEntry-level Full TimeLivermore, CA, United States R11h ago
-
Senior Machine Learning Engineer, Sentry Tower USD 220K-330KC plus plus | Computer Vision | Continuous integration | Data collection | Dataset curationEquity grants | Health benefits | Recovery BenefitsSenior-level Full TimeIrvine, California, United States; Remote R15h ago
-
Data Scientist / Software Engineer - REMOTE USD 100K-175KAPI Design | AWS | Agile | Azure | CI/CD401k match | Medical, dental & vision coverage | Remote-friendly | Training opportunitiesMid-level Full TimeDallas, TX, US R16h ago
-
Data Engineer USD 125K-133KAWS S3 | Amazon Redshift | Apache Airflow | DBT | Dimensional Modeling401k retirement plan | Long-Term Disability coverage | Medical, dental, and vision coverage | Optional life insurance | Paid HolidaysSenior-level Full TimeRemote (United States) R19h ago
-
Senior Platform/MLOps Engineer USD 168K-215KAnsible | Artificial Intelligence | C# | CI/CD | Configuration ManagementTravelSenior-level Full TimeRemote (USA) R20h ago
-
Machine Learning Engineer USD 185K-340KAPI Development | Data integration | Evaluation | Experiment Planning | Finetuning401k employer match | AI experimentation learning budget | Commuter benefits | Dental insurance | Flexible vacation policySenior-level Full TimeOakland, CA (or remote within US … R1d ago
-
AI Engineer USD 180K-240KAnalytics | Data Analysis | Fine Tuning | Language Models | Large Language ModelsFlexible collaboration tools | Remote work | Supportive team environmentMid-level Full TimeSF Hybrid R1d ago
-
Staff Machine Learning Engineer, Multimodal Modeling USD 200K-240KBash | Computer Vision | Contrastive Learning | Data pipeline | Distributed TrainingCaregiver support | Company holidays | Criminal Justice Information Services CJIS certification required | ERGs | Fertility benefitsSenior-level Full TimeRemote - USA R1d ago
-
Senior Perception Engineer USD 175K-215KAlgorithm Development | Calibration | Cameras | Computer Vision | GNSSSenior-level Full TimeRemote, US R1d ago
-
Sr Machine Learning Engineer USD 156K-211KA/B | A/B Testing | AWS | Airflow | AzureBonus program | Career development | Dental insurance | Disability insurance | Flexible spending accountsSenior-level Full TimeUS - Texas - Houston - … R1d ago
-
On-Call AI Solutions Specialist - REMOTE USD 67K-114KAI/ML | AI/ML libraries | AWS | AWS CodeBuild | AWS CodePipelinePart time up to 30 hours per week | Reasonable accommodations | Remote workMid-level Part TimeNationwide Remote Office (US99), United States R1d ago
-
Senior Software Engineer - Applied AI/ML USD 135K-155KAWS | AWS Lambda | Amazon SageMaker | Apache Airflow | Audio Data401k match | Dental insurance | Employee stock purchase plan | Medical insurance | Paid HolidaysSenior-level Full TimeChicago, IL, United States R1d ago
-
Senior AI Engineer USD 124K-174KAgent Orchestration | Artificial Intelligence | CI/CD | Human-in-the-loop | LLM-as-a-JudgeSenior-level Full TimeVirtual - Illinois, United States R1d ago
-
Senior Machine Learning Engineer USD 174K-287KDeep learning | Gradients | Graph theory | Inference Optimization | Language ModelsEmployee assistance program | Employee stock purchase plan | Flexible spending account | Health savings account | Paid HolidaysSenior-level Full TimeBoston, United States R1d ago
-
AI Engineer III USD 118K-147KAWS | Alerting | Azure | Docker | Embeddings401k match | Commuter benefit | Dental | Healthcare | Prescription plansSenior-level Full Time3750 Market Street, Philadelphia, PA, USA R1d ago
-
Senior AI Software Engineer (Hybrid Eligible) USD 140K-180KAI Foundry | AWS Bedrock | Azure AI | Azure AI Foundry | Azure OpenAIEducational assistance | Employee assistance program | Flexible work hours | Generous vacation and holidays | Hybrid work environmentSenior-level Full TimeOak Ridge, TN, US, 37830 R1d ago
-
Entry-level Full TimeUnited States - Remote R1d ago
-
Forward Deployed Engineer - Applied AI - Senior Manager - Financial Services - Consulting USD 144K-374KAPI Gateway | API Management | API strategy | AWS API | AWS API GatewaySenior-level Full TimeNew York, NY, US, 10001-8604 R1d ago
-
AI Search | AWS Bedrock | AWS ECS | AWS SageMaker | Asynchronous programmingSenior-level Full TimeNew York, NY, US, 10001-8604 R1d ago
-
AI Search | API Design | AWS Bedrock | Agentic Systems | Asynchronous programmingMid-level Full TimeNew York, NY, US, 10001-8604 R1d ago
-
AI Engineer I - Hybrid USD 125K-135KAPI Development | Agentic Workflows | Azure | Azure Fabric | CI/CDSenior-level Full TimeWindsor, Colorado, United States R1d ago
-
Senior Software Engineer, Perception Architecture USD 184K-240KC++ | Computer Vision | Data Pipelines | Deep learning | Image SegmentationSenior-level Full TimePittsburgh, PA or Remote R1d ago
-
Forward Deployed AI Engineer USD 160K-220KAgentic Workflows | CI/CD | Cloud infrastructure | Guardrails | Language ModelsAutonomy | Direct access to leadership | High-impact role | Remote flexibilitySenior-level Full TimeRemote (United States) R1d ago
-
Mid-Level Data Engineer USD 90K-98KAPI Development | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageRemote workMid-level Full TimeWork from home, VA, United States R1d ago