Senior Machine Learning Engineer, Distributed vLLM (llm-d)
Boston, United States
R
USD 170K-281K Senior-level Full Time Found 2d ago
Tasks
- Build distributed inference infrastructure using Kubernetes
- Conduct code reviews
- Contribute to technical discussions
- Design and develop inference solutions
- Develop inference algorithms
- Develop system components in Go and/or Rust
- Engage in industry and open source events
- Enhance resource utilization and fault tolerance
- Mentor engineering team
- Optimize memory utilization and request distribution
- Participate in upstream communities
Perks/Benefits
- Dental
- Disability
- Family medical leave
- Flexible spending
- Health savings
- Medical
- Military Leave
- Paid time off
- Parental leave
- Reimbursement programs
- Retirement 401k
- Stock purchase
- Vision
Skills/Tech-stack
API Gateways | CNI | Cilium | Cloud Native | Computer Architecture | Distributed Systems | Envoy | GPU Profiling | GPU Programming | GRPC | Golang | HTTP/2 | High Performance | High-performance networking | Infiniband | Istio | Kubernetes | Microservices | OpenTelemetry | Parallel processing | Python | RDMA | Reverse Proxies | RoCE | Rust | SGLang | TensorRT-LLM | UCX | VLLM | WASM
Education
N/A
Regions
Countries
States
Cities
Language: en |
Views: 1 |
Clicks: 0
Related jobs
-
API Integration | Customer Engagement | Debugging | Distributed Systems | Event DrivenBonuses | Catered lunch | Equity | Impact from day one | Ownership and autonomySenior-level Full TimeSan Francisco or New York City R1d ago
-
Sr. Data Engineer I (6436) USD 128K-138KAsync Programming | Caching Strategies | ETL | Evaluation Frameworks | Functional Programming401k | Dental insurance | Dependent care | Employee assistance | Flexible workSenior-level Full TimeHybrid - Local to D.C. metro … R1d ago
-
Machine Learning Engineer USD 150K-190KAPIs | CI/CD | Cloud Platforms | Containerization | Data EngineeringMid-level Full TimeRemote, United States R1d ago
-
A/B | A/B Testing | Airflow | Algorithms | B testingBenefits | Bonus | Employee travel credits | Equity | Inclusive cultureSenior-level Full TimeRemote-USA R1d ago
-
Software Engineer, Compute (8+ YOE) USD 196K-339KAWS | ArgoCD | CI/CD | CRDs | CloudFormationBenefits | Incentive compensation | Stock optionsSenior-level Full TimeSan Francisco, CA; New York, NY; … R1d ago
-
Data Analyst/BI Engineer USD 85K-110KAPI Integration | Apps Script | Automation | Azure | BigQuery401k | Company holidays | Dental | Healthcare | MatchingSenior-level Full TimeUnited States R1d ago
-
Senior Software Engineer - Data Engineering USD 85K-150KAWS | Apache Airflow | Apache Kafka | Cloud Engineering | Data WarehousingAccident | Critical illness | Dental | Disability | FSASenior-level Full Time601 S. Tryon Street, NC R1d ago
-
Business Intelligence Engineer USD 107K-204KAgile | Cloud analytics | DAX | Data Governance | Data ModelingBackup childcare | Educational assistance | Flexible schedules | Healthcare | Parental leaveSenior-level Full TimeUS-MA-REMOTE, United States R2d ago
-
Databricks Platform Engineer USD 97K-164KAgile | Apache Spark | CI/CD | Cloud Platforms | Data EngineeringCareer growth potential | H1B sponsorship potential | Remote workMid-level Full TimeUnited States - Remote R2d ago
-
Spark Engineer USD 110K-128KAWS EMR | Apache Spark | Azure Databricks | CI/CD | DataframesCareer growth | Equal employment opportunity | Inclusive environment | Remote workMid-level Full TimeUnited States - Remote R2d ago
-
Data Engineer USD 113K-151KAirbyte | BI tools | CI/CD | Cloud Data | Cloud Data Warehouses401k plan | Bereavement leave | Career purpose | Community service day | Medical, dental coverageMid-level Full TimeRemote (Texas, US); Remote (Arizona, US); … R2d ago
-
Senior Analytics Engineer USD 138K-166KAirflow | Automation | DBT | Data Governance | Data ModelingBenefits | EquitySenior-level Full TimeSan Francisco, CA, New York, NY, … R2d ago
-
Data Engineer USD 120K-135KApache Spark | Azure Databricks | Azure Functions | CICD | Data Modeling401k matching | Disability insurance | Flexible spending | Health/Dental/Vision | Learning opportunitiesMid-level Full TimeRemote - United States R2d ago
-
Senior Machine Learning Engineer USD 144K-204KAWS | Argo Workflows | Azure | Data Pipelines | DevOps401k match | Benefits from day one | Bonus | Dental | EquitySenior-level Full TimeRemote (US/Canada) R2d ago
-
Senior Data Engineer, working in AWS USD 135K-187KAWS EMR | AWS Glue | Apache Spark | Batch Processing | Data ArchitectureCollaborative environment | Flexible work arrangements | Professional developmentSenior-level Full TimeRemote - United States R2d ago
-
Senior Sales Engineer - Majors Northeast USD 149K-198K.NET | CRM management | Competitive Analysis | Customer Engagement | GoGlobal benefits | Inclusive culture | Mentorship | Onboarding | Professional developmentSenior-level Full TimeNew Jersey, USA, Remote R2d ago
-
Senior AI Engineer – Data and AI USD 130K-180KAI infrastructure | AI model governance | API frameworks | CD pipelines | CI/CDFamily support programs | Hybrid work opportunity | Medical, dental & vision coverage | Paid Holidays | Paid time offSenior-level Full TimePlano, TX, United States R2d ago
-
Senior AI Engineer – Data and AI USD 125K-165KAI model governance | API frameworks | CI/CD | Cloud Native | Cloud-native development401k match | Family support | Hybrid work option | Medical/Dental/Vision | Paid HolidaysSenior-level Full TimeCamas, WA, United States R2d ago
-
Data Engineer USD 108K-145KCloud Storage | Data Automation | Data Management | Data Pipeline Architecture | Data SecurityMid-level Full TimeRemote SD (Central Time), United States R3d ago
-
Anomaly Detection | Automation frameworks | Clustering | Data Analysis | Distributed SystemsEntry-level Full Time6314 Remote/Teleworker US, United States R3d ago
-
Senior Data Engineer USD 180K-200KAWS | Cloud Storage | Data Architecture | Data Lakes | Data ModelingDental | Equity | Flexible PTO | Medical | Remote workSenior-level Full TimeRemote, US or Canada - NYC … R3d ago
-
Staff AI Infrastructure Engineer USD 170K-234KAWS | ArgoCD | Azure | Bash | CloudPlatforms401k | Dental | DisabilityInsurance | LifeInsurance | MedicalSenior-level Full TimeUnited States - Remote R3d ago
-
Computer Vision Engineer USD 115K-172K3D Reconstruction | APIs | C++ | Cloud Platforms | Geospatial DataDental | Flexible PTO | Life insurance | Medical | Remote workMid-level Full TimeRemote US R3d ago
-
Professional Services Engineer (East Coast) USD 153K-221KAI tools | Collaboration | Customer Success | JavaScript | PythonBenefits | Incentive compensation | Stock optionsMid-level Full TimeRemote - US R3d ago
-
Senior-level Full TimeRemote, VA, US R3d ago