Sr. Machine Learning Engineer, Foundation Models Inference - Cloud OS & Inference
Tasks
- Author custom GPU kernels
- Build foundation model inference systems
- Collaborate on model architecture from prototype to deployment
- Deploy and operate high throughput services
- Design inference systems architecture
- Develop hardware/software co-design
- Implement inference tooling and systems
- Optimize inference efficiency
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | CUDA | CUDA C++ | Docker | GCP | GPU Programming | Go | JAX | Kubernetes | Multimodal Learning | NVIDIA Triton | NVIDIA Triton Server | OpenAI Triton | PyTorch | Python | SGLang | TGI | TPU Programming | TensorFlow | TensorRT-LLM | Transformers | Triton Server | VLLM
Education
Regions
Countries
States
Related jobs
-
Software Engineer 3 - (Python, LLMs, RAG) USD 232K-283KAI Agents | Backend Development | Distributed Systems | Docker | Elasticsearch401k contribution | Educational assistance | Federal Holidays | Healthcare coverage | Paid time offSenior-level Full TimeAnnapolis Junction, Maryland3h ago
-
Anomaly Detection | Clustering | Data Analysis | Elasticsearch | Exploratory Data Analysis11 federal holidays | 24 days PTO | 401k match | Educational assistance | Healthcare coverageSenior-level Full TimeFort Meade, Maryland3h ago
-
Software Engineer 1 - (Python, LLMs, UI/UX) USD 163K-199KAWS | Argo CD | CI/CD | Containerization | Docker401k matching | Educational assistance | Federal Holidays | Health insurance | Paid time offMid-level Full TimeAnnapolis Junction, Maryland3h ago
-
Senior-level Full TimeTel Aviv-Jaffa, Tel Aviv District, IL R4h ago
-
C++ | Caffe | Deep and Wide | Deep learning | GBDTMid-level Full TimeSeattle, Washington, United States7h ago
-
C++ | Computer Vision | Data Mining | Deep learning | GoEntry-level Full TimeSan Jose, California, United States7h ago
-
Anti-Fraud | Anti-spam | C++ | Computer Vision | GoEntry-level InternshipSeattle, Washington, United States7h ago
-
Algorithms | C++ | Computer Vision | Data Mining | Data StructuresEntry-level Full TimeSeattle, Washington, United States7h ago
-
Low Power Design Methodology and Optimization Engineer USD 192K-278KANSYS | C# | C++ | CPU Benchmarking | CPU microarchitectureSenior-level Full TimeAustin, TX, USA8h ago
-
Senior Full Stack Engineer, Gen AI USD 232K-258KAWS | AWS Bedrock | AWS CDK | Angular | CI/CDHybrid work | Remote work flexibility | Work-life balanceSenior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL9h ago
-
AWS Data Engineer USD 91K-155KAgile | Amazon Elastic Container Service | Amazon Web Services | Apache Airflow | Apache SparkRemote workSenior-level Full TimeMadrid, MD, Spain9h ago
-
API Integration | APIs | Agent systems | Apache Spark | AutomationInternal talks | Learning platform | Remote days | Sports classes | Wellness benefitsEntry-level Full TimeBrooklyn, United States R9h ago
-
MLOps Engineer USD 140K-175KApache Airflow | Dagster | Data Engineering | Distributed Computing | DockerMid-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL9h ago
-
Senior DevOps Engineer USD 124K-170KAWS | AWS CDK | AWS CloudFormation | Amazon CloudWatch | ArgoCDSenior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL12h ago
-
C# | C++ | CVS | Communication Protocols | Confluence401k match | Disability insurance | Education reimbursement | Health insurance | Health savings accountMid-level Full TimeSaint Paul, MN, United States15h ago
-
Research Engineer, Agentic Systems USD 175K-275KData sets | Evaluation Frameworks | Experimentation | Fine Tuning | Language Models401k employer match | Catered lunch | Commuter benefits | Dinner stipend | Generous PTO policyMid-level Full TimeUnion Square, New York City18h ago
-
Lead Infrastructure Engineer - Public Cloud Storage USD 119K-196KAccess Management | Block Storage | Cloud Compliance | Cloud Governance | Cloud Networking401k plan | Adoption reimbursement | Commuter benefits | Critical caregiving leave | Critical illness insuranceSenior-level Full Time111432-TX-Las Colinas Bldg A, Irving Campus, …19h ago
-
APIs | Agent Orchestration | Chunking | Cloud infrastructure | Context AssemblyDirect collaboration with founders | High ownership | In-office Flexibility | In-office collaboration | Remote workSenior-level Full TimeSan Francisco, CA; New York, New …19h ago
-
Mid-level Full TimeCoral Springs, Florida, United States19h ago
-
AI Engineering Specialist USD 110K-182KAPI Development | CI/CD | Cloud | Containers | Generative AISenior-level Full TimeCoral Springs, Florida, United States19h ago
-
Insights & Analytics Senior Specialist USD 93K-140KAPI Integration | AWS | Attention Mechanisms | Automated testing | Bias MitigationDental insurance | Health insurance | Paid time off | Retirement programs | Vision insuranceSenior-level Full TimeUS - Gaithersburg - MD, United …19h ago
-
Senior Data Analytics Engineer USD 145K-206KAWS | CRM | DBT | Data Model | Data Modeling401k match | Disability insurance | Employee assistance program | Flexible spending account | Health Savings Account contributionSenior-level Full TimeBRIC, United States R19h ago
-
Data Engineer – Python/AI USD 122K-179KArtifactory | CI/CD | Data Modeling | Data Quality | Data TransformationCareer development | Flexible benefits | Inclusive workplaceSenior-level Full TimeCharlotte, United States19h ago
-
Data Scientist III - FCRM USD 96K-155KAML | Agentic AI | Azure | Cloud Data | Cloud Data PlatformsContinuous improvement initiatives | Growth opportunities | Mentorship | Skill developmentSenior-level Full Time11325 North Community House Road, Suite …19h ago
-
Data Scientist III - FCRM Risk Modeling USD 96K-155KAnomaly Detection | Classification | Data Visualization | Data labeling | Fine TuningGrowth opportunities | Skill developmentSenior-level Full TimeMt Laurel - Operations Center Bldg …19h ago