Senior Machine Learning Engineer, Runtime and Serving
Tasks
- Architect ML runtime and serving system
- Build profiling and benchmarking tooling
- Collaborate on system level ML workload analysis
- Develop features for ML inference
- Extend ML compilers and runtimes
- Identify end to end ML bottlenecks
- Integrate ML inference runtimes
- Migrate ML workloads to JAX native runtime
- Optimize hardware aware compute
Perks/Benefits
- N/A
Skills/Tech-stack
Benchmarking | Buffer management | C++ | CUDA | Concurrent Systems | Continuous batching | Custom silicon | Data transfer | Deep learning | Distributed Systems | GPUs | JAX | KV caching | Low Latency | Low-Latency Systems | Machine Learning | Machine Learning Runtime | Model Compression | Model Optimization | Model Serving | ONNX Runtime | OpenXLA | PJRT | Prefix caching | Profiling | PyTorch | Python | Shared Memory | TPUs | TVM | Tensor Buffer Management | Tensor operations | TensorRT | Triton | XLA | Zero copy | Zero-copy data transfer
Education
Regions
Countries
States
Related jobs
-
Featured Feat. Applied AI Engineer - Bay Area USD 211K-263KArtificial Intelligence | C plus plus | C# | Embeddings | Feature Engineering401k | Comprehensive health and wellness benefits | Learning and development opportunities | Unlimited time offMid-level Full TimeHQ (San Francisco)27d ago
-
Data Engineer USD 76K-121KAWS | Airflow | Apache Airflow | Cloud Data | Cloud Data Warehouse401k matching | Dental insurance | Disability coverage | Life insurance | Medical insuranceMid-level Full TimePiscataway, NJ, US3h ago
-
Advanced Analytics - Vet USD 109K-155KAutomation | Cloud Storage | Data Engineering | Data Governance | Data ModelingMid-level Full TimeOverland Park, KS, US3h ago
-
Advanced Analytics - Retail USD 109K-155KAWS | Cloud Computing | Cloud Storage | Data Governance | Data Pipelines401k matching | Dental insurance | Disability insurance | Life insurance | Medical insuranceMid-level Full TimeOverland Park, KS, US3h ago
-
Bluetooth Low Energy | C# | C++ | Cryptography | Efficiency optimization401k matching | Career Development Programs | Corporate discounts | Dental insurance | Disability insuranceSenior-level Full TimeLos Angeles, CA, US R4h ago
-
Altium Designer | BLE | Bluetooth Low Energy | Bring-up | C++401k matching | Corporate discounts | Dental insurance | Disability insurance | Employee assistance programMid-level Full TimeLos Angeles, CA, US R4h ago
-
Data Engineer, Infrastructure FinOps USD 146K-194KAPI Design | BigQuery | CI/CD | CloudFormation | DBTMid-level Full TimeCosta Mesa, California, United States9h ago
-
Senior Software Engineer, Data Platform USD 166K-220KAWS | Amazon Athena | Apache Iceberg | Apache Spark | AzureSenior-level Full TimeCosta Mesa, California, United States9h ago
-
Senior-level Full TimeCosta Mesa, California, United States9h ago
-
Staff Data Scientist (Pricing) USD 179K-269KBehavioral Modeling | Causal Inference | Causal measurement | Choice Modeling | Contextual Bandits401k matching | Dental insurance | Employee learning development programs | Employee recognition programs | Financial assistance for hybrid workSenior-level Full TimeSan Francisco, CA10h ago
-
Ad Ranking | Agentic Workflows | Automl | Deep learning | Distributed Systems401k matching | Dental insurance | Employee assistance program | Health insurance | Paid time offSenior-level Full TimePalo Alto, California, USA10h ago
-
Senior Data Engineer USD 135K-168KAWS | Airflow | Amazon Redshift | Data Modeling | Data Warehousing401k | Flexible work arrangement | Health insurance | Mentorship program | Paid time offSenior-level Full TimePlano, TX12h ago
-
AI Full Stack Developer & Architect USD 140K-161KCloud Run | Kubernetes | MLOps | Machine Learning | Next.jsSenior-level Contract Full TimeSan Jose, CA, United States15h ago
-
Data & AI Platform Engineer USD 95K-155KAI Search | APIs | AWS | Airflow | ArcGIS401k matching | Dental insurance | Health insurance | Life insurance | Paid HolidaysSenior-level Full TimeRemote, United States R15h ago
-
Sr Data Engineer USD 100K-120KAPIs | AWS | AWS Glue | Airflow | Amazon RedshiftFully remote | Mentorship | On-call supportSenior-level Full TimeOrlando, FL, United States R16h ago
-
Embedded Software Verification & UI Programmer USD 90K-120KC# | DO-178B | DO-178C | LDRA | MCDC401k match | Certification assistance | Dental insurance | Disability insurance | Flexible workplaceSenior-level Full TimeWilmington, NC16h ago
-
Equities Data Engineer USD 175K-200KApache Iceberg | Apache Kafka | Apache Spark | CI/CD | Linux401k employer match | Dental insurance | Flexible spending account | Health insurance | Health savings accountMid-level Full TimeChicago, New York16h ago
-
Senior Engineer, Inference Control Plane USD 139K-174KAPI Gateway | Capacity Planning | Distributed Systems | Fault Tolerance | GPU UtilizationEmployee assistance program | Employee stock purchase program | Flexible time off | LinkedIn Learning access | Reimbursement for training and educationSenior-level Full TimeSeattle17h ago
-
Mid-level Full TimeNew York17h ago
-
Machine Learning Engineer USD 72K-131KCI/CD | Data Fusion | Data Pipelines | Data analytics | Deep learningHybrid work environment | MentorshipSenior-level Full TimeMelbourne, Florida, United States17h ago
-
Forward Deployment AI Engineer USD 120K-150KAgent Orchestration | Anthropic API | Autogen | Chroma | Cloud servicesClient facing work environment | Client site travel | Professional development opportunitiesMid-level Full TimeCleveland | Tampa | San Diego …17h ago
-
Junior Machine Learning Engineer USD 64K-106KCI/CD | Data Fusion | Data analytics | Data sets | Deep learningComprehensive benefits package | Hybrid work environment | Supportive work environment | US security clearance supportedEntry-level Full TimeMelbourne, Florida, United States17h ago
-
Staff Machine Learning Systems Engineer (MLOps) USD 210K-250KAWS EKS | Alerting | Autoscaling | CI/CD | ClickHouseFlexible remote work | Healthcare industry domain experienceSenior-level Full TimeUS Remote R18h ago
-
AI Researcher, LLMs USD 200K-300KDeep learning | Distributed Training | GPU Computing | Language Models | Large Language ModelsHealth benefits | Performance bonus | Retirement benefitsEntry-level Full TimeLondon, United Kingdom; New York, NY, …19h ago
-
Senior Machine Learning Platform Engineer USD 155K-215KAI Observability | AWS SageMaker | Alerting | Amazon ECS | Audio ProcessingOn-call rotationSenior-level Full TimeNew York, NY20h ago