ML Systems Engineer
Tasks
- Build model serving systems
- Configure autoscaling
- Design inference platforms
- Ensure end-to-end observability
- Implement batching
- Implement caching
- Implement request routing
- Operate high throughput low latency services
- Optimize GPU utilization
- Perform performance engineering and capacity planning
- Respond to incidents
Perks/Benefits
- N/A
Skills/Tech-stack
API Integration | Autoscaling | C++ | Capacity Planning | Distributed Systems | FinOps | GPU Architecture | Go | Kubernetes | LLM Inference | Machine Learning | Memory Management | Metrics | Model Compression | Model Quantization | Multi-region | Multi-region deployment | Observability | Performance Engineering | Python | Region deployment | Rust | Structured Logging | TensorRT-LLM | Tracing | VLLM
Education
Roles
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R18d ago
-
Charm Security-Forward Deployed AI Engineer USD 140K-200KAI Agents | API | Agentic Workflows | Automation | Backend DevelopmentCustomer Site Workshops | Travel opportunitiesMid-level Full TimeRemote, OR, US R10h ago
-
Data Engineer - AI, Hybrid USD 137K-200KDBT | Data Cleansing | Data Imputation | Data Modeling | Data Quality401k matching contribution | 401k plan | Disability coverage | Hybrid work model | Life insuranceSenior-level Full TimeUSA-RESEARCH TRIANGLE PARK, United States R22h ago
-
Staff Data Eng, Data Systems, TCGplayer USD 136K-228KAccess Control | Change Data Capture | Cost Management | Data Capture | Data Governance401k eligibility | Medical benefits | Paid time off | Parental leave | Remote work not available for U S visa sponsorshipSenior-level Full TimeRemote Oregon, United States R22h ago
-
Senior-level Full TimeUnited States - Remote R22h ago
-
AI Interaction Designer USD 140K-155KAgent Frameworks | Deterministic systems | Embeddings | Evaluation | LLM APIsRemote workMid-level Full TimeUnited States - Remote R22h ago
-
AI Research Engineer USD 100K-150KAccelerators | Computer Vision | Data labeling | Deep learning | Distributed TrainingSenior-level Full TimeUnited States - Remote R22h ago
-
Analytics Data Engineer USD 100K-120KAWS | Artificial Intelligence | Automation Scripting | Azure | CI/CD401k matching | All-hands meetings | Cell phone reimbursement | Dental insurance | FSA accountSenior-level Full TimeUnited States - Remote R22h ago
-
Big Data Application Developer USD 100K-150KAWS EMR | Airflow | Apache Atlas | Apache Flink | Apache HBaseRemote workSenior-level Full TimeUnited States - Remote R22h ago
-
Hadoop Big Data Developer USD 100K-150KAirflow | Apache Atlas | Apache Flink | Apache Hive | Apache HudiRemote workSenior-level Full TimeUnited States - Remote R22h ago
-
Data Engineer USD 72K-130KApache Spark | Azure | Azure Data | Azure Data Factory | Azure Data Lake401k contribution | Career development opportunities | Comprehensive benefits package | Equity stock purchase | Incentive and recognition programsSenior-level Full TimeEden Prairie, Minnesota, UNITED STATES; REMOTE R22h ago
-
AI Data Engineer USD 100K-150KApache Beam | CI/CD | Caching | Code review | CompressionRemote workSenior-level Full TimeUnited States - Remote R22h ago
-
ML Data Engineer USD 100K-150KApache Beam | CI/CD | Code review | Data Lineage | Data ModelingCareer growth | Remote workMid-level Full TimeUnited States - Remote R22h ago
-
Data Platform Engineer USD 100K-150KAutoscaling | C++ | CUDA | Capacity Planning | Distributed SystemsCareer growth | Remote workSenior-level Full TimeUnited States - Remote R22h ago
-
Embedded Robotics Engineer USD 125K-145KC++ | Concurrent programming | Control Systems | Critical software | DebuggingCareer growth | Remote workSenior-level Full TimeUnited States - Remote R22h ago
-
LLM Engineer USD 100K-150KDPO | Dataset curation | DeepSpeed | Evaluation | FSDPCareer growth | Remote work opportunitySenior-level Full TimeUnited States - Remote R22h ago
-
Machine Learning Engineer – RL USD 155K-180KDeep learning | GPU Computing | Hierarchical reinforcement learning | Multi-Agent | Multi-Agent Reinforcement LearningCareer growth potential | Full time direct employment | H1B transfer support | Remote workSenior-level Full TimeUnited States - Remote R22h ago
-
Azure Data and MLOps Engineer USD 116K-222KActive Directory | Azure Active Directory | Azure Data | Azure Data Factory | Azure Data Lake401k match | Company paid life insurance | Company paid vision plan | Company-paid disability insurance | PTOSenior-level ContractUnited States - Remote R22h ago
-
Prompt Engineer USD 100K-150KAgent Frameworks | Embeddings | Evaluation Pipelines | Fine Tuning | LLM APIsSenior-level Full TimeUnited States - Remote R22h ago
-
Robotics Software Engineer USD 100K-150KBehavior Trees | C++ | Concurrent programming | Control Systems | Embedded SystemsCareer growth | Mentorship | Remote workSenior-level Full TimeUnited States - Remote R22h ago
-
Robotics Solutions Engineer USD 100K-150KC++ | Concurrent Systems | Control | Debugging | GazeboCareer growth | Mentorship | Remote workSenior-level Full TimeUnited States - Remote R22h ago
-
AI Operations Engineer USD 150K-165KApache Beam | CI/CD | Code review | Data Lineage | Data ModelingCareer growth | Full-time employment | Remote workSenior-level Full TimeUnited States - Remote R22h ago
-
Senior-level Full TimeWestford, MA R22h ago
-
Model Optimization Engineer USD 150K-175KC++ | Compiler optimization | Cutlass | Deep learning | DeepSpeedSenior-level Full TimeUnited States - Remote R22h ago
-
ABAC | AI Agents | API Integration | Artificial Intelligence | Audit LoggingRemote workMid-level Full TimeRemote USA R1d ago