ML Systems Engineer
Tasks
- Build high performance model serving systems
- Design inference platforms
- Ensure end-to-end observability
- Implement caching and autoscaling
- Implement request routing and batching
- Operate production inference services
- Optimize GPU utilization
- Perform capacity planning
- Respond to production incidents
Perks/Benefits
- N/A
Skills/Tech-stack
Autoscaling | C++ | Caching | Capacity Planning | Distributed Systems | Distributed tracing | GPU Architecture | Go | Kubernetes | LLM | Machine Learning | Metrics | Model Inference | Observability | Performance Engineering | Python | Rust | Structured Logging | TensorRT | TensorRT-LLM | VLLM
Education
Roles
Related jobs
-
Senior Machine Learning Engineer USD 160K-200KAWS | CI/CD | Computer Vision | Data Processing | DockerCommuter benefits | Dental insurance | Employee assistance program | Equity | Health insuranceSenior-level Full TimeArlington, VA R21h ago
-
AI/ML Engineer USD 152K-220K3D Reconstruction | 3D Scene | 3D Scene Understanding | AI Agents | Cloud ComputingAgile team collaboration | Fully remote | Production monitoring ownershipMid-level Full TimeSan Francisco, CA (Hybrid) or United … R22h ago
-
Software Engineer I USD 97K-122KBatch inference | Cloud infrastructure | Docker | GPU Optimization | GoConference reimbursement | Education reimbursement | Employee assistance program | Flexible time off | Hybrid workEntry-level Full TimeSeattle R1d ago
-
Data Scientist USD 160K-170KAPI Integration | APIs | Agentic Workflows | Anomaly Detection | Artificial Intelligence401k retirement plan | Employee assistance program | Health Savings Account (HSA) | Life insurance | Long-term disabilityMid-level ContractPhoenix, Arizona, USA R1d ago
-
AI Integrations Staff Engineer USD 150K-230KAI Models | Agent SDKs | Back-end | Back-end development | Data ModelingAutomatic 401k contribution | Bi-annual company retreats | Employee referral program | Equity | Home office setupSenior-level Full TimeRemote R1d ago
-
AI Security Engineer USD 150K-160KAPI Gateway | AWS | Adversarial Testing | Azure | CI/CD401k retirement plan | Employee assistance program | Health savings account | Life insurance | Medical, dental, and visionMid-level ContractBolingbrook, Illinois, USA R1d ago
-
Lead Software Engineer (.Net Core + LLM's) USD 150K-225K.NET | AKS | ASP.Net Core | Airflow | Application Insights401k matching | Childcare assistance | Dental insurance | Disability insurance | Education reimbursementSenior-level Full TimeDallas, Texas, United States R1d ago
-
Senior Data Platform Engineer USD 180K-220KAKS | Airflow | Apache Spark | Azure | Azure SQL401k matching | Childcare assistance | Dental insurance | Disability insurance | Education reimbursementSenior-level Full TimeDallas, Texas, United States R1d ago
-
Argo CD | ArgoCD | CSI | CSI driver | FluxExecutive-level Full TimeRemote, USA, United States R1d ago
-
AI workflow | AI workflow tuning | API Development | AWS | Agentic AIRemote United StatesSenior-level Contract Full TimeChicago, IL / CA, US / … R1d ago
-
Senior Machine Learning Engineer USD 229K-360KA/B | A/B Testing | Amazon S3 | Amazon SageMaker | Apache AirflowDisability benefits | Equity awards | Health insurance | Life insurance | Paid time offSenior-level Full TimeSan Jose, California R1d ago
-
Senior Data Engineer USD 195K-352KAWS | Apache Airflow | Apache Spark | Batch Processing | Cloud platformCommuter benefits | Dental insurance | Disability insurance | Financial wellness support | Health insuranceSenior-level Full TimeAustin, Texas R1d ago
-
Senior Machine Learning Engineer, Search USD 361K-510KA/B | A/B Testing | Apache Airflow | Apache Spark | B testingCommuter benefits | Disability benefits | Equity awards | Health insurance | Life insuranceSenior-level Full TimeSan Jose, California R1d ago
-
Data Engineering Lead USD 174K-220KAmazon Redshift | BI reporting | DBT | Data Modeling | Data Monitoring401k | Health coverage | Hybrid work environment | Paid parental leave | Paid time offSenior-level Full TimeNew York R1d ago
-
Senior Embedded Software Engineer USD 120K-160KAADL | ADA | ARINC 653 | Agile | Atlassian Bitbucket401k match | Career development | Employee assistance program | Low-cost medical dental vision | Paid HolidaysSenior-level Full TimeDenver, CO R1d ago
-
Senior Embedded Software Engineer USD 120K-160KAtlassian Confluence | Atlassian Jira | Atlassian Suite | Bare Metal | Bitbucket401k match | Employee assistance program | Medical/Dental/Vision | Paid Holidays | Paid time offSenior-level Full TimeMarietta, GA R1d ago
-
Staff AI Engineer, GenAI USD 200K-230KAgentic AI | Apache Spark | Azure DevOps | Azure ML | CI/CDPaid caregiver leave | Paid sick leave | Paid vacationSenior-level Full TimeUSA - NY - Remote, United … R1d ago
-
Engineer III - Platform Data Engineer (Remote) USD 120K-180KAWS | Access Management | Apache Airflow | Apache Superset | AzureCompetitive vacation and holidays | Employee networks and volunteering | Paid adoption leave | Paid parental leave | Professional development opportunitiesSenior-level Full TimeUSA NY Remote, United States R1d ago
-
Data Engineer, Senior USD 77K-176KAWS | Agile | Azure | Azure Data | Azure Data FactoryDependent care | Paid leave | Paid training | Professional development | Retirement benefitsSenior-level Full TimeUSA, GA, Atlanta (575 Morosgo Drive … R1d ago
-
AI Platform Engineer USD 130K-180KAPI Gateway | AWS | Authentication | Authorization | AutoscalingCareer growth | Direct W2 employment | Remote workSenior-level Full TimeUnited States - Remote R1d ago
-
Senior AI/ML Engineer USD 145K-235KAI Services | API Integration | AWS | Agent Orchestration | Agent systems401k company match | Advancement opportunities | Collaborative work environment | Community support | Dental insuranceSenior-level Full TimePhoenix AZ, United States R1d ago
-
API Integration | Agentic AI | Artificial Intelligence | CI/CD | DevSecOpsMid-level Full TimeUnited States - Remote R1d ago
-
Global Red Team AI Engineer, AVP USD 90K-153KAPIs | Active Directory | Bash | Cloud Security | Data leakageEducational assistance | Health and wellness benefits | Paid Holidays | Paid maternity and parental bonding leave | Paid sick daysExecutive-level Full TimeWatermark - 410 North Scottsdale Road, … R1d ago
-
Global Red Team AI Engineer, AVP USD 90K-153KAI Governance | AI Security | API Security | Access Management | Active DirectoryEducational assistance | Health and wellness benefits | Paid Holidays | Paid maternity and parental bonding leave | Paid sick daysExecutive-level Full TimeNew Jersey Office - 210 Hudson … R1d ago
-
C# | C++ | CI/CD | Cloud Storage | Compute Cloud401k match | Education assistance | Health care and wellness plans | Paid Holidays | Professional development programsNone Full TimeEl Segundo, United States R1d ago