Staff ML/LLM Ops Engineer
USD 213K-272K Senior-level Full Time
Tasks
- Add input output filtering and jailbreak refusal monitoring
- Build model CI CD path
- Create generative evaluation and regression suites
- Define model platform API contract boundary
- Deploy and rollback models
- Implement LLM VLM and agent workload lifecycle
- Monitor drift and quality
- Own model lifecycle end to end
- Own retrieval and agent operational seams
- Set technical standards and mentor engineers
- Track token level cost and latency
Perks/Benefits
Skills/Tech-stack
API Design | Argo | CI/CD | Cost monitoring | Deployment and Rollback | Drift Detection | Generative Evaluation | Guardrails | Input Output | Input Output Filtering | Jailbreak Monitoring | Kubernetes | LLMOps | Latency monitoring | MLOps | Model CI/CD | Model Registry | Model Serving | Model versioning | Output filtering | Prompt versioning | Request Tracing | Retrieval Operations | Token Cost | Token Cost Monitoring | Vector Databases
Education
Roles
Engineer | LLM Ops Engineer | ML Ops Engineer | Ops Engineer
Related jobs
-
Software Engineer III, AI/ML, Proxybidder ML USD 147K-211KC++ | Data Processing | Debugging | JAX | KerasBenefits | Bonus target | EquitySenior-level Full TimeNew York, NY, USA1h ago
-
Software Engineer, Google Cloud Storage USD 147K-211KAccess Control | C++ | Chaos Engineering | Cloud Functions | Cloud StorageMid-level Full TimeRaleigh, NC, USA; Durham, NC, USA1h ago
-
Machine Learning Engineer USD 130K-170KAirflow | CI/CD | DBT | Docker | ELT401k match | Dental insurance | Disability coverage | Life insurance | Medical insuranceSenior-level Full TimeNew York, NY, US5h ago
-
Senior Principal Engineer- MLOps & AI Machinery, ADAS/AV USD 240K-320KASIL | Automation | Automotive Safety | Automotive hardware | Automotive safety standards401k match | Dental insurance | Flexible spending account | Health insurance | Health savings accountExecutive-level Full TimeSunnyvale, CA, United States8h ago
-
AI Software Engineer USD 100K-180KAgile | CI/CD | Code Analysis | Confluence | Data EngineeringCareer progression | World-class benefitsMid-level Full TimeAnnapolis Junction, Maryland, United States8h ago
-
AI Software Engineer-Senior USD 124K-195KAgile | Code Analysis | Confluence | Continuous Delivery | Continuous DeploymentCareer progression | World-class benefitsSenior-level Full TimeAnnapolis Junction, Maryland, United States8h ago
-
AI Analytic Software Engineer-Senior USD 130K-195KAWS Amplify | AWS Bedrock | Confluence | Docker | ElasticsearchCareer progression | World-class benefitsSenior-level Full TimeAnnapolis Junction, Maryland, United States8h ago
-
Sr. AI Engineer USD 150K-175KAccess Control | Agentic Frameworks | Auditability | CI/CD | Cloud Native401-k match | Dental insurance | Expense Reimbursement for Home Office | Life insurance | Medical insuranceSenior-level Full TimeRemote, USA, United States R9h ago
-
Data Platform Engineer USD 125K-188KAPI Gateway | AWS | AWS Glue | AWS Kinesis | AWS LambdaEmployee discounts | Matching 401-K | Medical/Dental/Vision | Paid time off | Wellness programMid-level Full TimeUnited States, San Mateo, CA12h ago
-
Senior Machine Learning Engineer USD 185K-255KApache Spark | CI/CD | Docker | Drift Detection | Feature EngineeringEvents and activities | Healthcare coverage | Hybrid work flexibility | Self-managed PTO | SnacksSenior-level Full TimeSeattle, WA13h ago
-
Data Platform Administrator USD 59K-72KAccess Management | Apache Spark | Automation | CI/CD | Data Governance401k employer matching | Birthday leave | Commuter benefits program | Educational assistance | Employer-paid health insuranceSenior-level Full TimeRockville, MD, US13h ago
-
Senior Machine Learning Operations Engineer USD 166K-208KAlerting | CI/CD | Canary Deployment | Champion Challenger | Drift DetectionSenior-level Full TimeSan Francisco, CA, New York, NY, … R14h ago
-
Senior Analytics Engineer I USD 101K-127KAWS | Agile | Azure | Azure Data | Azure Data Factory401k match | Dental insurance | Disability insurance | Equity compensation | Food and drinksSenior-level Full TimeLong Beach, CA15h ago
-
AI Lead Developer - Aerospace USD 145K-175KAPIs | AWS | Agent systems | Agentic AI | CI/CDCareer growth opportunities | Comprehensive benefits | Hybrid work schedule | MentorshipSenior-level Full TimeHerndon, Virginia15h ago
-
Senior Machine Learning Platform Engineer USD 170K-220KAWS SageMaker | Alerting | Amazon ECS | CI/CD | Container OrchestrationNYC office onsite | On-call rotationSenior-level Full TimeNew York, NY16h ago
-
Senior Software Engineer II, Applied AI USD 185K-232KAPI Design | Driven systems | Edge-to-cloud | Evaluation Framework | Event Driven401k match | Employee equity program | Flexible PTO | Health, dental, vision coverage | Retirement benefitsSenior-level Full TimeSeattle, Washington, United States16h ago
-
Senior Software Engineer, Content Storage Gateway USD 198K-248KAmazon Web Services | Cloud Computing | Cloud platform | Distributed Systems | GoSenior-level Full TimeRedwood City, CA16h ago
-
Senior-level Full TimeUnited States16h ago
-
Software Engineer, Data Platform USD 160K-200KAWS | Airflow | Azure | Dagster | Data WarehousingReasonable accommodations during interview process | Relocation assistanceMid-level Full TimeSan Francisco Bay Area16h ago
-
Staff Analytics Engineer USD 109K-125KAmazon Redshift | Automated testing | BigQuery | CI/CD | Cloud Data401k plan | Coaching | Flexible spending account | Flexible vacation policy | Healthcare coverageSenior-level Full TimeUnited States R16h ago
-
Senior-level Full TimeUnited States (Remote) R16h ago
-
Forward Deployed AI Product Engineer USD 167K-200KAI Evaluation | AI guardrails | CI/CD | Data Pipelines | Data TransformationOn site client collaboration | Remote work | Travel opportunitiesSenior-level Full TimeUS-Remote R16h ago
-
Senior AI Software Engineer (Agentic AI) USD 145K-196KAPI Gateway | Async request handling | Async/Await | Authentication | Automated testingCollaborative team | Health and wellness programs | Remote-friendly environmentSenior-level Full TimeBoston, MA17h ago
-
Application Software Engineer, Inference USD 135K-185KAgent Orchestration | Agent SDK | Auto Scaling | Batch scheduling | C++401k plan | Employee stock purchase plan | Long-term incentives | Medical, dental & vision coverage | Onsite Palo AltoEntry-level Full TimePalo Alto, CA17h ago
-
Forward Deployed AI Engineer - Lead USD 180K-250KAPI Design | Agent systems | Artificial Intelligence | Cloud Computing | Data Engineering100 percent covered medical dental and vision | 401k | Commuter benefits | Hybrid work model | In-office lunchSenior-level Full TimeSan Francisco17h ago