LLM Ops Engineer
Tasks
- Apply quality controls
- Build scalable AI platform
- Design failover strategies
- Develop unified APIs
- Enforce governance standards
- Ensure production readiness standards
- Establish secure compliant AI operations
- Evaluate emerging AI operations technologies
- Implement intelligent routing
- Implement testing frameworks
- Measure service level metrics
- Monitor AI platform performance
- Operate production AI services
- Optimize reliability and cost efficiency
- Protect model access
- Provide self-service tooling
- Safeguard sensitive data
- Set up alerting and dashboards
Perks/Benefits
- 401k matching
- Career development
- Company bonus plan
- Dental insurance
- Health insurance
- Hybrid work
- Incentive and recognition programs
- Vision insurance
Skills/Tech-stack
API Gateway | API Management | Access Control | Alerting | Analytics | Apache Airflow | Failover | High Availability | Inference Optimization | Infrastructure as Code | Kubeflow | Kubernetes | LLM Operations | Load Balancing | MLOps | MLflow | Machine Learning | Machine Learning Ops | Model Serving | Monitoring | Python | RAG | Retrieval-Augmented Generation | Secrets management | Terraform | Vector Databases | “as-code”
Education
N/A
Roles
DevOps | DevOps Engineer | Engineer | LLM Ops Engineer | MLOps Engineer | Ops Engineer
Related jobs
-
ASIC | Accelerometer | Adaptive filtering | C plus plus | C#Entry-level Full TimeSanta Clara, California6h ago
-
Senior Computer Vision Engineer ID72408 USD 170K-240KAnomaly Detection | Clustering | Computer Vision | Edge Computing | Image SegmentationFlexible schedule | Mentorship | Professional growth | TechtalksSenior-level Full TimeMiami, United States R9h ago
-
Senior Computer Vision Engineer ID72408 USD 170K-240KAnomaly Detection | Clustering | Computer Vision | Edge Computing | Image SegmentationFlexible schedule | Mentorship | Professional growth | TechtalksSenior-level Full TimeJacksonville, United States R9h ago
-
Senior Computer Vision Engineer ID72408 USD 170K-240KAnomaly Detection | Clustering | Computer Vision | Computer vision hardware | Data AnalysisFlexible schedule | Mentorship | Personalized growth roadmaps | Tech talksSenior-level Full TimeBaltimore, United States R9h ago
-
Senior Computer Vision Engineer ID72408 USD 170K-240KAnomaly Detection | Clustering | Computer Vision | Data Science | Edge ComputingFlextime | Mentorship | Personalized growth roadmaps | Remote and office options | TechtalksSenior-level Full TimeOrlando, United States R9h ago
-
Senior Computer Vision Engineer ID72408 USD 170K-240KAnomaly Detection | Clustering | Computer Vision | Edge Computing | Fine TuningFlextime | Mentorship | Personalized growth roadmaps | Remote and office options | TechtalksSenior-level Full TimeTallahassee, United States R9h ago
-
Partner Engineer, Generative AI USD 159K-223KAWS | Agent Orchestration | Bias Mitigation | C# | C++Entry-level Full TimeMenlo Park, CA11h ago
-
Enterprise Systems Engineer USD 165K-200KAnsible | As-a-Service | Chef | Configuration Management | Container OrchestrationEntry-level Full TimeMenlo Park, CA11h ago
-
Software Engineer, SystemML - AI Networking USD 124K-220KC# | C++ | CUDA | CUDA programming | Data-parallelEntry-level Full TimeMenlo Park, CA11h ago
-
Customer and Product Solutions Engineer, GenAI USD 127K-182KC++ | CSS | Cloud Platforms | Data Analysis | Gemini APIEquity compensation | Health insurance | Paid time off | Retirement benefitsMid-level Full TimeSunnyvale, CA, USA11h ago
-
Staff Software Engineer, Gen AI, Blackbelt Team USD 207K-300KCloud Architecture | Cloud Computing | Computer Vision | Data Processing | Deep learningSenior-level Full TimeSunnyvale, CA, USA; New York, NY, …11h ago
-
Agentic Integrations | Benchmarking | Data Pipelines | Fine Tuning | Human-in-the-loopSenior-level Full TimeNew York, NY, USA11h ago
-
AI Algorithms | APIs | Backend Services | C++ | Cloud infrastructureMid-level Full TimeSunnyvale, CA, USA11h ago
-
Advertising Systems | Benchmarking | Data Processing | Deep learning | Distributed ComputingSenior-level Full TimeMountain View, CA, USA11h ago
-
Senior Software Engineer, Generative AI, Search Health USD 174K-252KA/B | A/B Testing | B testing | Computer Vision | Data AnalysisSenior-level Full TimeMountain View, CA, USA11h ago
-
RTL Design Engineer, Machine Learning Accelerators USD 138K-197KASIC design | Code review | High Performance | High-Performance Design | Learning algorithmsMid-level Full TimeSunnyvale, CA, USA11h ago
-
Accelerated inference | Android | Application Programming | Application Programming Interfaces | CPUBonus | Equity compensation | Health insurance | Paid time off | Retirement planSenior-level Full TimeSunnyvale, CA, USA11h ago
-
C++ | Co-design | Hardware acceleration | Hardware co-design | Kernel optimizationMid-level Full TimeMountain View, CA, USA; San Francisco, …11h ago
-
Research Engineer, Winslow, DeepMind USD 174K-252KAudio Synthesis | Autoregressive models | Deep learning | Dialog Systems | Diffusion ModelsMid-level Full TimeMountain View, CA, USA11h ago
-
API Development | Azure | Azure Data | Azure Data Factory | Azure Data LakeRemote workSenior-level Full TimeWork from home, VA, United States16h ago
-
A Star | AutoWare | Behavior planning | C Sharp | C#Senior-level Full TimeUnited States, Washington, Redmond21h ago
-
Acceptance Testing | Cause analysis | Data Analysis | Electrical troubleshooting | IMUSecurity screening required | Travel opportunitiesSenior-level Full TimeUnited States, Washington, Redmond21h ago
-
Senior-level Full TimeUnited States22h ago
-
Sr. Forward Deployed Engineer USD 182K-250KAI APIs | AWS | Apache Spark | Application development | Artificial IntelligenceCustomer travel 20 percent timeSenior-level Full TimeSan Francisco, California22h ago
-
Sr. Forward Deployed Engineer USD 182K-250KAWS | Apache Spark | Application development | Artificial Intelligence | AzureCustomer-facing role | Travel 20 percent timeSenior-level Full TimeRemote - Washington D.C. R22h ago