LLMOps Engineer
Tasks
- Apply prompt protections
- Automate model versioning
- Build and maintain LLM pipelines
- Build monitoring and observability
- Conduct root cause analysis
- Deploy and host model endpoints
- Deploy updated prompts and models safely
- Develop embedding pipelines
- Document workflows and runbooks
- Enable alerting and logging
- Ensure scalability testing and integration
- Filter model outputs
- Implement CI/CD pipelines
- Implement MLSecOps guardrails
- Implement retrieval layers
- Integrate vector databases
- Maintain operational best practices
- Manage containers and microservices
- Manage datasets
- Monitor model outputs and performance
- Optimize inference runtimes
- Perform input validation
- Set up metrics dashboards
- Support automated testing and evaluation
- Support deployment to production
- Track configuration for reproducible development
- Troubleshoot operational incidents
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Agile | Alerting | Azure | CD | CI | CI/CD | Cloud platform | Configuration Management | Containerization | Dataset Management | DevSecOps | Docker | Embedding Models | Google Cloud | Google Cloud Platform | Input validation | Kubernetes | LLM Inference | Logging | Metrics | Microservices | Model versioning | Monitoring | Observability | Output filtering | Prompt engineering | Python | RAG | Retrieval-Augmented Generation | Security | Unit Testing | Vector Databases
Education
Roles
Related jobs
-
Senior-level Full TimeAnnapolis Junction, United States R3h ago
-
Mid-level Full TimeBedminster, United States3h ago
-
Software Engineer, Parallel Scientific Computing USD 130K-190KBenchmarking | C++ | CUDA C++ | Computer Architecture | High PerformanceEntry-level Full TimeRedwood City3h ago
-
Software Engineer, Scientific Computing USD 130K-190KCUDA | Inverse problems | Numerical Methods | Performance optimization | PythonEntry-level Full TimeRedwood City3h ago
-
Entry-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL3h ago
-
Data Engineer III USD 124K-207KAmazon Web Services | Apache Spark | Cloud platform | Databricks | Google CloudAbility to obtain security clearance | Professional developmentSenior-level Full TimeRosslyn, Virginia, United States4h ago
-
Senior Data Engineer USD 179K-318KAI/ML | Apache Airflow | Big Data | Data Deduplication | Data MatchingHealth insurance | Holiday pay | Learning and development | Life insurance | Long-term disabilitySenior-level Full TimeUSA-VA-Chantilly5h ago
-
Agent Evaluation & Evolution Machine Learning Engineer Intern (AML-Ark-US) - 2027 Summer USD 162K-316KAutomation | Benchmarking | Data Analysis | Language Models | Language ProcessingCareer development workshops | Hands-on projects | Industry exposure | Social eventsEntry-level InternshipSan Jose, California, United States5h ago
-
Visual Generation & Multimodal Evaluation Machine Learning Engineer Graduate (AML-Ark-US) - 2027 Start USD 128K-256KAutomated metrics | Computer Vision | Data Engineering | Data Pipelines | Deep learningEntry-level Full TimeSan Jose, California, United States5h ago
-
Data Lake Infrastructure & Data Analytics Research Engineer Graduate (AML-Ark-US) - 2027 Start USD 128K-256KAnalytics | Batch Processing | Data Engineering | Data Governance | Data LakeEntry-level Full TimeSan Jose, California, United States5h ago
-
Data Lake Infrastructure & Data Analytics Research Engineer Graduate (AML-Ark-US) - 2027 Start (PhD) USD 162K-316KBatch Processing | Data Engineering | Data Governance | Data Lake | Data QualityEntry-level Full TimeSan Jose, California, United States5h ago
-
Autoscaling | Containerd | Disaster Recovery | Docker | FinOpsEntry-level Full TimeSan Jose, California, United States5h ago
-
Autoscaling | Cluster scheduling | Container Runtime | Cross cluster | Cross-cluster schedulingEntry-level Full TimeSan Jose, California, United States5h ago
-
Autoscaling | Cluster scheduling | Container Runtime | Cross cluster | Cross-cluster schedulingEntry-level Full TimeSan Jose, California, United States5h ago
-
Autoscaling | Cluster scheduling | Container Runtime | Cross cluster | Cross-cluster schedulingEntry-level Full TimeSeattle, Washington, United States5h ago
-
Autoscaling | Container Runtime | Disaster Recovery | Docker | ElasticityEntry-level Full TimeSeattle, Washington, United States5h ago
-
Autoscaling | Container Runtime | Disaster Recovery | FinOps | KubernetesEntry-level Full TimeSeattle, Washington, United States5h ago
-
Agent Evaluation & Evolution Machine Learning Engineer Graduate (AML-Ark-US) - 2027 Start USD 121K-243KBenchmarking | Data Pipelines | Fine Tuning | Human evaluation | LLM EvaluationEntry-level Full TimeSeattle, Washington, United States5h ago
-
Agent Evaluation & Evolution Machine Learning Engineer Intern (AML-Ark-US) - 2027 Summer USD 162K-316KBenchmarking | Data Analysis | Deep learning | Language Models | Language ProcessingDevelopment workshops | Industry exposure | Learning programs | Social eventsEntry-level InternshipSeattle, Washington, United States5h ago
-
Visual Generation & Multimodal Evaluation Machine Learning Engineer Graduate (AML-Ark-US) - 2027 Start USD 121K-243KComputer Vision | Data pipeline | Deep learning | Fine Tuning | Language ModelsEntry-level Full TimeSeattle, Washington, United States5h ago
-
Data Lake Infrastructure & Data Analytics Research Engineer Graduate (AML-Ark-US) - 2027 Start USD 121K-243KApache Kafka | Apache Spark | Batch Processing | Cloud Computing | Data GovernanceEntry-level Full TimeSeattle, Washington, United States5h ago
-
Research Engineer, Data Lake Infrastructure & Data Analytics Graduate (AML-Ark-US) - 2027 Start (PhD) USD 153K-300KApache Flink | Apache Spark | Data Governance | Data Lake | Data QualityEntry-level Full TimeSeattle, Washington, United States5h ago
-
LLM AIOps Development Engineer - Data Center Networking USD 157K-256KBGP | CI/CD | ClickHouse | Deep learning | DockerMid-level Full TimeSan Jose, California, United States5h ago
-
LLM AIOps Development Engineer - Data Center Networking USD 157K-256KAgentic Systems | Anomaly Detection | BGP | CI/CD | Cause analysisMid-level Full TimeSeattle, Washington, United States5h ago
-
Autoscaling | Containerization | Disaster Recovery | FinOps | GPU resource managementEntry-level Full TimeSan Jose, California, United States6h ago