LLMOps Engineer
Tasks
- Apply input validation
- Automate model versioning
- Automate testing and evaluation
- Build CI/CD pipelines
- Build embedding pipelines
- Configure inference runtimes
- Create metrics dashboards
- Develop monitoring components
- Document workflows and runbooks
- Enforce prompt protections
- Ensure scalability and testing
- Filter model outputs
- Implement LLM pipelines
- Implement MLSecOps guardrails
- Implement logging for model outputs
- Implement retrieval layers
- Integrate vector databases
- Maintain model hosting endpoints
- Manage datasets
- Optimize containers and microservices
- Perform root cause analysis
- Set up alerting
- Support deployment of LLM systems
- Support safe deployment of prompts and models
- Track configuration for reproducible development
- Troubleshoot operational incidents
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Agile | Automated testing | Azure | CI/CD | Containerization | Docker | Embeddings | Google Cloud | Hugging Face | Hugging Face Transformers | Inference | Input validation | Kubernetes | Langchain | Learning operations | Llamaindex | Logging | MLOps | MLSecOps | Machine Learning | Machine Learning Operations | Microservices | Monitoring | Observability | Prompt engineering | Python | RAG | Retrieval-Augmented Generation | Vector Databases
Education
N/A
Roles
Related jobs
-
AI | ClickHouse | Confluence | ETL | Git401k match | Educational assistance | Federal Holidays | Health insurance | Paid time offMid-level Full TimeColumbia, Maryland1d ago
-
Data Governance | Data Modeling | Data Structures | Data pipeline | Java401k matching | Educational assistance | Federal Holidays | Healthcare coverage | Paid time offMid-level Full TimeAnnapolis Junction, Maryland1d ago
-
Software Engineer 1 - (Python, UI/UX, LLMs) USD 163K-199KAWS | Argo CD | CI/CD | Containerization | Docker401k match | Educational assistance | Federal Holidays | Health insurance | Paid time offMid-level Full TimeAnnapolis Junction, Maryland1d ago
-
Software Engineer 1 - (AI, Python, LLMs) USD 163K-199KAWS | Argo CD | CI/CD | Docker | Helm401k match | Federal Holidays | Health insurance | Paid time offMid-level Full TimeAnnapolis Junction, Maryland1d ago
-
Software Engineer, Machine Learning Infrastructure USD 140K-230KAPI Development | AWS | Airflow | Alerting | CI/CD401k access | Flexible PTO | Health, dental, vision coverage | Paid mealsMid-level Full TimeSan Francisco, CA, US1d ago
-
APIs | AWS | Apache Spark | Azure | Azure Data401k matching | Dental insurance | Flexible working arrangements | Health insurance | Life insuranceSenior-level Full TimeSkokie, United States1d ago
-
Anomaly investigation | Bitbake | Bitbucket Pipelines | C# | C++Travel up to 20 percentMid-level Full TimeHerndon, United States1d ago
-
Data Engineer, PDPO - Offense & Defense USD 147K-269KApache Spark | ClickHouse | Data Modeling | Data Warehousing | Distributed SystemsEntry-level Full TimeSan Jose, California, United States1d ago
-
Software Engineer Systems Machine Learning - Frameworks USD 112K-166KC# | C++ | CPU | CUDA | Compiler optimizationEntry-level Full TimeSunnyvale, CA | Bellevue, WA1d ago
-
Research Scientist, ML H/W-SW Codesign USD 177K-251KC# | C++ | Deep learning | GPU Architecture | Hardware accelerationMid-level Full TimeSunnyvale, CA1d ago
-
Robotics Verification & Validation Engineer USD 170K-230KAI Risk | AI Risk Assessment | Automated testing | Bias Mitigation | C++Senior-level Full TimeBurlingame, CA1d ago
-
Senior Software Developer, Machine Learning, Applied AI USD 174K-252KAI Agents | Agentic development | Data Processing | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeSunnyvale, CA, USA; Toronto, ON, Canada1d ago
-
Software Engineer, GenAI Silicon Automation, DeepMind USD 174K-252KABC | Application Programming | Application Programming Interfaces | C++ | CI/CDMid-level Full TimeMountain View, CA, USA1d ago
-
Senior Software Engineer, Search Quality, AI/ML USD 174K-252KAgentic Workflows | Algorithms | Backend Development | C++ | Data StorageSenior-level Full TimeNew York, NY, USA1d ago
-
Data Engineer, gTech Users and Products Engineering USD 106K-150KApache Flume | Data Modeling | Data Pipelines | Data Warehousing | Dimensional dataBonus target | Equity | Health insurance | Paid time off | Retirement planEntry-level Full TimeBoulder, CO, USA1d ago
-
Algorithms | Backend Development | C# | C++ | Code reviewSenior-level Full TimeSunnyvale, CA, USA1d ago
-
Software Engineer III, AI/ML, Keywordless Search Ads USD 147K-210KC++ | Data Processing | Data Storage | Debugging | Distributed ComputingSenior-level Full TimeMountain View, CA, USA1d ago
-
Software Engineer, Google Cloud Storage USD 147K-210KAccess Control | Best practices | Block Storage | C++ | Chaos EngineeringMid-level Full TimeRaleigh, NC, USA; Durham, NC, USA1d ago
-
AI Solutions Engineer USD 123K-178KAI Agents | Azure DevOps | Azure Machine Learning | Bias detection | CI/CDDental insurance | Disability insurance | Medical insurance | Paid time off | Supplemental insuranceSenior-level Full TimeReston, VA, US1d ago
-
Architect, Robotics in the Cloud USD 157K-355KAPI Versioning | Automated testing | Cloud | Continuous Improvement | DebuggingSenior-level Full TimeUnited States1d ago
-
Algorithm Engineer USD 150K-170KCI/CD | Code review | Data labeling | Deep learning | Digital SignalIn person office hubs | Remote work flexibilityMid-level Full TimeBoston, MA / Remote R1d ago
-
Principal Software Engineer - CoreAI USD 142K-274KAzure | Context engineering | Experiment design | Experimentation | Generative AISenior-level Full TimeUnited States, California, Mountain View; United …1d ago
-
Analytics Engineer USD 130K-170KCI/CD | DBT | Data Modeling | Data Quality | Data Quality Testing401k match | Flexible time off | Health benefits day one | Paid caregiver leave | Paid parental leaveSenior-level Full TimeUnited States (Remote) R1d ago
-
Senior Principal Software Engineer, Machine Learning USD 222K-453KA/B | A/B Testing | B testing | Canary Deployment | Capacity PlanningHybrid work model | MentorshipSenior-level Full TimeRemote, US R1d ago
-
Staff Machine Learning Engineer, Shopping Ads USD 230K-322KConversion modeling | Data labeling | Deep learning | Distributed Systems | Feature Engineering401k employer match | Comprehensive healthcare benefits | Family planning support | Flexible vacation | Gender-affirming careSenior-level Full TimeRemote - United States R1d ago