LLMOps Engineer
Tasks
- Build CI/CD pipelines for AI systems
- Build evaluation infrastructure for hallucination and tool call success
- Build sandboxed environments for AI agent repository access
- Create operational playbooks for incident recovery
- Define SLOs for AI system reliability
- Design AWS infrastructure for AI and agent systems
- Design and operate CodeAI development pipeline
- Design environment promotion and automated rollback
- Establish governance and security guardrails
- Handle deployments monitoring and incident response for AI systems
- Implement monitoring with AWS CloudWatch and evaluation dashboards
- Implement secure configuration and secrets management
- Implement versioning for models prompts and LangGraph agent graphs
- Manage integrations with Amazon Bedrock
- Monitor and optimize cost per request
Perks/Benefits
- 401k employer match
- Access to events
- Company holidays
- FSA eligibility
- Free lunch onsite
- HSA eligibility
- Medical, dental, and vision coverage
- Paid time off
- Parental leave
Skills/Tech-stack
AWS | AWS CloudWatch | Amazon Bedrock | CI/CD | Evaluation | Incident Response | Infrastructure as Code | Langgraph | MLOps | Machine Learning | Model versioning | Monitoring | Observability | Prompt engineering | SLO | Secrets management | “as-code”
Education
N/A
Roles
DevOps | DevOps Engineer | Engineer | LLMOps Engineer | MLOps Engineer
Related jobs
-
Research Engineer, Language USD 170K-251KData Processing | Deep learning | Distributed Systems | Efficient Inference | Efficient TrainingEntry-level Full TimeBurlingame, CA1h ago
-
AI/HPC Systems Performance Engineer USD 177K-276KC++ | Host Networking | IB | MPI | Machine LearningMid-level Full TimeMenlo Park, CA1h ago
-
Software Engineer, AI/ML, Geo Data Protection USD 147K-211KC++ | Data Processing | Debugging | Distributed Computing | Information RetrievalMid-level Full TimeMountain View, CA, USA2h ago
-
Software Engineer, AI/ML, Google Ads USD 174K-252KC plus plus | Data Processing | Data Storage | Data Structures | Data Structures and AlgorithmsMid-level Full TimeMountain View, CA, USA2h ago
-
Accelerator Virtualization | Artificial Intelligence | Container Orchestration | Container Runtime | Distributed SystemsSenior-level Full TimeSeattle, WA, USA; Kirkland, WA, USA2h ago
-
Forward Deployed Engineer III, Applied AI, Google Cloud USD 183K-265KAPIs | Agent systems | Chain-of-Thought | Conversational AI | CrewAICollaboration with research and engineering experts | Direct access to DeepMind teams | High travelSenior-level Full TimeSan Francisco, CA, USA; Atlanta, GA, …2h ago
-
Software Engineer III, AI/ML, Display Ads USD 147K-211KC++ | Data Analysis | Data Processing | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeMountain View, CA, USA2h ago
-
Staff Software Engineer USD 207K-300KArtificial Intelligence | C++ | Computer Vision | Data Processing | Embedding ModelsSenior-level Full TimeMountain View, CA, USA2h ago
-
Application development | C++ | Data Analysis | Data Processing | Data Processing PipelinesMid-level Full TimeSunnyvale, CA, USA2h ago
-
Senior Software Engineer, AI/ML, Google Cloud AI USD 174K-252KC++ | Code review | Data Processing | Debugging | Distributed ComputingSenior-level Full TimeSunnyvale, CA, USA2h ago
-
Senior Software Engineer, AI/ML GenAI, Google Play USD 174K-252KAlgorithms | C++ | Computer Vision | Data Processing | Data StructuresSenior-level Full TimeMountain View, CA, USA2h ago
-
Software Engineer III, AI/ML GenAI, Google Cloud Compute USD 147K-211KAudio generation | C++ | Data Processing | Debugging | Distributed ComputingSenior-level Full TimeKirkland, WA, USA2h ago
-
Senior-level Full TimeBoston, MA8h ago
-
Senior-level Full TimeBelmont, CA, US, 9400213h ago
-
AI Agents | AI Search | AWS | AWS Bedrock | Agentic Workflows401k | Dental insurance | Medical insurance | Paid sick hours | Vision insuranceSenior-level Contract Full TimeRidgefield Park, NJ, United States13h ago
-
Senior Data & ML Engineer USD 151K-205KDBT | Data Governance | Data Observability | Data Quality | Data Security401k match | Dental insurance | Equity | Family planning resources | Flexible vacation policySenior-level Full TimeRemote - USA R13h ago
-
Senior Software Engineer, Knowledge Graph USD 196K-230KData Ingestion | Data Processing | Distributed Systems | Flink | Graph DatabasesSenior-level Full TimeUnited States13h ago
-
Senior Machine Learning Engineer USD 198K-287KArtificial Intelligence | Data Engineering | Fine Tuning | Foundation Models | GenAIOccasional travel for offsites | On-call rotation participation | Reasonable accommodation for applicantsSenior-level Full TimeRemote - US R13h ago
-
Staff Machine Learning Engineer USD 141K-210KCI/CD | Computer Vision | Deep learning | Distributed Training | DockerSenior-level Full TimeSunnyvale, CA, United States13h ago
-
Senior Software Engineer, Data Platform USD 196K-245KAWS | Apache Airflow | Apache Flink | Apache Spark | AzureEquity | Inclusion and reasonable accommodations | Relocation assistanceSenior-level Full TimeSan Francisco Bay Area15h ago
-
Senior AI Technologist USD 122K-180KAWS | Apache Airflow | Apache Spark | Azure | CI/CDFully remote option | Hybrid option | Onsite optionSenior-level Full TimeRaleigh, North Carolina, United States; Albuquerque, … R15h ago
-
Senior AI Systems Engineer USD 122K-188KAlerting | Bash | CI/CD | CMMC | Cause analysisFully remote option | Hybrid option | Onsite optionSenior-level Full TimeRaleigh, North Carolina, United States; Albuquerque, … R15h ago
-
Staff AI Engineer USD 200K-240KAWS | Agentic Workflows | ClickHouse | Distributed Systems | DockerParental leave | Tuition reimbursement | Unlimited PTOSenior-level Full TimeHybrid (NYC Metro) R16h ago
-
Senior AI Engineer USD 170K-205KAWS | Agent Orchestration | Agentic Workflows | CI/CD | ClickHouseHealth benefits | Parental leave | Stock options | Tuition reimbursement | Unlimited PTOSenior-level Full TimeHybrid (NYC Metro) R16h ago
-
AI Engineer USD 110K-140KApplication design | Artificial Intelligence | Enterprise Architecture | Machine Learning | SDLC401k match | Dental insurance | Employee assistance | Life insurance | Medical insuranceSenior-level Full TimeSan Antonio, TX, United States16h ago