LLMOps Engineer
Tasks
- Build CI/CD pipelines for AI systems
- Build evaluation dashboards
- Build sandboxed agent environments
- Build shared evaluation infrastructure
- Define service level objectives for AI reliability
- Design AI infrastructure
- Develop operational playbooks
- Handle deployments and incident response
- Implement governance and security guardrails
- Implement secrets management
- Implement secure environment configuration
- Manage Amazon Bedrock integrations
- Manage environment promotion and rollback
- Measure hallucination and tool call success
- Monitor cost per request metrics
- Operate AI agent systems on AWS
- Operate CodeAI development pipeline
- Set up monitoring with CloudWatch
- Version models and prompts
Perks/Benefits
- 401k employer match
- Company holidays
- Dental insurance
- FSA eligibility
- HSA eligibility
- Health insurance
- Paid time off
- Parental leave
- Vision insurance
Skills/Tech-stack
AWS | Amazon Bedrock | CI/CD | CloudWatch | Docker | Evaluation | Incident Response | Infrastructure as Code | Langchain | Langgraph | Model versioning | Monitoring | Observability | Prompt engineering | SLO | Secrets management | Service Level | Service-Level Objectives | “as-code”
Education
N/A
Roles
DevOps | DevOps Engineer | Engineer | LLMOps Engineer | MLOps Engineer
Related jobs
-
Applied AI Lead USD 140K-160KAI Agents | AWS | AWS Bedrock | Anthropic Claude | Automation401k match | Cell phone stipend | College savings | EAP | FSA optionsSenior-level Full TimePhiladelphia, PA, United States6h ago
-
AI Research Engineer – Agentic AI USD 165K-180KAgent systems | Evaluation | Experiment design | Language Models | Large Language Models401k matching | Disability insurance | Health insurance | Life insurance | Paid time offMid-level Full TimeSunnyvale, CA, United States6h ago
-
AI/Machine Learning Engineer - Python - Loops USD 130K-150KAPI Development | CI/CD | Data Pipelines | Debugging | Embeddings401k | Community volunteering events | Dental insurance | Disability benefits | Flexible paid time offEntry-level Full TimePalo Alto, California, United States7h ago
-
Staff Backend AI Engineer, Remote USD 164K-219KAWS | AWS Cloud | AWS Cloud Development Kit | AWS Lambda | AWS cloud development401k matching | Dental insurance | Flexible time off | Medical insurance | Paid HolidaysSenior-level Full TimeUnited States, UNITED STATES, United States R8h ago
-
AI/ML Engineer USD 100K-150KAPI Design | Asynchronous programming | Claude Code | Cloud platform | Cursor401k | Employee assistance program | Health spending account | Life insurance | Long-term disabilityMid-level ContractDearborn, Michigan, USA R9h ago
-
Software Engineer 2 - (Python, LLM, Machine Learning) USD 201K-246KAPI Integration | AWS | Agentic Workflows | Azure | CrewAI401k match | Educational assistance | Federal Holidays | Healthcare coverage | Paid time offMid-level Full TimeAnnapolis Junction, Maryland R12h ago
-
AWS | CI/CD | Docker | Kubernetes | LLM401k match | Health insurance | Paid time offMid-level Full TimeAnnapolis Junction, MD12h ago
-
AI/ML | AKS | Audit Logs | Azure DevOps | Azure MonitoringLocal only candidates required | Onsite 2 days per week | Remote 3 days per weekSenior-level Full TimeAustin, TX R12h ago
-
Agentic AI Platform Engineer USD 109K-150KAI Agents | Access Control | Access Management | Authentication | AuthorizationContract-to-hire | Hybrid work schedule | US work authorization sponsorship or eligibility requirementsMid-level ContractDenver, United States13h ago
-
Automated testing | BSP | Bootloader | C# | C++Bonus | Growth potential | Health benefits | Travel under 15 percentSenior-level Full TimeMountain View, United States15h ago
-
Senior Data Engineer USD 114K-164KAzure DevOps | Azure Synapse | CI/CD | Data Governance | Data QualitySenior-level Full TimeSan Diego15h ago
-
ATA | Algorithms | C# | C++ | Data StructuresSenior-level Full TimeSunnyvale, CA, USA17h ago
-
Agent systems | Apache Beam | Artificial Intelligence | Autonomous Agents | Autonomous ReasoningMid-level Full TimeLondon, UK; Mountain View, CA, USA17h ago
-
Staff Software Engineer, Network Health USD 207K-300KAnomaly Detection | Automated remediation | Data Processing | Debugging | Distributed ComputingSenior-level Full TimeSunnyvale, CA, USA17h ago
-
Senior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL17h ago
-
Analyst, Business Insights & Execution USD 68K-115KAPI Integration | Automation | CI/CD | Data Ingestion | Data ModelingMid-level Full TimeMcLean, VA, US19h ago
-
Staff Machine Learning Engineer USD 180K-209KAI | AWS Kinesis | Apache Beam | Apache Flink | Apache SparkChallenging projects | Collegial culture | Flex workSenior-level Full TimeAtlanta, US21h ago
-
Senior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL R22h ago
-
A/AI Machine Learning Engineering Sr - E3 USD 110K-204KC++ | Computer Vision | Continuous Deployment | Continuous integration | Data Science401k match | Education assistance | Flexible work arrangements and schedules | Holidays | Medical, dental & vision coverageSenior-level Full TimeMoorestown, NJ, US23h ago
-
Mid-level Full TimeHartford, Connecticut, United States1d ago
-
Embedded Security Engineer (Starlink) USD 130K-175KC++ | Cryptography | Distributed Systems | Go | Hardware Security ModuleSenior-level Full TimeBastrop, TX1d ago
-
Embedded Security Engineer (Starlink) USD 130K-160KApplied cryptography | C++ | Distributed Systems | Golang | Hardware Security Module401k retirement plan | Dental insurance | Employee stock purchase plan | Life insurance | Long-term disabilitySenior-level Full TimeHawthorne, CA1d ago
-
Embedded Security Engineer (Starlink) USD 130K-165KC++ | Cryptography | Distributed Systems | Golang | Hardware Security Module401k retirement plan | Company shuttles | Comprehensive medical/vision/dental | Disability insurance | Employee stock purchase planSenior-level Full TimeRedmond, WA1d ago
-
Senior-level Full TimeDurham, NC1d ago
-
Staff AI Engineer - Zoom AI Services Platform USD 177K-387KAI Inference | AI Platform | AI Platform Engineering | API Design | C++Hybrid work | Remote workSenior-level Full TimeSeattle (WA), United States R1d ago