LLMOps Engineer
Tasks
- Build CI/CD pipelines for AI systems
- Build evaluation infrastructure for hallucination and tool call success
- Build sandboxed environments for AI agent repository access
- Create operational playbooks for incident recovery
- Define SLOs for AI system reliability
- Design AWS infrastructure for AI and agent systems
- Design and operate CodeAI development pipeline
- Design environment promotion and automated rollback
- Establish governance and security guardrails
- Handle deployments monitoring and incident response for AI systems
- Implement monitoring with AWS CloudWatch and evaluation dashboards
- Implement secure configuration and secrets management
- Implement versioning for models prompts and LangGraph agent graphs
- Manage integrations with Amazon Bedrock
- Monitor and optimize cost per request
Perks/Benefits
- 401k employer match
- Access to events
- Company holidays
- FSA eligibility
- Free lunch onsite
- HSA eligibility
- Medical, dental, and vision coverage
- Paid time off
- Parental leave
Skills/Tech-stack
AWS | AWS CloudWatch | Amazon Bedrock | CI/CD | Evaluation | Incident Response | Infrastructure as Code | Langgraph | MLOps | Machine Learning | Model versioning | Monitoring | Observability | Prompt engineering | SLO | Secrets management | “as-code”
Education
N/A
Roles
DevOps | DevOps Engineer | Engineer | LLMOps Engineer | MLOps Engineer
Related jobs
-
Data Architect USD 135K-165KAPI Integration | API Keys | API Management | Amazon Kinesis | Amazon Web ServicesHighly cleared team support | Security-focused environmentSenior-level Full TimeOther, VA5h ago
-
Lead Data Engineer – Azure Databricks USD 150K-180KARIMA | Azure Databricks | Data Processing | Data analytics | Machine LearningOnsite workSenior-level Full TimeTampa, United States6h ago
-
Mid-level Full TimeAuburn Hills, MI, United States6h ago
-
HR Analytics & Technology Engineer USD 110K-204KAlteryx | Artificial Intelligence | Data Governance | Data Modeling | Data Quality401k matching | Generous time off | Onsite fitness center | Tuition reimbursementSenior-level Full TimeUS-Rhode Island-Providence7h ago
-
Deloitte Technology - US Associate GenAI Engineer USD 80K-100K.Net Core | AWS | Agile | Angular | AzureMid-level Full TimeHermitage, Tennessee, United States7h ago
-
Senior-level Full TimeDallas, Texas, United States7h ago
-
Infra Engineer- US USD 120K-150KAWS | Amazon IAM | Azure | Cloud Cost Optimization | Cloud SecurityMid-level Full TimeNew York City, NY, US7h ago
-
Research Engineer, Gemini Latent Thinking, DeepMind USD 207K-300KAblation Study | Algorithm Development | Deep learning | Experiment design | Language ModelsSenior-level Full TimeCambridge, MA, USA; Mountain View, CA, …8h ago
-
Research Scientist, Robotics, Embodied AI, DeepMind USD 147K-211KDeep learning | Language Models | Machine Learning | Python | Reinforcement LearningSenior-level Full TimeMountain View, CA, USA8h ago
-
Research Scientist, Biomedical AI, DeepMind USD 147K-211KArtificial Intelligence | Benchmarking | Computational pipeline | Data Analysis | EvaluationMid-level Full TimeMountain View, CA, USA8h ago
-
C# | C++ | Co-design | Compiler technology | Computer ArchitectureSenior-level Full TimeSunnyvale, CA, USA8h ago
-
Kinetic Machine Learning Engineer USD 90K-123KClustering | Data Quality | Data quality profiling | Drift monitoring | Ensemble learning401k | Dental insurance | Educational assistance | Flexible savings account | Health savings accountMid-level Full TimeUnited States10h ago
-
ALB | ALB/NLB | AWS | AWS CDK | AWS CloudSenior-level Full TimeDallas, Texas, United States17h ago
-
API Integration | Agent systems | Asynchronous processing | Chunking | Cost OptimizationCompetitive salary based on experience | High-impact role | Opportunity to scale AI systems | Strong ownershipMid-level Full TimeAustin, Texas, United States - Remote R19h ago
-
AI Full Stack Engineer - KS001 USD 160K-225KAds API | Agent systems | Anthropic Claude | Cost monitoring | EmbeddingsHigh-impact role | Strong ownershipMid-level Full TimeAustin, Texas, United States - Remote R19h ago
-
Technical Architect - Machine Learning USD 165K-200KAKS | AWS | Async Programming | Autogen | AzureSenior-level Full TimeUSA - Remote, United States R19h ago
-
Mid-level ContractPhoenix, AZ19h ago
-
Lead AI Engineer (Gen AI Platform Services) USD 215K-245KAWS | AWS Ultraclusters | Azure | C# | C++Senior-level Full TimeSan Jose, CA, United States19h ago
-
Lead Software Engineer – Robotics Platform USD 224K-431KC++ | CUDA | Distributed tracing | Embedded Systems | Isaac SimEquity | Health and wellness benefits | Paid time offSenior-level Full TimeUS, CA, Santa Clara, United States19h ago
-
Principal Big Data Software USD 178K-261K3GPP | 5G | Agile | Ansible | Apache NiFi401k plan | Adoption reimbursement | Employee assistance programs | Employee discounts | Employee wellness programsSenior-level Full TimeUSA:TX:Plano / W Plano Pkwy - …19h ago
-
Staff Data Engineer USD 106K-284KAWS | Alerting | Amazon SNS | Apache Kafka | Argo CDMedical, dental, and vision coverage | Paid time off | Retirement savings options | Wellness programsSenior-level Full TimeWork At Home-Texas, United States19h ago
-
TAMIDS Senior AI Engineer / Lead AI Engineer USD 50K-55KArtificial Intelligence | Backend Development | Data Governance | Data Pipelines | Database ManagementSenior-level Full TimeCollege Station, TX, United States19h ago
-
Lead AI Software Engineer- AI Enablement USD 140K-231KAI Agents | AWS | AWS CDK | Agile Scrum | Amazon BedrockSenior-level Full TimeO'Fallon, Missouri (Main Campus), United States19h ago
-
Senior Machine Learning Engineer USD 150K-185KAWS | Artifact management | Auditability | Azure | Batch inferenceDental insurance | Disability insurance | EAP | Life insurance | Medical insuranceSenior-level Full TimeCHICAGO, IL, USA R19h ago
-
AWS | Agent Frameworks | Agent Orchestration | Amazon Kinesis | Amazon SageMaker401k plan | Dental insurance | Long-term disability | Medical insurance | Paid time offMid-level Full TimeCharlotte, 1120 S Tryon St., Corp, …19h ago