LLMOps Engineer
Tasks
- Build CI/CD pipelines for AI systems
- Build evaluation infrastructure for hallucination and tool call success
- Build sandboxed environments for AI agent repository access
- Create operational playbooks for incident recovery
- Define SLOs for AI system reliability
- Design AWS infrastructure for AI and agent systems
- Design and operate CodeAI development pipeline
- Design environment promotion and automated rollback
- Establish governance and security guardrails
- Handle deployments monitoring and incident response for AI systems
- Implement monitoring with AWS CloudWatch and evaluation dashboards
- Implement secure configuration and secrets management
- Implement versioning for models prompts and LangGraph agent graphs
- Manage integrations with Amazon Bedrock
- Monitor and optimize cost per request
Perks/Benefits
- 401k employer match
- Access to events
- Company holidays
- FSA eligibility
- Free lunch onsite
- HSA eligibility
- Medical, dental, and vision coverage
- Paid time off
- Parental leave
Skills/Tech-stack
AWS | AWS CloudWatch | Amazon Bedrock | CI/CD | Evaluation | Incident Response | Infrastructure as Code | Langgraph | MLOps | Machine Learning | Model versioning | Monitoring | Observability | Prompt engineering | SLO | Secrets management | “as-code”
Education
N/A
Roles
DevOps | DevOps Engineer | Engineer | LLMOps Engineer | MLOps Engineer
Related jobs
-
Senior-level Full TimeBoston, MA6h ago
-
Senior-level Full TimeBelmont, CA, US, 9400211h ago
-
AI Agents | AI Search | AWS | AWS Bedrock | Agentic Workflows401k | Dental insurance | Medical insurance | Paid sick hours | Vision insuranceSenior-level Contract Full TimeRidgefield Park, NJ, United States12h ago
-
Senior Data & ML Engineer USD 151K-205KDBT | Data Governance | Data Observability | Data Quality | Data Security401k match | Dental insurance | Equity | Family planning resources | Flexible vacation policySenior-level Full TimeRemote - USA R12h ago
-
Senior Software Engineer, Knowledge Graph USD 196K-230KData Ingestion | Data Processing | Distributed Systems | Flink | Graph DatabasesSenior-level Full TimeUnited States12h ago
-
Senior Machine Learning Engineer USD 198K-287KArtificial Intelligence | Data Engineering | Fine Tuning | Foundation Models | GenAIOccasional travel for offsites | On-call rotation participation | Reasonable accommodation for applicantsSenior-level Full TimeRemote - US R12h ago
-
Staff Machine Learning Engineer USD 141K-210KCI/CD | Computer Vision | Deep learning | Distributed Training | DockerSenior-level Full TimeSunnyvale, CA, United States12h ago
-
Senior Software Engineer, Data Platform USD 196K-245KAWS | Apache Airflow | Apache Flink | Apache Spark | AzureEquity | Inclusion and reasonable accommodations | Relocation assistanceSenior-level Full TimeSan Francisco Bay Area13h ago
-
Senior AI Technologist USD 122K-180KAWS | Apache Airflow | Apache Spark | Azure | CI/CDFully remote option | Hybrid option | Onsite optionSenior-level Full TimeRaleigh, North Carolina, United States; Albuquerque, … R14h ago
-
Senior AI Systems Engineer USD 122K-188KAlerting | Bash | CI/CD | CMMC | Cause analysisFully remote option | Hybrid option | Onsite optionSenior-level Full TimeRaleigh, North Carolina, United States; Albuquerque, … R14h ago
-
Staff AI Engineer USD 200K-240KAWS | Agentic Workflows | ClickHouse | Distributed Systems | DockerParental leave | Tuition reimbursement | Unlimited PTOSenior-level Full TimeHybrid (NYC Metro) R15h ago
-
Senior AI Engineer USD 170K-205KAWS | Agent Orchestration | Agentic Workflows | CI/CD | ClickHouseHealth benefits | Parental leave | Stock options | Tuition reimbursement | Unlimited PTOSenior-level Full TimeHybrid (NYC Metro) R15h ago
-
AI Engineer USD 110K-140KApplication design | Artificial Intelligence | Enterprise Architecture | Machine Learning | SDLC401k match | Dental insurance | Employee assistance | Life insurance | Medical insuranceSenior-level Full TimeSan Antonio, TX, United States15h ago
-
Staff Software Engineer, Leverage USD 53K-119KAPI Integration | API Keys | Access Management | Authentication | Backend Development401k match | Business expense stipend | Dental insurance | FSA | HSASenior-level Full TimeRemote - USA, CAN, MEX R15h ago
-
Senior AI Engineer USD 144K-210KAPI Development | Azure | Azure Machine Learning | Azure OpenAI | Cloud Computing401k retirement plan | Dental insurance | Education Course Access | Employee eyewear discount | Health insuranceSenior-level Full TimeDuluth, GA, United States15h ago
-
Software Engineer, Machine Learning Infrastructure USD 156K-235KDistributed Systems | High Availability | LLM Applications | Language Models | Large Language Models401k plan | Company bonus | Equity | Medical, dental, vision benefits | Wellness stipendsEntry-level Full TimeSeattle, San Francisco15h ago
-
Sr. Data Engineer I (Splunk) (6382) USD 170K-239KAgile | Data Normalization | Data Parsing | Forwarder | High Availability401k match | Dependent care | Employee Assistance and Wellness Programs | Flexible work arrangements | Health, dental, vision insuranceSenior-level Full TimeWashington, DC15h ago
-
Senior Machine Learning Engineer, Perception USD 220K-292KComputer Vision | Data Pipelines | Deep learning | Edge Computing | Image SegmentationCommuter benefits | Dental insurance | Disability insurance | Health insurance | Life insuranceSenior-level Full TimeWashington, District of Columbia, United States15h ago
-
Digital Health And Behavior Data Scientist USD 115K-130KAWS | Azure | Computational simulation | Data Quality | Data Reconciliation401k match | Dependent Care Assistant Program | Educational benefits | Flexible spending account | Medical, dental & vision coverageMid-level Full TimeBaltimore, MD15h ago
-
Generative AI Integration Engineer USD 191K-253KAgent Tool Calling | Autonomous Vehicles | C# | C++ | CameraCommuter benefits | Dental coverage | Disability insurance | Healthcare benefits | Life insuranceMid-level Full TimeCosta Mesa, California, United States16h ago
-
AI Engineer (Marketing) Intern, Summer 2026 USD 64K-74KAlgorithms | Data Structures | Go | Java | Language Models401k matching | Company intern presentations | Free mental health services | Intern swag | Lunch stipendEntry-level InternshipPalo Alto, CA16h ago
-
AI/ML Physical Design Flow Engineer USD 100K-500KAssembly | CAD Tools | Custom CAD Tools | Data Analysis | Data-Driven ModelingEqual opportunity employer | Hybrid workSenior-level Full TimeAustin, Texas, United States; Fort Collins, …17h ago
-
Staff Software Engineer, Data Infrastructure USD 221K-279KAWS | Apache Airflow | Apache Flink | Apache Iceberg | Apache KafkaAnnual refresh grants | Equity grants | In-person events | Remote work flexibilitySenior-level Full TimeUnited States - Remote R17h ago
-
AWS | Agent systems | Attention Mechanisms | Embeddings | Function CallingSenior-level Full TimeAustin, Texas, United States17h ago
-
Staff Data Engineer USD 146K-233KAWS | Airflow | Apache Flink | Apache Spark | CI/CD401k | Paid time off | Wellness programSenior-level Full TimeFoster City, CA, United States17h ago