Senior LLMOps Engineer
Tasks
- Architect LLM and RAG pipelines
- Build automated LLM evaluation systems
- Develop CI/CD workflows for LLM applications
- Ensure AI governance and compliance
- Implement observability and monitoring for LLM systems
- Implement secure GenAI infrastructure
- Integrate vector databases and retrieval layers
- Mentor engineers
- Perform troubleshooting and root cause analysis
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Airflow | Azure | CI/CD | Cloud platform | CloudFormation | Content Safety | Docker | Faiss | FastAPI | Google Cloud | Google Cloud Platform | Hugging Face | Hugging Face Transformers | Injection Defense | Kubernetes | Langchain | Llamaindex | Logging | MLSecOps | MLflow | Machine Learning | Milvus | Observability | Pinecone | Prompt injection | Prompt injection defense | PyTorch | Python | TensorRT-LLM | Terraform | VLLM | Weights and Biases
Education
Roles
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R27d ago
-
Agent Orchestration | Data Quality | Deep learning | Generative UI | GoSenior-level Full TimeMountain View, CALIFORNIA, United States10h ago
-
Context engineering | Deep learning | Dynamic Orchestration | Generative AI | Golang401k matching | ESPP | Family leave programs | Flexible spending accounts | Flexible time awaySenior-level Full TimeMountain View, CALIFORNIA, United States10h ago
-
Data Quality | Deep learning | Experimentation | Golang | LLM EvaluationSenior-level Full TimeMountain View, CALIFORNIA, United States10h ago
-
Deployed Engineer (Chicago) USD 150K-250KAWS | Agent architecture | Azure | Cloud Computing | Containerization401k plan | Flexible vacation | Meals on in office days | Medical, dental, and vision coverage | Travel up to 40 percentSenior-level Full TimeChicago, IL11h ago
-
Bioinformatics | C++ | CUDA | Cloud Computing | Computer VisionSenior-level Full TimeBaltimore, MD, United States11h ago
-
Staff AI Engineer USD 228K-288KArtificial Intelligence | Cloud infrastructure | Data Science | Distributed Systems | Graph Databases401k match | Company-sponsored life and disability insurance | Flexible spending accounts | Learning and development stipend | Mental health resourcesSenior-level Full TimeOakland, California, United States11h ago
-
Staff Partner Engineer, AI Partnerships USD 150K-206KAI integration | Agent Frameworks | Architecture | Cost Optimization | EvaluationGlobal travelSenior-level Full TimeNew York City, New York; San …12h ago
-
AI Research Engineer USD 200K-400KAgent systems | Constrained decoding | Data Curation | Evaluation Harness | Hugging FaceMid-level Full TimeNew York City12h ago
-
Data Engine & Annotation Systems Engineer USD 130K-190KAPIs | Active Learning | Auto-labeling | Bash | Computer VisionMid-level Full TimeSan Francisco Bay Area13h ago
-
Customer Facing Applied AI Engineer, Retail Perception USD 106K-128KComputer Vision | Data Engineering | Data Pipelines | Data Validation | GitMid-level Full TimeSan Francisco Bay Area13h ago
-
Senior Computer Vision / Applied AI Engineer USD 150K-235KActive Learning | Annotation QA | Barcode Decoding | CUDA | Computer VisionSenior-level Full TimeSan Francisco Bay Area13h ago
-
Principal / Staff Robotics Perception Engineer USD 150K-261KC++ | CUDA | Camera Calibration | Depth Estimation | Edge inferenceSenior-level Full TimeSan Francisco Bay Area13h ago
-
Senior AI Engineer, VideoAI USD 144K-236KA/B | A/B Testing | B testing | Deep learning | Distributed ComputingFlexible work hybrid model | Health and wellness programs | Time away from workSenior-level Full TimeMountain View, CA, United States13h ago
-
Senior Machine Learning Engineer, Price Modeling USD 196K-227KData Analysis | Data Visualization | Machine Learning | Model Evaluation | PythonEmployee travel credits | Inclusion and belonging initiatives | Occasional travel | Remote eligibleSenior-level Full TimeUnited States13h ago
-
Lead Machine Learning Engineer USD 172K-276KAWS | Azure | CI/CD | Databricks | Distributed SystemsFlexible autonomy | Learning and development programs | MentorshipSenior-level Full TimeChicago, Illinois, USA R13h ago
-
Human Data Engineer USD 144K-270KData Annotation | Data Integrity | Data Quality | Dataset evaluation | Machine Learning401k retirement plan | Dental insurance | Disability insurance | Discounts | Life insuranceMid-level Full TimePalo Alto, California, United States13h ago
-
Machine Learning Ops Engineer USD 140K-175KAnomaly monitoring | Ansible | CI/CD | Infrastructure as Code | Kubernetes401k match | Annual Company Holidays | Dental insurance | Life insurance | Medical insuranceSenior-level Full TimeUnited States14h ago
-
Application Insights | Azure | Azure Monitor | BeautifulSoup | CI/CD401k | Dental insurance | Educational assistance | Health insurance | Open to remoteMid-level Full TimeNew York, United States R14h ago
-
Senior Data Platform Engineer USD 160K-220KAnalytics | CDC | Data Classification | Data Governance | Data Lake401k employer matching | Childcare reimbursement | Company events | Company-paid parking | Fertility treatment coverageSenior-level Full TimeSan Diego, CA, United States14h ago
-
Senior Embedded Firmware Engineer CAD 130K-180KARM Cortex | ARM Cortex-M | C# | CI/CD | CMakeEmployee resource groups | Generous time-off policies | Healthcare benefits | Retirement benefits | Reward and recognition programsSenior-level Full TimeUnited States15h ago
-
Sr Machine Learning Engineer I USD 150K-241KAutomated testing | CI/CD | Data Versioning | Experimental Design | MLOpsDiscretionary paid time off | Emotional & mental wellness support | Employee resource groups | Fitness programs | Learning and development programsSenior-level Full TimeSeattle, Washington, United States R15h ago
-
Principal Engineer, Data & ML Infrastructure USD 200K-275KAWS | Cloud Computing | Data Mining | Data Processing | Data Warehousing401k match | Dental insurance | Health savings account | Life insurance | Medical insuranceSenior-level Full TimeBoston, Massachusetts, United States; Pittsburgh, Pennsylvania, … R15h ago
-
Staff Embedded C++ Software Engineer - Robotics USD 90K-140KAgile | C++ | CI/CD | Debugging | Functional testingSenior-level Full TimeWestborough, MA16h ago
-
Sr. Systems Engineer - AI USD 141K-209KAlerting | Artificial Intelligence | Auto Scaling | Automation | Backup and RecoverySenior-level Full TimeKansas City, KS, United States17h ago