Senior AI DevOps / LLMOps
Tasks
- Build evaluation in the loop release gates
- Capture production edge cases for model training feedback
- Define policy as code for AI endpoint compliance
- Deploy agentic workflows with stateful interactions
- Design CI CD pipelines for AI deployments
- Ensure hybrid infrastructure environment parity
- Implement dataset and model weight versioning workflows
- Implement progressive delivery for AI models
- Monitor tokens per second latency and model drift
- Provision GPU and TPU compute environments using Infrastructure as Code
- Run A B testing for LLM outputs and agent behavior
- Set up observability for inference endpoints
- Version control and test prompts with regression checks
Perks/Benefits
- N/A
Skills/Tech-stack
A/B | A/B Testing | Ansible | Arize Phoenix | B testing | Blue/green | Blue/green deployments | CUDA | Canary Releases | GPU virtualization | GitHub Actions | GitLab CI | Inference monitoring | Kubeflow | Kubernetes | Langsmith | MLflow | NVIDIA Triton | Open Policy Agent | Policy Agent | Progressive Delivery | Pulumi | Ray | Shadowing | Terraform | Vault | Weights and Biases
Education
N/A
Related jobs
-
Intermediate Backend Engineer - Analytics Instrumentation INR 2000K-3370KAt-Scale | Backend Development | ClickHouse | Cloud Native | Data QualityEquity compensation | Flexible paid time off | Growth and development fund | Parental leave | Remote workMid-level Full TimeRemote, India R9h ago
-
API Design | AWS | Amazon SageMaker | Automated retraining | CI/CDAutonomy and ownership | Continuous learning | Fully remote | High-growth environment | Professional developmentSenior-level Full TimeIndia R10h ago
-
Senior-level Full TimeUS - Remote; Canada - Remote R11h ago
-
Databricks Solution Architect INR 2000K-3000KAWS | Azure | CI/CD | CloudWatch | Data GovernanceOn-site client work | Remote work flexibilitySenior-level Full TimeIndia - Remote R15h ago
-
Senior Software Engineer Remote/Travel- Active Secret -Top Secret clearance(SCI-eligibility) USD 145K-204KAPI Testing | Cypher | Data Processing | DataOps | DevOpsCompetitive benefits | Growth opportunity | Remote work | TravelSenior-level Full TimeReston, VA, United States R23h ago
-
Airflow | Amazon SageMaker | Apache Beam | Argo Workflows | Attention MechanismSenior-level Full TimeTel Aviv/ Hybrid (Israel), Israel R1d ago
-
Senior-level Full TimeTel Aviv/ Hybrid (Israel), Israel R1d ago
-
Azure | Azure Data | Azure Data Explorer | Azure Event | Azure Event HubsMid-level Full TimeTel Aviv/ Hybrid (Israel), Israel R1d ago
-
Agile | Amazon Redshift | Amazon Web Services | Apache Airflow | Apache FlinkAdditional vacation weeks | Flexible working hours | Health days | Health insurance | Hybrid workSenior-level Full TimeVilnius, Lithuania R1d ago
-
A/B | A/B Testing | Agent systems | B testing | CI/CDAccess to learning platforms | English classes | Fully remote | Public holidays | Referral programSenior-level Full TimeCórdoba, Córdoba Province, Argentina R1d ago
-
A/B | A/B Testing | APIs | Amazon QuickSight | Apache AirflowAdditional personal days | Benefits card and discounts | Birthday gift | English classes | Full-time employmentSenior-level Full TimeBuenos Aires, Argentina R1d ago
-
Senior-level Full TimeUkraine - Remote R1d ago
-
Data Engineer, Platform EUR 42K-55KAmazon Web Services | Apache Spark | Databricks | Git | KubernetesAdditional paid leave | Career growth | Employee stock options | Paid volunteering opportunities | Performance bonusMid-level Full TimeRemote R1d ago
-
Experienced Data Engineer - Streaming Platform EUR 55K-95KAWS Kinesis | Amazon Web Services | Apache Beam | Apache Flink | Apache KafkaChild day care support | Gym membership | Lunch vouchers | Premium healthcare coverage | Relocation supportMid-level Full TimeParis R1d ago
-
Data Engineer GBP 50K-70KAmazon Web Services | Apache Flink | Apache Kafka | Apache Spark | Cloud platformBenefits package | Flexible work schedule | Remote work one day per weekMid-level Full TimeLondon R1d ago
-
Senior Data Engineer EUR 60K-84KCI/CD | ClickHouse | Docker | Kafka | KubernetesCareer development | Flexible working hours | Learning time | Remote-first | Social benefitsSenior-level Full TimeGermany /Spain / Romania (Remote) R1d ago
-
AIOps | APIs | AWS | Anomaly Detection | AzureFlexible working hours | Fully remote | Remote collaborationMid-level Full TimeIndia R2d ago
-
AIOps | AWS | Anomaly Detection | Azure | Azure OpenAIAutonomy | Collaborative team environment | Flexible schedule | Fully remote | Learning opportunitiesMid-level Full TimeBrazil R2d ago
-
Senior Applied AI Engineer - Remote USD 137K-230KAPI Design | AWS | Azure | CI/CD | Distributed SystemsRemote workMid-level Full TimeRemote job R2d ago
-
Mid-level Full TimeRemote job R2d ago
-
Principal Data Engineer USD 180K-220KAWS | Apache Airflow | Artificial Intelligence | CI/CD | Confluence401k | Autonomy | Company paid life insurance | Disability coverage | FSASenior-level Full TimeRemote - US, Canada and Poland R2d ago
-
Data Analytics USD 130K-170KA/B | A/B Testing | AI | B testing | Credit Risk401k match | Flexible time off | Growth opportunities | Health benefits | Remote-friendlyMid-level Full TimeUnited States (Remote) R2d ago
-
Forward Deployed ML/AI Engineer USD 167K-200KAWS | Azure | CI/CD | Databricks | DockerAnnual company retreat | Company winter break | Education bonus | High-performance culture | Optional in person events and meetupsSenior-level Full TimeUnited States R2d ago
-
Senior Analytics Engineer USD 135K-225KAirflow | CI/CD | DBT | Data Modeling | Data TransformationFlexible time off | Health, dental, and vision insurance | LinkedIn Learning access | Paid Holidays | Paid parental leaveSenior-level Full TimeUnited States (Remote) R2d ago
-
Software Engineer II, Fulfillment USD 106K-142KA/B | A/B Testing | AWS | B testing | CI/CD401k match | Education stipend | Employer-paid health insurance | Flexible time off | IKEA discountsSenior-level Full TimeSan Francisco, California, United States R2d ago