DevOps Engineer - AI Runtime Services
Tasks
- Build and operate LLM gateway
- Create caching and guardrails for latency and safety
- Develop evals and experimentation infrastructure
- Handle PII detection and policy enforcement
- Implement cost control and budgets quotas attribution
- Instrument LLM observability traces spans prompt response capture
- Maintain reliability with SLOs on call incident response postmortems
- Manage model provider keys routing rate limits failover quotas
Perks/Benefits
- Car lease policy
- Dental insurance
- Fitness benefit
- Gratuity
- Group medical insurance
- Mental health support
- Personal accident insurance
- Preventive healthcare
- Term life insurance
- Vision insurance
Skills/Tech-stack
AWS | Alerting | Caching | ClickHouse | Datadog | FinOps | GCP | GitLab CI | GitOps | Guardrails | Incident Response | Kubernetes | Litellm | Logging | Loki | Metrics | Observability | On-Call | PII Detection | Prometheus | Prompt Tracing | Python | RAG | SLOs | Terraform | Tokens
Education
N/A
Related jobs
-
Senior-level Full TimeBangalore, KA, IN,3h ago
-
Senior Machine Learning Engineer, Content Platform INR 3264K-5000KAmazon EMR | Amazon S3 | Apache Airflow | BERT | Big Data401k retirement plan | Commuter benefits | Dental insurance | Disability insurance | Financial wellness supportSenior-level Full TimeBengaluru, India4h ago
-
Senior-level Full TimeChennai, India11h ago
-
Senior Staff Data Analytics Engineer INR 3242K-4500KAI Operations | AI gateway | API Management | Agentic Frameworks | AutomationSenior-level Full TimeBengaluru, KA, India13h ago
-
Senior-level Full TimePune, India15h ago
-
Solutions Engineer - Data Engineering INR 2000K-3000KApache Airflow | CI/CD | DAG | Data Transformation | DockerHybrid work model | Office in HyderabadMid-level Full TimeHyderabad16h ago
-
Senior-level Full TimeMumbai, Maharashtra, India16h ago
-
Staff Software Engineer (Python) INR 3500K-5000KAWS | Authentication | Batch Processing | Data Pipelines | Distributed SystemsCollaborative team environment | Leadership development programs | Training sessionsSenior-level Full TimeMumbai, MH, India16h ago
-
Compute-Hyd 169229 INR 2000K-3000KAI Agents | API Development | Embeddings | LLM orchestration | Language ModelsMid-level Full TimeHyderabad, IND-TG, India16h ago
-
Lead Data Engineer - CDP INR 2500K-4500KAPI Gateway | Analytics.js | CCPA | CI/CD | CPRAArchitecture workshops | Client stakeholder management | Technical mentorshipSenior-level Full TimeHyderabad, TS, India17h ago
-
Senior Data Engineer - AWS INR 1500K-4000KAWS Glue | AWS Lambda | AWS S3 | Amazon EMR | Amazon RedshiftSenior-level Full TimeBangalore, India18h ago
-
Mid-level Full TimeBangalore - Karnataka - India Pune …19h ago
-
Mid-level Full TimeHyderabad, TS, 500032, IN19h ago
-
Principal Data Engineer INR 1500K-2500KAgile | Apache Airflow | Apache Kafka | Automated testing | CI/CDSenior-level Full TimeIN-MH-Pune20h ago
-
Senior-level Full TimeIN-MH-Pune20h ago
-
Network Data Scientist INR 2500K-4500KApplication Traffic Analysis | CI/CD | DNS | Data Pipelines | GitLab CISenior-level Full TimePune, IN20h ago
-
Algorithm Development | Automated trading | C++ | Electronic Trading | Financial MathematicsMid-level Full TimeHyderabad, Telangana, India20h ago
-
API Design | Anthropic | Automation | CRM Integrations | CrewAIDistributed work flexibility | Fully remote | High ownership roleMid-level Full TimeIndia R21h ago
-
Agentic AI Engineer INR 1200K-2500KAgentic architecture | Distributed Systems | Docker | LLM | LanggraphMid-level Full TimeKarnataka, Bengaluru, India21h ago
-
Entry-level Full Timehosur road bangalore, India21h ago
-
[T] Senior Software Engineer, AI/ML, Google Cloud INR 3000K-5000KC++ | Data Processing | Data Structures | Data structures algorithms | DebuggingSenior-level Full TimeBengaluru, Karnataka, India21h ago
-
Senior-level Full TimeBengaluru, India21h ago
-
Senior-level Full TimeBengaluru, India22h ago
-
Data Engineer - Scala + Spark + Java (Bng & Pune) INR 2000K-3000KAWS | Agile | Apache Airflow | Apache Hadoop | Apache KafkaHybrid workSenior-level Full TimeIndia - Bengaluru; India - Chennai …22h ago
-
Mid-level Full TimeIndia22h ago