LLM Ops Engineer
Tasks
- Collaborate with research and engineering for deployments
- Deploy self hosted LLMs
- Design inference infrastructure
- Ensure secure compliant resilient cloud model deployments
- Implement CI CD pipelines for LLM deployment and evaluation
- Manage LLM lifecycle
- Monitor latency throughput token usage cost drift and hallucinations
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Azure | CI/CD | Cloud platform | Containerization | Data Leakage Prevention | Data leakage | Deployment Rollback | Docker | GPU deployment | Google Cloud | Google Cloud Platform | Guardrails | IAM | Injection prevention | Kubeflow | Kubernetes | Leakage prevention | MLflow | Model Evaluation | Model Monitoring | Model Registry | Prompt injection | Prompt injection prevention | Retrieval-Augmented Generation | Vector Database
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Senior AI Engineer / Data Scientist (Agentic AI) INR 2000K-5000KAI Search | AI Services | Agentic AI | Azure | Azure AISenior-level Full TimeChennai, India1h ago
-
GenAI Developer INR 1800K-4500KAPI Development | AWS | Azure | C++ | Cloud platformFull-time work | Work from OfficeSenior-level Full TimeIN-TN-Chennai2h ago
-
Amazon S3 | Apache Iceberg | Cloud Computing | Concurrency | Data ModelingCareer development | Health benefits | Paid time off | Remote work flexibilitySenior-level Full TimeHyderabad, India3h ago
-
Agile | Apache Airflow | Azure Data | Azure Data Factory | Azure DevOpsEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, TN, India3h ago
-
Staff Software Engineer, Machine Learning INR 3000K-4680KC++ | Cross-Functional Collaboration | Cross-functional | Data Pipelines | Fine TuningHealth and wellness programs | Time awaySenior-level Full TimeBengaluru, KA, India4h ago
-
Mid-level Full TimeBangalore, Karnataka, IN4h ago
-
Senior AI Engineer INR 2500K-5000KAPI Design | Agile | Azure | Azure AI | Azure ArcHybrid work | On-call supportSenior-level Full TimeBangalore, Karnataka, IN4h ago
-
Entry-level Full TimeHyderabad6h ago
-
Senior Data Scientist INR 2000K-5000KAWS | Artificial neural networks | Azure | Chunking | Data StructuresSenior-level Full TimeBengaluru, Karnataka, India7h ago
-
Senior Engineer, Agentic AI & MLOps Engineering (5-8 years) INR 3700K-5000KAPIs | Agent Orchestration | Agent systems | Deep learning | LLMOpsSenior-level Full TimeBengaluru, KA, India7h ago
-
Software Engineer II INR 1500K-2500KAzure | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2Mid-level Full TimeIndia, Telangana, Hyderabad10h ago
-
Senior Data Engineer INR 3000K-4000KAWS | Airflow | Cloud platform | Data Modeling | Data TransformationCommuter benefits | Dental insurance | Financial wellness support | Health insurance | Life insuranceSenior-level Full TimeBengaluru, India10h ago
-
Lead Data Scientist-(VLM-Multimodal AI ,CV, Deep Learning) INR 4000K-5500KComputer Vision | Distributed Training | Embeddings | Faiss | Fine TuningCollaborative inclusive work environment | Employee wellness programs | Flexible-hybrid work | Learning and growth opportunities | Performance-based bonusSenior-level Full TimeMumbai, India10h ago
-
Senior Software Engineer INR 4000K-6000KAI Model Garden | AI vector search | Alerting | Bash | BigQuerySenior-level Full TimeNoida, UP, IN14h ago
-
Assistant Manager-Adobe Analytics INR 1000K-1890KA/B | A/B Testing | AWS | Adobe Analysis Workspace | Adobe AnalyticsMid-level Full TimePune, IN14h ago
-
Senior-level Full TimeOff Embassy Golf Links Business Park, …14h ago
-
APIs | Agentic AI | Azure | Bagging | BoostingFlexibility programmes | Inclusive benefits | Mentorship | Work-life balance supportSenior-level Full TimePune, India14h ago
-
Lead Consultant - Snowflake and Cortex AI Engineer INR 4000K-5000KAlerting | Audit Logging | Azure DevOps | CI/CD | Contract testingSenior-level Full TimeIndia - Bangalore14h ago
-
Data Engineer (AWS, Azure & Microsoft Copilot Studio) INR 3200K-4720KAI Foundry | AWS Bedrock | AWS Glue | AWS Identity | AWS Identity and Access ManagementHealthcare life sciences industry focus | Remote workSenior-level Full TimeBangalore, KA, IN14h ago
-
Senior Data Engineer II INR 3715K-5000KAPI Integration | Amazon Web Services | Apache Spark | Azure | Data GovernanceEmployee assistance program | Employee share plan | Flexible work arrangements | Generous holidays | Professional mentoringSenior-level Full TimeHyderabad, IN14h ago
-
Data Engineer (AWS, Azure & Microsoft Copilot Studio) INR 3200K-4580KAWS Glue | AWS Identity | AWS Identity and Access Management | AWS Lambda | Access ManagementSenior-level Full TimeBangalore, KA, IN14h ago
-
Azure Databricks Lead INR 2000K-2800KAzure | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeINDIA - PUNE - BIRLASOFT OFFICE …14h ago
-
IN_Senior Associate_AL/ML Developer _D&A_Advisory _Noida INR 2500K-4500KAI Pipelines | API Gateway | AWS | AWS Lambda | AWS Step FunctionsFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeNoida, India14h ago
-
Senior Engineer - Target India INR 4000K-5500KAgent systems | Autogen | CrewAI | Distributed Systems | ELK StackSenior-level Full TimeBangalore,India14h ago
-
AWS | Angular | Apache Spark | Azure | C#Senior-level Full TimeIndia, Hyderabad, DVS, SEZ-1 – Orion …14h ago