LLM Ops Engineer
Gurgaon, HR, India
INR 1800K-3000K (estimate) Mid-level Full Time
Tasks
- Collaborate with research and engineering for deployments
- Deploy and operate self hosted LLMs
- Design inference infrastructure
- Ensure secure compliant resilient deployments
- Implement CI/CD pipelines
- Manage LLM lifecycle
- Monitor latency throughput token usage cost drift hallucinations
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Access Management | Amazon Elastic Compute Cloud | Azure | CI/CD | Cloud Monitoring | Cloud platform | Compute Cloud | Data Leakage Prevention | Data leakage | Docker | Elastic Compute Cloud | Google Cloud | Google Cloud Platform | Guardrails | Identity and Access Management | Identity and access | Kubeflow | Kubernetes | Latency optimization | Leakage prevention | MLflow | Model Evaluation | Monitoring | Prompt injection | Prompt injection mitigation | Retrieval-Augmented Generation | Throughput Optimization | Token Economics | Vector Database
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Related jobs
-
Data Engineer (MS) (Remote) INR 2040K-3380KCI/CD | Data Transformation | Data Validation | Date normalization | ETLMentorship opportunities | Professional growth | Remote workSenior-level Full TimeMaharashtra, Pune, India R9h ago
-
ML / LLM Engineer (Remote) INR 2500K-3000KAmazon Web Services | Azure | Classification | Feature Engineering | Language ModelsRemote workMid-level Full TimeMaharashtra, Pune, India R9h ago
-
Senior-level Full TimeIN-TN-Chennai11h ago
-
Mid-level Full TimeIN-KA-Bangalore11h ago
-
Software Engineer - AI/ML with Python INR 2500K-3500KAI | AWS | Airflow | Apache Spark | BazelCollaborative work environment | Professional growth | Training and developmentSenior-level Full TimeBangalore - Karnataka, India - Kalyani …11h ago
-
Mid-level Full TimeBangalore - Karnataka, India - Kalyani …11h ago
-
Teams Telephony – Operations Automation & AI Engineer INR 2000K-3500KAI orchestration | Azure Functions | Azure Key Vault | Azure Relay | Azure StorageMid-level Full Timebangalore, India12h ago
-
Senior Data Engineer INR 3000K-4000KADLS Gen2 | Audit Logging | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimePune, Maharashtra, India12h ago
-
Engineering Analyst II, Gemini and Labs INR 1000K-1500KAdversarial techniques | Automation | Classifier | Data Analysis | Fine TuningHoliday coverage | Rotating on call coverage | Weekend coverageMid-level Full TimeBengaluru, Karnataka, India12h ago
-
Senior Database Engineer INR 2520K-3380KAerospike | Azure | Azure Cosmos | Azure Cosmos DB | Azure DataOn-call support | Relocation assistance | Rotational shifts 24x7Senior-level Full TimeBengaluru, KA, IN14h ago
-
Lead Software Engineer - Data Engineer INR 1500K-2400KABAC | AWS | AWS Glue | AWS Lambda | AWS Step FunctionsSenior-level Full TimeBengaluru, Karnataka, India14h ago
-
Senior Architect, ML Engineering INR 2500K-4500KAWS | Agentic Workflows | Async Programming | Azure | Circuit BreakersSenior-level Full TimePune, Maharashtra, India14h ago
-
Data Engineer - Senior INR 3000K-3500KAnomaly Detection | Application Insights | Azure | Azure Application Insights | Azure SQLSenior-level Full TimePune, Maharashtra, India15h ago
-
Germany (FS- D&A)- Executive-BLR INR 500K-500KAgile | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOpsHybrid workExecutive-level Full TimeBangalore, Karnataka, India17h ago
-
Cloud Support Engineer – Backup & Disaster Recovery INR 938K-1500KAWS | Backup and Disaster Recovery | Cloud Computing | Cloud Storage | DatabasesMid-level Full TimeBangalore, India17h ago
-
Mid-level Full TimeChennai, Tamil Nadu, India17h ago
-
Software Engineer - Associate INR 1170K-2000KAWS S3 | Agentic AI | Amazon ECS | Amazon EMR | Amazon SNSDevelopment opportunities | Reward and recognition | Volunteering opportunities | Wellness | Work-life balanceMid-level Full TimeHyderabad, India17h ago
-
Bash | Cloud platform | Data Processing | Docker | GCPAsynchronous culture | Flexible management approachMid-level Full TimeBangalore, India18h ago
-
Senior-level Full TimeIndia18h ago
-
Azure DevOps | Bash | CI/CD | Distributed tracing | DockerLearning-focused culture | MentorshipMid-level Full TimeBangalore, Karnataka, India18h ago
-
Azure DevOps | Bash | Distributed tracing | Docker | GitOpsLearning-focused culture | MentorshipMid-level Full TimeBangalore, Karnataka, India18h ago
-
Azure DevOps | Bash | Docker | GitOps | GrafanaLearning-focused culture | MentorshipMid-level Full TimeBangalore, Karnataka, India18h ago
-
Azure DevOps | Bash | CI/CD | Docker | EBPFLearning-focused culture | MentorshipMid-level Full TimeBangalore, Karnataka, India18h ago
-
Snowflake Data Engineer- Consultant INR 1500K-2700KAWS | AWS Glue | Access policies | Airflow | Amazon QuickSightCorporate social responsibility programs | Maternity leave | Networking opportunities | Paternity leave | Product and service discountsMid-level Full TimeBangalore, Karnataka, India18h ago
-
Azure DevOps | Bash | CI/CD | Distributed tracing | DockerMentorshipMid-level Full TimeBangalore, Karnataka, India18h ago