LLM Ops Engineer
Tasks
- Collaborate with research and engineering for deployments
- Deploy self hosted LLMs
- Design inference infrastructure
- Ensure secure compliant resilient cloud model deployments
- Implement CI CD pipelines for LLM deployment and evaluation
- Manage LLM lifecycle
- Monitor latency throughput token usage cost drift and hallucinations
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Azure | CI/CD | Cloud platform | Containerization | Data Leakage Prevention | Data leakage | Deployment Rollback | Docker | GPU deployment | Google Cloud | Google Cloud Platform | Guardrails | IAM | Injection prevention | Kubeflow | Kubernetes | Leakage prevention | MLflow | Model Evaluation | Model Monitoring | Model Registry | Prompt injection | Prompt injection prevention | Retrieval-Augmented Generation | Vector Database
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Mid-level Full TimeBangalore, Karnataka, IN3h ago
-
Senior AI Engineer INR 2500K-5000KAPI Design | Agile | Azure | Azure AI | Azure ArcHybrid work | On-call supportSenior-level Full TimeBangalore, Karnataka, IN3h ago
-
Entry-level Full TimeHyderabad5h ago
-
Software Engineer II INR 1500K-2500KAzure | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2Mid-level Full TimeIndia, Telangana, Hyderabad9h ago
-
Senior Data Engineer INR 3000K-4000KAWS | Airflow | Cloud platform | Data Modeling | Data TransformationCommuter benefits | Dental insurance | Financial wellness support | Health insurance | Life insuranceSenior-level Full TimeBengaluru, India9h ago
-
Lead Data Scientist-(VLM-Multimodal AI ,CV, Deep Learning) INR 4000K-5500KComputer Vision | Distributed Training | Embeddings | Faiss | Fine TuningCollaborative inclusive work environment | Employee wellness programs | Flexible-hybrid work | Learning and growth opportunities | Performance-based bonusSenior-level Full TimeMumbai, India9h ago
-
Senior Software Engineer INR 4000K-6000KAI Model Garden | AI vector search | Alerting | Bash | BigQuerySenior-level Full TimeNoida, UP, IN13h ago
-
Assistant Manager-Adobe Analytics INR 1000K-1890KA/B | A/B Testing | AWS | Adobe Analysis Workspace | Adobe AnalyticsMid-level Full TimePune, IN13h ago
-
Senior-level Full TimeOff Embassy Golf Links Business Park, …13h ago
-
APIs | Agentic AI | Azure | Bagging | BoostingFlexibility programmes | Inclusive benefits | Mentorship | Work-life balance supportSenior-level Full TimePune, India13h ago
-
Lead Consultant - Snowflake and Cortex AI Engineer INR 4000K-5000KAlerting | Audit Logging | Azure DevOps | CI/CD | Contract testingSenior-level Full TimeIndia - Bangalore13h ago
-
Data Engineer (AWS, Azure & Microsoft Copilot Studio) INR 3200K-4720KAI Foundry | AWS Bedrock | AWS Glue | AWS Identity | AWS Identity and Access ManagementHealthcare life sciences industry focus | Remote workSenior-level Full TimeBangalore, KA, IN13h ago
-
Senior Data Engineer II INR 3715K-5000KAPI Integration | Amazon Web Services | Apache Spark | Azure | Data GovernanceEmployee assistance program | Employee share plan | Flexible work arrangements | Generous holidays | Professional mentoringSenior-level Full TimeHyderabad, IN13h ago
-
Data Engineer (AWS, Azure & Microsoft Copilot Studio) INR 3200K-4580KAWS Glue | AWS Identity | AWS Identity and Access Management | AWS Lambda | Access ManagementSenior-level Full TimeBangalore, KA, IN13h ago
-
Azure Databricks Lead INR 2000K-2800KAzure | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeINDIA - PUNE - BIRLASOFT OFFICE …13h ago
-
IN_Senior Associate_AL/ML Developer _D&A_Advisory _Noida INR 2500K-4500KAI Pipelines | API Gateway | AWS | AWS Lambda | AWS Step FunctionsFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeNoida, India13h ago
-
API Security | Application Security | Application Security Testing | Azure DevOps | Branch PoliciesContract-to-hire | Hybrid work mode | On-call coverageMid-level ContractShaikpet, India23h ago
-
Principal Data Engineer INR 3000K-4000KAWS | AWS Glue | AWS Lambda | Amazon EMR | Amazon S3Employee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimePune, MH, India23h ago
-
Mid-level Full TimeKarnataka, Bengaluru, India23h ago
-
API Integrations | AWS | Automation & Integration | Azure | Cloud infrastructureCollaborative environment | Fully remote work | International projects | Professional growth opportunities | Work-life balanceMid-level Full TimeIndia R23h ago
-
Junior Software Engineer INR 480K-800KAzure Data | Azure Data Factory | Azure Data Lake | Azure Synapse | Azure Synapse AnalyticsClient facing communication experience | Night shift rotation | Remote workEntry-level Full TimeHyderabad/Remote, India R1d ago
-
Software Engineer - Data Engineer INR 2475K-3465KAWS | Azure | CI/CD | Computer Vision | Data GovernanceCollaborative work environment | Professional development | Training opportunitiesSenior-level Full TimeBangalore - Karnataka, India - Kalyani …1d ago
-
Associate Engineer - AI/ML with Python INR 2500K-4000KAWS | Celery | Django | Docker | ElasticsearchCollaborative work environment | In-office 5 days a week | Learning and development opportunities | Professional growth and developmentMid-level Full TimeBangalore - Karnataka, India - Kalyani …1d ago
-
Senior-level Full TimeIN-TN-Chennai1d ago
-
Databricks Platform Engineer INR 264KApache Spark | Azure Monitor | CI/CD | Cluster policies | DatabricksMid-level Full TimeIN-KA-Bangalore1d ago