Lead consultant - GenAI LLM Ops Engineer
Tasks
- Architect Infrastructure-as-Code frameworks
- Build CI CD pipelines for LLM artifacts
- Build and scale LLM platforms
- Define and track LLM SLOs
- Design deploy and maintain LLM serving infrastructure
- Ensure security, privacy, and compliance
- Implement model orchestration
- Implement observability with telemetry
- Improve model lifecycle management best practices
- Manage prompt governance and versioning
- Own end to end LLM operational lifecycle
- Run alerting and incident response
- Troubleshoot LLM deployment scaling and performance
Perks/Benefits
- N/A
Skills/Tech-stack
A/B | A/B Testing | AWS | Azure | Azure OpenAI | B testing | Bash | CI/CD | CloudFormation | Compliance | DevOps | Docker | GCP | Infrastructure as Code | Kubernetes | Lifecycle Management | Logging | MLOps | Machine Learning | Machine Learning Model Lifecycle Management | Metrics | Model Lifecycle Management | Model Orchestration | Observability | Privacy | Python | Security | Telemetry | Terraform | Vector Databases | “as-code”
Education
Roles
DevOps | DevOps Engineer | Engineer | LLM Ops Engineer | MLOps Engineer | Ops Engineer
Related jobs
-
Senior Software Engineer-Java INR 2300K-3200KAWS | AWS Lambda | Amazon EC2 | Amazon RDS | Amazon S3Senior-level Full TimeIN-AP-Hyderabad9h ago
-
Mid-level Full TimeIN-TN-Chennai9h ago
-
Data Science Engineer INR 1524K-2541KAlgorithms | Client-Server | Client-Server Architecture | Data Ingestion | Data PipelinesMid-level Full TimeHyderabad, India16h ago
-
Senior-level Full TimeBangalore, India21h ago
-
Software Engineer II - Python,Microservices,Kafka,Nosql, INR 2000K-3000KAKS | Apache Kafka | Application Gateway | Azure | Azure ADMid-level Full TimeBangalore, India21h ago
-
AI Cloud Solution Engineer_Director_Software Engineering INR 1500K-6000KAI Foundry | AWS Bedrock | Amazon SageMaker | Azure AI | Azure AI FoundryExecutive-level Full TimeRMZ Ecoworld Business Park, India21h ago
-
AI Automation Forward Deployment Engineer INR 2857K-4590KAI orchestration | Agentic AI | BigQuery | Cause analysis | Data ModelingDonation match | Flexible location | Flexible schedule | Health coverage | Paid vacationSenior-level Full TimeBangalore, India1d ago
-
Senior Analytics Engineer INR 2500K-2829KAirflow | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOpsContinuous learning and development | Hybrid work | International travel possibleSenior-level Full TimeHyderabad, Telangana, India1d ago
-
Infrastructure Engineer III - Cloud Database Administrator (DBA) INR 1800K-2200KAWS | AWS DMS | AWS RDS | Amazon CloudWatch | Amazon RedshiftSenior-level Full TimeHyderabad, Telangana, India1d ago
-
Lead Consultant - RAG Engineer INR 2535K-4225KAWS | AWS Step Functions | Airflow | Amazon SageMaker | Cloud NativeContinuous learning opportunities | Hands-on experience | MentorshipSenior-level Full TimeIndia-Gurugram1d ago
-
Software Engineer (Python, AI/ML) ID47296 INR 2535K-4225KCI/CD | Data Modeling | Git | Microservices | PytestBudget for education | Budget for personal growth | Budget for wellness | Local team meetups | Remote workSenior-level Full TimeNoida, India1d ago
-
Python Developer INR 2500K-3000KAWS | Debugging | Django | Event Driven | Event-driven architectureMid-level Full TimeIN-KA-Bangalore1d ago
-
Senior-level Full TimeIN-TN-Chennai1d ago
-
Databrick Developer INR 2000K-2040KAgile | Amazon Web Services | Apache Airflow | Apache Kafka | Apache SparkSenior-level Full TimeIN-TN-Chennai1d ago
-
GEN AI developer INR 2500K-3000KAPI Integration | Anthropic Claude | Context Management | Crew AI | FastAPIMid-level Full TimeIN-KA-Bangalore1d ago
-
Senior-level Full TimeIN-AP-Hyderabad1d ago
-
Azure | Csharp | Data Ingestion | Data cleaning | Machine LearningCommunity forums | Laptop provided | Medical insurance | Mentorship | No weekend workSenior-level Full TimeIndia R1d ago
-
AWS | Agent Framework | Agile | Azure | Azure DataBig 4 experienceSenior-level Full TimeGurgaon, Uttar Pradesh, India1d ago
-
Azure Data | Azure Data Factory | Azure Data Lake | Azure Databricks | Azure SQLBig 4 experienceMid-level Full TimeBengaluru, Karnataka, India1d ago
-
Data Engineer (Data Bricks) Onsite INR 2000K-3000KADLS | Azure | Azure Data | Azure Data Factory | Azure DatabricksMid-level Full TimeBangalore, Karnataka, India1d ago
-
Senior-level Full TimeGurugram, Haryana, India1d ago
-
002ASR - React Native Engineer INR 1800K-2500KAWS | Adobe XD | CI/CD | Context API | ExpoContract employment | Remote work | UK shiftSenior-level ContractTamil Nadu, Coimbatore, India1d ago
-
Software Engineer - Product (Technical Leadership) INR 2829K-5000KAI | Data Analysis | Java | JavaScript | Machine LearningSenior-level Full TimeBangalore, India1d ago
-
Senior-level Full TimeBangalore, India | Mumbai, India1d ago
-
Consultant- Data Support INR 316K-500KAlteryx | Azure Data | Azure Data Engineering | Azure Data Lake | Azure Databricks24/7 rotation | Customer service focusEntry-level Full TimeBangalore, Karnataka, India1d ago