Lead AI Engineer
Tasks
- Build model gateway
- Build observability layer
- Create eval in production infrastructure
- Deploy safe model transitions
- Design shadow testing for model transitions
- Ensure resilience and graceful degradation
- Handle provider outages and rate limits
- Implement model routing
- Implement tracing and dashboards
- Manage fallbacks
- Optimize requests and caching
- Run A B testing for model swaps
- Track inference cost
Perks/Benefits
Skills/Tech-stack
A/B | A/B Testing | API Gateway | B testing | Caching | Circuit Breaker | Distributed Systems | GPU workload scheduling | Go | Graceful Degradation | Grafana | Kubernetes | LLM APIs | Latency optimization | Load Balancing | ML Serving | Middleware | Observability | OpenTelemetry | Prometheus | Python | Request Optimization | Resilience Engineering | Retry logic | Streaming | Token Economics | Workload Scheduling
Education
N/A
Roles
AI | AI Engineer | Backend | Backend Engineer | Engineer | Lead | Lead AI Engineer
Related jobs
-
Senior-level Full TimeBengaluru, Karnataka, India1h ago
-
Forward Deployed Engineer, Generative AI, Google Cloud INR 2500K-4500KAPIs | Batch Processing | BigQuery | CI/CD | Cloud platformSenior-level Full TimeBengaluru, Karnataka, India; Gurgaon, Haryana, India1h ago
-
Senior Big Data Engineer INR 800K-1500KAmazon EMR | Amazon Kinesis | Amazon S3 | Apache Airflow | Apache FlinkSenior-level Full TimeChennai, India3h ago
-
Senior-level Full TimeWhitefield, Bangalore, India4h ago
-
Senior-level Full TimeWhitefield, Bangalore, India4h ago
-
Senior-level Full TimeWhitefield, Bangalore, India4h ago
-
Senior-level Full TimeWhitefield, Bangalore, India4h ago
-
Senior-level Full TimeWhitefield, Bangalore, India4h ago
-
Consultant - Delivery INR 2500K-4500KAWS | Amazon SageMaker | Azure | Azure AI | Data PreprocessingSenior-level Full TimePune, MH, IN5h ago
-
Scientist 5, Data Science (12+ years experience . Generative AI, interpretable ML, Statistics) INR 2500K-5000KA/B | A/B Testing | APIs | AWS | Agnostic RAGSenior-level Full TimeBengaluru, KA, India5h ago
-
Associate Staff Engineer, Generative AI INR 2500K-3199KAI Foundry | AI Search | AWS Bedrock | Agentic AI | Azure AIMid-level Full TimeChennai, India6h ago
-
Senior-level Full TimeBANGALORE, KA, IN, 5600486h ago
-
Staff - Back End Developer INR 2040K-3500KAPI Design | AWS | Asynchronous processing | Azure | CachingSenior-level Full TimeBANGALORE, KA, IN, 5600486h ago
-
Sr.EM Data Engineering INR 2800K-3500KAPI Development | AWS | Automated testing | CI/CD | Data ProcessingDental insurance | Flexible time off | Medical insurance | Paid parental leave | SabbaticalSenior-level Full TimeIndia (Remote-First) R7h ago
-
AI Engineering Intern INR 300K-420KAWS | Agent systems | Anthropic Claude | Anthropic Claude API | BenchmarkingAutonomy | Central office location | Code reviews | Employee medical coverage | MentorshipEntry-level InternshipPune, Maharashtra, India R7h ago
-
Sr. Staff Software Engineer, Machine Learning INR 2500K-4500KC++ | Data Pipelines | Deep learning | Explainability | FairnessHealth and wellness programs | Time away from workSenior-level Full TimeBengaluru, KA, India8h ago
-
Lead Software Engineer INR 3375K-4590KAWS | Distributed Systems | GitHub Copilot | Java | LLMContinuous learning | Cross-functional projects | Online learning campus | Training coursesSenior-level Full TimeMumbai, India8h ago
-
Software Engineer II INR 3050K-4590KAWS | Agile | Algorithms | Cloud Computing | Code reviewCareer growth | Collaborative team culture | Flexible work arrangements | Inclusive workplace | Learning opportunitiesSenior-level Full TimeMumbai, India8h ago
-
AI/ML Engineer II INR 950K-1250KAWS | Azure | Containerization | Data Preprocessing | Deep learningMid-level Full TimeRemote, India R9h ago
-
AI/ML Engineer II INR 950K-1250KAmazon Web Services | Azure | Cloud platform | Data Preprocessing | Deep learningMid-level Full TimeRemote, India R9h ago
-
Software Engineer (Backend - SDE 2) INR 2500K-3000KC++ | Cloud Computing | Distributed Systems | Go | JavaMid-level Full TimeBengaluru, India11h ago
-
Sr Software Engineer - Machine Learning (Pytorch/PySpark) INR 2520K-3380KAWS | Amazon EMR | Apache Spark | Azure | BERTFlexible working options | Hybrid work environmentSenior-level Full TimeGurgaon - Cyber Park, India12h ago
-
Senior-level Full TimeOff Embassy Golf Links Business Park, …12h ago
-
Lead Data Scientist INR 2040K-2600KCCPA | Cloud Computing | Data Governance | Data Privacy | DatabricksSenior-level Full TimePune - Baner, India12h ago
-
Senior Incident Optimization & Reliability Specialist - End-User Technology – Vice President INR 1971K-3200KAIOps | Alert Correlation | Automation | CMDB | Cause analysisSenior-level Full TimeTRIL INFO PARK, LITTLEWOOD TOWER, India12h ago