Senior Software Engineer - (Machine learning Platform)
Bengaluru, Karnataka, India
INR 2500K-4500K (estimate) Senior-level Full Time
Tasks
- Build and run LLM control plane and gateway
- Build real time context services with access controls
- Build training and scoring pipelines for machine learning models
- Define SLOs and enable autoscaling and spend controls
- Design agent orchestration patterns and state management
- Enable multi model multi vendor LLM routing
- Enforce safety and privacy
- Evolve domain graph and entity resolution
- Implement human in the loop review and safe actioning
- Implement hybrid retrieval and caching
- Maintain model and agent registry versioning and audit trails
- Monitor model and data drift and retrain
- Own agent runtime tool registry and permissions
- Provide templates CLIs sandboxes and documentation
- Run continuous offline and online evaluations
- Ship unified API and SDKs
Perks/Benefits
- N/A
Skills/Tech-stack
A/B | A/B Testing | API Design | AWS | Apache Airflow | Apache Flink | Apache Kafka | Apache Spark | B testing | CI/CD | Concurrency | Distributed Systems | Docker | Drift Detection | Feature Engineering | Function Calling | GRPC | Go | Graph Databases | Graph Processing | GraphQL | Human-in-the-loop | Hybrid search | Java | Kubeflow | Kubernetes | LLM Gateway | LLM routing | MLOps | MLflow | Microservices | Model Evaluation | Python | Quota Management | REST | Rate Limiting | Retrieval-Augmented Generation | Scala | The Loop | Token Accounting | Vector Search
Education
N/A
Related jobs
-
WFS Analytics 168084 INR 1500K-2500KAgile Development | Architectural patterns | Design Patterns | Distributed Systems | JavaMid-level Full TimeHyderabad, IND-TG, India3h ago
-
Mid-level Full TimeHyderabad, IND-TG, India3h ago
-
WFS Analytics 168071 INR 1500K-2500KAgile | Architectural patterns | Design Patterns | Distributed Systems | JavaMid-level Full TimeHyderabad, IND-TG, India3h ago
-
WFS Analytics 168046 INR 1500K-2500KAgile | Architectural patterns | Design Patterns | Java | JavaScriptMid-level Full TimeHyderabad, IND-TG, India3h ago
-
Mid-level Full TimeHyderabad, IND-TG, India3h ago
-
WFS Analytics 168050 INR 1500K-2500KAgile | Architectural patterns | Design Patterns | Distributed Systems | JavaMid-level Full TimeHyderabad, IND-TG, India3h ago
-
WFS Analytics 168059 INR 1500K-2500KAgile | Architectural patterns | Design Patterns | Distributed Systems | JavaMid-level Full TimeHyderabad, IND-TG, India3h ago
-
WFS Analytics 168066 INR 1500K-2500KAgile | Architecture patterns | Design Patterns | Distributed Systems | JavaMid-level Full TimeHyderabad, IND-TG, India3h ago
-
Principal consultant GenAI LLM Ops Engineer INR 3125K-5000KAWS | Alerting | Azure | Azure OpenAI | BashSenior-level Full TimeIndia-Bangalore6h ago
-
Senior Principal Consultant, Gen_AI Technical Lead INR 2500K-4500KA/B | A/B Testing | AWS | Azure | Azure OpenAISenior-level Full TimeIndia-Bangalore6h ago
-
Software Developer – QA Automation & AI Integration (Backend) INR 1170K-2500KAPI Integration | Automated testing | BDD | CI/CD | CucumberAI certifications | Mentorship | TrainingMid-level Full TimeIndia-Hyderabad6h ago
-
Senior-level Full TimeIN-MH-Pune7h ago
-
Python - AI ML INR 2500K-4225KActiveMQ | Advanced search | Advanced search algorithms | Agile | ChromaDBSenior-level Full TimeIN-AP-Hyderabad7h ago
-
AI Engineer (Fresher) – Mobile Radio Tester INR 180K-180KData Preprocessing | Deep learning | Machine Learning | Model Evaluation | PyTorchEntry-level Full TimeNew Delhi7h ago
-
Senior Software Engineer INR 2500K-2829KAWS Glue | AWS Lambda | AWS Step Functions | Amazon EC2 | Amazon EKSFamily well-being benefits | Health benefits | Hybrid work | Paid time offSenior-level Full TimeHyderabad, India7h ago
-
Data Engineer, Play Data Science and Analytics INR 1500K-2000KAI | Automation | C++ | Data Analysis | Data ModelingMid-level Full TimeBengaluru, Karnataka, India8h ago
-
Mid-level Full TimeGurugram, Haryana, India9h ago
-
Mid-level Full TimeChennai, Tamil Nadu, India9h ago
-
Senior Data Engineer-Digital Banking Kotak 811-Regional Sales INR 2000K-2300KAgile | Apache Hadoop | Apache Hive | Apache Spark | Batch ProcessingSenior-level Full TimeBangalore, Karnataka, India10h ago
-
Senior Data Engineer INR 1000K-2000KAmazon DynamoDB | Apache Airflow | Apache Spark | Azure Data | Azure Data FactorySenior-level Full TimeTelangana, Hyderabad, India10h ago
-
ML Engineer INR 1400K-2000K.NET | API Development | Apache Spark | Azure Cognitive | Azure Cognitive ServicesMid-level Full TimeHyderabad, TG, India10h ago
-
Software Engineer II - Java Fullstack + React + Python(AI/ML) INR 1000K-2200KAWS | AWS CodeDeploy | Agile | CI/CD | CucumberMid-level Full TimeHyderabad, Telangana, India10h ago
-
Principal Engineer, Data Analytics Engineering (Data Engineering , GenAI , Python , SQL) INR 2500K-5000KAWS | AWS Glue | AWS Lambda | Airflow | Amazon BedrockSenior-level Full TimeBengaluru, KA, India10h ago
-
Senior-level Full Timebangalore, India11h ago
-
Mid-level Full TimeChennai, Tamil Nadu, India11h ago