Senior Software Engineer (Machine Learning Platform)
Bengaluru, Karnataka, India
INR 3125K-5000K (estimate) Senior-level Full Time
Tasks
- Build LLM control plane gateway smart routing rate limits failover token cost tracking
- Build training scoring pipelines for classical ML and deep models standardize experiment tracking packaging
- Create templates CLIs sandboxes docs mentor engineers champion MLOps and AI safety best practices
- Define SLOs latency uptime cost view capabilities enable autoscaling spend controls
- Design agent orchestration patterns manage agent state long running workflows
- Enable multi model multi vendor LLM usage canarying versioning
- Enforce safety privacy content filtering prompt response validation PII redaction
- Evolve domain graph entity resolution build reliable data ingestion pipelines
- Implement human in the loop review safe actioning before agent touches dealer systems
- Maintain model agent registry versioning approvals audit trails reproducibility support compliance
- Monitor model and data drift retrain tune models
- Own agent runtime tool registry permissions function calling grounding retrieval
- Power hybrid retrieval graph vector keyword with cache TTL
- Run continuous offline online evaluations for quality factuality bias safety
- Serve real time context to agents with access controls and lineage
- Ship unified REST gRPC API and SDKs normalized schemas structured outputs caching observability traces logs metrics
Perks/Benefits
- N/A
Skills/Tech-stack
A/B | A/B Testing | API Design | AWS | Airflow | B testing | CI/CD | Canary Deployment | Concurrency | Distributed Systems | Docker | Drift Detection | Feature Engineering | Flink | Function Calling | GRPC | Go | Graph Databases | GraphQL | Human-in-the-loop | Hybrid search | Java | Kafka | Kubeflow | Kubernetes | LLM Gateway | MLOps | MLflow | Microservices | Milvus | Model Evaluation | Neo4j | Observability | Python | Qdrant | Quota Management | REST | Rate Limiting | Scala | Spark | The Loop | Token Accounting | Vector Search
Education
N/A
Related jobs
-
Senior AI Engineer INR 3125K-5000KAI Studio | AWS Bedrock | AWS SageMaker | Asynchronous programming | AutogenSenior-level Full TimeBangalore, Karnataka, IN2h ago
-
AI Engineer INR 2520K-3880KActive Learning | Azure Cognitive | Azure Cognitive Services | Azure OpenAI | Azure OpenAI ServiceFamily support | Learning and development opportunities | Life Coverage | Medical coverage | Relocation supportSenior-level Full TimeHyderabad, TS, India2h ago
-
Senior Applied AI Engineer INR 3384K-5000KAI orchestration | Context Management | Data Pipelines | Experimentation | Graph DatabasesDonation matching | Flexible PTO | Lunch stipend | Medical coverage | Team building eventsSenior-level Full TimeBengaluru, Karnataka, India3h ago
-
Staff Software Engineer(MLOps) INR 2857K-4500KAWS Athena | AWS DynamoDB | AWS Glue | AWS SageMaker | Apache AirflowHybrid work model | Mentorship cultureSenior-level Full TimeBangalore5h ago
-
Staff Engineer - Database Reliability Engineering INR 2695K-2829KAWS | Audit Logging | Aurora | Caching | CassandraSenior-level Full TimeChennai, TN, India7h ago
-
Mid-level Full TimePune, IN8h ago
-
Senior-level Full Time110380-IND-BENGALURU-INTL BLR Twr-1&2 CARNATION, India10h ago
-
Principal Engineer - Gen AI INR 2857K-4500KAPI Design | Agentic AI | Architecture Documentation | Artificial Intelligence | AzureSenior-level Full Time111443-IND-HYDERABAD-INTL HYD WF CENTRE BLK B8 …10h ago
-
Senior-level Full Time110380-IND-BENGALURU-INTL BLR Twr-1&2 CARNATION, India10h ago
-
Azure ML Engineer INR 1500K-2000KActive Directory | Application Insights | Azure DevOps | Azure Key Vault | Azure Machine LearningIn person collaboration flexibilityMid-level Full TimeIN319 - IND Bangalore Electronic City …10h ago
-
Azure Data Consultant INR 2516K-3100KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DatabricksSenior-level Full TimeBengaluru, KA, IN10h ago
-
Z2_Sr. Developer|Back-end technologies INR 2500K-4144KCI/CD | Caching | Data Management | Docker | ETLSenior-level Full TimeBangalore, KA, IN10h ago
-
AI and Applied Analytics Lead INR 2520K-4170KArtificial Intelligence | Azure AI | Azure Data | Azure Data Platform | Azure MLSenior-level Full TimeGurgaon, HR, IN, 12201010h ago
-
AI Engineer I (Remote) USD 30K-39KAWS | Attention Mechanisms | CI/CD | Containerization | Distributed SystemsEntry-level Full TimeIndia, Remote R13h ago
-
Staff Software Engineer – Data Platform Engineer INR 2520K-3380KAWS CloudFormation | Amazon EMR | Apache Iceberg | Apache Kafka | Apache SparkSenior-level Full TimeBengaluru, Karnataka, India15h ago
-
Senior Software Engineer– Data Platform Engineer INR 2520K-3200KAWS EMR | Apache Flink | Apache Iceberg | Apache Kafka | Apache SparkSenior-level Full TimeBengaluru, Karnataka, India15h ago
-
Software Engineer II - (Machine Learning Platform) INR 1600K-2000KA/B | A/B Testing | AWS | Airflow | B testingMid-level Full TimeBengaluru, Karnataka, India15h ago
-
Senior Staff Software Engineer (Machine learning Platform) INR 3100K-5000KA/B | A/B Testing | AWS | Airflow | AutoscalingSenior-level Full TimeBengaluru, Karnataka, India15h ago
-
Senior Data Engineer/Data Ops (m/f/d) INR 2520K-4000KApache Airflow | Apache Hadoop | Apache Spark | ClickHouse | Data ProcessingAnnual learning and development budget | Flexible schedule | Home office setup budget | Work from homeSenior-level Full TimeRemote EMEA/ Remote India R15h ago
-
Mid-level Full TimeHyderabad16h ago
-
Consultant- Sr AI Ops Engineer INR 2500K-4725KDocker | Kubernetes | LLM | Language Processing | MLOpsAutonomy | Collaboration | Impact | Mission-driven workSenior-level Full TimeBangalore16h ago
-
Senior Software Engineer - AI INR 3125K-4500KAWS | Asynchronous processing | Azure | Data Pipelines | Distributed SystemsDental insurance | Employee assistance program | Ergonomic work setup | Food and snacks | Generous time offSenior-level Full TimeBangalore, India17h ago
-
Senior-level Full TimeMaharashtra, Mumbai, India20h ago
-
Lead Consultant – Data Engineer INR 2486K-3380KApache Spark | Azure Data | Azure Data Factory | CI/CD | Data FactoryContinuous learning opportunities | MentorshipSenior-level Full TimeIndia-Hyderabad21h ago
-
Senior-level Full TimeIN-TN-Chennai21h ago