Senior Software Engineer (Machine Learning Platform)
Bengaluru, Karnataka, India
INR 3125K-5000K (estimate) Senior-level Full Time
Tasks
- Build LLM control plane gateway smart routing rate limits failover token cost tracking
- Build training scoring pipelines for classical ML and deep models standardize experiment tracking packaging
- Create templates CLIs sandboxes docs mentor engineers champion MLOps and AI safety best practices
- Define SLOs latency uptime cost view capabilities enable autoscaling spend controls
- Design agent orchestration patterns manage agent state long running workflows
- Enable multi model multi vendor LLM usage canarying versioning
- Enforce safety privacy content filtering prompt response validation PII redaction
- Evolve domain graph entity resolution build reliable data ingestion pipelines
- Implement human in the loop review safe actioning before agent touches dealer systems
- Maintain model agent registry versioning approvals audit trails reproducibility support compliance
- Monitor model and data drift retrain tune models
- Own agent runtime tool registry permissions function calling grounding retrieval
- Power hybrid retrieval graph vector keyword with cache TTL
- Run continuous offline online evaluations for quality factuality bias safety
- Serve real time context to agents with access controls and lineage
- Ship unified REST gRPC API and SDKs normalized schemas structured outputs caching observability traces logs metrics
Perks/Benefits
- N/A
Skills/Tech-stack
A/B | A/B Testing | API Design | AWS | Airflow | B testing | CI/CD | Canary Deployment | Concurrency | Distributed Systems | Docker | Drift Detection | Feature Engineering | Flink | Function Calling | GRPC | Go | Graph Databases | GraphQL | Human-in-the-loop | Hybrid search | Java | Kafka | Kubeflow | Kubernetes | LLM Gateway | MLOps | MLflow | Microservices | Milvus | Model Evaluation | Neo4j | Observability | Python | Qdrant | Quota Management | REST | Rate Limiting | Scala | Spark | The Loop | Token Accounting | Vector Search
Education
N/A
Related jobs
-
Agentic Architectures | Applied AI | Cloud Architecture | Data Systems | Database systemsSenior-level Full TimeBengaluru, Karnataka, India5h ago
-
Data Technology Engineer (Pune) INR 1500K-2500KAPI Management | Apache Airflow | Apigee | CI/CD | Container image managementMid-level Full TimeMaharashtra, Mumbai, India6h ago
-
Software Engineer - Data Science INR 2000K-3000KA/B | A/B Testing | Agentic AI | B testing | ClaudeCommercial awareness | Cross-functional collaboration | Onshore Offshore model experience | UK client experienceSenior-level Full TimeMumbai, MH, India8h ago
-
Lead Data Engineer INR 2520K-3380KAWS | AWS CloudFormation | AWS DMS | AWS Glue | AWS Lake FormationCommunity outreach programs | Employee Resource Group | Employee stock purchase program | Health and wellness incentivesSenior-level Full TimeBangalore, KA, IN, 56007610h ago
-
DE&A - GCP Data Engineer INR 2000K-2040KAgile | Alation | Apache Airflow | Apache Hadoop | Apache HiveSenior-level Full TimePune, Maharashtra, India11h ago
-
Data Engineer INR 2800K-4000KCloud Databases | Data Modeling | Data Normalization | Data Quality | Data WarehousingOnshore Offshore modelSenior-level Full TimeMumbai, MH, India22h ago
-
Mid-level Full TimeKochi, Kerala, India1d ago
-
Software Engineer - AI/ML INR 2500K-4500KAPI Development | Agent-based | Agent-based systems | Anthropic API | C#Senior-level Full TimeBengaluru, KA, India1d ago
-
Data Engineering Lead INR 3000K-4000KAmazon Web Services | Artificial Intelligence | Data Governance | Data Pipelines | Data platformAnnual bonus | Health insurance | Knowledge sharing | Learning and development | PensionSenior-level Full TimeRemote, Bangalore R1d ago
-
Mid-level Full TimePune, MAHĀRĀSHTRA, India1d ago
-
Senior Data Engineer (Databricks) (Remote) INR 1500K-2040KAI | API Keys | AWS Glue | AWS IAM | AWS LambdaCollaboration | Ownership culture | Remote workSenior-level Full TimeMaharashtra, Pune, India R1d ago
-
Analytics Engineer INR 2755K-4000KAWS | Alteryx | Apache Airflow | Azure | Azure DataDiscounted gym membership | Flexible working | Life assurance | Medical insurance | Pension schemeSenior-level Full TimeHyderabad, Telangana, India1d ago
-
AI / ML Engineer (Remote) INR 2500K-4500KAWS | Amazon SageMaker | CI/CD | Computer Vision | Data PreprocessingRemote workSenior-level Full TimeMaharashtra, Pune, India R1d ago
-
Fullstack Data Engineer (India) INR 1500K-2300KAPI Keys | AWS Glue | AWS IAM | AWS Lambda | AWS S3Remote work | UK shift hoursSenior-level Full TimeMaharashtra, Pune, India1d ago
-
Principal Consultant, Cloud Data Engineer INR 2800K-4000KApache Spark | Azure | Big Data | CI/CD | Data ModelingAI certifications | Mentorship | World-class trainingSenior-level Full TimeIndia-Bangalore1d ago
-
DE&A - Core - Advanced Data Engineering - Business Analyst INR 2400K-3500KADLS | AWS | Airflow | Anthropic Claude | Apache SparkAgile team collaboration | On-site workSenior-level Full TimeBengaluru North, Karnataka, India1d ago
-
Electrical Engineer with Computational Skill - "High-rise & Complex Buildings" - Chennai / Noida INR 1400K-1854KAMTECH | AutoCAD | Autodesk Revit | BIM | BIM automationContinuing professional developmentSenior-level Full TimeChennai, India1d ago
-
Senior-level Full TimePune, Maharashtra, India1d ago
-
Machine Learning Design Engineer, Silicon INR 3400K-5000KASIC design | Area Optimization | Assertion-based Formal Verification | CHISEL | CacheSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
Staff Software Engineer, Cloud Bigtable INR 1800K-3200KBigtable | C++ | Cassandra | Cloud deployment | Cloud infrastructureSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
Senior-level Full TimePune, India1d ago
-
Analytics Solutions Manager INR 1234K-1748KAccess Control | Anomaly Detection | Artificial Intelligence | CDC | CI/CDMid-level Full TimeBengaluru, Karnataka, India1d ago
-
Software Engineer II INR 1400K-1700KAPI Development | Apache Spark | Azure | Azure Cosmos | Azure Cosmos DBMid-level Full TimeBengaluru, KA, IN1d ago
-
Associate - Data Scientist INR 1800K-2500KAWS | Agent systems | Apache Spark | Azure | Cloud platformMid-level Full TimeNoida, Uttar Pradesh, India1d ago
-
Senior Data Engineer INR 2800K-3500KAPI Development | AWS | Algorithms | Amazon Kinesis | Amazon RedshiftCharity programs | Discounted gym memberships | Environmental initiatives | Flexible working | Life assuranceSenior-level Full TimeHyderabad, India1d ago