Software Engineer II - (Machine Learning Platform)
Bengaluru, Karnataka, India
INR 1600K-2000K (estimate) Mid-level Full Time
Tasks
- Add human in the loop review for safe actions
- Build LLM control plane and gateway
- Build training and scoring pipelines for machine learning models
- Define SLOs for latency uptime and cost and enable autoscaling
- Design agent orchestration patterns manage agent state and workflows
- Develop unified REST gRPC API and SDKs with normalized schemas caching and observability
- Enable multi model multi vendor LLM usage with canarying and versioning
- Enforce safety and privacy with content filtering PII redaction and validation
- Evolve domain graph entity resolution and data ingestion pipelines
- Implement hybrid retrieval with graph vector and keyword search
- Implement model and data drift monitoring retraining and tuning
- Implement smart routing rate limits failover token cost tracking
- Maintain model and agent registry versioning approvals audit trails and reproducibility
- Own agent runtime tool registry permissions function calling grounding and retrieval
- Run offline and online evaluations for quality factuality bias and safety
- Serve real time context to agents with access controls and lineage
Perks/Benefits
- N/A
Skills/Tech-stack
A/B | A/B Testing | AWS | Airflow | B testing | CI/CD | Control Plane | Docker | Drift Detection | Feature Engineering | Flink | GRPC | Go | Graph Database | Graph Databases | Graph retrieval | GraphQL | Hybrid search | Java | Kafka | Knowledge graphs | Kubeflow | Kubernetes | LLM | LLM Control Plane | LLM Gateway | MLOps | MLflow | Machine Learning | Microservices | Model Monitoring | Neo4j | Observability | Python | REST | Rate Limiting | Retrieval-Augmented Generation | Scala | Spark | Token Accounting | Vector Search
Education
N/A
Related jobs
-
Staff Software Engineer(MLOps) INR 2857K-4500KAWS Athena | AWS DynamoDB | AWS Glue | AWS SageMaker | Apache AirflowHybrid work model | Mentorship cultureSenior-level Full TimeBangalore4h ago
-
Mid-level Full TimePune, IN6h ago
-
Senior-level Full Time110380-IND-BENGALURU-INTL BLR Twr-1&2 CARNATION, India8h ago
-
Principal Engineer - Gen AI INR 2857K-4500KAPI Design | Agentic AI | Architecture Documentation | Artificial Intelligence | AzureSenior-level Full Time111443-IND-HYDERABAD-INTL HYD WF CENTRE BLK B8 …8h ago
-
Senior-level Full Time110380-IND-BENGALURU-INTL BLR Twr-1&2 CARNATION, India8h ago
-
AI Engineer I (Remote) USD 30K-39KAWS | Attention Mechanisms | CI/CD | Containerization | Distributed SystemsEntry-level Full TimeIndia, Remote R11h ago
-
Staff Software Engineer – Data Platform Engineer INR 2520K-3380KAWS CloudFormation | Amazon EMR | Apache Iceberg | Apache Kafka | Apache SparkSenior-level Full TimeBengaluru, Karnataka, India13h ago
-
Senior Software Engineer– Data Platform Engineer INR 2520K-3200KAWS EMR | Apache Flink | Apache Iceberg | Apache Kafka | Apache SparkSenior-level Full TimeBengaluru, Karnataka, India13h ago
-
Senior Software Engineer (Machine Learning Platform) INR 3125K-5000KA/B | A/B Testing | API Design | AWS | AirflowSenior-level Full TimeBengaluru, Karnataka, India13h ago
-
Senior Staff Software Engineer (Machine learning Platform) INR 3100K-5000KA/B | A/B Testing | AWS | Airflow | AutoscalingSenior-level Full TimeBengaluru, Karnataka, India13h ago
-
Senior Data Engineer/Data Ops (m/f/d) INR 2520K-4000KApache Airflow | Apache Hadoop | Apache Spark | ClickHouse | Data ProcessingAnnual learning and development budget | Flexible schedule | Home office setup budget | Work from homeSenior-level Full TimeRemote EMEA/ Remote India R14h ago
-
Mid-level Full TimeHyderabad14h ago
-
Consultant- Sr AI Ops Engineer INR 2500K-4725KDocker | Kubernetes | LLM | Language Processing | MLOpsAutonomy | Collaboration | Impact | Mission-driven workSenior-level Full TimeBangalore14h ago
-
Senior Software Engineer - AI INR 3125K-4500KAWS | Asynchronous processing | Azure | Data Pipelines | Distributed SystemsDental insurance | Employee assistance program | Ergonomic work setup | Food and snacks | Generous time offSenior-level Full TimeBangalore, India15h ago
-
Senior-level Full TimeMaharashtra, Mumbai, India18h ago
-
Lead Consultant – Data Engineer INR 2486K-3380KApache Spark | Azure Data | Azure Data Factory | CI/CD | Data FactoryContinuous learning opportunities | MentorshipSenior-level Full TimeIndia-Hyderabad19h ago
-
Senior-level Full TimeIN-TN-Chennai19h ago
-
GCP Data Engineer INR 1200K-2000KAmazon Redshift | Apache Airflow | Apache Flink | Apache Spark | Apache Spark StreamingSenior-level Full TimeIN-AP-Hyderabad20h ago
-
Senior-level Full TimeIN-AP-Hyderabad20h ago
-
Senior-level Full TimeIndia21h ago
-
Software Engineer III - Python, AWS INR 2500K-3200KAWS | Agentic Frameworks | Amazon Web Services | Apache Airflow | AzureSenior-level Full TimeMumbai, Maharashtra, India21h ago
-
Staff Software Engineer, Applied AI, Search INR 2500K-4500KData Processing | Debugging | Distributed Computing | Fine Tuning | Information RetrievalSenior-level Full TimeBengaluru, Karnataka, India21h ago
-
Agentic Architectures | Analytics | Applied AI | Cloud Computing | Cloud NativeSenior-level Full TimeBengaluru, Karnataka, India21h ago
-
Mid-level Full TimeBengaluru, Karnataka, India21h ago
-
Customer Engineer, AI Infrastructure INR 2500K-4500KASICs | Accelerators | CUDA | Cloud Native | Cloud Native ArchitectureCustomer facing collaboration | Travel opportunitiesSenior-level Full TimeBengaluru, Karnataka, India; Gurugram, Haryana, India21h ago