Senior Applied Machine Learning Engineer (Evals, Agents, Data) - Bengaluru
Bengaluru, Karnātaka, India
INR 3000K-5000K (estimate) Senior-level Full Time
Tasks
- Analyze agent failure patterns
- Automate evaluation checks
- Build evaluation datasets from real usage
- Build regression checks
- Coordinate human review
- Define AI quality standards for agents
- Implement release gates
- Improve agent quality using data and evaluation methods
- Partner with product and engineering teams to ship improvements
- Run offline evaluations
- Run online evaluations
- Select models and fine tune models
- Track AI quality with latency and cost
- Use model graders
Perks/Benefits
- N/A
Skills/Tech-stack
Agent systems | Automated testing | Dataset Building | Evaluation | Experiment design | Experiment tracking | Fine Tuning | Human Labeling | Language Models | Large Language Models | Machine Learning | Model selection | Multimodal AI | Python | Regression testing | Statistics | TypeScript | Video Understanding
Education
N/A
Related jobs
-
Access Control | Anomaly Detection | CI/CD | Classification | Deep learningCollaborative stakeholder environment | Hands on AI engineering | Health and governance focused projects | Remote working modelSenior-level Full TimeIndia14h ago
-
Python AI Engineer INR 360K-420KAI Agents | API Integration | Analytics | Cloud services | Computer VisionEntry-level Full TimeKarnataka, Bengaluru, India17h ago
-
Junior AI Specialist INR 300K-420KAWS | Apache Airflow | DBT | Data Modeling | Deep learningCertification programs | Health insurance | Language courses | Mentorship | Professional developmentEntry-level Full TimePune, India R18h ago
-
AI Engineer INR 3264K-5876KApp Service | Async Programming | Azure App | Azure App Service | Azure FunctionsEntry-level Full TimeBangalore, India; Hyderbad, India18h ago
-
Sr. AI Engineer INR 3740K-6612KA2A protocols | AI Security | Agent runtime | Agent systems | App ServiceSenior-level Full TimeBangalore, India; Hyderbad, India19h ago
-
GenAI Engineer INR 1860K-3000KAWS | Agent systems | Agentic AI | Amazon Elastic Kubernetes Service | Artificial neural networksMid-level Full TimeNoida, Uttar Pradesh, India19h ago
-
Senior Software Development Engineer INR 2500K-4000KAgile | Artificial Intelligence | CI/CD | Data Engineering | Data LakeSenior-level Full TimeIndia20h ago
-
GenAI Engineer INR 1860K-3000KAWS | Agent systems | Agentic AI | Apache Spark | Artificial neural networksMid-level Full TimeNoida, Uttar Pradesh, India21h ago
-
Qualtrics/Tableau - Analytics - Associate INR 4000K-4000KAgile | CI/CD | Dashboard governance | Data Modeling | Data pipelineExecutive-level Full TimeBengaluru, Karnataka, India21h ago
-
AI-ML Engineer II INR 3000K-5000KAWS | Agent systems | Agentic AI | Airflow | AutogenCareer growth | Mentorship | Technical leadership pathway | Technical ownershipSenior-level Full TimeBengaluru East, Karnataka, India22h ago
-
Senior-level Full TimeBengaluru East, Karnataka, India R22h ago
-
Staff Data Engineer INR 3242K-4200KCloud Data | Cloud data platform | Continuous integration | Data Engineering | Data QualityFlexible work hours | Mentorship | Remote work optionsSenior-level Full TimeHyderabad, Telangana , India R22h ago
-
Senior-level Full TimeChennai, Tamil Nadu, India22h ago
-
Software Engineer -Snowflake Development INR 1000K-1500KAWS | Acceptance Testing | Agile | Azure | CSVFlexible hybrid work model | Health insurance | Life insurance | Paid time off | Pension/retirement benefitsMid-level Full TimeChennai, India22h ago
-
Senior Process Manager INR 2500K-5000KAI Agents | AI Foundry | AI Governance | AI orchestration | API DesignSenior-level Full TimeMumbai, Maharashtra, India22h ago
-
Software Engineer INR 2000K-5000KAmazon Bedrock | Amazon SQS | Anthropic | Async Programming | Azure OpenAISenior-level Full TimeBangalore, India Office (BANGALORE)23h ago
-
AI/ML Architect INR 2500K-5000KAmazon Web Services | Anomaly Detection | Azure | Cloud platform | Data IngestionSenior-level Full TimeChennai, TN, India23h ago
-
Senior Data Engineer- Remote, India INR 1500K-2600KApache Airflow | Apache Kafka | Asset bundles | Azure | Azure DataRemote work in IndiaSenior-level Full TimeIndia R23h ago
-
Data Engineer INR 1500K-2500KAnalysis Services | Azure Analysis | Azure Analysis Services | Azure Blob | Azure Blob StorageMid-level Full TimeHyderabad, IN1d ago
-
Engineering-L2-Bengaluru-Associate-Software Engineering INR 1500K-2800KAWS | Agentic Frameworks | Azure | Fine Tuning | Google CloudMid-level Full TimeBengaluru, Karnataka, India1d ago
-
Senior-level Full TimeBengaluru, Karnataka, India1d ago
-
Senior Data Engineer, BizTech INR 3080K-4400KAmazon Redshift | Apache Flink | Apache Kafka | Apache Spark | Batch Data ProcessingSenior-level Full TimeBangalore, India1d ago
-
Senior-level Full TimeIN-Pune1d ago
-
VP - Applied AI ML Lead INR 2817K-4680KApache Hive | Apache Spark | Keras | Language Models | Language ProcessingSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
AI Agents | APIs | AWS | Application Modernization | AutomationCertification support | Employee Wellness Initiatives | Flexible work arrangements | Health insurance | Learning and developmentSenior-level Full TimeIndia1d ago