AI Evaluation Specialist - QA
Tasks
- Assess multi-agent systems
- Benchmark generative AI models
- Collaborate with cross-functional teams
- Create evaluation reports
- Design evaluation pipelines
- Develop automated testing scripts
- Mentor junior evaluators
- Monitor AI quality and safety
Perks/Benefits
- N/A
Skills/Tech-stack
AI APIs | Agent AI | Collaboration | Data Visualization | Documentation | Evaluation Frameworks | Generative AI | Generative AI APIs | ML evaluation | Metrics Analysis | Multi-Agent | Multi-Agent AI | Python
Education
Roles
AI | AI Evaluation Specialist | Evaluation Specialist | Specialist
Related jobs
-
Senior Data Scientist #3081 INR 2500K-3200KAWS SageMaker | Azure ML | Azure OpenAI | CI/CD | DatabricksFlexible working hours | Global collaboration opportunities | Professional development programs | Recognition programsSenior-level Full TimeChennai, India7h ago
-
AI ML Proactive INR 2500K-3500KAI Stack | API Integration | Agent Builder | BigQuery Vector Search | Cloud ArchitectureSenior-level Full TimeIN-AP-Hyderabad9h ago
-
Senior Staff Engineer, Generative AI INR 2500K-4500KAPI Development | AWS | Airflow | Artificial Intelligence | Azure MLContinuous learning opportunities | Flexible work hours | Remote work optionsSenior-level Full TimeRemote, India R10h ago
-
Senior Principal Data Scientist INR 2535K-4200KAlgorithms | Application development | BERT | Containerization | Distributed ArchitectureCompetitive benefits | Inclusive work environment | Learning and development opportunitiesSenior-level Full TimeBangalore, Karnataka, India10h ago
-
Engineering Analyst II, Gemini and Labs INR 1340K-2230KData Analysis | Hypothesis Testing | Python | SQL | Statistical AnalysisMid-level Full TimeBengaluru, Karnataka, India10h ago
-
Mid-level Full TimePune, Maharashtra, India11h ago
-
Senior-level Full TimeBangalore, Karnataka, IN13h ago
-
Senior AI/ML Engineer INR 2500K-4500KAI | Agent architectures | Agent systems | Deep learning | Fine TuningCollaborative environment | Cutting-edge AI technology | Innovation-driven cultureSenior-level Full TimeBengaluru, KA, India13h ago
-
Senior AI/ML Engineer INR 2500K-4500KAI frameworks | Agent systems | Fine Tuning | Language Models | Large Language ModelsSenior-level Full TimeBengaluru, KA, India14h ago
-
Applied AI ML Lead - Agentic/ Gen AI, Python INR 2500K-3200KAPI Development | Agentic AI | Cloud Platforms | Data pipeline | GitSenior-level Full TimeBengaluru, Karnataka, India14h ago
-
Mid-level Full TimeBangalore, Karnataka, India15h ago
-
Gen AI Architect INR 2500K-3200KAPIs | AWS | Agent Frameworks | Azure | CI/CDAI engineering certifications | Cloud certificationsSenior-level Full TimeNoida, Uttar Pradesh, India16h ago
-
Group Manager - AI Research INR 1875K-2800KAI frameworks | Artificial Intelligence | Fine Tuning | Generative AI | Language ModelsMid-level Full TimeGurgaon, HR, India16h ago
-
Senior-level Full Timebangalore, India16h ago
-
Senior-level Full TimeIN Bengaluru, India22h ago
-
Associate Consultant, Automation and RPA INR 2000K-2750KAzure | CI/CD | GitLab | Langgraph | LangsmithMid-level Full TimeBangalore, India22h ago
-
Senior Manager - AI & Innovation INR 2500K-4500KA/B | A/B Testing | AI platforms | B testing | Cloud platformFlexible working | Health insurance | Inclusive culture | Professional developmentSenior-level Full TimeHyderabad (Office), India22h ago
-
Senior Engineer, AI/ML - Pune INR 2535K-4725KAWS | C++ | Cloud infrastructure | Data Engineering | Data StructuresSenior-level Full TimeIndia-Pune22h ago
-
Principal Engineer, AI/ML - Pune INR 2535K-4500KAI | AWS | C++ | Cloud infrastructure | Data PipelinesSenior-level Full TimeIndia-Pune22h ago
-
Sr Solution Architect, Google Tech INR 2500K-4500KAI Risk | AI Tooling | AI architecture | AI risk management | APIsFlexible working hours | Health insurance | Mentorship opportunities | Training programsSenior-level Full TimeUniOps Bangalore Centre, India22h ago
-
Senior Java Fullstack GenAI Developer - Vice President INR 2000K-3500KAWS | Agentic AI | Angular | CI/CD | CloudFormationSenior-level Full TimePLOT NO-1, S.NO. 77, India22h ago
-
Sr Support Engineer 1 – AI, LLM, Python, ML INR 2500K-3600KAzure ML | CI/CD | Docker | Experiment tracking | GitSenior-level Full TimeBangalore, India22h ago
-
AI Enablement - Full Stack Developer INR 2500K-4144KAI Services | AKS | API Design | Agile | AngularMid-level Full TimeCandor TechSpace, Noida, India22h ago
-
AI Platform Architect- VP INR 2500K-4500KAPI Design | AWS Bedrock | Agentic Workflows | Amazon Elastic Container Registry | Amazon Elastic Container ServiceSenior-level Full TimeBCIT Bengaluru Office (MGS), India22h ago
-
Engineer AI/ML INR 1875K-2800KCloud Computing | Data Pipelines | Data Validation | Dataset Preprocessing | Generative AIFlexible work environment | Internal mobility | Volunteering opportunities | Well-being support | Work-life balanceMid-level Full TimeKA Bangalore, India22h ago