Senior Consultant - AI Training & Evaluation (MBB & Top-Tier Firms)
Tasks
- Build consulting project environments
- Create golden answer solutions
- Define evaluation criteria and quality standards
- Design structured consulting tasks for AI Agents
- Develop evaluation rubrics
- Evaluate AI outputs at scale
- Form and defend recommendations under uncertainty
- Produce client ready deliverables under time pressure
- Train and calibrate LLM grading system
Perks/Benefits
Skills/Tech-stack
Analytical reasoning | Data Synthesis | Evaluation rubrics | Financial Modeling | Hypothesis-driven | Hypothesis-driven thinking | Language Models | Large Language Models | Machine Learning | Market Analysis | Problem Solving | Problem structuring | Structured Problem-Solving
Education
N/A
Roles
AI | AI Consultant | Consultant | Management | Management Consultant
Related jobs
-
AI Solutions Builder EUR 67K-90KAWS | Agentic AI | CRM data | Command Line | Data integrationDirect collaboration with executive team | Fast paced collaborative team | Fully remote work | Growth opportunities | High ownership autonomySenior-level Full TimeEurope; Portugal - Remote; Serbia - … R5d ago
-
Sr. Tech AI/ML Product Manager - Job Hunt Engine USD 80K-120KA/B | A/B Testing | Agents | Artificial Intelligence | B testingCompetitive compensation | Equity | Paid time off | Remote work | Sick leaveSenior-level Full TimeSerbia - Remote R5d ago
-
AI Engineer - AI/LLM (Backend) USD 30K-42KAPI Design | AWS | Anthropic API | Backend Development | ChromaCollaborative low bureaucracy environment | Own and shape internal productSenior-level Full TimeSerbia - Remote R26d ago
-
AI Solution Architect USD 184K-287KAnsible | CI/CD | Containerization | Docker | Experiment trackingAdditional fully paid sick leave days | Additional vacation days | Allowance for life events and birthdays | Flexible working hours | Free snacks and drinksSenior-level Full TimePoland, Serbia, Lithuania, Cyprus, Georgia R1mo ago