Senior Consultant - AI Training & Evaluation (MBB & Top-Tier Firms)
Tasks
- Build financial models
- Build realistic consulting project environments
- Calibrate LLM based grading system
- Conduct market analysis
- Create grading frameworks and evaluation rubrics
- Define evaluation criteria and quality standards
- Design structured consulting tasks for AI Agents
- Develop client-ready deliverables
- Develop golden answer solutions for tasks
- Form and defend recommendations under uncertainty
- Structure ambiguous client problems
- Synthesize findings from messy inputs
Perks/Benefits
Skills/Tech-stack
Analytical planning | Evaluation rubrics | Financial Modeling | Hypothesis development | Language Models | Language Processing | Large Language Models | Market Analysis | Natural Language | Natural Language Processing | Problem Solving | Quality Assurance | Recommendation development
Education
N/A
Roles
AI | AI Consultant | Consultant | Management | Management Consultant
Related jobs
-
Team Lead, AI Engineering USD 140K-190KAPI Integration | Agent Orchestration | Agent systems | Agile | Code review401k match | Career growth opportunities | Dental insurance | Employee resource groups | Life insuranceSenior-level Full TimeRemote, United States R6h ago
-
Agentic AI Developer USD 63K-105KAPI Integration | Artificial Intelligence | Cloud deployment | Human-in-the-loop | LangchainHealth insurance | Holiday pay | Learning and development | Life insurance | Long-term disabilitySenior-level Full TimeUSA-Remote Work R10h ago
-
Product Manager, Central Products USD 171K-237KA/B | A/B Testing | AI Evaluation | Agent Orchestration | B testingMid-level Full TimeMenlo Park, CA | Remote, US R11h ago
-
Senior Director, Applied AI USD 180K-265KAgent SDK | Anthropic Agent SDK | Context engineering | Evals | Knowledge graphsAI and cloud credits | Equity | Global team collaboration | Professional developmentSenior-level Full TimeRedesign Health R1d ago
-
AI Solution Strategist USD 125K-188KArtificial Intelligence | Conversational AI | Customer Experience | Data-Driven Decision Making | Data-drivenMid-level Full TimeUSA - Remote R1d ago
-
AI Engineer USD 108K-129KAPIs | Access Controls | Agent Orchestration | Agentic architecture | CI/CDAsynchronous work environment | Continuous learning culture | Knowledge sharing | Mentorship opportunities | Remote workSenior-level Full TimeRemote, US R1d ago
-
Senior AI Engineer USD 160K-200KAPI Gateway | AWS ECS | AWS Fargate | AWS IAM | Amazon APIHealth care benefitsSenior-level Full TimeUnited States R1d ago
-
AI Research Engineer (Applied AI) USD 100K-150KAblation Studies | Accelerator hardware | Agentic Systems | Computer Vision | Data QualityMid-level Full TimeUnited States - Remote R1d ago
-
AI Research Engineer (Applied AI) USD 100K-150KAblation Studies | Accelerator hardware | Computer Vision | Data Quality | Data labelingMid-level Full TimeUnited States - Remote R1d ago
-
AI Research Engineer (Applied AI) USD 100K-150KAblation Studies | Accelerators | Agentic Systems | Computer Vision | Data QualityBenefits | Career growth | Remote workMid-level Full TimeUnited States - Remote R1d ago
-
AI Research Engineer (Applied AI) USD 100K-150KAccelerator hardware | Agentic Systems | Computer Vision | Data Quality | Data quality monitoringMid-level Full TimeUnited States - Remote R1d ago
-
AI Research Engineer (Applied AI) USD 100K-150KAblation Studies | Accelerator hardware | Agentic Systems | Computer Vision | Data QualityCareer growth | Diversity and inclusion | Remote workMid-level Full TimeUnited States - Remote R1d ago
-
AI Data Infrastructure Engineer USD 100K-150KApache Beam | CI/CD | Code review | Data Governance | Data LineageCareer growth | H1B transfer support | Remote work | W2 employmentMid-level Full TimeUnited States - Remote R1d ago
-
AI Automation Specialist (REMOTE) USD 100K-130KAPIs | Artificial Intelligence | Automation | CRM | CloudHealth insurance | Retirement plan | Unlimited PTOSenior-level Full TimeUnited States - Remote R1d ago
-
Senior AI/ML Engineer USD 128K-188KAWS CDK | AWS Cloud | AWS Cloud Architecture | AWS Lambda | Agile401k matching | Dental insurance | Health insurance | Paid Holidays | Paid time offSenior-level Full TimeHerndon, Virginia, United States R1d ago
-
Business Strategy | Evaluation rubrics | Financial Modeling | Hypothesis Testing | Language ModelsProject based work | Remote workSenior-level Full TimeFlorida, United States - Remote R1d ago
-
Analytical writing | Financial Modeling | Hypothesis-driven | Hypothesis-driven thinking | Market AnalysisProject based work | Remote workSenior-level Full TimeMichigan, United States - Remote R1d ago
-
Analytical writing | Financial Modeling | Hypothesis-driven | Hypothesis-driven thinking | Market AnalysisIndividual Contributor Role | Project based work | Remote work | Self-directed workSenior-level Full TimeTexas, United States - Remote R1d ago
-
Analytical reasoning | Business Strategy | Financial Modeling | Hypothesis-driven | Hypothesis-driven thinkingFlexible schedule | Project based work | Remote workSenior-level Full TimeNew York, New York, United States … R1d ago
-
Agentic AI Project Experience Program (Remote) USD 30K-40KAI Agents | API Integration | Agent systems | Airtable | Artificial IntelligenceMentor guidance | Portfolio project work | Team collaboration | Weekend live sessionsNone Full TimeSeattle, Washington, United States - Remote R1d ago
-
Applied AI Engineer | $150k-$175k + Hybrid + Equity | Exciting High-Growth AI-Powered Operational Intelligence Startup A USD 150K-175KAI Agents | AI orchestration | AI reliability | API Development | Backend Development10 days PTO | Equity | Health insurance | Hybrid work | Medical coverageExecutive-level Full TimeWayne, PA, United States R2d ago
-
AI Observability | Anthropic | Autogen | Braintrust | CrewAICommunity lunches | Pet-friendly office environment | Snacks and refreshmentsEntry-level InternshipLos Angeles Office R2d ago
-
Senior Manager, Data Science - Styling Algorithms) USD 200K-246KA/B | A/B Testing | Agentic AI | Artificial Intelligence | B testingAnnual bonus | Dental insurance | Equity grants | Medical insurance | Restricted stock unitsSenior-level Full TimeRemote USA R2d ago
-
Strategic AI/BI Account Executive USD 155K-214KAI | Apache Spark | Business Intelligence | Cloud Data | Cloud Data PlatformsExecutive-level Full TimeRemote - New York R2d ago
-
Senior Manager, AI Engineering USD 223K-358KArtificial Intelligence | Cost Optimization | Evaluation | Fine Tuning | GPU clusters401k match | Adoption reimbursement | Comprehensive onboarding | FSA | Fertility benefitsSenior-level Full TimeUS NY Remote, United States R2d ago