Senior Consultant - AI Training & Evaluation (MBB & Top-Tier Firms)
Tasks
- Build project environments for AI agents
- Create golden answer solutions
- Define grading frameworks
- Design AI agent consulting tasks
- Develop evaluation rubrics
- Produce client ready recommendations
- Structure client problems
- Train and calibrate LLM grading system
Perks/Benefits
Skills/Tech-stack
Benchmarking | Commercial due diligence | Cost Optimization | Due Diligence | Financial Modeling | Growth Strategy | Hypothesis-driven | Hypothesis-driven thinking | Market Analysis | Market sizing | Operational diagnosis | Problem Solving | Structured Problem-Solving | Written communication
Education
N/A
Roles
AI | AI Consultant | Consultant | Management | Management Consultant
Related jobs
-
Analytical writing | Business Analysis | Data Synthesis | Evaluation Frameworks | Financial ModelingIndividual contributor | Project based work | Remote workSenior-level Full TimeUnited States - Remote R14h ago
-
Benchmarking | Commercial due diligence | Cost Optimization | Data Interpretation | Due DiligenceProject-based role | Remote workSenior-level Full TimeFlorida, United States - Remote R14h ago
-
Data Analysis | Evaluation Design | Evaluation rubrics | Financial Modeling | Hypothesis-drivenIndividual Contributor Role | Project based work | Remote workSenior-level Full TimeTexas, United States - Remote R14h ago
-
Analytical Thinking | English communication | Evaluation rubrics | Financial Modeling | Hypothesis-drivenIndividual Contributor Role | Project based work | Remote workSenior-level Full TimeNew York, New York, United States … R14h ago
-
Principal Agentic AI Engineer USD 274K-338KAgent Orchestration | Auditability | Benchmarking | Confidence scoring | Distributed SystemsContinuing education support | Dental insurance | Flexible vacation policy | Health insurance | Paid parental leaveSenior-level Full Timesan francisconew york R16h ago
-
AI Performance Optimization Engineer USD 136K-258KBenchmarking | C++ | Continuous batching | Custom Kernel | Custom Kernel AuthoringMid-level Full TimeUnited States - Remote R2d ago
-
AI Performance Optimization Engineer USD 136K-258KAccess patterns | Benchmarking | C++ | Cache optimization | Compiler optimizationFull-time W2 employment | Health benefits | Remote workMid-level Full TimeUnited States - Remote R3d ago
-
AI Performance Optimization Engineer USD 136K-258KBenchmarking | C++ | Compiler optimization | Continuous batching | DebuggingMid-level Full TimeUnited States - Remote R3d ago
-
AI Performance Optimization Engineer USD 136K-258KAccess Optimization | Attention Optimization | Benchmarking | C++ | Compiler optimizationMid-level Full TimeUnited States - Remote R4d ago
-
Senior AI Architect USD 134K-237KAI orchestration | Agentic AI | Auditability | Caching | Chunking401k matching program | Adoption Assistance | Development and career growth | Fertility treatments | Flexible work schedulesSenior-level Full TimeVirtual Office (Colorado), United States R5d ago
-
AI Architect USD 140K-180KAI Foundry | AI Search | AI Studio | Agent SDK | Agents SDKFlexible work arrangements | Health, dental, vision insurance | Ongoing training | PTO | Paid medical premiumsSenior-level Full TimeUnited States - Remote R6d ago
-
Forward Deployed Engineer - Applied AI - Senior Manager - Financial Services - Consulting USD 144K-374KAPI Gateway | API Management | API strategy | AWS API | AWS API GatewaySenior-level Full TimeNew York, NY, US, 10001-8604 R7d ago
-
Principal AI Engineer USD 240K-260KAI systems | Agent evaluation | Agent systems | Agentic AI | Anthropic API401k | Company-provided equipment | Disability insurance | Flexible vacation policy | Life insuranceSenior-level Full TimeRemote (United States) R7d ago
-
Senior AI Engineer USD 170K-200KAgent systems | Agentic AI | Automated evals | Backend architecture | Continuous Improvement401k | Company equipment provided | Equity compensation | Flexible vacation policy | Medical, dental & vision coverageSenior-level Full TimeRemote (United States) R7d ago
-
Artificial Intelligence | Attention to detail | Data Annotation | English language | Fact-checkingAI Projects Portfolio Experience | Flexible schedule | Freelance work | Part-time | Remote workEntry-level FreelanceFlorida, United States - Remote R11d ago
-
Artificial Intelligence | Attention to detail | Content Classification | Data labeling | Fact-checkingFlexible schedule | Freelance work | Part-time remote workEntry-level FreelanceUnited States - Remote R11d ago
-
Astrophysics | Benchmarking | Bioinformatics | Circuit simulation | Collider Data AnalysisFlexible scheduling | Fully remote | Independent contractor | Weekly paymentsMid-level Full TimeUnited States - Remote R15d ago
-
AI Agents | Backend Development | Cost Optimization | Data Processing | Distributed SystemsDirect founder level technical exposure | Full visa sponsorship | High ownership | High-impact work | Remote workSenior-level Full TimeSan Francisco, CA; Onsite R15d ago
-
Agentic Systems | Benchmarking | Data Analysis | Data Visualization | Dataset ConstructionOnsite relocation support | Remote work | Visa sponsorship supportSenior-level Full TimeSan Francisco, CA; Onsite R16d ago
-
Business Development - Strategy Consultant (Partnerships Operations & Analytics Healthcare) – Hybrid (ET/CT) R0056075 USD 118K-207KBusiness Development | CRM Analytics | Data Visualization | Excel | Financial Modeling401k | Commuter benefits | FSA/HSA | Medical, dental, vision plans | Paid parental leaveExecutive-level Full TimeUSA - Philadelphia, PA, United States R16d ago
-
Senior Partner AI Architect USD 134K-237KAPIs | Access Management | Agentic AI | Caching | Cloud ArchitectureSenior-level Full TimeVirtual Office (North Carolina), United States R19d ago
-
Senior AI Architect USD 134K-237KArtificial Intelligence | Caching | Cloud Architecture | Cost Optimization | Embeddings401k matching program | Adoption Assistance | Career growth opportunities | Dental insurance | Fertility treatmentsSenior-level Full TimeVirtual Office (Georgia), United States R19d ago
-
Senior AI Architect USD 134K-237KArtificial Intelligence | Auditability | Caching | Cloud Computing | Cost Optimization401k matching program | Adoption Assistance | Development and career growth opportunities | Fertility treatments | Flexible work scheduleSenior-level Full TimeVirtual Office (Texas), United States R19d ago
-
Senior AI Architect USD 134K-237KAccess Management | Agentic AI | Artificial Intelligence | Caching | Cost Optimization401k matching | Adoption Assistance | Development and career growth | Fertility treatments | Flexible work schedulesSenior-level Full TimeVirtual Office (Arizona), United States R19d ago
-
Mid-level Full TimeRemote Worker - USA R22d ago