Senior Consultant - AI Training & Evaluation (MBB & Top-Tier Firms)
Tasks
- Build realistic consulting project environments
- Calibrate LLM grading system
- Create golden answer solutions
- Design structured consulting tasks for AI Agents
- Develop evaluation criteria and rubrics
- Structure ambiguous client problems
Perks/Benefits
Skills/Tech-stack
Benchmarking | Commercial due diligence | Cost Optimization | Data Interpretation | Due Diligence | Evaluation rubrics | Financial Modeling | Growth Strategy | Hypothesis generation | Language Models | Large Language Models | Logical reasoning | Market Analysis | Market sizing | Operational diagnosis
Education
N/A
Roles
AI | AI Consultant | Consultant | Management | Management Consultant
Related jobs
-
Analytical writing | Business Analysis | Data Synthesis | Evaluation Frameworks | Financial ModelingIndividual contributor | Project based work | Remote workSenior-level Full TimeUnited States - Remote R14h ago
-
Data Analysis | Evaluation Design | Evaluation rubrics | Financial Modeling | Hypothesis-drivenIndividual Contributor Role | Project based work | Remote workSenior-level Full TimeTexas, United States - Remote R14h ago
-
Benchmarking | Commercial due diligence | Cost Optimization | Due Diligence | Financial ModelingProject based work | Remote workSenior-level Full TimeMichigan, United States - Remote R14h ago
-
Analytical Thinking | English communication | Evaluation rubrics | Financial Modeling | Hypothesis-drivenIndividual Contributor Role | Project based work | Remote workSenior-level Full TimeNew York, New York, United States … R14h ago
-
Principal Agentic AI Engineer USD 274K-338KAgent Orchestration | Auditability | Benchmarking | Confidence scoring | Distributed SystemsContinuing education support | Dental insurance | Flexible vacation policy | Health insurance | Paid parental leaveSenior-level Full Timesan francisconew york R16h ago
-
AI Engineer (Latam, Remote) USD 70K-110KAPI Integration | Authentication | Claude | Database Management | LLM integrationCollaboration with U S based teams | Fully remote | High ownership and autonomy | Part-time flexibilitySenior-level Part TimeFlorida, Aventura, United States of America R1d ago
-
AI Services | AI orchestration | API Integration | Anthropic Claude | Azure AI401k | Dental insurance | Disability insurance | Health insurance | Life insuranceSenior-level Full TimeUS - Remote, United States R1d ago
-
API Development | Agent systems | CI/CD | Churn modeling | Cloud Computing401k matching | Adoption Assistance | Development and career growth opportunities | Fertility treatments | Flexible work schedulesSenior-level Full TimeVirtual Office (Massachusetts), United States R1d ago
-
.NET | API Management | Azure API | Azure API Management | Azure DevOpsDeferred compensation | Disability coverage | FSA options | Life insurance | Medical, dental & vision coverageMid-level Full TimeSalem | OHA | Fairview Industrial … R1d ago
-
AI System Design | Acceptance Testing | Agile | Cause analysis | Conversational AI401k matching | Health insurance | Paid Holidays | Paid time off | Remote workMid-level Full TimeRedmond, WA, United States R1d ago
-
Forward Deployed AI Lead USD 185K-210KAI Maturity | AI Maturity Assessment | AWS | Agentic AI | Agentic Workflow401k company match | 50 percent travel | Company issued laptop | Dental insurance | Equipment stipendSenior-level Full TimeUSA R1d ago
-
AI Developer USD 149K-190KChain-of-Thought | Continuous Deployment | Continuous integration | Deep learning | FHIRFlexible work schedule | Remote work opportunitySenior-level Full TimeUnited States R1d ago
-
Staff Developer, AI Experience USD 161K-287KAgentic coding | Artificial Intelligence | CI/CD | Context engineering | Continuous DeliveryRecognition programs | Remote work | Time off | Volunteer days | Wellness programsSenior-level Full TimeUnited States R2d ago
-
Staff Developer, AI Experience USD 161K-287KAgentic coding | Architecture | Artificial Intelligence | CI/CD | LLM EvaluationCharity support | Professional growth | Recognition programs | Time off programs | Volunteer daysSenior-level Full TimeUnited States R2d ago
-
AI Research Engineer (Applied AI) USD 150K-222KAccelerator hardware | Agentic Systems | Data Quality | Data quality monitoring | Deep learningCareer growth | Remote workMid-level Full TimeUnited States - Remote R2d ago
-
Prompt Engineering Architect USD 119K-228KAgent systems | Agentic Systems | Embeddings | Evaluation Frameworks | LLM APIsCareer growth | Remote workSenior-level Full TimeUnited States - Remote R2d ago
-
Senior AI Engineer USD 107K-195KAI Evaluation | AI Safety | API Integration | Agent systems | AutogenSenior-level Full Time6314 Remote/Teleworker US, United States R2d ago
-
AI Performance Optimization Engineer USD 136K-258KBenchmarking | C++ | Continuous batching | Custom Kernel | Custom Kernel AuthoringMid-level Full TimeUnited States - Remote R2d ago
-
AI Research Engineer (Applied AI) USD 150K-222KAgentic Systems | Computer Vision | Data Quality | Data labeling | Data quality monitoringCareer growth | Remote workMid-level Full TimeUnited States - Remote R2d ago
-
AI Research Engineer (Applied AI) USD 150K-222KAgentic Systems | Computer Vision | Data Quality | Data labeling | Data quality monitoringMid-level Full TimeUnited States - Remote R3d ago
-
AI Research Engineer (Applied AI) USD 150K-222KAccelerator hardware | Agentic Systems | Data Quality | Data labeling | Data quality monitoringMid-level Full TimeUnited States - Remote R3d ago
-
AI Research Engineer (Applied AI) USD 153K-222KAblation Studies | Accelerator hardware | Agentic Systems | Computer Vision | Data QualitySenior-level Full TimeUnited States - Remote R3d ago
-
AI Research Engineer (Applied AI) USD 150K-222KAblation Studies | Computer Vision | Data Quality | Data labeling | Data quality monitoringCareer growth | Health benefits | Remote workMid-level Full TimeUnited States - Remote R3d ago
-
AI Performance Optimization Engineer USD 136K-258KAccess patterns | Benchmarking | C++ | Cache optimization | Compiler optimizationFull-time W2 employment | Health benefits | Remote workMid-level Full TimeUnited States - Remote R3d ago
-
AI Performance Optimization Engineer USD 136K-258KBenchmarking | C++ | Compiler optimization | Continuous batching | DebuggingMid-level Full TimeUnited States - Remote R3d ago