1. Role Overview
Mercor is partnering with a leading AI research organization to engage experienced management consultants for a project focused on evaluating how well AI systems perform real-world consulting work. Rather than producing deliverables yourself, you will define what excellent work looks like: designing task-specific grading criteria and scoring completed work samples with rigorous, well-reasoned written justifications.
2. Key Responsibilities
Design precise, task-specific grading criteria for real-world consulting deliverables (market analyses, strategy recommendations, financial models, client-ready slide decks, and implementation roadmaps)
Score AI-generated and human work samples against those criteria, with detailed written justifications for every score
Apply consistent, evidence-based judgment so that scores are reproducible and defensible
Incorporate structured feedback from senior reviewers and iterate quickly on your work
3. Ideal Qualifications
5+ years of professional management consulting experience
Background at a top-tier strategy or management consulting firm (e.g., McKinsey, Bain, BCG, or equivalent)
Deep fluency in structured problem solving, market sizing, financial modeling and business-case building, and slide-based executive communication
Exceptionally strong written communication
Detail-oriented, consistent, and comfortable having your judgment reviewed and calibrated against peers
Prior experience with AI training, evaluation, or human-data projects is a strong plus
4. Application Process
Submit your resume or relevant professional background to get started
Qualified applicants may be asked to complete a brief assessment or submit additional information
New
New
New