Small business owners - US

About Turing:
Turing is one of the world’s fastest-growing AI companies accelerating the advancement and deployment of powerful AI systems.

Turing helps customers in two ways: Working with the world’s leading AI labs to advance frontier model capabilities in thinking, reasoning, coding, agentic behavior, multimodality, multilinguality, STEM and frontier knowledge; and leveraging that work to build real-world AI systems that solve mission-critical priorities for companies.

Role Overview:

We are seeking US-based generalist raters to participate in Workspace Personalization Evals. In this role, raters will perform generalist evaluation work using personalized prompts designed to retrieve context and data across connected Google Workspace apps. We are looking for a mix of Small Business Owners (>10 employees) and Retail Users.

Responsibilities:

• Create realistic business-related prompts based on defined user goals
• Interact with multiple AI chatbots (max. 5 turns per conversation)
• Assess response quality across clarity, usefulness, and accuracy
• Provide structured feedback and comparative evaluations
• Submit conversation transcripts and evaluation results

Requirements:

• Business owner with >10 Employees and strong understanding of small business operations
• Strong analytical and critical thinking skills
• Ability to follow structured evaluation guidelines
• Comfortable interacting with AI tools
• Primary Communication Tool: Must use Gmail as their primary business communication tool.
• App Connectivity: High familiarity and active usage across a combination of Google Workspace products, including Gmail, Chat, Calendar, Drive, Docs, Spreadsheets, Slides, Meet, etc., with a strong emphasis on heavy Chat, Drive, and Calendar usage.
  
  Description
  
  In this role, you will help evaluate how effectively AI systems leverage information across connected Google Workspace applications to provide personalized and contextually relevant responses. Your responsibilities will include:
• Evaluating AI-generated responses based on information retrieved from connected Google Workspace applications.
• Assessing the quality of context retrieval across Gmail, Chat, Calendar, Drive, Docs, Sheets, Slides, Meet, and other Workspace services.
• Rating responses for accuracy, relevance, personalization, completeness, and overall usefulness.
• Performing generalist evaluation tasks using project-provided guidelines and evaluation criteria.
• Identifying incorrect context retrieval, missing information, or irrelevant AI responses.
• Providing clear, detailed, and objective evaluation feedback to support model improvements.
• Following project guidelines while maintaining confidentiality and data privacy requirements.
  
  Offer Details
• Commitment Required: Up to 40 hours per week.
• Engagement Type: Contractor
• Engagement Length: upto 4  months
  
  Evaluation Process
• Shortlisted candidates will be asked to complete a Job Interest Form.
• Eligible candidates will proceed through the project-specific screening and qualification process.
• Final selected candidates will be contacted with the next steps, including consent requirements and onboarding.