AI Analyst -Retail Users - US

About Turing:
Turing is one of the world’s fastest-growing AI companies accelerating the advancement and deployment of powerful AI systems.

Turing helps customers in two ways: Working with the world’s leading AI labs to advance frontier model capabilities in thinking, reasoning, coding, agentic behavior, multimodality, multilinguality, STEM and frontier knowledge; and leveraging that work to build real-world AI systems that solve mission-critical priorities for companies.

Role Overview:

We are seeking US-based generalist raters to participate in Workspace Personalization Evals. In this role, raters will perform generalist evaluation work using personalized prompts designed to retrieve context and data across connected Google Workspace apps. We are looking for Retail Users.

Responsibilities:

• Create realistic business-related prompts based on defined user goals
• Interact with multiple AI chatbots (max. 5 turns per conversation)
• Assess response quality across clarity, usefulness, and accuracy
• Provide structured feedback and comparative evaluations
• Submit conversation transcripts and evaluation results

Requirements:

• Must be currently based in the United States.
• Must be an active Google Workspace/Gmail user who regularly uses Google services for personal productivity and communication.
• Must use Gmail as your primary email account.
• Active user of Google Workspace applications, including Gmail, Google Chat, Google Calendar, Google Drive, Google Docs, Google Sheets, Google Slides, and Google Meet.
• Strong familiarity with and regular use of Google Chat, Google Drive, and Google Calendar is required.
• Must have an active Google account with sufficient usage history and activity across Workspace applications.
• Strong analytical and critical thinking skills.
• Ability to follow structured evaluation guidelines.
• Comfortable interacting with AI tools and evaluating response quality.
• Willing to grant the required Google Workspace app permissions and complete all project consent forms and confidentiality agreements.
  
  Description
  In this role, you will help evaluate how effectively AI systems leverage information across connected Google Workspace applications to provide personalized and contextually relevant responses. Your responsibilities will include:
• Evaluating AI-generated responses based on information retrieved from connected Google Workspace applications.
• Assessing the quality of context retrieval across Gmail, Chat, Calendar, Drive, Docs, Sheets, Slides, Meet, and other Workspace services.
• Rating responses for accuracy, relevance, personalization, completeness, and overall usefulness.
• Performing generalist evaluation tasks using project-provided guidelines and evaluation criteria.
• Identifying incorrect context retrieval, missing information, or irrelevant AI responses.
• Providing clear, detailed, and objective evaluation feedback to support model improvements.
• Following project guidelines while maintaining confidentiality and data privacy requirements.
  
  Offer Details
• Commitment Required: Up to 40 hours per week.
• Engagement Type: Contractor
• Engagement Length: upto 4  months
  
  Evaluation Process
• Shortlisted candidates will be asked to complete a Job Interest Form.
• Eligible candidates will proceed through the project-specific screening and qualification process.
• Final selected candidates will be contacted with the next steps, including consent requirements and onboarding.