← All jobs
Alignerr Verified
remote · hourly

Customer Support / Success Task Author

$20–$50/hr
Share
Other hourly remote
Posted Jun 26, 2026

Alignerr is building a dataset of expert tasks that train and evaluate advanced AI agents on real enterprise work. As a Task Author for the Customer Support / Success role, you will design and calibrate end-to-end support triage tasks — reading a ticket, checking account configuration, searching runbooks, and deciding between fix and escalation — that reflect the real judgment calls experienced support professionals make under ambiguity.

Key Responsibilities

  • Author realistic support task prompts: customer issue triage, account configuration checks, runbook lookup, and fix-versus-escalation decisions.
  • Write scoring rubrics that define the correct routing decision, resolution path, or escalation criteria in terms that can be objectively checked.
  • Set up task environments with ticket queues, account records, runbooks, and system states that replicate a genuine support scenario.
  • Solve each task yourself to confirm the scenario is realistic, the correct answer is clear, and the rubric captures the right reasoning.
  • Calibrate task difficulty — adjust ticket ambiguity, account configuration complexity, or runbook depth until the task challenges the model appropriately.
  • Review and correct AI-drafted task prompts or rubrics when provided.

Qualifications

  • Experienced support engineer, technical support specialist, or customer success engineer with hands-on product support experience.
  • Deep familiarity with real product failure modes, escalation paths, and support tooling (ticketing systems, internal knowledge bases, runbooks).
  • Ability to reason through ambiguous support scenarios and articulate why a given routing decision is correct.
  • Comfortable defining verifiable correctness criteria — not just "good customer service" but an objectively defensible resolution or escalation decision.
  • Strong written communication; tasks and rubrics must be precise enough to be evaluated without interpretation.

Nice to Have

  • Experience supporting enterprise or industrial software products.
  • Background writing or maintaining runbooks, escalation playbooks, or internal knowledge bases.
Pay range
$20–$50/hr
Share
Similar roles

You might also like

Lilt Verified New
India · remote · hourly
Content Writer - Marathi - Remote
Other
Posted Sep 15, 2026
Pay on listing
Lilt Verified New
India · remote · hourly
Content Writer - Kannada - Remote
Other
Posted Sep 15, 2026
Pay on listing
Terac Verified New
Brazil · remote · hourly
Smartphone Users: Record Routine Household Activities (on Personal Smartphone)
Other
Posted Sep 15, 2026
$5/hr
Alignerr Verified New
remote · hourly
Data Operations Specialist
Other
Posted Sep 15, 2026
$20–$50/hr