Frontier models can explain robotics concepts and still stumble when asked to derive, tune, or debug a real system. This role puts your practice on that gap. You write realistic problems based on work you have done yourself, give them to frontier AI models, and judge the results the way you would review a colleague's design. Tasks are long form and you set your own pace, so writing clearly about your reasoning matters as much as the engineering.
KEY RESPONSIBILITIES Turn problems from your own work into realistic tasks, with a clear brief and the supporting files an expert would need Run the tasks through frontier AI models and judge what comes back against the standard of your profession Compare two model responses to the same task and explain which one holds up, and why Write grading rubrics that spell out what a correct answer has to include Document specific errors in model output, with evidence IDEAL QUALIFICATIONS 2+ years of industry or research experience in robotics, in any specialty (manipulation, mobile robots, controls, perception, motion planning) Degree in robotics, mechatronics, or a related engineering or computer science field, completed or in progress Comfortable with the standard tools of your specialty, such as ROS, simulation, and Python or C++ Full professional or native-level written English Based in the United States, United Kingdom, Ireland, Canada, or Australia NICE TO HAVE Published work or open-source robotics contributions (welcome, not required) Have used Claude or ChatGPT in professional work Prior work on an AI training or data platform WHAT SUCCESS LOOKS LIKE You clear the skills assessment on your own work, with no AI assistance Your tasks come from real problems in your own practice, and a frontier model genuinely fails them Your rubrics are specific enough that another expert would grade the same response the same way You act on reviewer feedback without needing to be walked through it You keep at least 10 hours a week going, week after week CONTRACT & PAYMENT TERMS
$40 to $125 USD an hour. The rate varies with your expertise, education, and experience. Minimum 10 hours a week with no weekly maximum; full-time hours are available.
Independent contractor, fully remote. Payment runs through PayPal, so you need a PayPal account. As an independent contractor, you handle your own taxes.
Getting on: a skills assessment that takes most people four to six hours. You are paid $240 for it if you pass, and you get one attempt, so take your time and do your best work. Work produced with AI tools is rejected.
After you pass: onboarding and a short training project, then you propose a task from your own practice, build it, and run it against frontier models. Each stage is reviewed before you move on, and you are paid for the work you complete.