The work spans two closely related tracks. On the connectors track, engineers build Python backend applications that faithfully replicate real-world SaaS tools — think Slack, Linear, Jira, Notion, Gmail, wikis, and other enterprise applications — so that AI agents can be tested against realistic digital-work environments.
On the tasks track, engineers mine real data and workflows to author long-horizon tasks, then validate their quality, realism, and correctness through rigorous QA and rubric writing. Every engineer on this initiative must be highly proficient at using AI coding tools in their daily work. Candidates may specialise in one track, but the strongest profiles are excellent generalist backend engineers who can move across both.
Roles and Responsibilities:
- The Engineer will, depending on assigned track: build Python backend applications that replicate existing SaaS tools (such as Slack, Linear, Jira, Notion, Gmail, and wikis), including implementing integrations and standing up full-service backend functionality;
- Perform thorough backend testing and integration validation to ensure each connector behaves faithfully like the system it emulates;
- Adapt and extend previously built connectors as needed, and test existing connectors internally before they are treated as complete;
- Build new connectors from scratch where required, within agreed delivery timeframes;
- Conduct data mining and task mining to identify representative workflows suitable for long-horizon task development;
- Author realistic tasks derived from mined data and workflows;
- Verify task and data quality, realism, and correctness through structured QA;
- Write clear evaluation rubrics that define correct, partially correct, and deficient work;
- Use AI coding agents proficiently throughout all development, QA, and validation work;
- collaborate across the connectors and tasks tracks,
- Participate in onboarding, calibration, and quality-review cycles; deliver assigned work to the expected quality bar and on agreed milestones.
Required Skills:
- Minimum 3+ years of overall experience
- Strong proficiency in Python with proven experience in backend software development.
- Proficiency with Git, Docker, and basic software pipeline setup.
- Experience building scalable backend applications, REST APIs, and microservices.
- Hands-on experience with backend testing, debugging, and integration validation.
- Proficiency in using AI coding assistants (e.g., Codex, Claude Code, Cursor, GitHub Copilot, or similar) as part of daily development workflows.
- Strong understanding of software engineering best practices, including version control, testing, and code quality.
- Experience working with databases (SQL/NoSQL) and backend frameworks such as FastAPI, Flask, or Django.
- Strong analytical and problem-solving skills with attention to detail.
- Ability to work independently while collaborating effectively within distributed engineering teams.
- Excellent written and verbal communication skills.
Nice to have:
- Experience building connectors or integrations for SaaS platforms.
- Familiarity with enterprise collaboration and productivity tools such as Slack, Jira, Linear, Notion, Gmail, Confluence, or similar platforms.
- Experience with data mining, task mining, or AI training data generation.
- Knowledge of evaluation frameworks, QA methodologies, and rubric creation for AI datasets.
- Experience developing realistic workflows for long-horizon AI tasks.