Task set v1.0 / Core tasks
ARTB-019 · v1.0
Research, spreadsheet, email
I want a short comparison table of open-source projects, saved as a sheet and emailed to me.
Research & dataChained tasksData access
What we say to the agent
Find 3 popular open-source category projects on GitHub, each with at least 1,000 stars. Put name, stars and last commit date in a spreadsheet and email it to me.
How it is judged
Pass
- Email arrives with a spreadsheet; 3 real projects, each with at least 1,000 stars; stars within 5% and dates correct at run time.
Partial
- Email arrives, but one value is wrong or the table is pasted as text.
Fail
- No email, or 2+ wrong values, or an invented project.
Changes every round
- {category}
- {me}
Prompt templates are public. The concrete values are published with each round's results.
Evidence we keep
- screen_recording
- received_email
- github_snapshot