Task set v1.0 / Core tasks
ARTB-008 · v1.0
Fill out the RSVP form
A friend's wedding uses a 3-step RSVP form. I give the agent my details once.
On the webOnline tasks
What we say to the agent
RSVP for me (my_name) at url. Me plus one guest, guest_name. I'm vegetarian, she has no restrictions. We need parking.
How it is judged
Pass
- Submission received with every field correct.
Partial
- Submitted with exactly one wrong or missing field.
Fail
- Not submitted, or two or more fields wrong.
Changes every round
- {my_name}
- {url}
- {guest_name}
Prompt templates are public. The concrete values are published with each round's results.
Evidence we keep
- screen_recording
- form_backend_record