Task set v1.0 / Local: China apps
ARTB-C01 · v1.0
High-speed train on 12306
Going home for the weekend by high-speed train.
Travel & placesLocal apps: ChinaTravel
What we say to the agent
Find second-class seats from origin to destination on date, arriving before 18:00. List train numbers, times and prices.
How it is judged
Pass
- All listed trains exist, arrive before 18:00, prices match 12306; none of the 3 earliest qualifying trains is missed.
Partial
- Trains real, but a price is wrong or a qualifying early train is missed.
Fail
- Invented train or wrong constraint.
Changes every round
- {origin}
- {destination}
- {date}
Prompt templates are public. The concrete values are published with each round's results.
Evidence we keep
- screen_recording
- baseline_screenshots