Task set v1.0 / Local: China apps
ARTB-C04 · v1.0
300 messages in the family group
I only want to know who is hosting Lunar New Year dinner and when.
Messages & emailLocal apps: ChinaGroups
What we say to the agent
Summarize the group chat: who is hosting Lunar New Year dinner, what date, and what I need to bring.
How it is judged
Pass
- Host, date and item all match the final plan.
Partial
- 2 of 3 correct.
Fail
- Reports the outdated plan, or 1 or fewer correct.
Changes every round
- {group}
Prompt templates are public. The concrete values are published with each round's results.
Evidence we keep
- screen_recording