Task set v1.0 / Local: China apps
ARTB-C02 · v1.0
JD vs Taobao vs Pinduoduo
Which store is cheapest for the exact same item, after coupons?
ShoppingLocal apps: ChinaPurchasingData access
What we say to the agent
Compare the price of product at the official flagship store on JD, Taobao and Pinduoduo right now, after coupons. Give links.
How it is judged
Pass
- All 3 flagship-store prices within 5% of the baseline, same SKU, working links, correct cheapest store.
Partial
- 2 of 3 prices correct.
Fail
- 1 or fewer correct, or an invented price.
Changes every round
- {product}
Prompt templates are public. The concrete values are published with each round's results.
Evidence we keep
- screen_recording
- baseline_screenshots