AgentRealTaskBench
中文 Request a test

Dimensions

5 × Task

Local apps: China

12306, JD/Taobao/Pinduoduo, Xiaohongshu, WeChat/Feishu, couriers.

ARTB-C01Local: China apps

Find second-class seats from origin to destination on date, arriving before 18:00. List train numbers, times and prices.

PassAll listed trains exist, arrive before 18:00, prices match 12306; none of the 3 earliest qualifying trains is missed.
ARTB-C02Local: China apps

Compare the price of product at the official flagship store on JD, Taobao and Pinduoduo right now, after coupons. Give links.

PassAll 3 flagship-store prices within 5% of the baseline, same SKU, working links, correct cheapest store.
ARTB-C03Local: China apps

Find 5 Xiaohongshu notes from the past month about topic, with links, and summarize the common tips.

Pass5 real notes, on topic, within 30 days, links open.
ARTB-C04Local: China apps

Summarize the group chat: who is hosting Lunar New Year dinner, what date, and what I need to bring.

PassHost, date and item all match the final plan.
ARTB-C05Local: China apps

Where is parcel tracking_number now, and when will it arrive?

PassCorrect courier and latest status matching the official tracker.

Results

  1. ChatGPT agent—
  2. Dots—
  3. Gemini—
  4. Claude—
  5. Muse—
  6. Grok Bot—
  7. Perplexity—
  8. Manus—
  9. Poke—
  10. Today—
  11. Instinct—
  12. Tomo—
  13. Pally—
  14. Asmi—
  15. szn—
  16. Tab—
  17. OpenClaw—
  18. Hermes Agent—
  19. Doubao—
  20. Kimi—