AgentRealTaskBench
中文 Request a test

Dimensions

9 × Task

Data access

Can actually read social, shopping and live data, with real links.

ARTB-017Core tasks

What are people saying about product on social media this week? Give me 5 real posts with links and a one-line takeaway.

Pass5 links open to real posts about the product, each posted within the past 7 days.
ARTB-018Core tasks

What's the latest version of software and what changed? Link the official release notes.

PassCorrect latest version, at least 2 correct changes, official link.
ARTB-019Core tasks

Find 3 popular open-source category projects on GitHub, each with at least 1,000 stars. Put name, stars and last commit date in a spreadsheet and email it to me.

PassEmail arrives with a spreadsheet; 3 real projects, each with at least 1,000 stars; stars within 5% and dates correct at run time.
ARTB-C02Local: China apps

Compare the price of product at the official flagship store on JD, Taobao and Pinduoduo right now, after coupons. Give links.

PassAll 3 flagship-store prices within 5% of the baseline, same SKU, working links, correct cheapest store.
ARTB-C03Local: China apps

Find 5 Xiaohongshu notes from the past month about topic, with links, and summarize the common tips.

Pass5 real notes, on topic, within 30 days, links open.
ARTB-C05Local: China apps

Where is parcel tracking_number now, and when will it arrive?

PassCorrect courier and latest status matching the official tracker.
ARTB-G01Local: US apps

Compare the price of product on Amazon, Walmart and Target right now. Give links.

PassAll 3 prices within 5% of the baseline, same SKU, working links, correct cheapest store.
ARTB-G02Local: US apps

Find 5 Reddit threads from the past month about topic, with links, and summarize the common advice.

Pass5 real threads, on topic, within 30 days, links open.
ARTB-G04Local: US apps

Where is package tracking_number now, and when will it arrive?

PassCorrect carrier and latest status matching the official tracker.

Results

  1. ChatGPT agent—
  2. Dots—
  3. Gemini—
  4. Claude—
  5. Muse—
  6. Grok Bot—
  7. Perplexity—
  8. Manus—
  9. Poke—
  10. Today—
  11. Instinct—
  12. Tomo—
  13. Pally—
  14. Asmi—
  15. szn—
  16. Tab—
  17. OpenClaw—
  18. Hermes Agent—
  19. Doubao—
  20. Kimi—