AgentRealTaskBench
中文 Request a test

Dimensions

3 × Task

Travel

Finds flights, trains and hotels that really exist and fit the constraints.

ARTB-006Core tasks

Find the cheapest nonstop flight from origin to destination on date, leaving after 12:00. Give me the flight number, time, price and where you found it.

PassFlight exists, is nonstop, departs after 12:00, and its price is within 5% of the cheapest baseline.
ARTB-C01Local: China apps

Find second-class seats from origin to destination on date, arriving before 18:00. List train numbers, times and prices.

PassAll listed trains exist, arrive before 18:00, prices match 12306; none of the 3 earliest qualifying trains is missed.
ARTB-G05Local: US apps

Find 3 hotels within 1 km of venue for dates, under budget/night, with free cancellation.

PassAll 3 exist and meet distance, price and cancellation constraints.

Results

  1. ChatGPT agent—
  2. Dots—
  3. Gemini—
  4. Claude—
  5. Muse—
  6. Grok Bot—
  7. Perplexity—
  8. Manus—
  9. Poke—
  10. Today—
  11. Instinct—
  12. Tomo—
  13. Pally—
  14. Asmi—
  15. szn—
  16. Tab—
  17. OpenClaw—
  18. Hermes Agent—
  19. Doubao—
  20. Kimi—