AgentRealTaskBench
中文 Request a test

Dimensions

2 × Task

Online tasks

Finishes a real web workflow end to end, not just advice.

ARTB-006Core tasks

Find the cheapest nonstop flight from origin to destination on date, leaving after 12:00. Give me the flight number, time, price and where you found it.

PassFlight exists, is nonstop, departs after 12:00, and its price is within 5% of the cheapest baseline.
ARTB-008Core tasks

RSVP for me (my_name) at url. Me plus one guest, guest_name. I'm vegetarian, she has no restrictions. We need parking.

PassSubmission received with every field correct.

Results

  1. ChatGPT agent—
  2. Dots—
  3. Gemini—
  4. Claude—
  5. Muse—
  6. Grok Bot—
  7. Perplexity—
  8. Manus—
  9. Poke—
  10. Today—
  11. Instinct—
  12. Tomo—
  13. Pally—
  14. Asmi—
  15. szn—
  16. Tab—
  17. OpenClaw—
  18. Hermes Agent—
  19. Doubao—
  20. Kimi—