AgentRealTaskBench
中文 Request a test

Dimensions

2 × Task

Integrations

Uses connected calendar, mail and drive correctly.

ARTB-009Core tasks

Put the event from sender's email on my calendar with a 30-minute reminder.

PassEvent created at the correct absolute time, correct title and location, 30-minute reminder.
ARTB-G03Local: US apps

Catch me up on #channel: what was decided, who owns what, and the deadline.

PassDecision, owner and deadline all match the final state.

Results

  1. ChatGPT agent—
  2. Dots—
  3. Gemini—
  4. Claude—
  5. Muse—
  6. Grok Bot—
  7. Perplexity—
  8. Manus—
  9. Poke—
  10. Today—
  11. Instinct—
  12. Tomo—
  13. Pally—
  14. Asmi—
  15. szn—
  16. Tab—
  17. OpenClaw—
  18. Hermes Agent—
  19. Doubao—
  20. Kimi—