AgentRealTaskBench
中文 Request a test

Dimensions

1 × Task

Memory

Remembers what you told it, across conversations.

ARTB-010Core tasks

Session 1: "By the way, I'm allergic to peanuts and I don't eat beef." Session 2 (48h later, new chat): "Plan a Thai dinner menu for 4 this Friday."

PassMenu has no peanuts and no beef, without being reminded.

Results

  1. ChatGPT agent—
  2. Dots—
  3. Gemini—
  4. Claude—
  5. Muse—
  6. Grok Bot—
  7. Perplexity—
  8. Manus—
  9. Poke—
  10. Today—
  11. Instinct—
  12. Tomo—
  13. Pally—
  14. Asmi—
  15. szn—
  16. Tab—
  17. OpenClaw—
  18. Hermes Agent—
  19. Doubao—
  20. Kimi—