AgentRealTaskBench
中文 Request a test

Task set v1.0 / Core tasks

ARTB-012 · v1.0

Remind me at 9 tomorrow

I need a nudge to call the dentist tomorrow morning.

Schedule & memoryProactive help

What we say to the agent

Remind me tomorrow at 9:00 to call the dentist.

How it is judged

Pass
  • Reminder arrives between 8:55 and 9:05 with the right content, without the user opening the app.
Partial
  • Arrives within 30 minutes, or only visible after opening the app.
Fail
  • No reminder.

Changes every round

  • —

Prompt templates are public. The concrete values are published with each round's results.

Evidence we keep

  • screen_recording
  • notification_screenshot