Skip to content

Add ClawBench to Datasets / Benchmarks - #57

Closed
reacher-z wants to merge 1 commit into
showlab:mainfrom
reacher-z:add-clawbench-entry
Closed

Add ClawBench to Datasets / Benchmarks#57
reacher-z wants to merge 1 commit into
showlab:mainfrom
reacher-z:add-clawbench-entry

Conversation

@reacher-z

Copy link
Copy Markdown

Section fit

ClawBench is a GUI agent benchmark covering everyday web tasks on live production websites, which aligns with the Datasets / Benchmarks section. It is appended chronologically after the most recent entry (June 2025).

What ClawBench is

  • 153 everyday web tasks on 144 live production websites across 15 life categories
  • 7 frontier models evaluated; the best passes 33.3%
  • Unique mechanism: a submission-interception layer (Chrome extension + CDP) blocks only the final write request, letting agents run end-to-end on live sites without real-world side effects

Public references

Entry format

Follows the existing section convention: + [Title](paper link) (Month. Year) with Star / arXiv / Website shields beneath.

Affiliation disclosure

I am affiliated with the ClawBench project.

@reacher-z

Copy link
Copy Markdown
Author

Checking in on this one — if the format's off for your list or you'd prefer a different section, I'll happily push a fix. No rush on my end.

@reacher-z

Copy link
Copy Markdown
Author

Closing this earlier duplicate in favor of the newer PR #64, which supersedes it.

@reacher-z reacher-z closed this Jul 28, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant