Skip to content

bench format update#1420

Closed
sjarvie wants to merge 15 commits intoopen-compass:mainfrom
Specter-Co:sjarvie--bench-format-update
Closed

bench format update#1420
sjarvie wants to merge 15 commits intoopen-compass:mainfrom
Specter-Co:sjarvie--bench-format-update

Conversation

@sjarvie
Copy link
Copy Markdown

@sjarvie sjarvie commented Jan 29, 2026

No description provided.

hil01 builder and others added 15 commits December 5, 2025 10:29
merge changes from source
- Load pre-extracted frames instead of videos
- Pass config_name for Hydra processor instantiation
- Include detection_metadata_paths for BoxCropEventProcessor
- Remove processor config loading (handled by wrapper)

Expected TSV columns: index, video, context, config_name, original_question, answer, rule_id

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
@kennymckormick
Copy link
Copy Markdown
Member

Data File Missing

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants