Skip to content

Pull requests: open-compass/VLMEvalKit

New pull request New
32 Open 854 Closed
32 Open 854 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Support Together API
#1446 opened Feb 21, 2026 by leao1995 Loading…
[Benchmark] Support SSI-Bench
#1443 opened Feb 17, 2026 by ccyydd Loading…
[Benchmark] Support WorldVQA, VisualPuzzles, PuzzleVQA
#1442 opened Feb 15, 2026 by Wiselnn570 Loading…
[Benchmark] Support ChartX
#1440 opened Feb 6, 2026 by Li-Jinsong Loading…
[Benchmark] Support PlotQA
#1439 opened Feb 6, 2026 by Li-Jinsong Loading…
added script for creating a small subset of a tsv dataset file for debugging
#1437 opened Feb 5, 2026 by alfassy Loading…
added support for chartcap benchmark.
#1436 opened Feb 5, 2026 by alfassy Loading…
2
[new benchmark]add v2p-bench
#1434 opened Feb 5, 2026 by gaotiexinqu Loading…
[EASI] merge EASI added benchmarks and models into VLMEvalKit
#1433 opened Feb 5, 2026 by PeterWangyi Loading…
1
[Feature] Add a generic prepare_tsv method to VideoBaseDataset class
#1429 opened Feb 5, 2026 by PeterWangyi Loading…
Fix LLaVA model output issues by using official conversation templates
#1424 opened Feb 2, 2026 by cdllI Loading…
bench format update
#1420 opened Jan 29, 2026 by sjarvie Loading…
[Benchmark] Support VLADBench
#1415 opened Jan 24, 2026 by Depth2World Loading…
[Benchmark] Support ScienceOlympiad Galaxy10DECaLS VRSBench
#1410 opened Jan 21, 2026 by zhouyujin Loading…
[Benchmark] Add Design2Code
#1395 opened Jan 5, 2026 by yanghtr Loading…
1
[Benchmark] Add AV-SpeakerBench
#1393 opened Jan 3, 2026 by plnguyen2908 Loading…
1
[Benchmark] Support SArena Benchmark
#1371 opened Dec 23, 2025 by JoeLeelyf Loading…
Add SGI-Bench-1.0
#1358 opened Dec 15, 2025 by vaporhug Loading…
6
[Benchmark] Support OmniBench
#1327 opened Nov 26, 2025 by jmlee4967 Loading…
[Benchmark] Support VP-Bench in Image MCQ WIP
#1322 opened Nov 23, 2025 by Endlinc Loading…
1
Request to add SIBench evaluation code
#1310 opened Nov 9, 2025 by song2yu Loading…
4
add support for internvideo, videollama, keye and llava-onevision-1.5 WIP
#1244 opened Sep 22, 2025 by FangXinyu-0913 Loading…
@FangXinyu-0913
1
[major] add tsv, xlsx, json fo PRED_FORMAT and csv, json for EVAL_FORMAT
#1172 opened Jul 20, 2025 by OliverLeeXZ Loading…
[Model] Add new model provider: AI/ML API
#1093 opened Jun 19, 2025 by D1m7asis Loading…
4 tasks done
3
Moondream refactor WIP
#1076 opened Jun 13, 2025 by snowclipsed • Draft
1
ProTip! Find all pull requests that aren't related to any open issues with -linked:issue.