Repository navigation
docs(cc_ocr_v2): refresh complete dataset statistics - #1990
Merged
Merged
Conversation
Contributor
There was a problem hiding this comment.
🟢 Approval recommended
No active review issues were identified in the CC-OCR-V2 documentation, metadata, and regression-test changes.
No open issues 🎉
What changed in this PR
Updates EvalScope’s CC-OCR-V2 documentation to reflect all 7,093 samples now available in the complete dataset, without changing loading or scoring semantics.
Changes:
- Corrects the dataset description and adds guidance for diagnosing incomplete snapshots.
- Refreshes generated metadata and bilingual pages to report 7,093 samples and 7,118 images.
- Adds regression tests confirming both affected samples load once their missing images are restored.
| File | Description |
|---|---|
tests/benchmark/test_cc_ocr_v2.py |
Adds restored-image regression coverage for both sample IDs. |
evalscope/benchmarks/cc_ocr_v2/cc_ocr_v2_adapter.py |
Updates description text and incomplete-snapshot guidance only. |
evalscope/benchmarks/_meta/cc_ocr_v2.json |
Refreshes generated statistics and bilingual documentation content. |
docs/zh/benchmarks/cc_ocr_v2.md |
Regenerates the Chinese page with complete dataset counts. |
docs/en/benchmarks/cc_ocr_v2.md |
Regenerates the English page with complete dataset counts. |
Review effort: Balanced
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
The CC-OCR-V2 documentation still reports 7,091 loaded samples and attributes two missing images to the official dataset. Historical ModelScope mirror revisions reverted those images; both are present in the current mirror and official Hugging Face dataset. A fresh snapshot now loads all 7,093 samples with the existing adapter.
This updates the source description, regenerates full-dataset statistics and bilingual benchmark pages, and adds regression coverage for the two samples being included once their images are restored. The grounding description now explicitly explains that absolute pixel predictions are interpreted as 0-1000 coordinates and scaled to pixels. Fixed usage hints are localized as Chinese comments while code blocks and string/data literals remain protected. The shared benchmark-documentation translator now uses
qwen3.8-flash. Scoring and loading semantics are unchanged.Validation:
qwen3-vl-plusevaluation produces predictions, successful reviews, and a two-sample report.make lintpass.make docs-pipeline BENCHMARK=cc_ocr_v2 FORCE=1andmake docs-generate.Maintainer clarification: Eioss/CC-OCR-V2#3 (comment)
Historical mirror evidence: revision
aca514a4cc7b662b14b24d9c755ab770b8632e2e(2026-08-10) has 149 images indoc_parsing_doc_doc_scan_150, excluding4a74943cc5a4.jpg. Current revision5acd45e358b64ca426f079e2bb52d56a4853bbb2has all 150. Commit history also records the corresponding image revert for0913e4fab7c9.jpg.