Skip to content

Pull requests: open-compass/opencompass

New pull request New
83 Open 1,367 Closed
83 Open 1,367 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Package dataset runtime resources
#2584 opened Aug 3, 2026 by Danielxu0208 • Draft
@bittersweet1999
Bound OpenAI REST retries and requests
#2583 opened Aug 3, 2026 by Danielxu0208 • Draft
@bittersweet1999
Fix OpenAI SDK request forwarding
#2582 opened Aug 3, 2026 by Danielxu0208 • Draft
@bittersweet1999
Fix QuALITY hard accuracy calculation
#2581 opened Aug 3, 2026 by Danielxu0208 • Draft
@bittersweet1999
Harden CRUXEval output comparison
#2580 opened Aug 3, 2026 by Danielxu0208 • Draft
@bittersweet1999
Fix multi-replica metric aggregation
#2579 opened Aug 3, 2026 by Danielxu0208 • Draft
@bittersweet1999
Fix BABILong 2k config syntax
#2578 opened Aug 3, 2026 by Danielxu0208 • Draft
@bittersweet1999
Reject unsupported WildBench evaluation modes
#2577 opened Aug 3, 2026 by Danielxu0208 • Draft
@bittersweet1999
Fix option matching without cushion
#2576 opened Aug 3, 2026 by Danielxu0208 • Draft
@bittersweet1999
[Fix] Support Transformers 5 tokenization
#2575 opened Aug 3, 2026 by taking-lying-flat • Draft
3 tasks done
1
@bittersweet1999
[Fix] Fix per-turn statistics in dump-res-length and repeat detection issues for multi-round conversations
#2569 opened Jul 27, 2026 by Myhs-phz Collaborator Loading…
@bittersweet1999
[Dataset] Align ARC-AGI-1/2 evaluation with ARC Prize protocol
#2563 opened Jul 21, 2026 by Vicentvankor Loading…
@liushz
Add MedFailBench dataset adapter
#2560 opened Jul 18, 2026 by goktugozkanmd Loading…
@tonysy
3
fix: use last-match in generic LLM judge postprocess (verdict-injection defense)
#2534 opened Jul 14, 2026 by AUTHENSOR Loading…
3 tasks done
@liushz
feat(dataset): add CHHallu-Src v1 — Chinese history hallucination & source-attribution benchmark
#2525 opened Jul 11, 2026 by lizhuojunx86 Loading…
@tonysy
fix(MedCalc_Bench): guard calid-69 ground_truth regex match (AttributeError)
#2523 opened Jul 9, 2026 by WatchTree-19 Loading…
@acylam
fix(evaluator): guard IndexError on truncated judge choice (JudgeEvaluator/RMBEvaluator)
#2522 opened Jul 9, 2026 by WatchTree-19 Loading…
@acylam
Add robust HumanEval postprocess for chat outputs
#2515 opened Jul 8, 2026 by Ding-god Loading…
3 of 6 tasks
1
[Fix] Extract the final answer in GPQA simple-eval predictions
#2496 opened Jun 27, 2026 by Hibbert133 Contributor Loading…
4 of 6 tasks
@tonysy
1
Add optional juryeval integration for LLM-as-Judge metrics
#2465 opened May 31, 2026 by py-ai-dev Loading…
@tonysy
[Fix] Combine split eval results in default summarizer
#2451 opened May 15, 2026 by yhzhu99 Contributor Loading…
1
@tonysy
feat: upgrade MiniMax default model to M3
#2418 opened Mar 20, 2026 by octo-patch Contributor Loading…
3 tasks done
@tonysy
[Fix] CEval ModelScope load and HF generate for causal LMs
#2416 opened Mar 19, 2026 by DeliWang Loading…
6 tasks
@acylam
1
Add support for Azure OpenAI models and managed identity auth
#2415 opened Mar 18, 2026 by jgbradley1 Loading…
2 of 6 tasks
[Fix] Fix eval stage is extremely slow
#2409 opened Mar 5, 2026 by xming521 Loading…
6 tasks
@acylam
3
ProTip! Mix and match filters to narrow down what you’re looking for.