Skip to content

Actions: huggingface/lighteval

Actions

All workflows

Actions

Loading...
Loading

Showing runs from all workflows
2,500+ workflow runs
2,500+ workflow runs

Filter by Workflow

⌥ + click/return to exclude

Filter by Event

⌥ + click/return to exclude

Filter by Status

⌥ + click/return to exclude

Filter by Branch

⌥ + click/return to exclude

Filter by Actor

⌥ + click/return to exclude
fix: isolate few-shot sampler RNG and pool from shared and global state (#1307, #1309) Build PR Documentation #2126: Pull request #1379 opened by Abelo9996
Action required Abelo9996:fix-fewshot-sampler-seed-reproducibility
Abelo9996:fix-fewshot-sampler-seed-reproducibility
Action required
fix: isolate few-shot sampler RNG and pool from shared and global state (#1307, #1309) Slow end to end tests #1624: Pull request #1379 opened by Abelo9996
Action required Abelo9996:fix-fewshot-sampler-seed-reproducibility
Abelo9996:fix-fewshot-sampler-seed-reproducibility
Action required
fix: isolate few-shot sampler RNG and pool from shared and global state (#1307, #1309) Tests #4024: Pull request #1379 opened by Abelo9996
Action required Abelo9996:fix-fewshot-sampler-seed-reproducibility
Abelo9996:fix-fewshot-sampler-seed-reproducibility
Action required
fix: isolate few-shot sampler RNG and pool from shared and global state (#1307, #1309) Quality #4025: Pull request #1379 opened by Abelo9996
Action required Abelo9996:fix-fewshot-sampler-seed-reproducibility
Abelo9996:fix-fewshot-sampler-seed-reproducibility
Action required
vLLM Main Branch Tests vLLM Main Branch Tests #28: Scheduled
1h 1m 15s main
main
1h 1m 15s
Upload PR Documentation Upload PR Documentation #1573: completed by mshimkus-positron
7s
7s
Upload PR Documentation Upload PR Documentation #1572: completed by Tanisha-Katara
1s
1s
Upload PR Documentation Upload PR Documentation #1571: completed by atirna
10s
10s
Fix few-shot sampler isolation .github/workflows/pr_style_bot.yaml #328: Issue comment #1334 (comment) by atirna
Failure
Failure
Upload PR Documentation Upload PR Documentation #1570: completed by Kloudedge-apex
1s
1s
Upload PR Documentation Upload PR Documentation #1569: completed by Kloudedge-apex
7s
7s
Pass max_tokens as an int on the litellm judge backend Build PR Documentation #2125: Pull request #1378 opened by gyanu2507
Action required gyanu2507:fix/litellm-judge-max-tokens-int
gyanu2507:fix/litellm-judge-max-tokens-int
Action required
Pass max_tokens as an int on the litellm judge backend Tests #4023: Pull request #1378 opened by gyanu2507
Action required gyanu2507:fix/litellm-judge-max-tokens-int
gyanu2507:fix/litellm-judge-max-tokens-int
Action required
Pass max_tokens as an int on the litellm judge backend Quality #4024: Pull request #1378 opened by gyanu2507
Action required gyanu2507:fix/litellm-judge-max-tokens-int
gyanu2507:fix/litellm-judge-max-tokens-int
Action required
Pass max_tokens as an int on the litellm judge backend Slow end to end tests #1623: Pull request #1378 opened by gyanu2507
Action required gyanu2507:fix/litellm-judge-max-tokens-int
gyanu2507:fix/litellm-judge-max-tokens-int
Action required
[FT] Add tests for VLLMModel base methods .github/workflows/pr_style_bot.yaml #327: Issue comment #724 (comment) by sneha4175
Failure
Failure
Add unit tests for VLLMModel core methods (#724) Build PR Documentation #2124: Pull request #1377 opened by sneha4175
Action required sneha4175:add-vllm-model-unit-tests
sneha4175:add-vllm-model-unit-tests
Action required
Add unit tests for VLLMModel core methods (#724) Quality #4023: Pull request #1377 opened by sneha4175
Action required sneha4175:add-vllm-model-unit-tests
sneha4175:add-vllm-model-unit-tests
Action required
Add unit tests for VLLMModel core methods (#724) Tests #4022: Pull request #1377 opened by sneha4175
Action required sneha4175:add-vllm-model-unit-tests
sneha4175:add-vllm-model-unit-tests
Action required
Add unit tests for VLLMModel core methods (#724) Slow end to end tests #1622: Pull request #1377 opened by sneha4175
Action required sneha4175:add-vllm-model-unit-tests
sneha4175:add-vllm-model-unit-tests
Action required
Use ast.literal_eval instead of eval in hellaswag_arabic_pfn .github/workflows/pr_style_bot.yaml #326: Issue comment #1294 (comment) by jayzuccarelli
Failure
Failure
Fix normalized multiple-choice probability underflow Build PR Documentation #2123: Pull request #1376 opened by YusefSyed
Action required YusefSyed:fix/normalized-mc-prob-underflow
YusefSyed:fix/normalized-mc-prob-underflow
Action required
Fix normalized multiple-choice probability underflow Quality #4022: Pull request #1376 opened by YusefSyed
Action required YusefSyed:fix/normalized-mc-prob-underflow
YusefSyed:fix/normalized-mc-prob-underflow
Action required
Fix normalized multiple-choice probability underflow Tests #4021: Pull request #1376 opened by YusefSyed
Action required YusefSyed:fix/normalized-mc-prob-underflow
YusefSyed:fix/normalized-mc-prob-underflow
Action required
Fix normalized multiple-choice probability underflow Slow end to end tests #1621: Pull request #1376 opened by YusefSyed
Action required YusefSyed:fix/normalized-mc-prob-underflow
YusefSyed:fix/normalized-mc-prob-underflow
Action required