fix(sglang): size batch truncation from the longest input in the batch, not the first - #1355

fix(sglang): size batch truncation from the longest input in the batch, not the first#1355

shoemoney wants to merge 1 commit into

huggingface:mainhuggingface/lighteval:mainfrom

shoemoney:fix-sglang-context-size-longest-inputshoemoney/lighteval:fix-sglang-context-size-longest-inputCopy head branch name to clipboard