You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
server: --batch-size 0 aborts in output_reserve #37
Observed: exit 134 with GGML_ASSERT(n_outputs >= 1) from llama_context::output_reserve().
The CLI setter assigns zero without validation. llama_init_from_model() only rejects the case where both n_batch and n_ubatch are zero, so the default nonzero n_ubatch lets n_batch=0 reach context allocation.
Activity