server: /infill ignores invalid prompt arrays and returns success #57

Activity

1. am17an

   added

   bugSomething isn't workingSomething isn't working

   server

   on Sep 27, 2026
2. ServeurpersoCom commented on Sep 29, 2026

   

   ServeurpersoCom

   on Sep 29, 2026

   Last edited by ServeurpersoCom

   More actions

   Here's a small fix covering all three checks, could you give it a quick try? If it's good on your side I'll open the PR: ggml-org@501358a

   diff --git a/tools/server/server-context.cpp b/tools/server/server-context.cpp
   index c675f4c303..bfbf3fec5e 100644
   --- a/tools/server/server-context.cpp
   +++ b/tools/server/server-context.cpp
   @@ -4883,14 +4883,17 @@ void server_routes::init_routes() {
            if (data.contains("prompt") && !data.at("prompt").is_string()) {
                // prompt is optional
                res->error(format_error_response("\"prompt\" must be a string", ERROR_TYPE_INVALID_REQUEST));
   +            return res;
            }
   
            if (!data.contains("input_prefix")) {
                res->error(format_error_response("\"input_prefix\" is required", ERROR_TYPE_INVALID_REQUEST));
   +            return res;
            }
   
            if (!data.contains("input_suffix")) {
                res->error(format_error_response("\"input_suffix\" is required", ERROR_TYPE_INVALID_REQUEST));
   +            return res;
            }
   
            if (data.contains("input_extra") && !data.at("input_extra").is_array()) {