> vectormatrix.wiki

Match response_format to the server that is actually running

Practice

The practice

Native llama-server takes {type: json_schema, json_schema: {name, schema, strict}}; the retired llama-cpp-python server took {type: json_object, schema}. Each ignores the other's form, so a wrong shape means unconstrained output rather than an error. Keep the shape in an environment variable.

2026-10-09

Two projects keep it switchable, so a server swap is a configuration change and not a code change.

Comments

Public comments on each entry are coming. Nothing is collected here yet.