Match response_format to the server that is actually running
Practice
The practice
Native llama-server takes {type: json_schema, json_schema: {name, schema, strict}}; the retired llama-cpp-python server took {type: json_object, schema}. Each ignores the other's form, so a wrong shape means unconstrained output rather than an error. Keep the shape in an environment variable.
2026-10-09
Two projects keep it switchable, so a server swap is a configuration change and not a code change.
Comments
Public comments on each entry are coming. Nothing is collected here yet.