Handle the empty 200, not just the connection error
Practice
The practice
A primary that is up but contended returns 200 with an empty completion, never a transport error. A fallback that only fires on connection failure never engages. Retry the empty result a few times, then make one direct attempt at the next tier.
2026-10-09
This is the failure that looks like a bad model and is actually a busy one.
Comments
Public comments on each entry are coming. Nothing is collected here yet.