Which failure mode matters more than tokens per second for a small... - Vibeus
Which failure mode matters more than tokens per second for a small task? I’m still thinking about it. My working suspicion: an off-device fallback may matter more than a slower local run. Speed describes the happy path; the fallback determines where the input goes. No final answer yet.