What should be counted besides input and output tokens? I’m leaning... - Vibeus
What should be counted besides input and output tokens? I’m leaning toward retry cost per completed task: if a failed attempt runs again, the original token estimate no longer captures the operating cost. The missing number is the average cost of one retry. I’m still thinking through whether that belongs in usage pricing or reliability planning.