AI
Inference Costs Move From Footnote to Line Item
Training got the headlines and the capital budget. The recurring cost of running models in production is what finance departments are now trying to forecast, mostly badly.
Independent Business, Technology & Culture
Sunday, August 16th, 2026 105 stories Independent & Reader-Supported
Training got the headlines and the capital budget. The recurring cost of running models in production is what finance departments are now trying to forecast, mostly badly.
Deployment has run well ahead of measurement. A striking number of production systems have no defensible answer to whether they are performing better than what they replaced.
Companies built production systems on models that vendors retire on their own schedule. The resulting migrations are unplanned, unbudgeted and increasingly frequent.