news

Workplaces look for cheaper AI as ‘tokenmaxxing’ fades as a corporate fad

AP reports the tokenmaxxing fad is buckling as costs climb without matching productivity. Moody's AI analytics head Vincent Gusdorf, author of a new report, says bills piled in and teams realized the tools need disciplined use.

Published 2026-07-28Source: AP News
AP News source artwork

Why it matters

Bain's Jue Wang says client token costs have been doubling almost every other month. At $200 per developer per month across 20,000 developers, that becomes a line item no general manager ever planned for.

Tokenmaxxing read

Wang's diagnosis is a routing failure: teams reach for Opus even to draft routine email. Her fix is model routing, sending easy queries to cheaper systems and hard tasks to powerful ones. Mozilla CTO Raffi Krikorian calls it the new lines-of-code metric.

Source takeaway

The backlash has teeth: Satya Nadella warns customers pay twice, in tokens and in proprietary data, and Palantir's Alex Karp says enterprises are privately livid about tokens that return nothing. Cheap Chinese open models cut the other way.

Topic links

Related projects

Tools that match this angle

#2Direct
Observability

Langfuse

langfuse/langfuse

Open-source LLM engineering platform for observability, traces, metrics, evals, prompt management, datasets, and playground workflows.

33.2K3.6KSource-available
tracesevalscosts
#5Direct
Evaluation

promptfoo

promptfoo/promptfoo

A CLI and CI workflow for testing prompts, agents, and RAG systems across models, with evals and red-team style checks.

24.3K2.2KMIT
prompt-evalscirag
#6In spirit
Evaluation

DSPy

stanfordnlp/dspy

A framework for programming and optimizing language-model pipelines rather than hand-tuning one prompt at a time.

37.3K3.2KMIT
optimizationprogrammingevals
Related feed

More source-linked context

404 Media source artwork
news4M
news

Microsoft Tells Engineers ‘Tokenmaxxing Is Not What We Are Optimizing For’

Microsoft EVP Jay Parikh told staff that tokenmaxxing is not the goal, giving divisions AI token budget targets as of July 2026 and making OpenAI's cheaper GPT-5.6 the default model for internal use.

tokenmaxxingexplainerworkplace-ai
Read note
the Guardian source artwork
newsTG
news

Atlassian tightens tracking of staff AI use as other technology firms encourage ‘tokenmaxxing’

Guardian Australia saw an internal memo: Atlassian gave R&D staff monthly AI “wallets” of $500 to $2,000 spanning four tools including Claude Code. Alerts fire near the cap, usage pauses at zero, and no top-up has been refused yet.

tokenmaxxingexplainerworkplace-ai
Read note
Fortune source artwork
newsF
news

'You just hired a million bad employees': How the brief tokenmaxxing era delivered the opposite of what it promised

Fortune's Nick Lichtenberg argues the tokenmaxxing boom backfired: firms rolled out AI agents faster than they could manage them. Hebbia founder George Sivulka warns most companies effectively 'hired a million bad employees.'

tokenmaxxingexplainerworkplace-ai
Read note