news

Beyond token-maxing: How US Bank AI chief navigates costs

U.S. Bank chief AI officer Prashant Mehrotra tells American Banker the bank never ran token maxing. Every proposed use case is bucketed by whether it drives growth, cuts cost, or merely feels productive — and the last bucket loses.

Published 2026-07-30Source: American Banker
American Banker source artwork

Why it matters

Mehrotra credits three forces for the retreat: model providers raising prices, an experimentation phase that has ended, and teams finally seeing enough value to operationalise it. A cost-discipline account from a regulated buyer, not a vendor.

Tokenmaxxing read

His filter is frequency, not sophistication: a dazzling use case that fires once a month loses to dull high-volume work with a measurable baseline. Experiments are timeboxed and killed when they miss, so the spending decision lands before any tokens burn.

Source takeaway

A Q&A, so every claim is the bank’s own framing with no independent verification and no spend figures. Useful for the operating model — evangelise, educate, enable, execute, and reuse over reinvention — not for benchmarking what U.S. Bank pays.

Topic links

Related projects

Tools that match this angle

#1Direct
Routing

LiteLLM

BerriAI/litellm

An OpenAI-compatible gateway and SDK for calling many model providers with budgets, logging, load balancing, guardrails, and cost tracking.

56.5K10.7KSource-available
gatewaycost-trackingrouting
#2Direct
Observability

Langfuse

langfuse/langfuse

Open-source LLM engineering platform for observability, traces, metrics, evals, prompt management, datasets, and playground workflows.

33.2K3.6KSource-available
tracesevalscosts
#10Direct
Routing

Portkey Gateway

Portkey-AI/gateway

An AI gateway for routing across LLMs with guardrails, provider abstraction, and an OpenAI-compatible API surface.

12.7K1.2KMIT
gatewayguardrailsrouting
Related feed

More source-linked context

PYMNTS.com source artwork
newsP
news

AI Agents Just Got Their Own Company Credit Cards

Mercury launched Agent Cards through Mercury Spend: virtual cards an AI agent spends from inside company-set rules, with transactions outside them declined automatically and no way for the agent to raise its own limit.

tokenmaxxingagentsai-spend
Read note
HackerNoon source artwork
newsH
newsmedium review

Auto-Mode Routing: What Stop Us From Sending "How to Center a Div" to Claude 3.5 Opus | HackerNoon

The vCodeX team audited about 100,000 internal prompt logs, found roughly 65% were definitional questions or minor refactors hitting frontier endpoints by default, and built a sub-40ms complexity router across three model tiers.

tokenmaxxingcost-governanceai-spend
Read note
ZDNET source artwork
newsZ
news

Token-maxing is an AI cost sink - how to use agents without busting your budget

ZDNET asks enterprise leaders how to run agents without wrecking the budget. Boomi CEO Steve Lucas says he spent ten times more on Claude last year than the year before, and calls that pace flatly unsustainable.

tokenmaxxingagentstoken-consumption
Read note