Essay
You Have 40 AI Pilots and Zero in Production
Most large enterprises I walk into have the same dashboard: a dozen, sometimes forty, AI pilots. Impressive demos. Executive sponsors. Slideware. And almost none of it is in production, carrying real load, changing a real number on the P&L.
The reflex is to call this an innovation problem: we need more experiments, better models, a bigger AI team. It isn't. It's an architecture problem, and until you name it as one, the next ten pilots die exactly where the last ten did.
Why pilots stall
A pilot is optimized to demo. Production is optimized to survive. Those are different engineering problems, and the gap between them is where every stalled program lives.
A demo has to work once, on the happy path, in front of an audience. A production system has to work on the unhappy paths: the malformed input, the model that regresses after a version bump, the edge case that only shows up at ten thousand requests. The demo needs a good model. Production needs evaluation, monitoring, rollback, retraining, governance, and a way to consume the output inside a workflow people already use.
That second list is the unglamorous 60% of the work. It's also the 60% nobody funds, because it doesn't demo.
The missing layer
Across five AI builds and two Fortune 500 accounts, the pattern is identical: pilots stall not because the models are bad, but because there's no platform underneath them.
Each team stands up its own stack: its own prompt, its own eval (if any), its own deployment path, and every one of them re-solves the same hard problems, badly. You don't end up with one AI capability. You end up with forty half-built ones, none of which crosses into production, because crossing that line requires infrastructure no single pilot can justify building alone.
A Center of Excellence doesn't fix this. A CoE that owns no product is a budget line, not a structure. What fixes it is a small platform team, five to ten people, that owns the substrate every pilot needs: the eval harness, the model gateway, observability, the deployment path, governance. Pilots stop rebuilding plumbing and start shipping.
What to actually do
If you're staring at a wall of stalled pilots, three moves:
- Kill most of them. Forty pilots isn't a portfolio; it's a deferred decision. Pick the two or three tied to a real, measurable outcome: dollars, hours, or risk, not "efficiency", and stop the rest today.
- Fund the platform, not just the pilots. The infrastructure that gets one pilot to production gets all of them there. It's the highest-ROI line on the board, and the one that never makes the slide.
- Ship the thinnest end-to-end thing first. One capability, working all the way through into a workflow people already open, not a standalone "AI tool" nobody does. A thin slice in production teaches you more than forty demos.
The enterprises pulling ahead aren't the ones with the most pilots. They're the ones that treated getting one thing into production as the real work, and built the layer that made the second, third, and tenth almost free.
How many pilots does your organization have in flight right now, and how many are carrying real load?
