The Study Everyone's Citing About AI Failing — What It Actually Says | Seth Brand
AI August 28, 2026 8 min read

The Study Everyone's Citing About AI Failing — What It Actually Says

What the research actually measured, and the one pattern behind almost every failure in it.

You've probably seen the number by now: roughly 95% of generative AI pilots at companies fail to deliver a measurable return. It comes from research out of MIT that got picked up widely through 2025 and into 2026, and it shows up constantly now — in sales pitches (both for and against AI), in skeptical LinkedIn posts, in "why AI is overhyped" articles.

It's a real, widely-reported finding. It's also frequently used to mean something it doesn't quite say. Worth being precise about both halves.

What the number is actually describing

The research looked at generative AI pilot projects inside companies — not "does AI work," but "do the specific projects companies are running with it actually pay off." The finding was that the large majority don't show a measurable return. That's a real, sobering number, and it's not describing some fringe result — it reflects a pattern that shows up again and again in how these projects get built.

What it is not saying: that AI itself doesn't work, that the underlying technology is unreliable, or that a small business shouldn't bother. Reading it that way is exactly the mistake this article is about.

The actual pattern behind most of the failures

Set aside the exact percentage for a second and look at what actually tends to go wrong in projects like this — the pattern that comes up again and again, in the MIT coverage and in every other postmortem of a failed AI project:

  • Scope outran the underlying process. A project gets built to automate something end-to-end before the business even had a consistent, documented process for doing it manually. AI amplifies whatever process is underneath it — including a messy one.
  • Nobody was reviewing the output. Full automation, no human checkpoint, deployed on day one. The first time it's wrong, it's wrong in front of a customer, and the whole project gets killed in a panic instead of tuned.
  • Success was never defined before the project started. No baseline, no specific metric, no 30-day check-in. Six months later nobody can say whether it worked because nobody wrote down what "worked" would look like.
  • It solved a problem the business didn't actually have. Chosen because it was impressive to build, not because it addressed a real, named bottleneck.

Every one of those is avoidable. None of them requires more advanced AI. They're project-management failures wearing an AI costume.

What "not being part of the 95%" actually looks like

The inverse of that list is the whole playbook:

  1. Start with one workflow that already has a consistent, describable process.
  2. Keep a human reviewing the output, at least at first.
  3. Write down the baseline (how long the task takes, how often it goes wrong) before you start.
  4. Check that number again in 30 days. If it hasn't moved, fix the workflow before adding a second one.

This is the entire structure behind the AI Readiness Audit — a real example is linked there, worked all the way through with the baseline and the 30-day check built in. It's also why there's a whole page dedicated to what won't get built before you ever ask: most of the "no" answers on that list are exactly the scope-creep pattern above, refused in advance.

The honest takeaway

A statistic like this is genuinely useful — as a warning about scope, not as a verdict on the technology. The businesses that avoid becoming part of it aren't the ones with access to better AI. They're the ones that started smaller than felt exciting, put a person in the loop, and actually checked whether it worked.