Home/Blog/AI Architecture
AI Architecture

Most AI Pilots Fail Before the Model Is Chosen

Direct answer · Why do most AI pilots fail?

Because the two things that determine success are settled before any model is selected: whether the data is reliable enough to reason over, and whether the process being automated has actually been defined. MIT's 2025 NANDA study found roughly 95% of enterprise GenAI pilots produced no measurable P&L impact, and attributed the divide to organisational rather than technological factors. Neither prerequisite requires buying anything to fix.

Summary

An argument against buying AI tooling, from a firm that sells AI transformation.

An argument against our own category

We sell AI transformation. What follows argues that most companies asking to buy it should spend the next quarter on something else, and that the something else does not involve a vendor.

This is not modesty. It is that the failure pattern is consistent enough to be predictable, and selling into it produces the 95% rather than the 5%.

What the research actually found

MIT's NANDA initiative published The GenAI Divide: State of AI in Business 2025, built on 300 public deployments, more than 150 executive interviews and $30-40 billion of tracked enterprise spend. The headline: roughly 95% of enterprise GenAI pilots delivered no measurable P&L impact.

The finding that matters more is the diagnosis. The authors are explicit that the divide is organisational, not technological — data readiness, integration depth and the capacity to learn from deployment separate the two groups. Model choice is not on the list.

Two secondary findings sharpen it. Deployments built through purchasing or partnership succeeded roughly 67% of the time against about a third of that for solo internal builds. And over 90% of firms showed a 'shadow AI economy' — employees using personal AI tools while the official pilot stalled.

FIG. 1 — THE GENAI DIVIDE IN FOUR NUMBERS (MIT NANDA, 2025)
95% Pilots without P&L impact 90% Firms with shadow-AI use 67% Buy/partner success rate 22% Solo-build success rate
Source: MIT NANDA, The GenAI Divide: State of AI in Business 2025. Solo-build figure is approximately one-third of the reported buy/partner success rate.

Prerequisite one — data the model can rely on

A model does not hedge. Given inconsistent records it produces an answer with the same confidence it would use on perfect data, and it produces it faster than a person could produce a wrong one. Speed is the risk.

The check is unglamorous and takes an afternoon: export the data the workflow depends on, count duplicates, count records stale beyond twelve months, count fields that should be pick-lists and are free text. That percentage predicts your outcome better than any model benchmark.

Prerequisite two — a process someone has written down

You cannot automate a process that exists only as convention. What gets encoded is one person's version of it, and the disagreement surfaces after go-live as 'the AI is wrong' when the AI is faithfully reproducing an ambiguity that was always there.

The check is equally cheap: two people who own the process write its steps and decision rules independently. Where the lists diverge is your specification. It is a morning of calendar time and it routinely saves a quarter.

Data quality and process definition are prerequisites, not phases. Both are free to diagnose and neither is in the vendor deck.

Why the sequencing instinct is wrong

The instinct is to prove value first and fix foundations later, and it is entirely reasonable — foundations are hard to fund without a demonstrated win. It is also the mechanism that produces stranded pilots.

What happens: the pilot runs on a clean, narrow slice, demos well, and gets funded for production. Production is where variance lives. The data that was fine for fifty curated records is not fine for fifty thousand real ones, and the process that seemed obvious turns out to have four undocumented exceptions.

The alternative is not slower. Run the two checks above before choosing a model. If they pass, the pilot proceeds with a real chance of shipping. If they fail, you have learned it for the cost of an afternoon rather than a quarter.

What we would tell you to do instead of hiring us

If you do exactly this and nothing else, you will be ahead of most of the 95%:

  • Export the data behind your candidate workflow and count duplicates, dormant records and free-text fields that should be structured
  • Have two process owners independently write the steps and decision rules; compare
  • Pick a high-volume, low-variance workflow — not the interesting one
  • Write down the number you expect to move and its value today
  • Only then evaluate models, and evaluate them on your tasks rather than on leaderboards

Four of those five cost nothing but attention. If the first two fail, the honest recommendation is a data and process engagement, and if you would rather run that internally we will tell you what to look for.

The uncomfortable corollary for vendors

MIT's buy-versus-build finding cuts in our favour and we are not going to pretend it does not — partnership outperformed solo internal builds by roughly three to one. But the same study makes clear that partnership succeeds when the organisational prerequisites are in place, not instead of them.

A partner who sells you an AI programme without checking those prerequisites is selling you a place in the 95%. That is the part of the category we are arguing against.

Frequently asked

It comes from MIT's NANDA initiative's 2025 study of 300 public deployments and over 150 executive interviews, and it is the most-cited enterprise AI research of the cycle. It measures pilots with no measurable P&L impact — not pilots that failed technically, which is a different and smaller number.

Then that is the project, and it is worth knowing before spending on AI tooling. Data cleanup has a return independent of AI: better reporting, better forecasting, less manual reconciliation. The AI case gets easier afterwards.

The data export and count is an afternoon. The independent process write-up is a morning of two people's time plus a comparison meeting. Neither requires a vendor, a budget or a procurement cycle.

High volume, low variance. The interesting problem is where variance lives, and variance is where AI fails publicly. Choose the boring frequent one, prove the mechanism, then expand.

CE
Corelynx Editorial · Corelynx · info@corelynx.com
Keep reading
Salesforce & Agentforce August 28, 2026 10 min read

Salesforce Optimisation vs Replatforming: How to Tell Which You Need

Most mid-market companies are not buying their first CRM. They are deciding whether to fix the one they have or leave it.

Read the article
Salesforce & Agentforce August 24, 2026 13 min read

Agentforce Readiness: Six Evidence Tests, and What Failing Each One Costs

The demo is always impressive. What determines whether it survives production is six things, and none of them are the agent.

Read the article
AI Architecture August 17, 2026 12 min read

The AI Architecture Decision That Determines Whether You Can Ever Switch Providers

Most AI lock-in is not contractual. It is architectural, self-inflicted, and decided in week two of the pilot.

Read the article
Technical Leadership August 14, 2026 8 min read

Why We Tell Some Founders They Don't Need a Fractional CTO

A meaningful share of founders who ask us for a fractional CTO do not need one. Telling them costs us a deal and buys something worth more.

Read the article
Technical Leadership August 10, 2026 12 min read

The 12 Decisions a Founder Shouldn't Make Without Technical Leadership

Most technical debt is not written in code. It is decided in a meeting, by someone without the context to know what they are choosing.

Read the article
Build vs Buy August 7, 2026 10 min read

Rebuilding a Bespoke CRM as the System of Revenue Truth: What We'd Do Differently

Publishing your own second-guessing is rare in consulting. It is also the only way a case study tells you anything useful.

Read the article
Build vs Buy August 3, 2026 11 min read

What a Production-Grade MVP Actually Includes

Two quotes for the same MVP, $20,000 apart. The gap is almost never features — it is the eight things that do not demo.

Read the article
Adoption & Change July 29, 2026 9 min read

Your CRM Will Not Fail on Technology. It Will Fail on Adoption.

The post-mortem on a failed CRM almost never blames the software, and almost always blames "adoption". But adoption is an outcome, not a cause. Here is what produces it.

Read the article
CRM Strategy July 22, 2026 12 min read

How to Develop a CRM Strategy Before You Buy Anything

Most CRM strategies are written after the platform is chosen, which makes them implementation plans wearing a strategy label. Here are the four decisions that have to come first — and the order they go in.

Read the article
Revenue Operations July 15, 2026 11 min read

Is Your CRM Delivering? Six Tests It Should Pass

Most CRM reviews measure adoption — logins, records created, fields filled. Those tell you the system is being used, not that it is working. Here are six tests that measure whether it earns its cost.

Read the article
Build vs Buy July 8, 2026 10 min read

Why an Off-the-Shelf CRM Is Not Enough for Your Company

Packaged CRM is the right answer more often than custom-software firms like to admit — and the wrong answer more often than buyers realise. Here is the decision framework, including the cases where you should not build.

Read the article
Field Operations June 30, 2026 9 min read

Mobile CRM: What Field Teams Actually Need From It

Every CRM has a mobile app and most field teams do not use it. The reason is a design decision, not a technology limit — mobile gets treated as a smaller desktop rather than a different job.

Read the article
Revenue Operations June 24, 2026 16 min read

What Is Revenue Intelligence? The 2026 Executive Guide

Vendors use the term for everything from call recording to dashboards. Underneath the noise is a real discipline — here's the plain-language version, with a maturity model and a starting sequence.

Read the article
AI Architecture June 18, 2026 17 min read

Public vs. Private LLMs: An AI Architecture That Protects Your Data

You don't have to choose between AI capability and data privacy — and you definitely don't have to marry one vendor. The architecture that solves both, explained in plain language.

Read the article
Salesforce & Agentforce June 10, 2026 14 min read

Salesforce Agentforce Implementation Cost in 2026: A Transparent Breakdown

Agentforce ARR is growing 205% year over year, and every Salesforce AE has quota pressure to sell it. Here's what implementation actually costs — and the readiness question to answer before spending anything.

Read the article

Talk this through with a practitioner.

The first conversation is about context and fit — nothing more.

Book a Strategy Session

Keep exploring.

See everything under Blog.

Browse Blog
Book a Strategy Session