Bridging the AI Value Gap: Why Organizations Must Shift from Cost-Cutting to a ‘Return on Intelligence’

As the initial wave of artificial intelligence enthusiasm transitions into a period of rigorous corporate scrutiny, organizations are facing a sobering reality: while AI is undeniably boosting individual productivity, it has yet to move the needle on the corporate bottom line for the vast majority of enterprises. Industry analysts now suggest that the path to profitability requires a fundamental shift in how companies measure success, urging leaders to look beyond immediate cost savings toward a broader framework of "Return on Intelligence."

The disconnect between investment and impact has become a central theme in executive boardrooms. For nearly two years, organizations have poured billions into generative AI and large language models (LLMs), yet the financial returns remain elusive for most. Michael Chui, a senior fellow at the McKinsey Global Institute, notes that this phenomenon is not entirely unexpected, though the pressure to perform is mounting.

“There’s a delay between the development of technology, even the investment in the technology, and the value that an organization can capture from it,” Chui explained. This lag time is now testing the patience of stakeholders. According to Chui, the honeymoon period of experimental "sandboxes" is ending. “The CFOs are asking CIOs, investors are asking CEOs: ‘Where’s the ROI from this stuff, already?’”

The Productivity Paradox: Individual Gains vs. Organizational Profit

The current state of AI adoption is characterized by a striking paradox. Data from McKinsey’s “State of AI” survey, released in August, reveals that while 80% of respondents reported that AI had improved their individual productivity, that efficiency has not translated into corporate-wide financial performance. Only 37% of those surveyed could definitively say that AI’s impact was visible in their year-end profits—a figure that has remained stagnant since the previous year.

Even more telling is the rarity of "high-performing" AI organizations. Only 6% of respondents reported that AI delivered significant value, defined as accounting for at least 5% of their total operating profit. This suggests a massive "drop-off" between the value individual employees derive from using AI tools—such as drafting emails or summarizing meetings—and the value the organization as a whole captures.

Chui argues that the reason for this gap lies in the way AI is currently being deployed. Most companies are simply layering AI tools on top of existing, outdated processes. However, the most significant gains are expected to come from a total overhaul of the way work is done. According to McKinsey’s Technology Trends Outlook, the highest-performing companies are those that redesign their workflows from the ground up, creating environments where humans and AI agents work in a seamless, integrated fashion.

“Usually an end-to-end workflow involves multiple individuals, and completely redesigning that with the use of AI… is characteristic of high-performing companies,” Chui said. Without this structural change, AI remains a peripheral tool rather than a core driver of business value.

Controlling costs

As organizations attempt to scale their AI initiatives, they are running into a formidable obstacle: the unpredictable and often exorbitant cost of compute and tokens. In the world of generative AI, "tokens" represent the basic units of text or code processed by a model, and the costs associated with them can escalate rapidly as usage grows.