Bridging the AI Value Gap: Why Organizations Must Shift from Cost-Cutting to a ‘Return on Intelligence’

Despite the current challenges, there is evidence that the relationship between the finance and technology departments is maturing. Chui noted that CFOs and CIOs are beginning to develop new disciplines for tracking AI expenditures and returns more accurately. This cross-functional collaboration is seen as vital for moving AI from a speculative expense to a strategic asset.

The right foundation: context, infrastructure, governance

To bridge the gap between "amplified ignorance" and genuine business value, analysts agree that organizations must invest in a robust foundation consisting of data quality, technical infrastructure, and rigorous governance.

“Governance adds trust. Context adds meaning. Without strong foundations, AI may well stand for amplified ignorance,” Thanaraj warned. He pointed out that data quality remains one of the primary roadblocks to AI success. Because large language models are essentially sophisticated prediction engines, they rely heavily on the context provided to them. Without clear, high-quality data, these models are prone to "hallucinations"—generating confident but entirely incorrect outputs.

Herschel added that this "context layer" is something that cannot be purchased as a plug-and-play solution. It must be built internally to reflect the unique needs, proprietary data, and specific business logic of the organization.

The technical requirements are equally demanding. Jack Gold, principal analyst at J. Gold Associates, emphasized the need for a robust networking backbone to handle the massive data movement required by AI. As agent-to-agent interactions become commonplace and mission-critical, the infrastructure must be able to support a dramatic expansion in the number and distribution of these agents across remote devices and locations.

To manage this complexity, a growing number of organizations are implementing what is known as an AI "harness." This is a software layer designed to control, coordinate, and govern models, tools, and workflows. The importance of this layer is backed by data: a global KPMG survey released last month found that while 55% of all organizations have a formal AI harness layer, that number jumps to 86% among organizations that report having already established a clear ROI from their AI investments.

The presence of a harness layer suggests that success in AI is not just about having the best model, but about having the best system for managing those models. Organizations that can successfully combine clear accountability, coordinated governance, and reliable value measurement will be the ones best positioned to turn broad AI adoption into sustained, long-term performance.

As the industry moves into 2025, the focus is shifting away from the novelty of what AI can do and toward the practical reality of what it should do for the enterprise. For those who can navigate the complexities of cost, context, and workflow redesign, the promise of the "Return on Intelligence" remains within reach.