November 17, 2026

Qualcomm Validates High-Bandwidth Computing Architecture to Overcome the AI Memory Wall

In a significant move to reshape the landscape of artificial intelligence infrastructure, Qualcomm executives have begun showcasing the first tangible results of a new architectural approach designed to eliminate one of the most persistent bottlenecks in modern computing. This summer, the company introduced an architecture known as High-Bandwidth Computing (HBC), which is positioned as a direct answer to the "memory wall"—a phenomenon where the speed of data movement, rather than raw processing power, becomes the primary constraint on performance for AI inference and the emerging field of agentic AI.

The memory wall has long been a source of frustration for chip designers and data center operators alike. As AI models grow in complexity and size, the industry has reached a point where the performance of these systems depends less on how many calculations a processor can perform per second and more on how quickly that processor can be fed the necessary data. This imbalance not only throttles the potential of advanced large language models but also significantly inflates the costs associated with running AI workloads at scale.

Qualcomm’s strategy involves a fundamental shift in how compute and memory interact. Traditionally, the industry has relied on two primary methods to manage data flow. The first involves housing the AI model within fast, on-chip memory, which offers incredible speed but is severely limited by physical space and capacity. The second, more common approach in high-end AI hardware involves the use of stacked High-Bandwidth Memory (HBM). While HBM provides the necessary throughput, it comes with a steep premium in terms of cost, power consumption, and manufacturing complexity.

Qualcomm is now advocating for a third path: near-memory computing, or HBC. This architecture effectively moves the compute resources closer to the data they need to process, minimizing the physical distance data must travel and, by extension, reducing the latency and energy required for every operation.

Gerardo Giaretta, vice president and general manager of datacenter CPU and AI at Qualcomm, recently detailed the challenges of the current status quo during a briefing with journalists and analysts. He noted that traditional computer architectures typically rely on DDR memory located off the package. While DDR offers plenty of capacity, it is hampered by a narrow link that moves data at a relatively slow pace. To solve this, the industry turned to HBM, which increases the number of "lanes" and the speed of data movement between the compute and the memory stack.

However, Giaretta pointed out that HBM is not a perfect solution. The premium paid for HBM is not just financial; it includes a significant increase in power consumption and requires highly complex 2.5D packaging and co-host packaging techniques. These requirements make it difficult to scale efficiently, especially as the demand for inference-only workloads grows.

The HBC architecture aims to solve the problem of data movement by fundamentally changing the physical relationship between the components. In Qualcomm’s implementation, a stack of LPDDR-based memory is placed directly over a compute die. This vertical integration means that data no longer has to traverse millimeters of distance across a circuit board or an interposer. Instead, it moves across micrometers.