November 17, 2026

The Token Tax: Why Large Language Models Charge Bengali Speakers Six Times More for the Same Words

In the rapidly advancing world of artificial intelligence, a hidden economic and technical disparity is emerging, one that places a significant "tax" on non-English speakers. Recent investigations into the architecture of leading large language models (LLMs) have revealed that the cost of processing text varies wildly depending on the language used. For speakers of Bengali, the penalty is particularly steep: using Meta’s Llama 3.1 to process a paragraph in Bengali requires 6.3 times more tokens than the exact same paragraph in English.

This discrepancy is not a result of the inherent complexity of the language or the laws of physics. Instead, it is a direct consequence of tokenizer design—the initial layer of an AI model that breaks human text into the numerical units the machine can understand. While some newer models, such as Google’s Gemma 3, have successfully narrowed this gap to a negligible margin, others continue to operate with tokenizers that treat common global languages as rare, expensive anomalies.

The implications of this "token tax" are far-reaching, affecting everything from the literal cost of API calls to the effective memory capacity of the models and the carbon footprint of global AI usage.

The Study That Exposed the Language-Energy Divide

The conversation around linguistic inequity in AI reached a fever pitch following the publication of a landmark study by researchers at the University of Michigan. Titled "The Language-Energy Divide: Measuring Energy Costs of Multilingual LLM Inference," the paper was presented at EMNLP 2026. The researchers utilized Michigan’s ML.Energy framework on the university’s Great Lakes computing cluster to measure the actual joules consumed during AI inference.

The team tested several prominent models, including Alibaba’s Qwen 3, Google’s Gemma 3, and Meta’s Llama 3.1. They used the Belebele dataset—a multilingual reading comprehension benchmark—to compare how much energy the models consumed when answering the same questions in 122 different languages.

The findings were staggering. The study revealed that these models use anywhere from 1.4 to 180 times more energy to process non-English text compared to equivalent English text. For widely spoken South Asian languages, the numbers were particularly concerning: Hindi required 7.9 times the energy of English, while Bengali reached a multiplier of 15.3x.

The primary mechanism identified by the researchers was token count. In the world of LLMs, every token represents a unit of compute. If a language is "shattered" into a high number of tokens by a model’s tokenizer, the model must perform more calculations to process that text, leading directly to higher energy consumption and increased latency.

Verifying the Arithmetic of Inequity

The claim that tokenization is the root cause of this energy disparity is one that can be verified outside of a high-performance computing lab. By examining the tokenizers of the models used in the Michigan study—Qwen 3, Gemma 3, and Llama 3.1—alongside OpenAI’s GPT-4o, the sheer scale of the disparity becomes clear through simple arithmetic.

In a controlled test, a single three-sentence paragraph was translated into eight languages: French, German, Spanish, Chinese, Japanese, Arabic, Hindi, and Bengali. By running these translations through the official tokenization files of each model, the "markup" for each language becomes visible.

When the paragraph was tokenized in English, the results were remarkably consistent across all models, hovering between 43 and 44 tokens. However, once the script shifted away from the Latin alphabet, the numbers diverged sharply. On Meta’s Llama 3.1, the Bengali version of the paragraph exploded to 278 tokens—a 6.32x multiplier over the English version. On Qwen 3, the same Bengali text cost 244 tokens (5.67x).