Raja Deen Dayal & Sons studio · Raja Lala Deen Dayal, c. 1890 · Public domain
0

AI in Indian languages: the gap with English in 2024 benchmarks, and who is building the data

“Use an AI chat or voice tool in my own language”

English is used by about half of the websites whose language is known, while Bengali is at 0.1% and Hindi, Tamil, Telugu and six other Indian languages are each below 0.1%.

Compiled by the Takṣa team from public reportsLast updated 10 October 2026

The problem

W3Techs, which tracks the language of websites, reported in October 2026 that English is used by 49.5% of the websites whose content language it knows. It lists Bengali at 0.1% and Hindi, Marathi, Tamil, Telugu, Urdu, Gujarati, Kannada, Malayalam and Punjabi each below 0.1%. The Census of India 2011, as reported by Gulf News in 2018, found 96.71% of people have one of the 22 Scheduled languages as their mother tongue.

The authors of IndicLLMSuite, a research paper at ACL 2024, say progress on models for languages other than English has been hindered by the scarcity of tailored resources. Their own answer was to build datasets covering 22 Indian languages, with 251 billion tokens. W3Techs counts websites, not text, so its figures show where the web's content is, not what any AI model was trained on.

The authors of IndicGenBench, also at ACL 2024, tested large language models available in 2024 on text tasks such as translation and question answering in 29 Indic languages. They reported "a significant performance gap in all languages compared to English".

Two companies working on this are listed in the Solved elsewhere tab. Whether these efforts cover the languages and dialects most people speak, or reach people who do not read or type, is not shown by anything we read.

As of October 2026, we found no survey of how many people want AI chat or voice tools in their own language.

Who has this problem
People who speak an Indian language and want AI chat or voice tools in it.
Languages needed
Hindi and regional languages