{"id":211955,"date":"2024-03-10T22:05:48","date_gmt":"2024-03-10T22:05:48","guid":{"rendered":"https:\/\/michigandigitalnews.com\/index.php\/2024\/03\/10\/ai-chatbots-think-in-english-research-finds\/"},"modified":"2025-06-25T17:20:53","modified_gmt":"2025-06-25T17:20:53","slug":"ai-chatbots-think-in-english-research-finds","status":"publish","type":"post","link":"https:\/\/michigandigitalnews.com\/index.php\/2024\/03\/10\/ai-chatbots-think-in-english-research-finds\/","title":{"rendered":"AI chatbots ‘think’ in English, research finds"},"content":{"rendered":"

[ad_1]
\n
<\/p>\n

\n

The large-language-models (LLMs) behind AI<\/a> chatbots \u2018think\u2019 in English, even when being asked questions in other languages, new research shows.\u00a0<\/span><\/p>\n

To investigate this phenomenon, researchers at the Swiss Federal Institute of Technology in Lausanne looked at three versions of these AI chatbot models<\/a>: opening them up to see the various \u201clayers\u201d that make up these LLMs\u2019 inner processing.<\/span><\/p>\n

\u201cWe opened up these models and looked at each of the layers,\u201d researcher Veniamin Veselovsky told the New Scientist<\/a>. \u201cEach of these layers does something to the input, the original prompt that you give it. We wanted to see, can we see that the internal layers are actually processing in English?\u201d<\/span><\/p>\n

The \u2018English subspace\u2019<\/span><\/h2>\n

The models, which were chosen on account of their open-source nature, were fed three types of prompts in four languages: French, German, Russian, and Chinese. The first prompt-type asked the LLM to repeat the word it was given. The second requested that the LLM translate from one non-English word to another. And the third and final prompt asked the LLM to fill a one-word gap in a sentence.\u00a0<\/span><\/p>\n

The researchers then managed to backtrace all the different changes and processes the LLM had to go through in order to arrive at the answers to these prompts. What they found was that all of these LLMs and all of these layered processes have one thing in common: they all pass through what they coin the \u201cEnglish subspace.\u201d <\/span><\/p>\n

This basically means that instead of translating straight from French to German, it takes a detour and translates from French, to English, and <\/span>then <\/span><\/i>to German, or vice versa. According to Veselvosky, this is significant because it suggests that these LLMs are using English in order to understand certain concepts.\u00a0<\/span><\/p>\n

Speaking to the New Scientist, Aliya Bhatia of the Center for Democracy & Technology in Washington DC explained why these results may be concerning.<\/span><\/p>\n

\u201cThere\u2019s more high-quality data available in English and some UN languages to train models than in most other languages and as a result, AI developers train their models mostly on English-language data,\u201d she explained.<\/span><\/p>\n

\u00a0\u201cBut using English as the intermediary through which to teach a model how to analyse language risks superimposing a limited world view onto other linguistically and culturally distinct regions.\u201d<\/span><\/p>\n

Featured Image: Ideogram<\/strong><\/em><\/p>\n<\/p><\/div>\n

[ad_2]
\n
Source link <\/a><\/p>\n","protected":false},"excerpt":{"rendered":"

[ad_1] The large-language-models (LLMs) behind AI chatbots \u2018think\u2019 in English, even when being asked questions in other languages, new research shows.\u00a0 To investigate this phenomenon,<\/p>\n","protected":false},"author":1,"featured_media":211956,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"_uf_show_specific_survey":0,"_uf_disable_surveys":false,"footnotes":""},"categories":[152],"tags":[],"_links":{"self":[{"href":"https:\/\/michigandigitalnews.com\/index.php\/wp-json\/wp\/v2\/posts\/211955"}],"collection":[{"href":"https:\/\/michigandigitalnews.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/michigandigitalnews.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/michigandigitalnews.com\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/michigandigitalnews.com\/index.php\/wp-json\/wp\/v2\/comments?post=211955"}],"version-history":[{"count":1,"href":"https:\/\/michigandigitalnews.com\/index.php\/wp-json\/wp\/v2\/posts\/211955\/revisions"}],"predecessor-version":[{"id":338976,"href":"https:\/\/michigandigitalnews.com\/index.php\/wp-json\/wp\/v2\/posts\/211955\/revisions\/338976"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/michigandigitalnews.com\/index.php\/wp-json\/wp\/v2\/media\/211956"}],"wp:attachment":[{"href":"https:\/\/michigandigitalnews.com\/index.php\/wp-json\/wp\/v2\/media?parent=211955"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/michigandigitalnews.com\/index.php\/wp-json\/wp\/v2\/categories?post=211955"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/michigandigitalnews.com\/index.php\/wp-json\/wp\/v2\/tags?post=211955"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}