Performance

Latency of the evaluated solutions and which of them reach quality in real time.

Takeaways for , , , and

Takeaway 1

In 93% of measured model–language pairs, translation is either real-time or more than four times the real-time threshold.

We call a solution real-time when we get the translation of a text in 2 seconds or less, ~2.7 seconds per 1,000 words for our average text. In their median language, 10 of the 56 models are real-time, translation with 38 takes more than 12 seconds per 1,000 words, and every language has at least one real-time model.

Time per 1,000 source words across measured model–language pairs

Chart data

Time per 1,000 source words across measured model–language pairs (3,886 points summarized)
Points	Lowest, seconds per 1,000 source words	Lower quartile, seconds per 1,000 source words	Median, seconds per 1,000 source words	Upper quartile, seconds per 1,000 source words	Highest, seconds per 1,000 source words
3,886	0.121	9.659	50.729	89.74	5,929.64

Takeaway 2

MT engine translations take a median of ~2 seconds per 1,000 source words, compared with ~66 seconds for LLMs.

The median LLM time is ~37 times the median MT engine time. With Google Cloud Advanced Translation API, translation takes a median of 0.17 seconds per 1,000 words, and with MoonshotAI Kimi K2.5, 323 seconds. The fastest LLM is OpenAI gpt-oss-120b, an open-weight LLM, at a median of 2.7 seconds per 1,000 words.

To Youdao Translation Service API, NiuTrans and iFlyTek MT, three of the slowest MT engines, we send the texts in 177 requests, one sentence after another, and their time includes all of them.

See details →

Time per 1,000 source words, by model type

Chart data

Time per 1,000 source words, by model type (3,886 points by group)
Class	Points	Lowest, seconds per 1,000 source words	Lower quartile, seconds per 1,000 source words	Median, seconds per 1,000 source words	Upper quartile, seconds per 1,000 source words	Highest, seconds per 1,000 source words
MT engines	841	0.121	0.39	2.867	33.956	138.83
LLM-based MT engines	356	0.376	0.7217	1.615	3.462	277.19
LLMs	2,269	9.651	42.767	65.841	102.19	5,929.64
Open-weight LLMs	420	1.325	36.642	65.244	198.97	588.46

Takeaway 3

No assessed real-time one-step solution meets every Standard requirement.

We assessed real-time one-step solutions in 84 languages, from MT engines such as DeepL Next Gen, Translated Lara 2 and Microsoft Translator and from OpenAI gpt-oss-120b. Only two meet general translation quality (no critical error, at most three major errors and at most 20 weighted errors per 1,000 words), DeepL Next Gen in German and Romanian. 4 out of 198 meet both tag handling and formatting. A repair of tags and formatting by code does not add time, but it leaves general translation quality as it is.

The one-step solutions that meet every Standard requirement come from LLMs adjusted with context in the request. The fastest is Google Gemini 3.5 Flash in Indonesian at ~12 seconds per 1,000 source words, and across the 38 languages where such a solution exists, the fastest one takes a median of ~65 seconds per 1,000 words. Within a language, the LLM solutions that meet every Standard requirement take ~1.1 times as long as the other LLM solutions at the median, and longer in 27 of the 38 languages.

See details →

One-step solutions by translation time and the Standard requirements they meet

Chart data

One-step solutions by translation time and the Standard requirements they meet
Model	Language	Seconds per 1,000 source words over the four texts	Status	Class
Google Cloud Advanced Translation API	Kurdish (Kurmanji)	0.13	Other solutions	MT engine
Google Cloud Advanced Translation API	Scottish Gaelic	0.16	Other solutions	MT engine
Microsoft Translator	Chinese Simplified	0.17	Other solutions	MT engine
Microsoft Translator	Danish	0.19	Other solutions	MT engine
Microsoft Translator	Italian	0.19	Other solutions	MT engine
Google Cloud Advanced Translation API	Sinhala	0.19	Other solutions	MT engine
Microsoft Translator	Spanish (European)	0.2	Other solutions	MT engine
Microsoft Translator	Estonian	0.2	Other solutions	MT engine
Microsoft Translator	Galician	0.2	Other solutions	MT engine
Microsoft Translator	Khmer	0.2	Other solutions	MT engine
Microsoft Translator	Urdu	0.2	Other solutions	MT engine
Microsoft Translator	Finnish	0.21	Other solutions	MT engine
Microsoft Translator	Portuguese (European)	0.21	Other solutions	MT engine
Microsoft Translator	Telugu	0.21	Other solutions	MT engine
Microsoft Translator	Ukrainian	0.21	Other solutions	MT engine
Microsoft Translator	Afrikaans	0.23	Other solutions	MT engine
Microsoft Translator	German	0.23	Other solutions	MT engine
Microsoft Translator	Macedonian	0.23	Other solutions	MT engine
Microsoft Translator	Swedish	0.23	Other solutions	MT engine
Google Cloud Advanced Translation API	Cebuano	0.24	Other solutions	MT engine
Microsoft Translator	Welsh	0.24	Other solutions	MT engine
Microsoft Translator	Lao	0.24	Other solutions	MT engine
Microsoft Translator	Croatian	0.26	Other solutions	MT engine
Microsoft Translator	Kannada	0.26	Other solutions	MT engine
Microsoft Translator	Norwegian	0.26	Other solutions	MT engine
Microsoft Translator	Albanian	0.26	Other solutions	MT engine
Microsoft Translator	Amharic	0.27	Other solutions	MT engine
Microsoft Translator	Catalan	0.3	Other solutions	MT engine
ModernMT Enterprise Edition	Finnish	0.32	Other solutions	MT engine
Microsoft Translator	Hindi	0.32	Other solutions	MT engine
Microsoft Translator	Romanian	0.32	Other solutions	MT engine
Microsoft Translator	Odia (Oriya)	0.34	Other solutions	MT engine
Microsoft Translator	Greek	0.35	Other solutions	MT engine
ModernMT Enterprise Edition	Lithuanian	0.35	Other solutions	MT engine
Microsoft Translator	Malayalam	0.36	Other solutions	MT engine
Google Translation LLM	Belarusian	0.38	Other solutions	LLM-based MT engine
Microsoft Translator	Hebrew	0.38	Other solutions	MT engine
ModernMT Enterprise Edition	Bosnian	0.43	Other solutions	MT engine
Google Translation LLM	Slovak	0.44	Other solutions	LLM-based MT engine
Microsoft Translator	Assamese	0.46	Other solutions	MT engine
Google Translation LLM	Polish	0.46	Other solutions	LLM-based MT engine
Google Translation LLM	Vietnamese	0.48	Other solutions	LLM-based MT engine
DeepL Next Gen	Malay	0.5	Other solutions	LLM-based MT engine
Google Translation LLM	Turkish	0.5	Other solutions	LLM-based MT engine
Google Translation LLM	Estonian	0.51	Other solutions	LLM-based MT engine
Google Translation LLM	Thai	0.51	Other solutions	LLM-based MT engine
DeepL Next Gen	Vietnamese	0.52	Other solutions	LLM-based MT engine
Google Translation LLM	Basque	0.54	Other solutions	LLM-based MT engine
Google Translation LLM	Latvian	0.54	Other solutions	LLM-based MT engine
Google Translation LLM	Azerbaijani	0.55	Other solutions	LLM-based MT engine
DeepL Next Gen	Czech	0.55	Other solutions	LLM-based MT engine
Google Translation LLM	Tamil	0.55	Other solutions	LLM-based MT engine
ModernMT Enterprise Edition	Greek	0.56	Other solutions	MT engine
Microsoft Translator	Farsi	0.56	Other solutions	MT engine
DeepL Next Gen	Galician	0.56	Other solutions	LLM-based MT engine
Google Translation LLM	Hungarian	0.56	Other solutions	LLM-based MT engine
Google Translation LLM	Nepali	0.56	Other solutions	LLM-based MT engine
DeepL Next Gen	Dutch	0.56	Other solutions	LLM-based MT engine
DeepL Next Gen	Sundanese	0.56	Other solutions	LLM-based MT engine
Google Translation LLM	Tagalog	0.56	Other solutions	LLM-based MT engine
DeepL Next Gen	Korean	0.58	Other solutions	LLM-based MT engine
DeepL Next Gen	Farsi	0.59	Other solutions	LLM-based MT engine
DeepL Next Gen	Croatian	0.59	Other solutions	LLM-based MT engine
DeepL Next Gen	Estonian	0.6	Other solutions	LLM-based MT engine
DeepL Next Gen	French	0.6	Other solutions	LLM-based MT engine
DeepL Next Gen	Polish	0.6	Other solutions	LLM-based MT engine
DeepL Next Gen	Swedish	0.6	Other solutions	LLM-based MT engine
Google Translation LLM	Swahili	0.6	Other solutions	LLM-based MT engine
DeepL Next Gen	Tagalog	0.6	Other solutions	LLM-based MT engine
DeepL Next Gen	Danish	0.62	Other solutions	LLM-based MT engine
DeepL Next Gen	Indonesian	0.62	Other solutions	LLM-based MT engine
DeepL Next Gen	Portuguese (European)	0.62	Other solutions	LLM-based MT engine
Google Translation LLM	Armenian	0.63	Other solutions	LLM-based MT engine
Google Translation LLM	Kannada	0.64	Other solutions	LLM-based MT engine
DeepL Next Gen	Latvian	0.64	Other solutions	LLM-based MT engine
DeepL Next Gen	Slovak	0.64	Other solutions	LLM-based MT engine
Google Translation LLM	Czech	0.66	Other solutions	LLM-based MT engine
DeepL Next Gen	Slovenian	0.66	Other solutions	LLM-based MT engine
DeepL Next Gen	Afrikaans	0.67	Other solutions	LLM-based MT engine
DeepL Next Gen	Finnish	0.67	Other solutions	LLM-based MT engine
DeepL Next Gen	Icelandic	0.67	Other solutions	LLM-based MT engine
DeepL Next Gen	Albanian	0.67	Other solutions	LLM-based MT engine
DeepL Next Gen	Urdu	0.67	Other solutions	LLM-based MT engine
DeepL Next Gen	Macedonian	0.69	Other solutions	LLM-based MT engine
Google Translation LLM	Arabic (MSA)	0.7	Other solutions	LLM-based MT engine
DeepL Next Gen	Azerbaijani	0.7	Other solutions	LLM-based MT engine
DeepL Next Gen	Welsh	0.7	Other solutions	LLM-based MT engine
DeepL Next Gen	German	0.7	Other solutions	LLM-based MT engine
Google Translation LLM	Icelandic	0.7	Other solutions	LLM-based MT engine
Google Translation LLM	Georgian	0.7	Other solutions	LLM-based MT engine
Google Translation LLM	Khmer	0.7	Other solutions	LLM-based MT engine
DeepL Next Gen	Uzbek	0.7	Other solutions	LLM-based MT engine
DeepL Next Gen	Tajik	0.71	Other solutions	LLM-based MT engine
Google Translation LLM	Irish	0.73	Other solutions	LLM-based MT engine
DeepL Next Gen	Armenian	0.73	Other solutions	LLM-based MT engine
Google Translation LLM	Lao	0.73	Other solutions	LLM-based MT engine
DeepL Next Gen	Turkish	0.73	Other solutions	LLM-based MT engine
DeepL Next Gen	Belarusian	0.74	Other solutions	LLM-based MT engine
DeepL Next Gen	Romanian	0.74	Other solutions	LLM-based MT engine
DeepL Next Gen	Tatar	0.74	Other solutions	LLM-based MT engine
Google Translation LLM	Bulgarian	0.75	Other solutions	LLM-based MT engine
DeepL Next Gen	Catalan	0.75	Other solutions	LLM-based MT engine
DeepL Next Gen	Nepali	0.75	Other solutions	LLM-based MT engine
DeepL Next Gen	Georgian	0.77	Other solutions	LLM-based MT engine
DeepL Next Gen	Tamil	0.77	Other solutions	LLM-based MT engine
DeepL Next Gen	Lithuanian	0.78	Other solutions	LLM-based MT engine
DeepL Next Gen	Bosnian	0.81	Other solutions	LLM-based MT engine
DeepL Next Gen	Hungarian	0.81	Other solutions	LLM-based MT engine
DeepL Next Gen	Telugu	0.82	Other solutions	LLM-based MT engine
DeepL Next Gen	Hausa	0.83	Other solutions	LLM-based MT engine
DeepL Next Gen	Ukrainian	0.83	Other solutions	LLM-based MT engine
DeepL Next Gen	Basque	0.85	Other solutions	LLM-based MT engine
DeepL Next Gen	Javanese	0.85	Other solutions	LLM-based MT engine
Google Translation LLM	Burmese	0.85	Other solutions	LLM-based MT engine
DeepL Next Gen	Arabic (MSA)	0.86	Other solutions	LLM-based MT engine
DeepL Next Gen	Marathi	0.86	Other solutions	LLM-based MT engine
DeepL Next Gen	Irish	0.87	Other solutions	LLM-based MT engine
DeepL Next Gen	Bengali	0.89	Other solutions	LLM-based MT engine
Google Translation LLM	Tajik	0.89	Other solutions	LLM-based MT engine
Google Translation LLM	Punjabi	0.9	Other solutions	LLM-based MT engine
DeepL Next Gen	Hindi	0.91	Other solutions	LLM-based MT engine
Google Translation LLM	Mongolian	0.91	Other solutions	LLM-based MT engine
DeepL Next Gen	Hebrew	0.94	Other solutions	LLM-based MT engine
DeepL Next Gen	Chinese Simplified	0.94	Other solutions	LLM-based MT engine
DeepL Next Gen	Assamese	1.01	Other solutions	LLM-based MT engine
DeepL Next Gen	Japanese	1.01	Other solutions	LLM-based MT engine
ModernMT Enterprise Edition	Serbian	1.01	Other solutions	MT engine
DeepL Next Gen	Bulgarian	1.02	Other solutions	LLM-based MT engine
Amazon Translate	Dutch	1.05	Other solutions	MT engine
DeepL Next Gen	Gujarati	1.06	Other solutions	LLM-based MT engine
DeepL Next Gen	Russian	1.07	Other solutions	LLM-based MT engine
Translated Lara 2	Danish	1.09	Other solutions	LLM-based MT engine
DeepL Next Gen	Punjabi	1.1	Other solutions	LLM-based MT engine
Translated Lara 2	Indonesian	1.13	Other solutions	LLM-based MT engine
DeepL Next Gen	Italian	1.14	Other solutions	LLM-based MT engine
Translated Lara 2	Swedish	1.16	Other solutions	LLM-based MT engine
DeepL Next Gen	Mongolian	1.17	Other solutions	LLM-based MT engine
Translated Lara 2	Galician	1.18	Other solutions	LLM-based MT engine
DeepL Next Gen	Malayalam	1.18	Other solutions	LLM-based MT engine
Translated Lara 2	Korean	1.2	Other solutions	LLM-based MT engine
Amazon Translate	Italian	1.21	Other solutions	MT engine
Translated Lara 2	Croatian	1.24	Other solutions	LLM-based MT engine
Translated Lara 2	Slovenian	1.25	Other solutions	LLM-based MT engine
Translated Lara 2	Bosnian	1.26	Other solutions	LLM-based MT engine
DeepL Next Gen	Thai	1.26	Other solutions	LLM-based MT engine
Amazon Translate	German	1.3	Other solutions	MT engine
DeepL Next Gen	Greek	1.3	Other solutions	LLM-based MT engine
Amazon Translate	French	1.3	Other solutions	MT engine
DeepL Next Gen	Pashto	1.3	Other solutions	LLM-based MT engine
Translated Lara 2	Serbian	1.3	Other solutions	LLM-based MT engine
Translated Lara 2	Russian	1.32	Other solutions	LLM-based MT engine
Translated Lara 2	Afrikaans	1.33	Other solutions	LLM-based MT engine
Translated Lara 2	Czech	1.34	Other solutions	LLM-based MT engine
Translated Lara 2	Polish	1.34	Other solutions	LLM-based MT engine
Translated Lara 2	Vietnamese	1.34	Other solutions	LLM-based MT engine
Google Translation LLM	Amharic	1.36	Other solutions	LLM-based MT engine
OpenAI gpt-oss-120b	Dutch	1.36	Other solutions	Open-weight LLM
Translated Lara 2	Turkish	1.36	Other solutions	LLM-based MT engine
Translated Lara 2	Slovak	1.37	Other solutions	LLM-based MT engine
Translated Lara 2	Romanian	1.38	Other solutions	LLM-based MT engine
Translated Lara 2	Farsi	1.42	Other solutions	LLM-based MT engine
Translated Lara 2	Ukrainian	1.44	Other solutions	LLM-based MT engine
Translated Lara 2	Hungarian	1.45	Other solutions	LLM-based MT engine
Translated Lara 2	Macedonian	1.45	Other solutions	LLM-based MT engine
Amazon Translate	Korean	1.48	Other solutions	MT engine
Google Translation LLM	Kyrgyz	1.48	Other solutions	LLM-based MT engine
Translated Lara 2	Albanian	1.5	Other solutions	LLM-based MT engine
Amazon Translate	Spanish (European)	1.52	Other solutions	MT engine
Translated Lara 2	Tagalog	1.52	Other solutions	LLM-based MT engine
Translated Lara 2	Latvian	1.58	Other solutions	LLM-based MT engine
Translated Lara 2	Irish	1.61	Other solutions	LLM-based MT engine
OpenAI gpt-oss-120b	French	1.65	Other solutions	Open-weight LLM
Translated Lara 2	Urdu	1.72	Other solutions	LLM-based MT engine
DeepL Next Gen	Yiddish	1.75	Other solutions	LLM-based MT engine
Amazon Translate	Japanese	1.79	Other solutions	MT engine
Translated Lara 2	Georgian	1.8	Other solutions	LLM-based MT engine
Translated Lara 2	Thai	1.8	Other solutions	LLM-based MT engine
Translated Lara 2	Belarusian	1.84	Other solutions	LLM-based MT engine
DeepL Next Gen	Norwegian	1.84	Other solutions	LLM-based MT engine
OpenAI gpt-oss-120b	Indonesian	1.85	Other solutions	Open-weight LLM
OpenAI gpt-oss-120b	Malay	1.88	Other solutions	Open-weight LLM
DeepL Next Gen	Chinese Traditional	1.97	Other solutions	LLM-based MT engine
DeepL Next Gen	Spanish (European)	2	Other solutions	LLM-based MT engine
Translated Lara 2	Hindi	2	Other solutions	LLM-based MT engine
OpenAI gpt-oss-120b	Arabic (MSA)	2.01	Other solutions	Open-weight LLM
OpenAI gpt-oss-120b	Catalan	2.07	Other solutions	Open-weight LLM
Translated Lara 2	Marathi	2.12	Other solutions	LLM-based MT engine
Translated Lara 2	Tatar	2.22	Other solutions	LLM-based MT engine
Translated Lara 2	Mongolian	2.23	Other solutions	LLM-based MT engine
Translated Lara 2	Tajik	2.26	Other solutions	LLM-based MT engine
OpenAI gpt-oss-120b	Pashto	2.3	Other solutions	Open-weight LLM
Translated Lara 2	Kannada	2.32	Other solutions	LLM-based MT engine
Translated Lara 2	Telugu	2.38	Other solutions	LLM-based MT engine
OpenAI gpt-oss-120b	Norwegian	2.39	Other solutions	Open-weight LLM
OpenAI gpt-oss-120b	Hebrew	2.42	Other solutions	Open-weight LLM
Translated Lara 2	Tamil	2.55	Other solutions	LLM-based MT engine
OpenAI gpt-oss-120b	Welsh	2.57	Other solutions	Open-weight LLM
Translated Lara 2	Punjabi	2.62	Other solutions	LLM-based MT engine
OpenAI gpt-oss-120b	Bulgarian	2.7	Other solutions	Open-weight LLM
Translated Lara 2	Malayalam	2.82	Other solutions	LLM-based MT engine
OpenAI gpt-oss-120b	Tatar	2.85	Other solutions	Open-weight LLM
Elia Machine Translation System	Spanish (European)	2.96	Other solutions	MT engine
Yandex Cloud Translate v2	Russian	3.92	Other solutions	MT engine
Yandex Cloud Translate v2	Belarusian	4.75	Other solutions	MT engine
Translated Lara 2	Amharic	5.16	Other solutions	LLM-based MT engine
Translated Lara 2	Lao	5.45	Other solutions	LLM-based MT engine
Translated Lara 2	Khmer	6.26	Other solutions	LLM-based MT engine
Translated Lara 2	Sinhala	6.38	Other solutions	LLM-based MT engine
OpenAI GPT-5.6 Luna	Portuguese (European)	11.48	Other solutions	LLM
OpenAI GPT-5.6 Luna	German	11.63	Other solutions	LLM
Google Gemini 3.5 Flash	Indonesian	11.94	Meet every requirement	LLM
OpenAI GPT-5.6 Luna	Italian	12.09	Other solutions	LLM
OpenAI GPT-5.6 Luna	Indonesian	12.1	Meet every requirement	LLM
OpenAI GPT-5.6 Luna	Norwegian	12.14	Meet every requirement	LLM
OpenAI GPT-5.6 Luna	French	12.28	Other solutions	LLM
Google Translation LLM	Marathi	12.29	Other solutions	LLM-based MT engine
OpenAI GPT-5.6 Luna	Malay	12.72	Meet every requirement	LLM
Google Gemini 3.5 Flash	French	12.89	Other solutions	LLM
OpenAI GPT-5.6 Luna	Catalan	13.35	Other solutions	LLM
Google Gemini 3.5 Flash	Catalan	13.45	Other solutions	LLM
OpenAI GPT-4.1	Swedish	13.46	Other solutions	LLM
Google Gemini 3.5 Flash	Malay	13.49	Meet every requirement	LLM
Google Gemini 3.5 Flash	Chinese Traditional	13.49	Other solutions	LLM
Google Gemini 3.5 Flash	Korean	14.13	Other solutions	LLM
Google Gemini 3.5 Flash	Hindi	14.22	Other solutions	LLM
Google Gemini 3.5 Flash	Serbian	14.33	Other solutions	LLM
OpenAI GPT-5.6 Luna	Sundanese	14.43	Other solutions	LLM
Google Gemini 3.5 Flash	Japanese	14.48	Other solutions	LLM
OpenAI GPT-5.6 Terra	Chinese Simplified	14.49	Other solutions	LLM
OpenAI GPT-5.6 Luna	Bengali	14.71	Other solutions	LLM
OpenAI GPT-4.1	Galician	14.76	Other solutions	LLM
OpenAI GPT-5.6 Luna	Georgian	14.92	Other solutions	LLM
Google Gemini 3.5 Flash	Bulgarian	14.94	Other solutions	LLM
Google Gemini 3.5 Flash	Croatian	14.96	Other solutions	LLM
Google Gemini 3.5 Flash	Bosnian	14.98	Other solutions	LLM
OpenAI GPT-5.6 Luna	Swahili	15.07	Other solutions	LLM
Google Gemini 3.5 Flash	Turkish	15.25	Other solutions	LLM
OpenAI GPT-4.1	Norwegian	15.27	Other solutions	LLM
OpenAI GPT-4.1	French	15.35	Other solutions	LLM
Google Gemini 3.5 Flash	Slovenian	15.76	Other solutions	LLM
Google Gemini 3.5 Flash	Polish	15.78	Other solutions	LLM
OpenAI GPT-5.6 Luna	Kazakh	15.82	Other solutions	LLM
OpenAI GPT-5.6 Luna	Farsi	15.88	Other solutions	LLM
OpenAI GPT-5.6 Luna	Uzbek	15.93	Other solutions	LLM
Google Gemini 3.5 Flash	Macedonian	15.98	Other solutions	LLM
OpenAI GPT-4.1	German	16	Other solutions	LLM
Google Gemini 3.5 Flash	Tagalog	16	Other solutions	LLM
Google Gemini 3.5 Flash	Gujarati	16.05	Other solutions	LLM
Google Gemini 3.5 Flash	Belarusian	16.08	Other solutions	LLM
xAI Grok 4.20 (non-reasoning)	Turkish	16.33	Other solutions	LLM
Google Gemini 3.5 Flash	Estonian	16.72	Other solutions	LLM
OpenAI GPT-5.6 Luna	Irish	16.79	Other solutions	LLM
Google Gemini 3.5 Flash	Georgian	16.88	Other solutions	LLM
OpenAI GPT-4.1	Finnish	16.92	Other solutions	LLM
Google Gemini 3.5 Flash	Marathi	17.02	Other solutions	LLM
OpenAI GPT-4.1	Bosnian	17.06	Other solutions	LLM
Google Gemini 3.5 Flash	Swahili	17.06	Other solutions	LLM
OpenAI GPT-5.6 Terra	Korean	17.09	Other solutions	LLM
OpenAI GPT-5.6 Luna	Frisian	17.14	Other solutions	LLM
Google Gemini 3.5 Flash	Farsi	17.17	Other solutions	LLM
OpenAI GPT-5.6 Luna	Telugu	17.27	Other solutions	LLM
Google Gemini 3.5 Flash	Telugu	17.41	Other solutions	LLM
OpenAI GPT-5.6 Terra	Spanish (European)	17.45	Meet every requirement	LLM
Google Gemini 3.5 Flash	Kannada	17.52	Other solutions	LLM
Google Gemini 3.5 Flash	Malayalam	17.54	Other solutions	LLM
OpenAI GPT-4.1	Estonian	17.6	Other solutions	LLM
Google Gemini 3.5 Flash	Tamil	17.64	Other solutions	LLM
OpenAI GPT-4.1	Arabic (MSA)	17.77	Other solutions	LLM
Google Gemini 3.5 Flash	Latvian	17.94	Other solutions	LLM
Google Gemini 3.5 Flash	Frisian	18.04	Other solutions	LLM
Google Gemini 3.5 Flash	Greek	18.09	Other solutions	LLM
OpenAI GPT-5.6 Luna	Mongolian	18.27	Other solutions	LLM
OpenAI GPT-5.6 Luna	Hungarian	18.29	Other solutions	LLM
OpenAI GPT-5.6 Luna	Icelandic	18.43	Other solutions	LLM
Google Gemini 3.5 Flash	Azerbaijani	18.5	Other solutions	LLM
xAI Grok 4.20 (non-reasoning)	Bosnian	18.95	Other solutions	LLM
OpenAI GPT-5.6 Luna	Welsh	18.98	Other solutions	LLM
Google Gemini 3.5 Flash	Uzbek	19.02	Other solutions	LLM
Google Gemini 3.5 Flash	Kazakh	19.11	Other solutions	LLM
OpenAI GPT-5.6 Luna	Assamese	19.3	Other solutions	LLM
OpenAI GPT-4.1	Czech	19.5	Other solutions	LLM
OpenAI GPT-5.6 Terra	Japanese	19.56	Other solutions	LLM
Google Gemini 3.5 Flash	Lithuanian	19.74	Other solutions	LLM
OpenAI GPT-4.1	Russian	19.74	Other solutions	LLM
Google Gemini 3.5 Flash	Pashto	20.01	Other solutions	LLM
OpenAI GPT-4.1	Turkish	20.48	Other solutions	LLM
xAI Grok 4.20 (non-reasoning)	Frisian	20.56	Other solutions	LLM
OpenAI GPT-4.1	Malay	20.6	Other solutions	LLM
xAI Grok 4.20 (non-reasoning)	Lithuanian	21.06	Other solutions	LLM
Google Gemini 3.5 Flash	Sesotho	21.09	Other solutions	LLM
OpenAI GPT-4.1	Latvian	21.53	Other solutions	LLM
OpenAI GPT-4.1	Danish	21.64	Other solutions	LLM
OpenAI GPT-4.1	Nepali	21.73	Other solutions	LLM
Google Gemini 3.5 Flash	Kyrgyz	21.83	Other solutions	LLM
OpenAI GPT-4.1	Indonesian	21.92	Meet every requirement	LLM
OpenAI GPT-4.1	Swahili	22.11	Other solutions	LLM
OpenAI GPT-4.1	Ukrainian	22.73	Other solutions	LLM
OpenAI GPT-5.6 Terra	Polish	22.86	Other solutions	LLM
xAI Grok 4.20 (non-reasoning)	Uzbek	23.1	Other solutions	LLM
Google Gemini 3.5 Flash	Lao	23.28	Other solutions	LLM
OpenAI GPT-5.6 Luna	Sinhala	23.33	Other solutions	LLM
Google Gemini 3.5 Flash	Tajik	23.48	Other solutions	LLM
OpenAI GPT-4.1	Armenian	23.57	Other solutions	LLM
OpenAI GPT-4.1	Catalan	23.75	Other solutions	LLM
OpenAI GPT-5.6 Terra	Swedish	23.79	Other solutions	LLM
OpenAI GPT-4.1	Greek	23.9	Other solutions	LLM
xAI Grok 4.20 (non-reasoning)	Kurdish (Kurmanji)	23.99	Other solutions	LLM
OpenAI GPT-4.1	Belarusian	24.18	Other solutions	LLM
OpenAI GPT-4.1	Hungarian	24.55	Other solutions	LLM
Google Gemini 3.5 Flash	Punjabi	24.58	Other solutions	LLM
OpenAI GPT-5.6 Terra	Danish	24.67	Meet every requirement	LLM
Google Gemini 3.5 Flash	Burmese	24.81	Other solutions	LLM
OpenAI GPT-4.1	Marathi	24.84	Other solutions	LLM
OpenAI GPT-4.1	Slovenian	25.48	Other solutions	LLM
OpenAI GPT-4.1	Albanian	25.8	Other solutions	LLM
Cohere Command A Translate	Chinese Simplified	25.8	Other solutions	LLM
OpenAI GPT-5.6 Terra	Bulgarian	25.99	Meet every requirement	LLM
OpenAI GPT-4.1	Dutch	26.35	Other solutions	LLM
OpenAI GPT-4.1	Farsi	26.49	Other solutions	LLM
xAI Grok 4.20 (non-reasoning)	Kazakh	26.74	Other solutions	LLM
OpenAI GPT-5.6 Luna	Burmese	26.81	Other solutions	LLM
OpenAI GPT-4.1	Portuguese (European)	26.93	Other solutions	LLM
Cohere Command A Translate	Spanish (European)	27.07	Other solutions	LLM
OpenAI GPT-4.1	Hindi	27.56	Other solutions	LLM
OpenAI GPT-5.6 Terra	Czech	27.7	Meet every requirement	LLM
Cohere Command A Translate	Portuguese (European)	27.94	Other solutions	LLM
Cohere Command A Translate	Indonesian	28.17	Other solutions	LLM
OpenAI GPT-4.1	Croatian	28.18	Other solutions	LLM
Cohere Command A Translate	Italian	28.23	Other solutions	LLM
OpenAI GPT-5.6 Terra	Afrikaans	28.46	Other solutions	LLM
OpenAI GPT-5.6 Terra	Slovak	28.54	Other solutions	LLM
Cohere Command A Translate	French	28.91	Other solutions	LLM
OpenAI GPT-4.1	Somali	29.21	Other solutions	LLM
Cohere Command A Translate	Japanese	29.52	Other solutions	LLM
Cohere Command A Translate	Korean	29.72	Other solutions	LLM
OpenAI GPT-5.6 Terra	Bosnian	29.82	Other solutions	LLM
Cohere Command A Translate	German	29.87	Other solutions	LLM
xAI Grok 4.20 (non-reasoning)	Kyrgyz	30.21	Other solutions	LLM
OpenAI GPT-4.1	Slovak	30.25	Other solutions	LLM
OpenAI GPT-4.1	Kannada	30.38	Other solutions	LLM
Cohere Command A Translate	Vietnamese	30.48	Other solutions	LLM
OpenAI GPT-5.6 Terra	Albanian	30.89	Other solutions	LLM
Mistral Medium 3.1	Russian	31.44	Other solutions	LLM
OpenAI GPT-5.6 Terra	Macedonian	31.66	Meet every requirement	LLM
OpenAI GPT-5.6 Luna	Odia (Oriya)	31.78	Other solutions	LLM
Cohere Command A Translate	Arabic (MSA)	32.25	Other solutions	LLM
Cohere Command A Translate	Czech	32.26	Other solutions	LLM
MiniMax M2.5	Chinese Traditional	32.36	Other solutions	LLM
Meta Llama 4 Maverick	Portuguese (European)	32.73	Other solutions	Open-weight LLM
Cohere Command A Translate	Galician	32.89	Other solutions	LLM
Anthropic Claude Haiku 4.5	Serbian	33.16	Other solutions	LLM
Cohere Command A Translate	Hebrew	33.23	Other solutions	LLM
Meta Llama 4 Maverick	German	33.42	Other solutions	Open-weight LLM
OpenAI GPT-5.6 Terra	Latvian	33.53	Other solutions	LLM
OpenAI GPT-5.6 Terra	Tagalog	33.57	Other solutions	LLM
OpenAI GPT-4.1	Romanian	33.92	Other solutions	LLM
OpenAI GPT-4.1	Basque	34.33	Other solutions	LLM
Cohere Command A Translate	Malay	34.44	Other solutions	LLM
ALL-Lab	Arabic (MSA)	35.23	Other solutions	MT engine
Mistral Large 3	French	35.5	Other solutions	LLM
Anthropic Claude Haiku 4.5	Afrikaans	35.66	Other solutions	LLM
OpenAI GPT-4.1	Urdu	35.7	Other solutions	LLM
Widn AI Tower Sugarloaf	Chinese Simplified	35.8	Other solutions	LLM-based MT engine
Cohere Command A Translate	Greek	36.12	Other solutions	LLM
Anthropic Claude Sonnet 5	French	36.23	Other solutions	LLM
Anthropic Claude Sonnet 5	Indonesian	36.76	Other solutions	LLM
Cohere Command A Translate	Dutch	37.42	Other solutions	LLM
Cohere Command A Translate	Sundanese	37.68	Other solutions	LLM
OpenAI GPT-4.1	Bulgarian	38.09	Other solutions	LLM
Translated Lara 2	Odia (Oriya)	38.16	Other solutions	LLM-based MT engine
OpenAI GPT-4.1	Sundanese	38.29	Other solutions	LLM
Mistral Medium 3.1	Japanese	38.62	Other solutions	LLM
Anthropic Claude Sonnet 5	German	38.64	Other solutions	LLM
Cohere Command A Translate	Romanian	39.11	Other solutions	LLM
Mistral Medium 3.1	Polish	39.48	Other solutions	LLM
Cohere Command A Translate	Ukrainian	39.56	Other solutions	LLM
OpenAI GPT-5.5	Italian	39.64	Other solutions	LLM
Widn AI Tower Sugarloaf	Italian	39.68	Other solutions	LLM-based MT engine
Swiss AI Apertus-8B-2509	Chinese Simplified	39.7	Other solutions	Open-weight LLM
OpenAI GPT-5.6 Sol	Chinese Traditional	39.83	Other solutions	LLM
Anthropic Claude Sonnet 5	Russian	39.88	Other solutions	LLM
DeepSeek V3.2	German	40.05	Other solutions	LLM
OpenAI GPT-5.5	Chinese Traditional	40.2	Other solutions	LLM
AI21 Jamba Large 1.7	Spanish (European)	40.44	Other solutions	LLM
xAI Grok 4.20 (reasoning)	Galician	40.94	Other solutions	LLM
Anthropic Claude Sonnet 5	Swedish	41.14	Other solutions	LLM
xAI Grok 4.20 (non-reasoning)	Yiddish	41.77	Other solutions	LLM
Widn AI Tower Sugarloaf	Portuguese (European)	41.83	Other solutions	LLM-based MT engine
Cohere Command A Translate	Catalan	42.06	Other solutions	LLM
Anthropic Claude Sonnet 5	Chinese Traditional	42.16	Other solutions	LLM
Widn AI Tower Sugarloaf	Japanese	42.24	Other solutions	LLM-based MT engine
Mistral Large 3	Russian	42.28	Other solutions	LLM
Anthropic Claude Sonnet 5	Dutch	42.39	Other solutions	LLM
OpenAI GPT-4.1	Icelandic	42.43	Other solutions	LLM
Anthropic Claude Sonnet 5	Japanese	42.69	Other solutions	LLM
Widn AI Tower Sugarloaf	Spanish (European)	42.81	Other solutions	LLM-based MT engine
Anthropic Claude Fable 5	Chinese Simplified	42.89	Other solutions	LLM
Anthropic Claude Opus 4.8	Spanish (European)	43.14	Other solutions	LLM
DeepSeek V3.2	Danish	43.2	Other solutions	LLM
Anthropic Claude Sonnet 5	Korean	43.38	Other solutions	LLM
OpenAI GPT-5.6 Sol	Romanian	43.41	Other solutions	LLM
Google Gemini 3.5 Flash	Vietnamese	43.47	Other solutions	LLM
DeepSeek V3.2	Lithuanian	43.51	Other solutions	LLM
Anthropic Claude Fable 5	Portuguese (European)	43.91	Other solutions	LLM
OpenAI GPT-5.6 Sol	Russian	43.94	Meet every requirement	LLM
Anthropic Claude Sonnet 5	Norwegian	44.22	Other solutions	LLM
Anthropic Claude Fable 5	Russian	44.24	Other solutions	LLM
Mistral Large 3	Chinese Simplified	44.26	Other solutions	LLM
xAI Grok 4.20 (reasoning)	Hebrew	45.22	Other solutions	LLM
OpenAI GPT-5.5	Turkish	45.41	Meet every requirement	LLM
OpenAI GPT-5.5	Russian	45.72	Other solutions	LLM
Anthropic Claude Opus 4.8	French	45.8	Other solutions	LLM
Anthropic Claude Sonnet 5	Catalan	46.18	Other solutions	LLM
Mistral Large 3	Dutch	46.51	Other solutions	LLM
OpenAI GPT-4.1	Wolof	46.51	Other solutions	LLM
OpenAI GPT-5.5	French	47.04	Other solutions	LLM
OpenAI GPT-4.1	Yiddish	47.37	Other solutions	LLM
OpenAI GPT-5.6 Sol	Galician	47.71	Meet every requirement	LLM
xAI Grok 4.20 (reasoning)	Catalan	47.74	Other solutions	LLM
Anthropic Claude Opus 4.8	Chinese Simplified	48.13	Other solutions	LLM
OpenAI GPT-4.1	Tajik	48.23	Other solutions	LLM
Anthropic Claude Sonnet 5	Polish	48.33	Other solutions	LLM
Mistral Large 3	Swedish	48.38	Other solutions	LLM
Widn AI Tower Sugarloaf	Polish	48.52	Other solutions	LLM-based MT engine
Anthropic Claude Opus 4.8	German	48.65	Other solutions	LLM
Anthropic Claude Fable 5	Chinese Traditional	48.84	Other solutions	LLM
Anthropic Claude Fable 5	French	48.97	Other solutions	LLM
Widn AI Tower Sugarloaf	Romanian	49.48	Other solutions	LLM-based MT engine
OpenAI GPT-5.5	Malay	49.59	Meet every requirement	LLM
Cohere Command A Translate	Serbian	49.71	Other solutions	LLM
Anthropic Claude Opus 4.8	Italian	49.93	Other solutions	LLM
Mistral Large 3	Catalan	49.97	Other solutions	LLM
OpenAI GPT-5.5	Norwegian	50.18	Meet every requirement	LLM
OpenAI GPT-5.6 Sol	Turkish	50.19	Other solutions	LLM
xAI Grok 4.20 (reasoning)	Dutch	50.56	Other solutions	LLM
Anthropic Claude Sonnet 5	Arabic (MSA)	50.57	Other solutions	LLM
Mistral Large 3	Danish	50.64	Other solutions	LLM
Anthropic Claude Sonnet 4.6	Portuguese (European)	50.73	Other solutions	LLM
Anthropic Claude Sonnet 5	Vietnamese	50.8	Other solutions	LLM
OpenAI GPT-5.5	Swedish	50.83	Meet every requirement	LLM
Widn AI Tower Sugarloaf	Hungarian	51.2	Other solutions	LLM-based MT engine
Anthropic Claude Sonnet 4.6	Italian	51.2	Other solutions	LLM
Anthropic Claude Fable 5	Japanese	51.38	Other solutions	LLM
OpenAI GPT-5.6 Terra	Kyrgyz	51.38	Other solutions	LLM
AI21 Jamba Large 1.7	Javanese	51.47	Other solutions	LLM
Mistral Large 3	Vietnamese	51.47	Other solutions	LLM
xAI Grok 4.20 (reasoning)	Kinyarwanda	51.58	Other solutions	LLM
Mistral Large 3	Romanian	51.67	Other solutions	LLM
Widn AI Tower Sugarloaf	Ukrainian	52.14	Other solutions	LLM-based MT engine
Mistral Large 3	Malay	52.37	Other solutions	LLM
Anthropic Claude Fable 5	Norwegian	52.56	Meet every requirement	LLM
Anthropic Claude Fable 5	Galician	52.59	Meet every requirement	LLM
Anthropic Claude Fable 5	Korean	52.67	Other solutions	LLM
xAI Grok 4.20 (reasoning)	Afrikaans	52.91	Other solutions	LLM
Anthropic Claude Opus 4.8	Japanese	52.92	Other solutions	LLM
Mistral Large 3	Norwegian	53.88	Other solutions	LLM
Anthropic Claude Sonnet 5	Ukrainian	53.93	Other solutions	LLM
OpenAI GPT-5.5	Danish	54.04	Meet every requirement	LLM
Google Gemini 3.5 Flash	Russian	54.16	Other solutions	LLM
Anthropic Claude Opus 4.8	Korean	54.17	Other solutions	LLM
OpenAI GPT-5.6 Sol	Ukrainian	54.25	Other solutions	LLM
Anthropic Claude Opus 4.8	Chinese Traditional	54.55	Other solutions	LLM
xAI Grok 4.20 (reasoning)	Finnish	54.82	Other solutions	LLM
OpenAI GPT-5.5	Slovenian	54.95	Meet every requirement	LLM
Anthropic Claude Sonnet 5	Bosnian	55.18	Other solutions	LLM
Mistral Large 3	Chinese Traditional	55.26	Other solutions	LLM
Mistral Large 3	Ukrainian	55.35	Other solutions	LLM
Anthropic Claude Opus 4.8	Galician	55.65	Other solutions	LLM
Anthropic Claude Sonnet 5	Serbian	55.7	Other solutions	LLM
Mistral Large 3	Serbian	55.81	Other solutions	LLM
Anthropic Claude Sonnet 5	Hindi	55.84	Other solutions	LLM
Anthropic Claude Opus 4.8	Catalan	56.83	Other solutions	LLM
Anthropic Claude Sonnet 5	Czech	56.88	Other solutions	LLM
Google Gemini 3.5 Flash	Nepali	56.92	Other solutions	LLM
Anthropic Claude Fable 5	Turkish	57.49	Meet every requirement	LLM
Google Gemini 3.5 Flash	Slovak	57.5	Other solutions	LLM
Anthropic Claude Sonnet 5	Afrikaans	57.53	Other solutions	LLM
Anthropic Claude Opus 4.8	Norwegian	57.56	Meet every requirement	LLM
Anthropic Claude Fable 5	Arabic (MSA)	57.8	Meet every requirement	LLM
DeepSeek V3.2	Swahili	57.86	Other solutions	LLM
Google Gemini 3.5 Flash	Urdu	57.9	Other solutions	LLM
OpenAI GPT-5.6 Sol	Dutch	58.07	Meet every requirement	LLM
Anthropic Claude Fable 5	Tagalog	58.13	Other solutions	LLM
Google Gemini 3.5 Flash	Bengali	58.24	Other solutions	LLM
OpenAI GPT-5.6 Sol	Thai	58.31	Other solutions	LLM
Google Gemini 3.5 Flash	Thai	58.42	Other solutions	LLM
Anthropic Claude Sonnet 4.6	Romanian	58.51	Other solutions	LLM
Google Gemini 3.5 Flash	Swedish	58.68	Other solutions	LLM
OpenAI GPT-4.1	Welsh	59.15	Other solutions	LLM
DeepSeek V3.2	Hungarian	59.19	Other solutions	LLM
OpenAI GPT-5.6 Sol	Serbian	59.65	Other solutions	LLM
Anthropic Claude Fable 5	Romanian	59.68	Meet every requirement	LLM
Mistral Large 3	Hebrew	59.85	Other solutions	LLM
Google Gemini 3.5 Flash	Galician	59.88	Meet every requirement	LLM
Anthropic Claude Opus 4.8	Polish	59.95	Other solutions	LLM
Anthropic Claude Fable 5	Ukrainian	60.03	Other solutions	LLM
xAI Grok 4.20 (reasoning)	Greek	60.27	Other solutions	LLM
Anthropic Claude Sonnet 4.6	Malay	60.35	Other solutions	LLM
Google Gemini 3.5 Flash	Basque	60.4	Other solutions	LLM
DeepSeek V3.2	Gujarati	60.44	Other solutions	LLM
Anthropic Claude Fable 5	Croatian	60.6	Meet every requirement	LLM
Widn AI Tower Sugarloaf	Finnish	60.69	Other solutions	LLM-based MT engine
Anthropic Claude Opus 4.8	Danish	60.91	Other solutions	LLM
Anthropic Claude Fable 5	Bosnian	60.98	Other solutions	LLM
xAI Grok 4.20 (reasoning)	Spanish (European)	61.46	Other solutions	LLM
Google Gemini 3.5 Flash	Hungarian	61.46	Other solutions	LLM
OpenAI GPT-5.5	Lithuanian	61.54	Other solutions	LLM
Mistral Large 3	Lithuanian	61.63	Other solutions	LLM
Anthropic Claude Sonnet 4.6	Polish	61.68	Other solutions	LLM
Google Gemini 3.5 Flash	Arabic (MSA)	62.04	Other solutions	LLM
Anthropic Claude Fable 5	Serbian	62.04	Meet every requirement	LLM
Anthropic Claude Sonnet 5	Slovenian	62.06	Other solutions	LLM
OpenAI GPT-5.6 Sol	Croatian	62.26	Meet every requirement	LLM
Anthropic Claude Sonnet 4.6	Czech	62.27	Other solutions	LLM
Mistral Large 3	Hindi	62.47	Other solutions	LLM
OpenAI GPT-5.5	Uzbek	62.85	Other solutions	LLM
Anthropic Claude Fable 5	Afrikaans	62.89	Other solutions	LLM
Anthropic Claude Fable 5	Slovenian	63.01	Meet every requirement	LLM
Anthropic Claude Fable 5	Czech	63.13	Meet every requirement	LLM
Anthropic Claude Opus 4.8	Turkish	63.16	Other solutions	LLM
OpenAI GPT-5.5	Catalan	63.34	Meet every requirement	LLM
Mistral Large 3	Czech	63.38	Other solutions	LLM
OpenAI GPT-5.6 Terra	Armenian	63.4	Other solutions	LLM
Anthropic Claude Sonnet 5	Bengali	63.53	Other solutions	LLM
xAI Grok 4.20 (reasoning)	Welsh	63.61	Other solutions	LLM
Google Gemini 3.5 Flash	Finnish	63.61	Other solutions	LLM
Anthropic Claude Sonnet 4.6	Serbian	63.63	Other solutions	LLM
Anthropic Claude Sonnet 4.6	Korean	64.3	Other solutions	LLM
DeepSeek V3.2	Burmese	64.57	Other solutions	LLM
Google Gemini 3.1 Pro Preview	Vietnamese	64.61	Other solutions	LLM
DeepSeek V3.2	Armenian	64.62	Other solutions	LLM
Mistral Medium 3.1	Indonesian	64.66	Other solutions	LLM
DeepSeek V3.2	Slovenian	64.82	Other solutions	LLM
Google Gemini 3.1 Pro Preview	Chinese Traditional	64.89	Other solutions	LLM
OpenAI GPT-5.5	Croatian	64.93	Meet every requirement	LLM
Google Gemini 3.1 Pro Preview	Chinese Simplified	65.32	Other solutions	LLM
OpenAI GPT-5.5	Dutch	65.33	Other solutions	LLM
Anthropic Claude Fable 5	Slovak	65.82	Meet every requirement	LLM
Anthropic Claude Fable 5	Hindi	65.83	Other solutions	LLM
Anthropic Claude Sonnet 4.6	Croatian	66	Other solutions	LLM
xAI Grok 4.20 (reasoning)	Cebuano	66.27	Other solutions	LLM
Anthropic Claude Sonnet 5	Bulgarian	66.49	Other solutions	LLM
Google Gemini 3.5 Flash	Albanian	66.55	Other solutions	LLM
OpenAI GPT-5.6 Sol	Finnish	66.69	Meet every requirement	LLM
Anthropic Claude Opus 4.8	Vietnamese	66.82	Meet every requirement	LLM
Google Gemini 3.5 Flash	Sinhala	67.04	Other solutions	LLM
OpenAI GPT-5.5	Arabic (MSA)	67.15	Meet every requirement	LLM
Anthropic Claude Sonnet 4.6	Slovak	67.23	Other solutions	LLM
Anthropic Claude Fable 5	Vietnamese	67.52	Meet every requirement	LLM
Anthropic Claude Sonnet 4.6	Slovenian	67.79	Other solutions	LLM
Google Gemini 3.1 Pro Preview	Farsi	68.09	Meet every requirement	LLM
Google Gemini 3.5 Flash	Amharic	68.11	Other solutions	LLM
Anthropic Claude Fable 5	Bulgarian	68.23	Meet every requirement	LLM
OpenAI GPT-5.5	Serbian	68.3	Other solutions	LLM
OpenAI GPT-5.5	Latvian	68.41	Other solutions	LLM
Anthropic Claude Fable 5	Swahili	68.46	Other solutions	LLM
Anthropic Claude Opus 4.8	Hindi	68.8	Other solutions	LLM
Anthropic Claude Sonnet 5	Estonian	69.31	Other solutions	LLM
DeepSeek V3.2	Odia (Oriya)	69.95	Other solutions	LLM
Google Gemini 3.5 Flash	Afrikaans	70.02	Other solutions	LLM
Anthropic Claude Sonnet 4.6	Afrikaans	70.13	Other solutions	LLM
Anthropic Claude Opus 4.8	Czech	70.26	Meet every requirement	LLM
OpenAI GPT-5.5	Tagalog	70.75	Other solutions	LLM
Mistral Large 3	Icelandic	71.05	Other solutions	LLM
Anthropic Claude Sonnet 4.6	Ukrainian	71.38	Other solutions	LLM
Google Gemini 3.1 Pro Preview	Catalan	71.54	Meet every requirement	LLM
OpenAI GPT-5.6 Sol	Slovenian	71.67	Other solutions	LLM
Anthropic Claude Fable 5	Bengali	71.98	Meet every requirement	LLM
Google Gemini 3.1 Pro Preview	Arabic (MSA)	72.18	Other solutions	LLM
OpenAI GPT-5.5	Hungarian	72.48	Other solutions	LLM
Google Gemini 3.1 Pro Preview	Spanish (European)	72.79	Meet every requirement	LLM
OpenAI GPT-5.5	Macedonian	72.81	Meet every requirement	LLM
Anthropic Claude Sonnet 4.6	Tagalog	74.01	Other solutions	LLM
Anthropic Claude Sonnet 4.6	Turkish	74.32	Other solutions	LLM
Anthropic Claude Fable 5	Hungarian	74.35	Meet every requirement	LLM
OpenAI GPT-5.5	Azerbaijani	74.4	Meet every requirement	LLM
Anthropic Claude Fable 5	Latvian	74.55	Other solutions	LLM
Anthropic Claude Sonnet 5	Macedonian	74.63	Other solutions	LLM
Anthropic Claude Sonnet 4.6	Vietnamese	74.63	Other solutions	LLM
xAI Grok 4.20 (reasoning)	Irish	74.79	Other solutions	LLM
Google Gemini 3.5 Flash	Odia (Oriya)	75.25	Other solutions	LLM
DeepSeek V3.2	Malayalam	75.3	Other solutions	LLM
Google Gemini 3.1 Pro Preview	Indonesian	75.58	Meet every requirement	LLM
OpenAI GPT-5.5	Finnish	75.62	Other solutions	LLM
Mistral Large 3	Tagalog	75.66	Other solutions	LLM
Anthropic Claude Sonnet 4.6	Bulgarian	75.69	Other solutions	LLM
Google Gemini 3.1 Pro Preview	Bengali	75.73	Other solutions	LLM
Mistral Large 3	Bengali	75.8	Other solutions	LLM
Anthropic Claude Fable 5	Lithuanian	76.16	Other solutions	LLM
Google Gemini 3.1 Pro Preview	Tamil	77.04	Other solutions	LLM
Google Gemini 3.1 Pro Preview	Thai	77.14	Other solutions	LLM
Anthropic Claude Fable 5	Farsi	77.46	Other solutions	LLM
OpenAI GPT-5.6 Terra	Yiddish	77.56	Other solutions	LLM
DeepSeek V3.2	Lao	77.61	Other solutions	LLM
Google Gemini 3.1 Pro Preview	Tagalog	77.66	Other solutions	LLM
Mistral Large 3	Thai	78.27	Other solutions	LLM
Anthropic Claude Sonnet 5	Marathi	78.42	Other solutions	LLM
Anthropic Claude Opus 4.8	Slovenian	78.5	Other solutions	LLM
Google Gemini 3.1 Pro Preview	Hindi	78.55	Other solutions	LLM
Anthropic Claude Sonnet 4.6	Sundanese	78.75	Other solutions	LLM
OpenAI GPT-5.6 Sol	Estonian	78.84	Meet every requirement	LLM
OpenAI GPT-5.6 Terra	Kannada	79.03	Other solutions	LLM
Anthropic Claude Fable 5	Macedonian	79.11	Meet every requirement	LLM
Anthropic Claude Sonnet 5	Urdu	79.23	Other solutions	LLM
Google Gemini 3.1 Pro Preview	German	79.3	Meet every requirement	LLM
Anthropic Claude Fable 5	Estonian	79.4	Other solutions	LLM
Anthropic Claude Sonnet 5	Albanian	79.73	Other solutions	LLM
Google Gemini 3.5 Flash	Welsh	80.11	Other solutions	LLM
Mistral Large 3	Nepali	80.12	Other solutions	LLM
OpenAI GPT-5.5	Sundanese	80.34	Other solutions	LLM
OpenAI GPT-5.5	Farsi	80.86	Other solutions	LLM
Google Gemini 3.1 Pro Preview	Bulgarian	81.57	Meet every requirement	LLM
Google Gemini 3.1 Pro Preview	Cebuano	81.67	Other solutions	LLM
Google Gemini 3.1 Pro Preview	Slovenian	81.75	Other solutions	LLM
OpenAI GPT-5.6 Sol	Hebrew	81.8	Other solutions	LLM
Google Gemini 3.1 Pro Preview	Italian	81.8	Other solutions	LLM
Google Gemini 3.1 Pro Preview	Sinhala	81.91	Other solutions	LLM
Mistral Large 3	Marathi	81.92	Other solutions	LLM
Anthropic Claude Sonnet 4.6	Estonian	82.03	Other solutions	LLM
OpenAI GPT-5.5	Afrikaans	82.14	Other solutions	LLM
Google Gemini 3.1 Pro Preview	Swedish	82.3	Meet every requirement	LLM
Google Gemini 3.1 Pro Preview	Ukrainian	82.61	Meet every requirement	LLM
Anthropic Claude Opus 4.8	Bengali	82.7	Other solutions	LLM
Google Gemini 3.1 Pro Preview	Urdu	83.95	Other solutions	LLM
Google Gemini 3.1 Pro Preview	Lao	84.08	Other solutions	LLM
Google Gemini 3.1 Pro Preview	Hebrew	84.11	Other solutions	LLM
Anthropic Claude Fable 5	Cebuano	84.38	Other solutions	LLM
Google Gemini 3.1 Pro Preview	Croatian	84.47	Meet every requirement	LLM
Google Gemini 3.1 Pro Preview	Norwegian	84.85	Meet every requirement	LLM
Anthropic Claude Sonnet 5	Welsh	85.09	Other solutions	LLM
Anthropic Claude Fable 5	Albanian	85.18	Meet every requirement	LLM
Mistral Large 3	Kannada	85.37	Other solutions	LLM
Google Gemini 3.1 Pro Preview	Swahili	85.49	Other solutions	LLM
Google Gemini 3.1 Pro Preview	Basque	85.52	Other solutions	LLM
Anthropic Claude Sonnet 5	Thai	85.52	Other solutions	LLM
Google Gemini 3.1 Pro Preview	Czech	85.53	Other solutions	LLM
OpenAI GPT-5.6 Sol	Azerbaijani	85.76	Other solutions	LLM
Anthropic Claude Fable 5	Hebrew	85.9	Meet every requirement	LLM
Google Gemini 3.1 Pro Preview	Kannada	86.61	Other solutions	LLM
Anthropic Claude Sonnet 4.6	Arabic (MSA)	86.62	Other solutions	LLM
Anthropic Claude Sonnet 5	Nepali	86.64	Other solutions	LLM
Mistral Large 3	Telugu	86.8	Other solutions	LLM
Google Gemini 3.1 Pro Preview	Danish	86.82	Other solutions	LLM
Google Gemini 3.1 Pro Preview	Slovak	87.02	Meet every requirement	LLM
Anthropic Claude Sonnet 4.6	Latvian	87.08	Other solutions	LLM
Anthropic Claude Opus 4.8	Bulgarian	87.12	Other solutions	LLM
DeepSeek V3.2	Sinhala	87.13	Other solutions	LLM
OpenAI GPT-5.6 Sol	Basque	87.24	Other solutions	LLM
Anthropic Claude Fable 5	Uzbek	87.41	Other solutions	LLM
Google Gemini 3.5 Flash	Armenian	87.67	Other solutions	LLM
Google Gemini 3.1 Pro Preview	Nepali	87.68	Other solutions	LLM
Google Gemini 3.1 Pro Preview	Frisian	87.95	Other solutions	LLM
OpenAI GPT-5.5	Mongolian	87.98	Other solutions	LLM
DeepSeek V3.2	Frisian	88.13	Other solutions	LLM
Anthropic Claude Fable 5	Basque	88.41	Other solutions	LLM
Google Gemini 3.1 Pro Preview	Hungarian	88.92	Other solutions	LLM
Google Gemini 3.1 Pro Preview	Icelandic	88.96	Other solutions	LLM
Anthropic Claude Opus 4.8	Sundanese	89.05	Other solutions	LLM
OpenAI GPT-5.5	Basque	89.19	Other solutions	LLM
Anthropic Claude Fable 5	Azerbaijani	89.58	Other solutions	LLM
OpenAI GPT-5.5	Icelandic	89.64	Other solutions	LLM
Google Gemini 3.1 Pro Preview	Korean	89.83	Other solutions	LLM
Anthropic Claude Opus 4.8	Icelandic	90.06	Other solutions	LLM
Google Gemini 3.1 Pro Preview	Finnish	90.56	Other solutions	LLM
Anthropic Claude Fable 5	Welsh	91.16	Meet every requirement	LLM
Google Gemini 3.1 Pro Preview	Romanian	91.52	Other solutions	LLM
Mistral Large 3	Punjabi	91.7	Other solutions	LLM
Google Gemini 3.1 Pro Preview	Dutch	92.13	Other solutions	LLM
Google Gemini 3.1 Pro Preview	Tatar	92.18	Other solutions	LLM
Google Gemini 3.1 Pro Preview	Amharic	92.55	Other solutions	LLM
OpenAI GPT-5.5	Hausa	92.89	Other solutions	LLM
Anthropic Claude Fable 5	Marathi	92.98	Other solutions	LLM
Google Gemini 3.1 Pro Preview	French	94.21	Other solutions	LLM
Anthropic Claude Fable 5	Greek	94.51	Meet every requirement	LLM
xAI Grok 4.20 (reasoning)	Albanian	94.79	Other solutions	LLM
Anthropic Claude Opus 4.8	Estonian	95.3	Other solutions	LLM
Anthropic Claude Opus 4.8	Hungarian	95.47	Other solutions	LLM
Anthropic Claude Opus 4.8	Latvian	95.72	Other solutions	LLM
Anthropic Claude Fable 5	Belarusian	95.74	Meet every requirement	LLM
Anthropic Claude Fable 5	Nepali	95.81	Other solutions	LLM
xAI Grok 4.20 (reasoning)	Estonian	95.94	Other solutions	LLM
Google Gemini 3.1 Pro Preview	Telugu	96.17	Other solutions	LLM
OpenAI GPT-5.5	Cebuano	96.27	Other solutions	LLM
OpenAI GPT-5.5	Tajik	96.49	Other solutions	LLM
Google Gemini 3.1 Pro Preview	Macedonian	96.62	Meet every requirement	LLM
Google Gemini 3.1 Pro Preview	Welsh	96.79	Other solutions	LLM
Google Gemini 3.1 Pro Preview	Kyrgyz	96.8	Other solutions	LLM
Google Gemini 3.1 Pro Preview	Belarusian	96.84	Meet every requirement	LLM
Anthropic Claude Fable 5	Urdu	96.95	Other solutions	LLM
Google Gemini 3.1 Pro Preview	Marathi	97.33	Other solutions	LLM
Google Gemini 3.1 Pro Preview	Mongolian	97.85	Other solutions	LLM
Google Gemini 3.1 Pro Preview	Turkish	97.86	Meet every requirement	LLM
OpenAI GPT-5.5	Greek	97.92	Meet every requirement	LLM
Google Gemini 3.1 Pro Preview	Latvian	98.23	Other solutions	LLM
Google Gemini 3.1 Pro Preview	Japanese	98.78	Other solutions	LLM
Google Gemini 3.1 Pro Preview	Lithuanian	99.23	Other solutions	LLM
Anthropic Claude Sonnet 4.6	Hebrew	100.01	Other solutions	LLM
Anthropic Claude Opus 4.8	Frisian	100.39	Other solutions	LLM
Alibaba Qwen3-235B-A22B	Italian	100.74	Other solutions	Open-weight LLM
OpenAI GPT-5.6 Sol	Hausa	101.33	Other solutions	LLM
Alibaba Qwen3-235B-A22B	Portuguese (European)	101.33	Other solutions	Open-weight LLM
Anthropic Claude Sonnet 4.6	Farsi	101.37	Other solutions	LLM
Anthropic Claude Sonnet 4.6	Urdu	101.72	Other solutions	LLM
Google Gemini 3.1 Pro Preview	Albanian	102.63	Other solutions	LLM
Google Gemini 3.1 Pro Preview	Bosnian	103.14	Meet every requirement	LLM
Google Gemini 3.1 Pro Preview	Kazakh	103.14	Other solutions	LLM
Anthropic Claude Fable 5	Thai	103.32	Other solutions	LLM
Google Gemini 3.1 Pro Preview	Georgian	103.67	Other solutions	LLM
Google Gemini 3.1 Pro Preview	Tajik	103.85	Other solutions	LLM
OpenAI GPT-5.5	Kyrgyz	104.1	Other solutions	LLM
Anthropic Claude Sonnet 4.6	Bengali	104.2	Other solutions	LLM
Google Gemini 3.1 Pro Preview	Gujarati	104.38	Other solutions	LLM
Google Gemini 3.1 Pro Preview	Assamese	104.46	Other solutions	LLM
Anthropic Claude Fable 5	Irish	104.75	Other solutions	LLM
Anthropic Claude Opus 4.8	Basque	105.08	Other solutions	LLM
Google Gemini 3.1 Pro Preview	Russian	105.64	Other solutions	LLM
Google Gemini 3.5 Flash	Irish	105.78	Other solutions	LLM
OpenAI GPT-5.5	Kazakh	108.21	Other solutions	LLM
Anthropic Claude Sonnet 4.6	Kazakh	108.57	Other solutions	LLM
Anthropic Claude Opus 4.8	Uzbek	108.7	Other solutions	LLM
Anthropic Claude Fable 5	Kazakh	108.96	Other solutions	LLM
OpenAI GPT-5.5	Tatar	109.51	Other solutions	LLM
Google Gemini 3.1 Pro Preview	Burmese	111.12	Other solutions	LLM
Google Gemini 3.1 Pro Preview	Estonian	111.75	Other solutions	LLM
OpenAI GPT-5.5	Pashto	112.01	Other solutions	LLM
OpenAI GPT-5.5	Shona	112.26	Other solutions	LLM
xAI Grok 4.20 (reasoning)	Kannada	112.34	Other solutions	LLM
Anthropic Claude Opus 4.8	Kurdish (Kurmanji)	113.18	Other solutions	LLM
Google Gemini 3.1 Pro Preview	Serbian	113.5	Other solutions	LLM
OpenAI GPT-5.6 Sol	Belarusian	113.77	Meet every requirement	LLM
Anthropic Claude Sonnet 4.6	Belarusian	114.25	Other solutions	LLM
OpenAI GPT-5.5	Urdu	114.36	Other solutions	LLM
Google Gemma 4	Indonesian	115.12	Meet every requirement	Open-weight LLM
Google Gemini 3.1 Pro Preview	Irish	115.29	Other solutions	LLM
Anthropic Claude Fable 5	Assamese	117.04	Other solutions	LLM
OpenAI GPT-5.5	Nepali	118.31	Meet every requirement	LLM
Anthropic Claude Fable 5	Tajik	118.33	Other solutions	LLM
Anthropic Claude Opus 4.8	Thai	119.18	Other solutions	LLM
Google Gemini 3.1 Pro Preview	Malayalam	119.31	Other solutions	LLM
OpenAI GPT-5.5	Scottish Gaelic	119.5	Other solutions	LLM
Google Gemini 3.1 Pro Preview	Armenian	119.84	Other solutions	LLM
OpenAI GPT-5.6 Sol	Tajik	119.95	Other solutions	LLM
OpenAI GPT-5.5	Georgian	120.16	Other solutions	LLM
z.ai GLM-5	Chinese Simplified	120.43	Other solutions	LLM
OpenAI GPT-5.5	Marathi	121.46	Other solutions	LLM
OpenAI GPT-5.5	Welsh	123.1	Other solutions	LLM
Google Gemini 3.1 Pro Preview	Pashto	123.87	Other solutions	LLM
Anthropic Claude Sonnet 4.6	Tajik	124.14	Other solutions	LLM
Mistral Large 3	Gujarati	124.43	Other solutions	LLM
Anthropic Claude Fable 5	Kyrgyz	124.63	Other solutions	LLM
Anthropic Claude Sonnet 4.6	Georgian	125.14	Other solutions	LLM
Anthropic Claude Opus 4.8	Irish	126.26	Other solutions	LLM
OpenAI GPT-5.5	Frisian	127.84	Other solutions	LLM
Anthropic Claude Fable 5	Tatar	128.17	Other solutions	LLM
OpenAI GPT-5.6 Sol	Urdu	128.48	Other solutions	LLM
Google Gemini 3.1 Pro Preview	Odia (Oriya)	128.76	Other solutions	LLM
Anthropic Claude Opus 4.8	Kazakh	129.58	Other solutions	LLM
Google Gemma 4	Norwegian	130.11	Other solutions	Open-weight LLM
xAI Grok 4.20 (reasoning)	Odia (Oriya)	130.58	Other solutions	LLM
OpenAI GPT-5.6 Sol	Hindi	131.27	Other solutions	LLM
OpenAI GPT-5.6 Sol	Pashto	131.28	Other solutions	LLM
OpenAI GPT-5.5	Gujarati	132.24	Other solutions	LLM
Google Gemma 4	Thai	132.59	Other solutions	Open-weight LLM
Anthropic Claude Fable 5	Pashto	134.21	Other solutions	LLM
Google Gemma 4	Vietnamese	134.35	Other solutions	Open-weight LLM
OpenAI GPT-5.6 Sol	Yiddish	135.25	Other solutions	LLM
Anthropic Claude Fable 5	Tamil	135.39	Other solutions	LLM
Google Gemini 3.1 Pro Preview	Punjabi	135.46	Other solutions	LLM
Google Gemini 3.1 Pro Preview	Uzbek	135.55	Other solutions	LLM
Google Gemini 3.1 Pro Preview	Scottish Gaelic	135.78	Other solutions	LLM
OpenAI GPT-5.6 Sol	Nepali	137.66	Other solutions	LLM
z.ai GLM-5	Chinese Traditional	137.97	Other solutions	LLM
Google Gemma 4	Bosnian	138.24	Other solutions	Open-weight LLM
Google Gemini 3.1 Pro Preview	Greek	138.74	Meet every requirement	LLM
Anthropic Claude Fable 5	Mongolian	140.6	Other solutions	LLM
OpenAI GPT-5.6 Sol	Greek	141.29	Meet every requirement	LLM
Anthropic Claude Opus 4.8	Tajik	142.93	Other solutions	LLM
Google Gemma 4	Farsi	143.85	Other solutions	Open-weight LLM
OpenAI GPT-5.5	Bengali	144.3	Meet every requirement	LLM
z.ai GLM-5	Galician	145.48	Other solutions	LLM
Anthropic Claude Opus 4.8	Assamese	145.83	Other solutions	LLM
OpenAI GPT-5.5	Malayalam	146.02	Other solutions	LLM
Anthropic Claude Sonnet 5	Telugu	146.14	Other solutions	LLM
Google Gemma 4	Marathi	147.67	Other solutions	Open-weight LLM
Anthropic Claude Opus 4.8	Kyrgyz	147.72	Other solutions	LLM
Google Gemma 4	Croatian	148.02	Other solutions	Open-weight LLM
Anthropic Claude Sonnet 5	Tamil	148.15	Other solutions	LLM
Google Gemma 4	Hindi	148.41	Other solutions	Open-weight LLM
Anthropic Claude Opus 4.8	Tatar	149.21	Other solutions	LLM
Google Gemma 4	Khmer	154.43	Other solutions	Open-weight LLM
Google Gemma 4	Korean	156.7	Other solutions	Open-weight LLM
z.ai GLM-5	Swedish	157.27	Other solutions	LLM
OpenAI GPT-5.5	Tamil	159.1	Other solutions	LLM
OpenAI GPT-5.5	Armenian	159.13	Other solutions	LLM
MoonshotAI Kimi K2.5	Slovak	160.19	Other solutions	LLM
Google Gemma 4	Afrikaans	161.41	Other solutions	Open-weight LLM
OpenAI GPT-5.5	Kannada	161.87	Other solutions	LLM
Anthropic Claude Sonnet 4.6	Khmer	162.89	Other solutions	LLM
Google Gemma 4	Bengali	164.73	Other solutions	Open-weight LLM
OpenAI GPT-5.5	Telugu	164.75	Other solutions	LLM
Anthropic Claude Opus 4.8	Finnish	165.21	Other solutions	LLM
Anthropic Claude Opus 4.8	Mongolian	166.04	Other solutions	LLM
MoonshotAI Kimi K2.5	Galician	166.19	Other solutions	LLM
Google Gemma 4	Russian	166.43	Other solutions	Open-weight LLM
OpenAI GPT-5.5	Yiddish	166.72	Other solutions	LLM
OpenAI GPT-5.5	Irish	168.09	Other solutions	LLM
Google Gemma 4	Urdu	169.21	Other solutions	Open-weight LLM
Anthropic Claude Opus 4.8	Tamil	170.53	Other solutions	LLM
OpenAI GPT-5.6 Sol	Malayalam	171.48	Other solutions	LLM
Google Gemini 3.1 Pro Preview	Polish	171.56	Other solutions	LLM
z.ai GLM-5	Romanian	171.61	Other solutions	LLM
Anthropic Claude Sonnet 5	Amharic	172.41	Other solutions	LLM
Google Gemma 4	Malayalam	172.45	Other solutions	Open-weight LLM
OpenAI GPT-5.6 Sol	Gujarati	173.62	Other solutions	LLM
Anthropic Claude Fable 5	Yiddish	173.85	Other solutions	LLM
Anthropic Claude Opus 4.8	Telugu	174.01	Other solutions	LLM
OpenAI GPT-5.6 Sol	Marathi	175.06	Other solutions	LLM
OpenAI GPT-5.5	Assamese	175.53	Other solutions	LLM
Anthropic Claude Fable 5	Telugu	175.53	Other solutions	LLM
Anthropic Claude Sonnet 4.6	Lao	176.44	Other solutions	LLM
Google Gemma 4	Gujarati	177.25	Other solutions	Open-weight LLM
Google Gemma 4	Azerbaijani	178.72	Other solutions	Open-weight LLM
Google Gemma 4	Amharic	179.57	Other solutions	Open-weight LLM
Google Gemma 4	Assamese	181.33	Other solutions	Open-weight LLM
Google Gemma 4	Punjabi	182.23	Other solutions	Open-weight LLM
z.ai GLM-5	Indonesian	184.37	Meet every requirement	LLM
Google Gemma 4	Telugu	185.17	Other solutions	Open-weight LLM
Google Gemma 4	Tagalog	185.41	Other solutions	Open-weight LLM
Google Gemma 4	Swahili	186.33	Other solutions	Open-weight LLM
MoonshotAI Kimi K2.5	Chinese Traditional	187.23	Other solutions	LLM
Google Gemma 4	Sinhala	187.91	Other solutions	Open-weight LLM
Google Gemma 4	Tamil	192.53	Other solutions	Open-weight LLM
Google Gemma 4	Macedonian	193.63	Other solutions	Open-weight LLM
z.ai GLM-5	Farsi	194.43	Other solutions	LLM
MoonshotAI Kimi K2.5	Dutch	194.72	Other solutions	LLM
Google Gemma 4	Kannada	194.82	Other solutions	Open-weight LLM
Google Gemma 4	Albanian	195.19	Other solutions	Open-weight LLM
Google Gemma 4	Arabic (MSA)	197.14	Other solutions	Open-weight LLM
Google Gemma 4	Turkish	198.97	Other solutions	Open-weight LLM
Google Gemma 4	Italian	199.5	Other solutions	Open-weight LLM
Anthropic Claude Fable 5	Amharic	199.84	Other solutions	LLM
OpenAI GPT-5.6 Sol	Tamil	200.07	Other solutions	LLM
OpenAI GPT-5.6 Sol	Amharic	201.4	Other solutions	LLM
Google Gemma 4	Serbian	202.47	Other solutions	Open-weight LLM
z.ai GLM-5	Macedonian	206.34	Other solutions	LLM
Google Gemini 3.1 Pro Preview	Azerbaijani	206.35	Other solutions	LLM
Google Gemma 4	Cebuano	207.66	Other solutions	Open-weight LLM
MoonshotAI Kimi K2.5	Bengali	208.1	Other solutions	LLM
z.ai GLM-5	Slovenian	214.2	Other solutions	LLM
OpenAI GPT-5.5	Khmer	215.51	Meet every requirement	LLM
OpenAI GPT-5.5	Amharic	216.01	Other solutions	LLM
MoonshotAI Kimi K2.5	Afrikaans	216.33	Other solutions	LLM
OpenAI GPT-5.6 Sol	Lao	220.27	Other solutions	LLM
z.ai GLM-5	Dutch	220.5	Other solutions	LLM
z.ai GLM-5	Slovak	221.41	Other solutions	LLM
OpenAI GPT-5.5	Sinhala	221.67	Other solutions	LLM
Anthropic Claude Opus 4.8	Amharic	225.55	Other solutions	LLM
OpenAI GPT-5.5	Punjabi	229.83	Other solutions	LLM
Anthropic Claude Sonnet 5	Gujarati	231.75	Other solutions	LLM
z.ai GLM-5	Croatian	235.67	Other solutions	LLM
MoonshotAI Kimi K2.5	Yoruba	236.96	Other solutions	LLM
Google Gemma 4	Polish	237.47	Other solutions	Open-weight LLM
MoonshotAI Kimi K2.5	Danish	237.65	Other solutions	LLM
Anthropic Claude Opus 4.8	Armenian	243.05	Other solutions	LLM
z.ai GLM-5	Frisian	245.44	Other solutions	LLM
Anthropic Claude Fable 5	Sinhala	246.57	Other solutions	LLM
MoonshotAI Kimi K2.5	Frisian	247.54	Other solutions	LLM
Google Gemma 4	Ukrainian	250.26	Other solutions	Open-weight LLM
z.ai GLM-5	Hebrew	252.63	Other solutions	LLM
OpenAI GPT-5.6 Sol	Khmer	253.34	Other solutions	LLM
OpenAI GPT-5.6 Sol	Punjabi	257.54	Other solutions	LLM
MoonshotAI Kimi K2.5	Croatian	257.61	Other solutions	LLM
Anthropic Claude Fable 5	Georgian	259.15	Meet every requirement	LLM
z.ai GLM-5	Basque	264.92	Other solutions	LLM
OpenAI GPT-5.5	Lao	265.57	Other solutions	LLM
z.ai GLM-5	Tagalog	265.9	Other solutions	LLM
z.ai GLM-5	Thai	266.38	Other solutions	LLM
z.ai GLM-5	Belarusian	266.51	Other solutions	LLM
z.ai GLM-5	Hindi	267.6	Other solutions	LLM
Anthropic Claude Opus 4.8	Georgian	270.42	Other solutions	LLM
MoonshotAI Kimi K2.5	Bulgarian	270.46	Other solutions	LLM
Anthropic Claude Opus 4.8	Sinhala	274.96	Other solutions	LLM
z.ai GLM-5	Pashto	277.41	Other solutions	LLM
OpenAI GPT-5.5	Burmese	284.07	Other solutions	LLM
Google Gemma 4	Odia (Oriya)	284.97	Other solutions	Open-weight LLM
z.ai GLM-5	Azerbaijani	291.98	Other solutions	LLM
z.ai GLM-5	Kazakh	302.26	Other solutions	LLM
Anthropic Claude Fable 5	Gujarati	309.24	Other solutions	LLM
Anthropic Claude Opus 4.8	Gujarati	311.48	Other solutions	LLM
z.ai GLM-5	Tatar	337.14	Other solutions	LLM
z.ai GLM-5	Bengali	354	Other solutions	LLM
Anthropic Claude Opus 4.8	Khmer	361.16	Other solutions	LLM
z.ai GLM-5	Khmer	363.32	Other solutions	LLM
MoonshotAI Kimi K2.5	Odia (Oriya)	376.08	Other solutions	LLM
z.ai GLM-5	Armenian	377.86	Other solutions	LLM
OpenAI GPT-5.5	Odia (Oriya)	379.17	Other solutions	LLM
z.ai GLM-5	Kannada	421.69	Other solutions	LLM
z.ai GLM-5	Lithuanian	453.2	Other solutions	LLM
z.ai GLM-5	Gujarati	525.72	Other solutions	LLM
z.ai GLM-5	Tamil	537.49	Other solutions	LLM
z.ai GLM-5	Punjabi	765.27	Other solutions	LLM
z.ai GLM-5	Malayalam	779.38	Other solutions	LLM
z.ai GLM-5	Lao	3,897.34	Other solutions	LLM

Takeaway 4

Two-step solutions take ~twice as long as the same solutions in one step, and three-step solutions ~three times as long.

In each LLM step, we get the whole text again from the LLM, so a post-edit or a repair takes about as long as the translation. We estimate the LQA step at ~85 seconds per 1,000 words, with all its requests in parallel. Two-step solutions (translation + repair by code) take as long as the same solutions in one step, since the repair of tags and formatting by code does not add measurable time.

In the 42 languages where only two-step or three-step solutions meet every Standard requirement, the fastest of them takes a median of ~190 seconds per 1,000 words, against ~60 seconds per 1,000 words where a one-step solution does.

We implement these workflows in Intento Language Hub. Timings from platform logs cover the model calls made through the Hub. The Intento LQA duration here remains an estimate.

See details →

Median time per 1,000 words of two-step and three-step solutions, by step

Chart data

Median time per 1,000 words of two-step and three-step solutions, by step
Step	Translation, s per 1,000 words	Intento LQA step (estimate), s per 1,000 words	Post-edit or repair, s per 1,000 words	Total, s per 1,000 words
Two-step (translation + repair by code)	96.8	0	0	96.8
Two-step (translation + post-edit)	81.8	0	84.2	177.3
Three-step (translation + LQA + repair)	83	86	86.15	260.45

Takeaway 5

Meeting Standard requirements takes a similar time to Basic in 45 of 53 languages, while Advanced takes longer in 18.

We compare the fastest solution that meets the requirements of each quality level in the same languages, those where two solutions meet every Advanced requirement. In German, the fastest solution that meets the Basic requirements is real-time (DeepL Next Gen, under 1 second per 1,000 words), and the fastest one that meets the Standard requirements takes 30 seconds per 1,000 words, a two-step solution (translation + post-edit) on OpenAI GPT-5.6 Luna.

Meeting the Advanced requirements takes 2 to 4.4 times as long in eight languages, such as Bulgarian (26 to 116 seconds per 1,000 words). We check gender neutrality only on the two best solutions of each language, those with the fewest errors, so the fastest solution that meets the Advanced requirements often runs on a slower model or takes more steps.

See details →

Languages by the translation-time change between sets of quality requirements

Chart data

Languages by the translation-time change between sets of quality requirements
Translation-time change between sets of quality requirements	Less (by more than 10%)	About the same (within 10%)	10% more to 2 times as long	2 to 10 times as long, languages	10 times as long or more, languages
Basic to Standard	0	45	4	3	1
Standard to Advanced	1	34	10	8	0

Takeaway 6

Adding glossary terms and a tone instruction increases LLM translation time by ~1.6 seconds per 1,000 source words.

Median times differ between LLMs by up to ~320 seconds per 1,000 source words. We compare the translation time of the same LLM in the same language without context and with context in the request, for 29 LLMs in 100 languages, and 62% of the translations take longer with context. With MT engines, the time changes by ~0.2 seconds per 1,000 words with the glossary and formality parameters.

Change in translation time with context in the request, same LLM and language

Chart data

Change in translation time with context in the request, same LLM and language (2,684 points summarized)
Group	Points	Lowest, change in seconds per 1,000 source words with context in the request (scale compressed beyond ±5 s)	Lower quartile, change in seconds per 1,000 source words with context in the request (scale compressed beyond ±5 s)	Median, change in seconds per 1,000 source words with context in the request (scale compressed beyond ±5 s)	Upper quartile, change in seconds per 1,000 source words with context in the request (scale compressed beyond ±5 s)	Highest, change in seconds per 1,000 source words with context in the request (scale compressed beyond ±5 s)
One LLM in one language	2,684	-4,566.32	-3.768	1.57	9.125	2,495.43

Takeaway 7

The gender-neutrality agent adds 1 to 12 seconds per 1,000 source words to median translation time.

The agent works with one-step, two-step (translation + post-edit or repair by code) and three-step solutions (translation + LQA + repair), on the source sentences while we translate them and on the translated sentences in the later steps.

One-step solutions take a median of 63 seconds per 1,000 words without the agent and 64 seconds with it, two-step solutions 98 and 110 seconds, and three-step solutions 223 and 228 seconds (the LQA step not counted).

Translation time with and without the gender-neutrality agent, by number of steps

Chart data

Translation time with and without the gender-neutrality agent, by number of steps
Solution	State	Lowest, seconds per 1,000 words	Lower quartile, seconds per 1,000 words	Median, seconds per 1,000 words	Upper quartile, seconds per 1,000 words	Highest, seconds per 1,000 words
One-step solutions	Without the agent	17.4	53.9	63	74.4	215.5
One-step solutions	With the agent	23.6	43.6	63.8	89.4	156.9
Two-step solutions	Without the agent	11.5	85.2	98	205.6	597.2
Two-step solutions	With the agent	19.3	86.8	109.8	200.1	432.3
Three-step solutions	Without the agent	45.1	186.5	223	345.1	804.5
Three-step solutions	With the agent	47.4	192	227.7	383.9	817.1

Takeaway 8

For most models, translation into the slowest language takes over three times as long as into the median language.

Odia is among the ten slowest languages for 23 of the 27 models we timed in 80 or more languages, Lao for 22, and Chinese Simplified among the ten fastest for 21. Sorted by translation time, neighboring languages differ by less than 50% for 20 of the 27 models, and the other seven have one or two outliers at the slow end.

See details →

Translation time in the median and slowest languages, by model

Chart data

Translation time in the median and slowest languages, by model
Model	Median language, s per 1,000 words, seconds per 1,000 source words	Slowest language, s per 1,000 words, seconds per 1,000 source words	Slowest against median	Type
Translated Lara 2	2	30.1	15.1×	LLM-based MT engine
OpenAI gpt-oss-120b	2.73	9.1	3.3×	Open-weight LLM
Yandex Cloud Translate v2	4.11	8.1	2.0×	MT engine
OpenAI GPT-5.6 Luna	15.97	49	3.1×	LLM
xAI Grok 4.20 (non-reasoning)	20.35	5,029.7	247.1×	LLM
OpenAI GPT-4.1	28.09	137.4	4.9×	LLM
OpenAI GPT-5.6 Terra	39.49	123.1	3.1×	LLM
Anthropic Claude Haiku 4.5	45.33	109.6	2.4×	LLM
Swiss AI Apertus-8B-2509	50.82	258.1	5.1×	Open-weight LLM
Mistral Medium 3.1	53.48	1,756.1	32.8×	LLM
MiniMax M2.5	58.39	708.7	12.1×	LLM
Cohere Command A Translate	63.59	167.2	2.6×	LLM
AI21 Jamba Large 1.7	64.03	149.7	2.3×	LLM
xAI Grok 4.20 (reasoning)	65.02	231.3	3.6×	LLM
DeepSeek V3.2	65.27	143.5	2.2×	LLM
Google Gemini 3.5 Flash	67.63	101.4	1.5×	LLM
Mistral Large 3	78.68	528.9	6.7×	LLM
Anthropic Claude Sonnet 5	78.77	266.3	3.4×	LLM
Anthropic Claude Fable 5	87.56	335.9	3.8×	LLM
Anthropic Claude Sonnet 4.6	89.72	178.5	2.0×	LLM
OpenAI GPT-5.5	90.39	360.8	4.0×	LLM
Anthropic Claude Opus 4.8	96.27	367.7	3.8×	LLM
Google Gemini 3.1 Pro Preview	99.24	420.3	4.2×	LLM
OpenAI GPT-5.6 Sol	99.38	419.9	4.2×	LLM
Google Gemma 4	224.41	449.1	2.0×	Open-weight LLM
z.ai GLM-5	237.07	5,929.6	25.0×	LLM
MoonshotAI Kimi K2.5	323.15	658.6	2.0×	LLM

More on Performance

Takeaway 0

We compare translation time per 1,000 source words because the test texts differ in length.

The four source texts range from 270 to 999 words. We model translation time as a fixed time per request plus a time per word. With MT engines, most of it is the fixed time (~1.7 seconds per request for Yandex Cloud Translate v2), and with most LLMs it is the time per word (~0.06 seconds per word for Anthropic Claude Sonnet 5), so with an MT engine a short text takes more time per word.

We record the time of each text while we translate it, and for the models we call through the Intento platform, we take it from the platform logs, so these times are indicative.

See details →

Performance

Takeaways for Localization managers, Business leaders, Linguists, and other rolesLocalization engineersLSPsTech vendors (TMS / MT)AI labs / model buildersAnalysts / pressProcurementAcademics──────────See everything

In 93% of measured model–language pairs, translation is either real-time or more than four times the real-time threshold.

MT engine translations take a median of ~2 seconds per 1,000 source words, compared with ~66 seconds for LLMs.

No assessed real-time one-step solution meets every Standard requirement.

Two-step solutions take ~twice as long as the same solutions in one step, and three-step solutions ~three times as long.

Meeting Standard requirements takes a similar time to Basic in 45 of 53 languages, while Advanced takes longer in 18.

Adding glossary terms and a tone instruction increases LLM translation time by ~1.6 seconds per 1,000 source words.

The gender-neutrality agent adds 1 to 12 seconds per 1,000 source words to median translation time.

For most models, translation into the slowest language takes over three times as long as into the median language.

More on Performance

We compare translation time per 1,000 source words because the test texts differ in length.

Automate translation to meet your requirements

Takeaways for , , , and