We add complexity to a translation solution only when a simpler solution cannot meet the requirements.
The framework defines eight levels of solution complexity. Fine-tuned models are out of scope in the 2026 edition.
- Off-the-shelf NMT: A neural machine translation engine with default settings and no glossary.
- Adjusted NMT: An NMT solution with glossaries, tone of voice, tag handling and other settings supported through the API.
- Off-the-shelf LLM: An LLM with a simple translation prompt.
- Adjusted LLM: An LLM with glossary retrieval and prompts tailored to tone of voice, tags and other requirements.
- Fine-tuned models: NMT domain adaptation or LLM fine-tuning, combined with other customization features. Out of scope in the 2026 edition.
- Two-step solution: A translation step using NMT or an LLM, followed by automatic post-editing with an LLM to address unmet requirements.
- Multi-step: More than two steps in one workflow: translation, validation and repair.
- Multi-agent systems: Agents responsible for different groups of requirements work together to meet all of them.
Languages per model at each level of solution complexity
| Model | 1. Off-the-shelf NMT | 2. Adjusted NMT | 3. Off-the-shelf LLM | 4. Adjusted LLM | 6. Two-step solution | 7. Multi-step | 8. Multi-agent systems |
|---|---|---|---|---|---|---|---|
| Alibaba | 78 | ||||||
| ALL-Lab | 14 | 8 | |||||
| Amazon | 69 | ||||||
| AppTek NMT | 54 | ||||||
| Baidu | 12 | ||||||
| Elia Elhuyar Machine Translation System | 5 | ||||||
| Google Cloud Advanced Translation API | 99 | 16 | |||||
| iFlyTek MT | 6 | ||||||
| Microsoft Translator | 90 | ||||||
| ModernMT Enterprise Edition | 93 | 15 | |||||
| Naver Papago NMT Commercial | 11 | 2 | |||||
| NiuTrans | 22 | ||||||
| Oracle | 21 | ||||||
| Pangeanic | 22 | ||||||
| SYSTRAN PNMT API | 57 | 14 | |||||
| Tarjama | 1 | ||||||
| TartuNLP | 7 | ||||||
| Tencent Cloud TMT | 13 | ||||||
| Yandex | 83 | 13 | |||||
| Youdao | 8 | ||||||
| DeepL Next Gen | 85 | 15 | 1 | ||||
| Google Translation LLM | 80 | 79 | |||||
| Supertext LLM | 26 | ||||||
| Tilde | 31 | 19 | |||||
| Translated Lara 2 | 97 | 97 | 1 | 2 | |||
| Widn AI Tower Anthill | 20 | 38 | |||||
| Widn AI Tower Sugarloaf | 22 | 20 | |||||
| Widn AI Tower Vesuvius | 20 | 38 | |||||
| AI21 Jamba Large 1.7 | 100 | 100 | |||||
| Anthropic Claude Fable 5 | 100 | 100 | 24 | 22 | 21 | ||
| Anthropic Claude Haiku 4.5 | 100 | 100 | 1 | ||||
| Anthropic Claude Opus 4.8 | 100 | 100 | 12 | 13 | 2 | ||
| Anthropic Claude Sonnet 4.6 | 100 | 100 | 6 | 8 | |||
| Anthropic Claude Sonnet 5 | 100 | 100 | 7 | 6 | |||
| Cohere Command A Translate | 100 | 100 | 1 | ||||
| Cohere Tiny Aya | 69 | 67 | |||||
| DeepSeek V3.2 | 100 | 100 | 6 | 5 | 3 | ||
| GLM-5 | 100 | 100 | 19 | 13 | 1 | ||
| Google Gemini 3.1 Pro Preview | 100 | 100 | 49 | 34 | 25 | ||
| Google Gemini 3.5 Flash | 100 | 100 | 21 | 17 | |||
| Grok 4.20 (non-reasoning) | 100 | 100 | 1 | 1 | |||
| Grok 4.20 (reasoning) | 100 | 100 | 3 | 4 | |||
| M2.5 | 100 | 100 | |||||
| Mistral Large 3 | 100 | 100 | 2 | 3 | |||
| Mistral Medium 3.1 | 100 | 100 | |||||
| MoonshotAI Kimi K2.5 | 100 | 100 | 1 | 1 | |||
| OpenAI GPT-4.1 | 100 | 100 | 15 | 10 | |||
| OpenAI GPT-5.5 | 100 | 100 | 33 | 21 | 26 | ||
| OpenAI GPT-5.6 Luna | 100 | 100 | 10 | 7 | 3 | ||
| OpenAI GPT-5.6 Sol | 100 | 100 | 17 | 9 | 12 | ||
| OpenAI GPT-5.6 Terra | 100 | 100 | 7 | 7 | 8 | ||
| Alibaba Cloud Qwen3-235B-A22B | 79 | 79 | |||||
| Apertus-8B-2509 | 100 | 100 | |||||
| Google Gemma 4 | 100 | 97 | 6 | 3 | 1 | ||
| Meta Llama 4 Maverick | 11 | 11 | |||||
| OpenAI gpt-oss-120b | 100 | 100 | 1 | 1 | |||
| SpeakLeash Bielik-11B-v3.0-Instruct | 30 | 30 |
Units — 1. Off-the-shelf NMT: languages; 2. Adjusted NMT: languages; 3. Off-the-shelf LLM: languages; 4. Adjusted LLM: languages; 6. Two-step solution: languages; 7. Multi-step: languages; 8. Multi-agent systems: languages
Number of languages in which we evaluated the model at each level. Two-step, multi-step and multi-agent solutions count under the model of the first step. Level 5, fine-tuned models, is not part of this edition.