The State of Translation Automation 2026 · Languages

English to Japanese AI translation quality, cost and speed

What it takes to automate translation from English into Japanese against 10 requirements in three levels: the solutions that meet them, what they cost and how fast they are, from the 2026 benchmark of 57 AI models and MT engines.

How good is AI translation from English to Japanese?

Key findings on English to Japanese translation

  1. 1Near missThe one-step solution on Google Gemini 3.1 Pro Preview meets every Standard requirement in Japanese except general translation quality, at $3.91 per million characters. Its translations have 22.4 weighted errors per 1,000 words, over the bar, with two major errors and no critical error.See the data →
  2. 2Cost driverThe three-step solutions (translation + LQA + repair) that meet every Basic requirement in Japanese cost $570 to $645 per million characters. On the same three models, one-step solutions cost $3.91 to $26.43 per million characters, and two-step ones (translation + post-edit) $29.21 to $58.91.See the data →
  3. 3Agent effectWith the gender-neutrality agent, the three-step solution (translation + LQA + repair) on Google Gemini 3.1 Pro Preview meets every Advanced requirement in Japanese, with 10.9 total errors per 1,000 words against 20.0 without it. The agent raises its cost from $578 to $948 per million characters.See the data →

Find English to Japanese translation solutions for your requirements

Pick a quality level, or your own requirements, bars and constraints, to see the shortlisted solutions that meet them in Japanese, with a column for each requirement you select. Under Optimize for, choose which of them comes first: the one with the fewest total errors, the lowest cost or the shortest time. Click a column heading to sort by it.

The shortlisted solutions on 13 models, with their Intento LQA results. Total errors per 1,000 words add the weighted general translation quality errors (minor 1, major 5, critical 10) to the missed glossary terms, sentences in the wrong register, tag errors and sentences that fail gender neutrality, each counted once. Formatting counts as met or missed and does not add to the total errors. The models that did not make the shortlist have automatic scores only: the shortlist. Inconclusive: the three LQA judges agree on fewer than 90% of the sentences of the solution, so it has no general translation quality result (09-02). Gender neutrality: the Advanced requirements count the two best solutions of the language, with the gender-neutrality agent where they need it. The results of the other solutions are shown for information.

How we measure it: 11-01 · 11-02

Trade-offs in English to Japanese translation

Trade-off

Under the Standard requirements in Japanese, the three-step solution (translation + LQA + repair) on Anthropic Claude Fable 5 has fewer errors and takes less time, and the one on Google Gemini 3.1 Pro Preview costs less. The first has 16.8 total errors per 1,000 words and takes 191 seconds per 1,000 words, against 20.0 and 302. The second costs $578 per million characters, against $645. Optimize for selects Anthropic Claude Fable 5 for quality and latency, and Google Gemini 3.1 Pro Preview for cost.

Constraints

Under the Standard requirements in Japanese, a cost cap of at most $577 per million characters or a time limit below 191 seconds per 1,000 words removes both solutions. Under the Basic requirements, which cover general translation quality alone, the cheapest solution costs $570 per million characters and the fastest takes 180 seconds per 1,000 words. None of the real-time (<2 sec) solutions meet even the Basic requirements.

Trade-off

Under the Advanced requirements, the three-step solution (translation + LQA + repair) on Google Gemini 3.1 Pro Preview with the gender-neutrality agent has 10.9 total errors per 1,000 words, against 16.8 for the one on Anthropic Claude Fable 5, which meets gender neutrality without the agent. It costs $948 per million characters against $645 and takes 277 against 191 seconds per 1,000 words. Optimize for selects it for quality and Anthropic Claude Fable 5 for cost and latency.

English to Japanese translation quality levels

Optimize for
Basic requirements☆☆☆

Tier 2: two or more solutions, none simple

Solutions that meet them
3 (0 one-step)
Simplest solution
three-step
Fewest errors

Anthropic Claude Fable 5
three-step

Total errors per 1,000 words
16.8
Cost per million characters
$645
Seconds per 1,000 words
191
Lowest cost

Anthropic Claude Opus 4.8
three-step

Total errors per 1,000 words
17.5
Cost per million characters
$570
Seconds per 1,000 words
180
Shortest time

Anthropic Claude Opus 4.8
three-step

Total errors per 1,000 words
17.5
Cost per million characters
$570
Seconds per 1,000 words
180
Standard requirements☆☆

Tier 2: two or more solutions, none simple

Solutions that meet them
2 (0 one-step)
Simplest solution
three-step
Fewest errors

Anthropic Claude Fable 5
three-step

Total errors per 1,000 words
16.8
Cost per million characters
$645
Seconds per 1,000 words
191
Lowest cost

Google Gemini 3.1 Pro Preview
three-step

Total errors per 1,000 words
20.0
Cost per million characters
$578
Seconds per 1,000 words
302
Shortest time

Anthropic Claude Fable 5
three-step

Total errors per 1,000 words
16.8
Cost per million characters
$645
Seconds per 1,000 words
191
Advanced requirements☆☆

Tier 2: two or more solutions, none simple

Solutions that meet them
2 (0 one-step)
Simplest solution
three-step
Fewest errors

Google Gemini 3.1 Pro Preview
three-step with the gender-neutrality agent

Total errors per 1,000 words
10.9
Cost per million characters
$948
Seconds per 1,000 words
277
Lowest cost

Anthropic Claude Fable 5
three-step

Total errors per 1,000 words
16.8
Cost per million characters
$645
Seconds per 1,000 words
191
Shortest time

Anthropic Claude Fable 5
three-step

Total errors per 1,000 words
16.8
Cost per million characters
$645
Seconds per 1,000 words
191

Optimize for selects one of the solutions that meet the level: the one with the fewest total errors, the lowest cost or the shortest time. Where no solution meets the level, the card shows the available solution with the fewest total errors and what it misses. Total errors count every requirement with countable errors.

Quality levelTierSolutionsSimplest solutionModelTotal errors per 1,000 wordsCost per million charactersSeconds per 1,000 words
BasicTier 2: two or more solutions, none simple☆☆☆three-stepAnthropic Claude Opus 4.817.5$570180
StandardTier 2: two or more solutions, none simple☆☆three-stepGoogle Gemini 3.1 Pro Preview20.0$578302
AdvancedTier 2: two or more solutions, none simple☆☆three-stepAnthropic Claude Fable 516.8$645191

One solution per level: the simplest that meets the level, the cheapest of them where several are equally simple. ★ a one-step solution, ☆ a solution with more steps or the gender-neutrality agent.

Level step-up

On terminology, the Standard requirements remove the three-step solution (translation + LQA + repair) on Anthropic Claude Opus 4.8, one of three that meet the Basic ones. Its translations have 88.5% of the glossary terms right, against 100% in one step. Under the Basic requirements it is the cheapest and fastest, with the fewest weighted errors per 1,000 words, 11.5. Optimize for selects it for cost and latency there, and Anthropic Claude Fable 5 for quality, with 16.8 total errors per 1,000 words against 17.5.

How we measure it: 11-01 · 11-02 · 08-09

English to Japanese translation cost against errors

Chart data
Cost and weighted errors of the one-step solutions in Japanese
ModelUS dollars per million charactersWeighted errors per 1,000 wordsGroup
Mistral Medium 3.11.0958Misses a Standard requirement
Google Gemini 3.5 Flash2.9235.9Misses a Standard requirement
Google Gemini 3.1 Pro Preview3.9122.4Misses a Standard requirement
OpenAI GPT-5.6 Terra4.7724.7Misses a Standard requirement
Anthropic Claude Sonnet 55.3139.2Misses a Standard requirement
Widn AI Tower Sugarloaf1084.4Misses a Standard requirement
Anthropic Claude Opus 4.813.3322.7Misses a Standard requirement
Amazon Translate15100.2Misses a Standard requirement
Anthropic Claude Fable 526.4325.7Misses a Standard requirement
DeepL Next Gen27.532.3Misses a Standard requirement
Price vs quality

Of the one-step solutions with a price in Japanese, the two dearest, on DeepL Next Gen at $27.50 and Anthropic Claude Fable 5 at $26.43 per million characters, have 32.3 and 25.7 weighted errors per 1,000 words, against 22.4 for the one on Google Gemini 3.1 Pro Preview at $3.91. Those on Amazon Translate and Widn AI Tower Sugarloaf have the most, 100.2 and 84.4 weighted errors per 1,000 words, at $15 and $10 per million characters.

How we measure it: 11-01 · 10-10

English to Japanese translation requirements

Chart data
Errors per 1,000 words of the one-step solutions in Japanese, median, by requirement
RequirementMedian errors per 1,000 words
General translation quality35.9
Tag handling2
Gender neutrality1.1
Terminology0
Tone of voice0

The requirements with countable errors. Every solution with its result on each requirement: the explorer.

Bottleneck

In Japanese, the one-step solutions closest to the bar of general translation quality, on Google Gemini 3.1 Pro Preview, Anthropic Claude Opus 4.8, OpenAI GPT-5.6 Terra and Anthropic Claude Fable 5, have at most two major errors and no critical error, but 22.4 to 25.7 weighted errors per 1,000 words. On three of these models, two-step solutions (translation + post-edit) have 22.7 to 25.7 weighted errors per 1,000 words, and three-step solutions (translation + LQA + repair) 11.5 to 17.8, each three-step one with 100% of the tags right.

How we measure it: 09-09 · 09-10 · 09-11 · 09-12 · 09-18

AI models and MT engines for English to Japanese translation

Chart data
Weighted errors per 1,000 words of the shortlisted one-step solutions in Japanese
ModelWeighted errors per 1,000 words of the shortlisted one-step solutions in JapaneseClass
Amazon Translate100.2MT engines
Widn AI Tower Sugarloaf84.4LLM-based MT engines
Mistral Medium 3.158LLMs
Cohere Command A Translate41.9LLMs
Anthropic Claude Sonnet 539.2LLMs
Google Gemini 3.5 Flash35.9LLMs
DeepL Next Gen32.3LLM-based MT engines
Anthropic Claude Fable 525.7LLMs
OpenAI GPT-5.6 Terra24.7LLMs
Anthropic Claude Opus 4.822.7LLMs
Google Gemini 3.1 Pro Preview22.4LLMs

No translation into Japanese: Widn AI Tower Vesuvius (cut off part-way).

Model types

None of the one-step solutions on the eight shortlisted LLMs with a conclusive result have a critical error in Japanese, and they have 22.4 to 58.0 weighted errors per 1,000 words. Those on the two LLM-based MT engines and on the MT engine Amazon Translate have 32.3, 84.4 and 100.2 weighted errors per 1,000 words, with one critical error on Widn AI Tower Sugarloaf and six on Amazon Translate. Translations from DeepL Next Gen have 1.44 times as many weighted errors as those from Google Gemini 3.1 Pro Preview.

How we measure it: 00-04 · 08-15 · 23-01

How we shortlisted English to Japanese translation solutions

Chart data
Ranks of the models on the two automatic metrics, Japanese
ModelCOMET-KiwiRank on COMET-KiwiMetricXRank on MetricXShortlistedShortlist place
xAI Grok 4.20 (reasoning)0.801111.4820NoNot shortlisted
OpenAI GPT-5.50.800121.3611NoNot shortlisted
DeepSeek V3.20.800131.5522NoNot shortlisted
Google Gemma 40.798151.3814NoNot shortlisted
MoonshotAI Kimi K2.50.796161.4219NoNot shortlisted
Mistral Large 30.794181.3815NoNot shortlisted
OpenAI GPT-4.10.794191.3612NoNot shortlisted
Microsoft Translator0.792211.3918NoNot shortlisted
Anthropic Claude Haiku 4.50.790221.5723NoNot shortlisted
ModernMT Enterprise Edition0.788231.5121NoNot shortlisted
Translated Lara 20.787241.6625NoNot shortlisted
Google Translation LLM0.784251.7327NoNot shortlisted
Pangeanic PangeaMT0.778261.7630NoNot shortlisted
Swiss AI Apertus-8B-25090.778271.7026NoNot shortlisted
OpenAI gpt-oss-120b0.772281.7429NoNot shortlisted
Google Cloud Advanced Translation API0.772292.2433NoNot shortlisted
MiniMax M2.50.766301.7428NoNot shortlisted
SYSTRAN PNMT API0.763311.9431NoNot shortlisted
AI21 Jamba Large 1.70.763322.3134NoNot shortlisted
Alibaba Qwen3-235B-A22B0.760331.5824NoNot shortlisted
Supertext LLM0.756342.0232NoNot shortlisted
iFlyTek MT0.738352.7140NoNot shortlisted
Naver Papago NMT Commercial0.738362.3135NoNot shortlisted
Tencent Cloud TMT0.731372.3436NoNot shortlisted
Alibaba Machine Translation API0.730382.4937NoNot shortlisted
Oracle Cloud Language Service0.723392.5638NoNot shortlisted
Yandex Cloud Translate v20.722402.7039NoNot shortlisted
Cohere Tiny Aya0.701413.2341NoNot shortlisted
AppTek NMT0.675423.5942NoNot shortlisted
Youdao Translation Service API0.652434.1443NoNot shortlisted
Widn AI Tower Anthill0.4214411.4744NoNot shortlisted
DeepL Next Gen0.80911.191YesTop 8 by both metrics
Cohere Command A Translate0.80521.326YesTop 8 by both metrics
Anthropic Claude Sonnet 50.80431.3917YesTop 8 by COMET-Kiwi
Anthropic Claude Opus 4.80.80341.329YesTop 8 by COMET-Kiwi
OpenAI GPT-5.6 Terra0.80351.263YesTop 8 by both metrics
Google Gemini 3.5 Flash0.80361.3816YesTop 8 by COMET-Kiwi
Anthropic Claude Fable 50.80271.327YesTop 8 by both metrics
z.ai GLM-50.80281.3813YesTop 8 by COMET-Kiwi
Google Gemini 3.1 Pro Preview0.80291.274YesTop 8 by MetricX
Widn AI Tower Sugarloaf0.802101.315YesTop 8 by MetricX
Anthropic Claude Sonnet 4.60.799141.222YesTop 8 by MetricX
Amazon Translate0.794171.3510YesReal-time place
Mistral Medium 3.10.792201.328YesTop 8 by MetricX
ModelSolution complexityCOMET-Kiwi rankCOMET-KiwiMetricX rankMetricXShortlist
DeepL Next GenAdjusted NMT10.80911.19Top 8 by both metrics
Cohere Command A TranslateAdjusted LLM20.80561.32Top 8 by both metrics
Anthropic Claude Sonnet 5Adjusted LLM30.804171.39Top 8 by COMET-Kiwi
Anthropic Claude Opus 4.8Adjusted LLM40.80391.32Top 8 by COMET-Kiwi
OpenAI GPT-5.6 TerraAdjusted LLM50.80331.26Top 8 by both metrics
Google Gemini 3.5 FlashAdjusted LLM60.803161.38Top 8 by COMET-Kiwi
Anthropic Claude Fable 5Adjusted LLM70.80271.32Top 8 by both metrics
z.ai GLM-5Adjusted LLM80.802131.38Top 8 by COMET-Kiwi
Google Gemini 3.1 Pro PreviewAdjusted LLM90.80241.27Top 8 by MetricX
Widn AI Tower SugarloafAdjusted NMT100.80251.31Top 8 by MetricX
xAI Grok 4.20 (reasoning)Adjusted LLM110.801201.48Not shortlisted
OpenAI GPT-5.5Adjusted LLM120.800111.36Not shortlisted
DeepSeek V3.2Adjusted LLM130.800221.55Not shortlisted
Anthropic Claude Sonnet 4.6Adjusted LLM140.79921.22Top 8 by MetricX
Google Gemma 4Adjusted LLM150.798141.38Not shortlisted
MoonshotAI Kimi K2.5Adjusted LLM160.796191.42Not shortlisted
Amazon TranslateOff-the-shelf NMT170.794101.35Real-time place
Mistral Large 3Adjusted LLM180.794151.38Not shortlisted
OpenAI GPT-4.1Adjusted LLM190.794121.36Not shortlisted
Mistral Medium 3.1Adjusted LLM200.79281.32Top 8 by MetricX
Microsoft TranslatorOff-the-shelf NMT210.792181.39Not shortlisted
Anthropic Claude Haiku 4.5Adjusted LLM220.790231.57Not shortlisted
ModernMT Enterprise EditionAdjusted NMT230.788211.51Not shortlisted
Translated Lara 2Adjusted NMT240.787251.66Not shortlisted
Google Translation LLMOff-the-shelf NMT250.784271.73Not shortlisted
Pangeanic PangeaMTOff-the-shelf NMT260.778301.76Not shortlisted
Swiss AI Apertus-8B-2509Off-the-shelf LLM270.778261.70Not shortlisted
OpenAI gpt-oss-120bOff-the-shelf LLM280.772291.74Not shortlisted
Google Cloud Advanced Translation APIAdjusted NMT290.772332.24Not shortlisted
MiniMax M2.5Adjusted LLM300.766281.74Not shortlisted
SYSTRAN PNMT APIAdjusted NMT310.763311.94Not shortlisted
AI21 Jamba Large 1.7Adjusted LLM320.763342.31Not shortlisted
Alibaba Qwen3-235B-A22BAdjusted LLM330.760241.58Not shortlisted
Supertext LLMOff-the-shelf NMT340.756322.02Not shortlisted
iFlyTek MTOff-the-shelf NMT350.738402.71Not shortlisted
Naver Papago NMT CommercialAdjusted NMT360.738352.31Not shortlisted
Tencent Cloud TMTOff-the-shelf NMT370.731362.34Not shortlisted
Alibaba Machine Translation APIOff-the-shelf NMT380.730372.49Not shortlisted
Oracle Cloud Language ServiceOff-the-shelf NMT390.723382.56Not shortlisted
Yandex Cloud Translate v2Off-the-shelf NMT400.722392.70Not shortlisted
Cohere Tiny AyaOff-the-shelf LLM410.701413.23Not shortlisted
AppTek NMTOff-the-shelf NMT420.675423.59Not shortlisted
Youdao Translation Service APIOff-the-shelf NMT430.652434.14Not shortlisted
Widn AI Tower AnthillAdjusted NMT440.4214411.47Not shortlisted
OpenAI GPT-5.6 LunaAdjusted LLM—0.801—1.30Same model family as OpenAI GPT-5.6 Terra
OpenAI GPT-5.6 SolAdjusted LLM—0.799—1.29Same model family as OpenAI GPT-5.6 Terra
xAI Grok 4.20 (non-reasoning)Adjusted LLM—0.792—1.50Same model family as xAI Grok 4.20 (reasoning)

Every model we got a translation from, as the shortlist compared it: off the shelf, without context in the request, or adjusted, with it. A model that did not make the shortlist is shown adjusted, unless off the shelf it scores higher by 0.03 or more on COMET-Kiwi. Ranks among 44 models, with each model family counted once, and the top 8 of each metric in bold. Higher is better on COMET-Kiwi, lower on MetricX. The scores rank models within this language and are not a requirement result.

Metrics vs LQA

In Japanese, Anthropic Claude Opus 4.8 is on the shortlist as 4th on COMET-Kiwi, and Google Gemini 3.1 Pro Preview as 4th on MetricX. Each is 9th on the other metric, and the three-step solution on each meets every Basic requirement. By Intento LQA, the one-step solution on Google Gemini 3.1 Pro Preview has 22.4 weighted errors per 1,000 words, against 32.3 for DeepL Next Gen, first on both metrics. Nearest the cut in the tail are xAI Grok 4.20 (reasoning), 11th on COMET-Kiwi, and OpenAI GPT-5.5, 11th on MetricX.

How we measure it: 00-08 · 00-09

English to Japanese translation cost

Quality levelCheapest solution that meets every requirement of the levelCost per million characters
BasicAnthropic Claude Opus 4.8, three-step$570
StandardGoogle Gemini 3.1 Pro Preview, three-step$578
AdvancedAnthropic Claude Fable 5, three-step$645
Chart data
Cost of the shortlisted one-step solutions in Japanese
ModelUS dollars per million charactersClass
Mistral Medium 3.1$1.09LLMs
z.ai GLM-5$1.82LLMs
Google Gemini 3.5 Flash$2.92LLMs
Google Gemini 3.1 Pro Preview$3.91LLMs
OpenAI GPT-5.6 Terra$4.77LLMs
Anthropic Claude Sonnet 5$5.31LLMs
Anthropic Claude Sonnet 4.6$7.13LLMs
Widn AI Tower Sugarloaf$10LLM-based MT engines
Anthropic Claude Opus 4.8$13.33LLMs
Amazon Translate$15MT engines
Anthropic Claude Fable 5$26.43LLMs
DeepL Next Gen$27.5LLM-based MT engines
Chart data
Tokens per character of the translation into Japanese, by model
ModelTokens per characterClass
Mistral Medium 3.10.813LLMs
Mistral Large 30.801LLMs
AI21 Jamba Large 1.70.745LLMs
Anthropic Claude Opus 4.80.721LLMs
Anthropic Claude Fable 50.719LLMs
Anthropic Claude Sonnet 50.718LLMs
Anthropic Claude Haiku 4.50.674LLMs
Anthropic Claude Sonnet 4.60.674LLMs
OpenAI GPT-5.6 Terra0.575LLMs
OpenAI GPT-5.6 Sol0.572LLMs
OpenAI GPT-5.6 Luna0.571LLMs
MoonshotAI Kimi K2.50.565LLMs
OpenAI GPT-5.50.564LLMs
OpenAI GPT-4.10.562LLMs
z.ai GLM-50.53LLMs
DeepSeek V3.20.525LLMs
Alibaba Qwen3-235B-A22B0.52Open-weight LLMs
Widn AI Tower Sugarloaf0.51LLM-based MT engines
Cohere Command A Translate0.483LLMs
Google Gemini 3.5 Flash0.444LLMs
Google Gemini 3.1 Pro Preview0.443LLMs
Google Gemma 40.438Open-weight LLMs
xAI Grok 4.20 (non-reasoning)0.432LLMs
xAI Grok 4.20 (reasoning)0.432LLMs
Cohere Tiny Aya0.429LLMs
Widn AI Tower Anthill0.421LLM-based MT engines
MiniMax M2.50.309LLMs
Cost driver

The tokenizers produce a median 0.56 tokens per character of the Japanese translation, 2.2 times their rate on the English source. More tokens per character do not always cost more: the one-step solution on Mistral Medium 3.1, whose tokenizer produces the most, is the cheapest priced one on the shortlist, at $1.09 per million characters. The cheapest solution costs $570 per million characters under the Basic requirements, $578 under the Standard and $645 under the Advanced ones, each a three-step solution (translation + LQA + repair).

How we measure it: 10-01 · 10-03 · 05-02

English to Japanese translation speed

Quality levelFastest solution that meets every requirement of the levelSeconds per 1,000 words
BasicAnthropic Claude Opus 4.8, three-step180
StandardAnthropic Claude Fable 5, three-step191
AdvancedAnthropic Claude Fable 5, three-step191
Chart data
Time to translate 1,000 words into Japanese, by model
ModelSeconds per 1,000 wordsClass
Microsoft Translator0.3MT engines
Google Cloud Advanced Translation API0.4MT engines
Google Translation LLM0.6LLM-based MT engines
Pangeanic PangeaMT0.6MT engines
DeepL Next Gen1LLM-based MT engines
ModernMT Enterprise Edition1MT engines
Translated Lara 21.5LLM-based MT engines
Amazon Translate1.8MT engines
SYSTRAN PNMT API2.5MT engines
OpenAI gpt-oss-120b2.8Open-weight LLMs
Oracle Cloud Language Service4.1MT engines
Yandex Cloud Translate v24.5MT engines
Widn AI Tower Anthill8.1LLM-based MT engines
xAI Grok 4.20 (non-reasoning)13LLMs
Google Gemini 3.5 Flash14LLMs
Cohere Tiny Aya14LLMs
OpenAI GPT-5.6 Luna15LLMs
Supertext LLM16LLM-based MT engines
OpenAI GPT-4.117LLMs
Alibaba Machine Translation API19MT engines
OpenAI GPT-5.6 Terra20LLMs
Cohere Command A Translate30LLMs
Anthropic Claude Haiku 4.531LLMs
Mistral Medium 3.139LLMs
Naver Papago NMT Commercial39MT engines
Widn AI Tower Sugarloaf42LLM-based MT engines
MiniMax M2.542LLMs
Anthropic Claude Sonnet 543LLMs
OpenAI GPT-5.545LLMs
Swiss AI Apertus-8B-250948Open-weight LLMs
OpenAI GPT-5.6 Sol48LLMs
iFlyTek MT50MT engines
Anthropic Claude Fable 551LLMs
DeepSeek V3.251LLMs
xAI Grok 4.20 (reasoning)52LLMs
Anthropic Claude Opus 4.853LLMs
Tencent Cloud TMT55MT engines
Mistral Large 357LLMs
AI21 Jamba Large 1.760LLMs
Youdao Translation Service API60MT engines
Anthropic Claude Sonnet 4.661LLMs
Alibaba Qwen3-235B-A22B94Open-weight LLMs
Google Gemini 3.1 Pro Preview99LLMs
AppTek NMT104MT engines
Google Gemma 4146Open-weight LLMs
z.ai GLM-5186LLMs
MoonshotAI Kimi K2.5238LLMs

Real-time models are those the shortlist counts as real-time, under 2 seconds per text across the languages we timed. The chart shows the time of each model into Japanese.

Real-time

The ten real-time (<2 sec) models in Japanese are six MT engines, three LLM-based MT engines and the open-weight OpenAI gpt-oss-120b. Two of them are on the shortlist, DeepL Next Gen and Amazon Translate, and translations from both meet tone of voice. Neither of them meets general translation quality, terminology or tag handling. The fastest solution takes 180 seconds per 1,000 words under the Basic requirements and 191 under the Standard and Advanced ones, each time a three-step solution (translation + LQA + repair).

How we measure it: 12-01 · 12-02 · 12-09

Tone of voice and gender-neutral English to Japanese translation

Tone of voice
Formal register, with です・ます (teineigo), 敬語 where natural
Gender-neutrality strategy
neutral nouns + omission or rephrasing (no forced 彼/彼女)
Options in the language
generic 彼/彼女 split, neutral role nouns + rephrasing
Default gender
None where the source leaves the gender open
The two best solutionsSolutionSentences about people that are gender-neutralMeets every Advanced requirementCost per million charactersSeconds per 1,000 words
Anthropic Claude Fable 5three-step100%✓$645191
Google Gemini 3.1 Pro Previewthree-step, with the gender-neutrality agent100%✓$948277
Analysis

For tone of voice in Japanese we check the formal register, with です・ます (teineigo) and 敬語 where natural. Translations from the shortlisted solutions keep it at 100%, as tone of voice requires, except those from the one on Mistral Medium 3.1, at 97.9%. For gender neutrality we check neutral nouns, with omission or rephrasing in place of a forced 彼 or 彼女, and no default gender. Both of the two best solutions have 100% of the sentences about people gender-neutral, the one on Anthropic Claude Fable 5 without the gender-neutrality agent.

How we measure it: 02-05 · 02-06 · 08-11 · 09-18

How confident are we in measuring English to Japanese translation quality?

How we measure it: 00-07 · 07-05 · 09-02

Automate translation to meet your requirements

See Intento Language Hub in action.

Book a demo
Leave feedback