The State of Translation Automation 2026 · Languages

English to Yiddish AI translation quality, cost and speed

What it takes to automate translation from English into Yiddish against 10 requirements in three levels: the solutions that meet them, what they cost and how fast they are, from the 2026 benchmark of 57 AI models and MT engines.

How good is AI translation from English to Yiddish?

Key findings on English to Yiddish translation

  1. 1Near missWith the gender-neutrality agent, 100% of the sentences about people in the translations from OpenAI GPT-5.5 are gender-neutral. That three-step solution (translation + LQA + repair) misses the Advanced requirements on general translation quality alone, with 20.1 weighted errors per 1,000 words, just over the bar.See the data →
  2. 2BottleneckIn one step, the solution on Anthropic Claude Fable 5 meets tone of voice and tag handling in Yiddish but not general translation quality, with 44.2 weighted errors per 1,000 words. In two steps (translation + post-edit) it has 34.6 weighted errors per 1,000 words, still over the bar, and in three (translation + LQA + repair) 8.9, under it.See the data →
  3. 3Cost driverOn OpenAI GPT-5.5, the one-step solution costs $13.29 per million characters in Yiddish and has 54.7 weighted errors per 1,000 words, and the two-step solution (translation + post-edit) $48.46 and 41.9. On this model, only the three-step solution (translation + LQA + repair) meets every Standard requirement.See the data →

Find English to Yiddish translation solutions for your requirements

Pick a quality level, or your own requirements, bars and constraints, to see the shortlisted solutions that meet them in Yiddish, with a column for each requirement you select. Under Optimize for, choose which of them comes first: the one with the fewest total errors, the lowest cost or the shortest time. Click a column heading to sort by it.

The shortlisted solutions on 12 models, with their Intento LQA results. Total errors per 1,000 words add the weighted general translation quality errors (minor 1, major 5, critical 10) to the missed glossary terms, sentences in the wrong register, tag errors and sentences that fail gender neutrality, each counted once. Formatting counts as met or missed and does not add to the total errors. The models that did not make the shortlist have automatic scores only: the shortlist. Inconclusive: the three LQA judges agree on fewer than 90% of the sentences of the solution, so it has no general translation quality result (09-02). Gender neutrality: the Advanced requirements count the two best solutions of the language, with the gender-neutrality agent where they need it. The results of the other solutions are shown for information.

How we measure it: 11-01 · 11-02

Trade-offs in English to Yiddish translation

Trade-off

Two three-step solutions (translation + LQA + repair) meet every Standard requirement in Yiddish, and neither leads on errors, cost and time at once. The one on Anthropic Claude Fable 5 has 10.9 total errors per 1,000 words and takes 408 seconds per 1,000 words, against 18.9 and 438 for the one on OpenAI GPT-5.5. The one on OpenAI GPT-5.5 costs less, $653 against $683 per million characters. Optimizing for quality or latency selects the solution on Anthropic Claude Fable 5, and optimizing for cost the one on OpenAI GPT-5.5.

Constraints

None of the solutions that meet even the Basic requirements in Yiddish cost less than $652 per million characters or take less than 407 seconds per 1,000 words. Both are three-step solutions (translation + LQA + repair). The three-step solution on OpenAI GPT-5.6 Terra costs less and takes less time than both, at $640 per million characters and 307 seconds per 1,000 words. Its translations have 22.1 weighted errors per 1,000 words, over the bar.

Agent effect

For the Advanced requirements, the gender-neutrality agent works with both three-step solutions (translation + LQA + repair). On Anthropic Claude Fable 5 it raises the cost from $683 to $1,116 per million characters, and on OpenAI GPT-5.5 from $653 to $1,122. Time rises from 408 to 440 and from 438 to 473 seconds per 1,000 words. Total errors rise, from 10.9 to 11.8 and from 18.9 to 20.1 per 1,000 words. Weighted errors rise, from 8.9 to 11.5 and from 16.5 to 20.1 per 1,000 words, the last over the bar.

English to Yiddish translation quality levels

Optimize for
Basic requirements☆☆

Tier 2: two or more solutions, none simple

Solutions that meet them
2 (0 one-step)
Simplest solution
three-step
Fewest errors

Anthropic Claude Fable 5
three-step

Total errors per 1,000 words
10.9
Cost per million characters
$683
Seconds per 1,000 words
408
Lowest cost

OpenAI GPT-5.5
three-step

Total errors per 1,000 words
18.9
Cost per million characters
$653
Seconds per 1,000 words
438
Shortest time

Anthropic Claude Fable 5
three-step

Total errors per 1,000 words
10.9
Cost per million characters
$683
Seconds per 1,000 words
408
Standard requirements☆☆

Tier 2: two or more solutions, none simple

Solutions that meet them
2 (0 one-step)
Simplest solution
three-step
Fewest errors

Anthropic Claude Fable 5
three-step

Total errors per 1,000 words
10.9
Cost per million characters
$683
Seconds per 1,000 words
408
Lowest cost

OpenAI GPT-5.5
three-step

Total errors per 1,000 words
18.9
Cost per million characters
$653
Seconds per 1,000 words
438
Shortest time

Anthropic Claude Fable 5
three-step

Total errors per 1,000 words
10.9
Cost per million characters
$683
Seconds per 1,000 words
408
Advanced requirements

Tier 4: no solution

Solutions that meet them
0
Best available

Anthropic Claude Fable 5
three-step with the gender-neutrality agent

Misses gender neutrality.

Total errors per 1,000 words
11.8
Cost per million characters
$1,116
Seconds per 1,000 words
440

Optimize for selects one of the solutions that meet the level: the one with the fewest total errors, the lowest cost or the shortest time. Where no solution meets the level, the card shows the available solution with the fewest total errors and what it misses. Total errors count every requirement with countable errors.

Quality levelTierSolutionsSimplest solutionModelTotal errors per 1,000 wordsCost per million charactersSeconds per 1,000 words
BasicTier 2: two or more solutions, none simple☆☆three-stepOpenAI GPT-5.518.9$653438
StandardTier 2: two or more solutions, none simple☆☆three-stepOpenAI GPT-5.518.9$653438
AdvancedTier 4: no solutionNo solution———

One solution per level: the simplest that meets the level, the cheapest of them where several are equally simple. ★ a one-step solution, ☆ a solution with more steps or the gender-neutrality agent.

Level step-up

The two three-step solutions (translation + LQA + repair) that meet every Basic requirement in Yiddish also meet every Standard requirement, and Optimize for selects the same solutions for both. None of the one-step or two-step solutions (translation + post-edit) meet even the Basic requirements. The Advanced requirements remove both three-step solutions, also with the gender-neutrality agent. The best available, on Anthropic Claude Fable 5 with the agent, has 11.8 total errors per 1,000 words and misses gender neutrality.

How we measure it: 11-01 · 11-02 · 08-09

English to Yiddish translation cost against errors

Chart data
Cost and weighted errors of the one-step solutions in Yiddish
ModelUS dollars per million charactersWeighted errors per 1,000 wordsGroup
xAI Grok 4.20 (non-reasoning)1.78307.5Misses a Standard requirement
OpenAI GPT-4.13.69168.8Misses a Standard requirement
OpenAI GPT-5.6 Terra5.571.9Misses a Standard requirement
OpenAI GPT-5.6 Sol9.3856.4Misses a Standard requirement
OpenAI GPT-5.513.2954.7Misses a Standard requirement
DeepL Next Gen27.583.1Misses a Standard requirement
Anthropic Claude Fable 543.0244.2Misses a Standard requirement
Price vs quality

Among the one-step solutions on LLMs with a conclusive Intento LQA result in Yiddish, each dearer one has fewer weighted errors. They run from $1.78 per million characters and 307.5 weighted errors per 1,000 words on xAI Grok 4.20 (non-reasoning) to $43.02 and 44.2 on Anthropic Claude Fable 5. The one-step solution on DeepL Next Gen, an LLM-based MT engine, costs $27.50 per million characters. Its translations have 83.1 weighted errors per 1,000 words, more than those from OpenAI GPT-5.6 Terra at $5.50 per million characters.

How we measure it: 11-01 · 10-10

English to Yiddish translation requirements

Chart data
Errors per 1,000 words of the one-step solutions in Yiddish, median, by requirement
RequirementMedian errors per 1,000 words
General translation quality71.9
Gender neutrality2.7
Tone of voice0
Tag handling0

The requirements with countable errors. Every solution with its result on each requirement: the explorer.

Bottleneck

None of the one-step or two-step solutions (translation + post-edit) meet general translation quality in Yiddish. The seven one-step solutions with a conclusive result have 44.2 to 307.5 weighted errors per 1,000 words, and the two-step solutions 34.6 to 161.2, all over the bar. Three-step solutions (translation + LQA + repair) have 8.9 and 16.5 weighted errors per 1,000 words on Anthropic Claude Fable 5 and OpenAI GPT-5.5, under the bar, and 22.1 and 112.4 on OpenAI GPT-5.6 Terra and OpenAI GPT-4.1, over it.

How we measure it: 09-09 · 09-10 · 09-11 · 09-12 · 09-18

AI models and MT engines for English to Yiddish translation

Chart data
Weighted errors per 1,000 words of the shortlisted one-step solutions in Yiddish
ModelWeighted errors per 1,000 words of the shortlisted one-step solutions in YiddishClass
xAI Grok 4.20 (non-reasoning)307.5LLMs
OpenAI GPT-4.1168.8LLMs
DeepL Next Gen83.1LLM-based MT engines
OpenAI GPT-5.6 Terra71.9LLMs
OpenAI GPT-5.6 Sol56.4LLMs
OpenAI GPT-5.554.7LLMs
Anthropic Claude Fable 544.2LLMs
Model types

In one step, translations from the six shortlisted LLMs with a conclusive Intento LQA result have 44.2 to 307.5 weighted errors per 1,000 words in Yiddish. Those from DeepL Next Gen, an LLM-based MT engine, have 83.1 weighted errors per 1,000 words, 1.88 times as many as those from Anthropic Claude Fable 5. For the shortlisted MT engine, Google Cloud Advanced Translation API, the Intento LQA result is not conclusive. Of the six LLMs, Anthropic Claude Fable 5 and OpenAI GPT-5.6 Sol meet our language-support criteria.

How we measure it: 00-04 · 08-15 · 23-01

How we shortlisted English to Yiddish translation solutions

Chart data
Ranks of the models on the two automatic metrics, Yiddish
ModelCOMET-KiwiRank on COMET-KiwiMetricXRank on MetricXShortlistedShortlist place
Google Gemini 3.1 Pro Preview0.69992.439NoNot shortlisted
Anthropic Claude Opus 4.80.695112.5610NoNot shortlisted
Anthropic Claude Sonnet 50.691122.6714NoNot shortlisted
z.ai GLM-50.688142.7015NoNot shortlisted
MiniMax M2.50.686153.3219NoNot shortlisted
MoonshotAI Kimi K2.50.686162.9717NoNot shortlisted
DeepSeek V3.20.686172.6111NoNot shortlisted
Google Gemma 40.660183.8623NoNot shortlisted
Mistral Large 30.648203.5520NoNot shortlisted
OpenAI gpt-oss-120b0.637223.5521NoNot shortlisted
Mistral Medium 3.10.619235.7024NoNot shortlisted
Yandex Cloud Translate v20.598242.7316NoNot shortlisted
Anthropic Claude Haiku 4.50.588255.8425NoNot shortlisted
Swiss AI Apertus-8B-25090.577266.3826NoNot shortlisted
Cohere Command A Translate0.556276.9027NoNot shortlisted
AI21 Jamba Large 1.70.3422813.5928NoNot shortlisted
OpenAI GPT-5.6 Luna0.74511.831YesTop 8 by both metrics
DeepL Next Gen0.72122.075YesTop 8 by both metrics
OpenAI GPT-5.6 Terra0.72031.973YesTop 8 by both metrics
Anthropic Claude Fable 50.71942.216YesTop 8 by both metrics
OpenAI GPT-5.50.71752.024YesTop 8 by both metrics
OpenAI GPT-5.6 Sol0.71661.922YesTop 8 by both metrics
xAI Grok 4.20 (non-reasoning)0.70572.6212YesTop 8 by COMET-Kiwi
Anthropic Claude Sonnet 4.60.70282.6513YesTop 8 by COMET-Kiwi
OpenAI GPT-4.10.698102.337YesTop 8 by MetricX
Google Gemini 3.5 Flash0.690132.398YesTop 8 by MetricX
Google Cloud Advanced Translation API0.658193.3118YesReal-time place
Translated Lara 20.643213.5922YesReal-time place
ModelSolution complexityCOMET-Kiwi rankCOMET-KiwiMetricX rankMetricXShortlist
OpenAI GPT-5.6 LunaAdjusted LLM10.74511.83Top 8 by both metrics
DeepL Next GenOff-the-shelf NMT20.72152.07Top 8 by both metrics
OpenAI GPT-5.6 TerraAdjusted LLM30.72031.97Top 8 by both metrics
Anthropic Claude Fable 5Adjusted LLM40.71962.21Top 8 by both metrics
OpenAI GPT-5.5Adjusted LLM50.71742.02Top 8 by both metrics
OpenAI GPT-5.6 SolAdjusted LLM60.71621.92Top 8 by both metrics
xAI Grok 4.20 (non-reasoning)Adjusted LLM70.705122.62Top 8 by COMET-Kiwi
Anthropic Claude Sonnet 4.6Adjusted LLM80.702132.65Top 8 by COMET-Kiwi
Google Gemini 3.1 Pro PreviewAdjusted LLM90.69992.43Not shortlisted
OpenAI GPT-4.1Adjusted LLM100.69872.33Top 8 by MetricX
Anthropic Claude Opus 4.8Adjusted LLM110.695102.56Not shortlisted
Anthropic Claude Sonnet 5Adjusted LLM120.691142.67Not shortlisted
Google Gemini 3.5 FlashAdjusted LLM130.69082.39Top 8 by MetricX
z.ai GLM-5Adjusted LLM140.688152.70Not shortlisted
MiniMax M2.5Off-the-shelf LLM150.686193.32Not shortlisted
MoonshotAI Kimi K2.5Adjusted LLM160.686172.97Not shortlisted
DeepSeek V3.2Adjusted LLM170.686112.61Not shortlisted
Google Gemma 4Adjusted LLM180.660233.86Not shortlisted
Google Cloud Advanced Translation APIOff-the-shelf NMT190.658183.31Real-time place
Mistral Large 3Adjusted LLM200.648203.55Not shortlisted
Translated Lara 2Adjusted NMT210.643223.59Real-time place
OpenAI gpt-oss-120bAdjusted LLM220.637213.55Not shortlisted
Mistral Medium 3.1Adjusted LLM230.619245.70Not shortlisted
Yandex Cloud Translate v2Off-the-shelf NMT240.598162.73Not shortlisted
Anthropic Claude Haiku 4.5Adjusted LLM250.588255.84Not shortlisted
Swiss AI Apertus-8B-2509Adjusted LLM260.577266.38Not shortlisted
Cohere Command A TranslateOff-the-shelf LLM270.556276.90Not shortlisted
AI21 Jamba Large 1.7Off-the-shelf LLM280.3422813.59Not shortlisted
xAI Grok 4.20 (reasoning)Adjusted LLM—0.699—2.76Same model family as xAI Grok 4.20 (non-reasoning)

Every model we got a translation from, as the shortlist compared it: off the shelf, without context in the request, or adjusted, with it. A model that did not make the shortlist is shown adjusted, unless off the shelf it scores higher by 0.03 or more on COMET-Kiwi. Ranks among 28 models, with each model family counted once, and the top 8 of each metric in bold. Higher is better on COMET-Kiwi, lower on MetricX. The scores rank models within this language and are not a requirement result.

Metrics vs LQA

The automatic metrics rank DeepL Next Gen 2nd on COMET-Kiwi and 5th on MetricX in Yiddish, and Anthropic Claude Fable 5 4th and 6th. Intento LQA orders them the other way: the one-step solution on DeepL Next Gen has 83.1 weighted errors per 1,000 words, and the one on Anthropic Claude Fable 5 44.2. The solution on OpenAI GPT-5.6 Luna, 1st on both metrics, has no conclusive Intento LQA result. Nearest the cut in the tail is Google Gemini 3.1 Pro Preview, 9th on both metrics.

How we measure it: 00-08 · 00-09

English to Yiddish translation cost

Quality levelCheapest solution that meets every requirement of the levelCost per million characters
BasicOpenAI GPT-5.5, three-step$653
StandardOpenAI GPT-5.5, three-step$653
AdvancedNo solution—
Chart data
Cost of the shortlisted one-step solutions in Yiddish
ModelUS dollars per million charactersClass
OpenAI GPT-5.6 Luna$0.52LLMs
xAI Grok 4.20 (non-reasoning)$1.78LLMs
OpenAI GPT-4.1$3.69LLMs
Google Gemini 3.5 Flash$5.33LLMs
OpenAI GPT-5.6 Terra$5.5LLMs
OpenAI GPT-5.6 Sol$9.38LLMs
Anthropic Claude Sonnet 4.6$12.26LLMs
OpenAI GPT-5.5$13.29LLMs
Google Cloud Advanced Translation API$20MT engines
Translated Lara 2$24.99LLM-based MT engines
DeepL Next Gen$27.5LLM-based MT engines
Anthropic Claude Fable 5$43.02LLMs
Chart data
Tokens per character of the translation into Yiddish, by model
ModelTokens per characterClass
z.ai GLM-50.927LLMs
Mistral Large 30.885LLMs
Mistral Medium 3.10.871LLMs
Anthropic Claude Fable 50.694LLMs
Anthropic Claude Opus 4.80.688LLMs
Anthropic Claude Sonnet 50.675LLMs
Anthropic Claude Sonnet 4.60.671LLMs
Anthropic Claude Haiku 4.50.659LLMs
DeepSeek V3.20.637LLMs
MoonshotAI Kimi K2.50.629LLMs
xAI Grok 4.20 (non-reasoning)0.619LLMs
xAI Grok 4.20 (reasoning)0.617LLMs
Cohere Command A Translate0.603LLMs
MiniMax M2.50.598LLMs
AI21 Jamba Large 1.70.581LLMs
Google Gemini 3.1 Pro Preview0.501LLMs
Google Gemma 40.498Open-weight LLMs
Google Gemini 3.5 Flash0.484LLMs
OpenAI GPT-5.6 Terra0.368LLMs
OpenAI GPT-5.50.365LLMs
OpenAI GPT-4.10.364LLMs
OpenAI GPT-5.6 Sol0.362LLMs
OpenAI GPT-5.6 Luna0.36LLMs
Cost driver

Over the 23 models, a Yiddish translation has a median 0.62 tokens per character, 2.3 times as many as the English source. Translations from the five shortlisted OpenAI models have 0.36 to 0.368 tokens per character, and from Anthropic Claude Fable 5 0.694. With nearly the same tokens per character, the one-step solutions on the OpenAI models cost $0.52 to $13.29 per million characters. On Anthropic Claude Fable 5, the one-step solution costs $43.02 per million characters and the three-step one (translation + LQA + repair) $683.

How we measure it: 10-01 · 10-03 · 05-02

English to Yiddish translation speed

Quality levelFastest solution that meets every requirement of the levelSeconds per 1,000 words
BasicAnthropic Claude Fable 5, three-step408
StandardAnthropic Claude Fable 5, three-step408
AdvancedNo solution—
Chart data
Time to translate 1,000 words into Yiddish, by model
ModelSeconds per 1,000 wordsClass
Google Cloud Advanced Translation API0.2MT engines
DeepL Next Gen1.7LLM-based MT engines
Translated Lara 23.3LLM-based MT engines
OpenAI gpt-oss-120b3.3Open-weight LLMs
Yandex Cloud Translate v23.7MT engines
OpenAI GPT-5.6 Luna18LLMs
xAI Grok 4.20 (non-reasoning)42LLMs
OpenAI GPT-4.147LLMs
MiniMax M2.567LLMs
AI21 Jamba Large 1.768LLMs
Swiss AI Apertus-8B-250977Open-weight LLMs
OpenAI GPT-5.6 Terra78LLMs
Mistral Medium 3.180LLMs
Anthropic Claude Haiku 4.585LLMs
Google Gemini 3.5 Flash89LLMs
xAI Grok 4.20 (reasoning)101LLMs
Cohere Command A Translate105LLMs
DeepSeek V3.2108LLMs
Mistral Large 3129LLMs
Google Gemini 3.1 Pro Preview132LLMs
OpenAI GPT-5.6 Sol135LLMs
Anthropic Claude Sonnet 5146LLMs
Anthropic Claude Sonnet 4.6157LLMs
OpenAI GPT-5.5167LLMs
Anthropic Claude Fable 5174LLMs
Anthropic Claude Opus 4.8192LLMs
Google Gemma 4245Open-weight LLMs
MoonshotAI Kimi K2.5252LLMs
z.ai GLM-5435LLMs

Real-time models are those the shortlist counts as real-time, under 2 seconds per text across the languages we timed. The chart shows the time of each model into Yiddish.

Real-time

The four real-time (<2 sec) models in Yiddish are the MT engine Google Cloud Advanced Translation API, the LLM-based MT engines DeepL Next Gen and Translated Lara 2 and the open-weight OpenAI gpt-oss-120b. Of the three on the shortlist, only the solution on DeepL Next Gen has a conclusive Intento LQA result, with 83.1 weighted errors per 1,000 words. None of the three meet formatting.

How we measure it: 12-01 · 12-02 · 12-09

Tone of voice and gender-neutral English to Yiddish translation

Tone of voice
Formal register, with איר
Gender-neutrality strategy
neutral rephrasing and plurals
Options in the language
masculine default, paired forms, neutral rephrasing
Default gender
None where the source leaves the gender open
The two best solutionsSolutionSentences about people that are gender-neutralMeets every Advanced requirementCost per million charactersSeconds per 1,000 words
Anthropic Claude Fable 5three-step, with the gender-neutrality agent99.1%✗$1,116440
OpenAI GPT-5.5three-step, with the gender-neutrality agent100%✗$1,122473
Analysis

For Yiddish we check the formal register, with איר, and gender-neutral wording through neutral rephrasing and plurals, never a default gender. The other options in Yiddish are a masculine default, paired forms and neutral rephrasing alone. Translations from Translated Lara 2 and Google Cloud Advanced Translation API have 76.6% and 93.62% of the sentences in the formal register, and translations from every other shortlisted model 100%.

How we measure it: 02-05 · 02-06 · 08-11 · 09-18

How confident are we in measuring English to Yiddish translation quality?

Confidence

Over the 12 shortlisted solutions in Yiddish, the median share of sentences on which the three LQA judges agree is 90.7%. They agree most on the translations from Anthropic Claude Fable 5, on 94.9% of the sentences, and least on those from OpenAI GPT-5.6 Luna, on 79.1%.

How we measure it: 00-07 · 07-05 · 09-02

Automate translation to meet your requirements

See Intento Language Hub in action.

Book a demo
Leave feedback