Where the model breaks in your language
16 minWhat you do
Run your anchor task in English, then in Swahili, Sheng, Pidgin, Yoruba or Amharic, and score both. Benchmarks put the drop at about 19 points for the strongest models and up to 37 for open ones, with only around 2% of African languages supported at all. Then learn the mitigations: translate-work-translate, a term glossary, and knowing when to simply stay in English.
You walk away holding
A measured view of what your language costs you

