benchmarks

Oct 15, 2026

Can speech-to-text spell ‘makolet’? I tested seven models on Hebrish

English speakers in Israel talk Hebrish, and dictation software mangles the Hebrew words. I built an open benchmark to measure it: my fine-tune gets two-thirds of them right, off-the-shelf models a third to under half.