Topic
Evaluations
Benchmarks and evals — measuring models against real workloads.
1 post
How much bitrate does an audio-multimodal LLM actually need?
An eval across 12 audio-capable models on OpenRouter, 5 MP3 bitrates, 4 dictation samples. The default upload quality in most dictation apps is 2–4× overprovisioned — and the more interesting finding had nothing to do with bitrate.
audio llm transcription
+6