Audio Understanding Bitrate Eval 0426

Audio Understanding — MP3 Bitrate Evaluation (April 2026) Empirical eval measuring how MP3 compression bitrate affects transcription accuracy across every audio-input LLM available on OpenRouter. 📝 Blog post: MP3 Bitrate Sensitivity in Audio-Multimodal LLMs 💻 Code & methodology: github.com/danielrosehill/Audio-Understanding-Bitrate-Eval-0426 TL;DR Ran a benchmark across 12 OpenRouter audio-multimodal models × 4 dictation samples × 5 MP3 bitrates (16/24/32/48/64 kbps)… See the full description on the dataset page: https://huggingface.co/datasets/danielrosehill/Audio-Understanding-Bitrate-Eval-0426.