Instruction-Following Short Leaderboard

Reset
Models IWSLT25INSTRUCT
SQA-BERTScore ASR-WER ST-COMET SSUM-BERTScore
NLE_IWSLT25_IF_SHORT_en-en_constrained_primary 🏆 0.126 🏆 0.032 🏆 N/A N/A
CUNI-NL_IWSLT25_IF_SHORT_en-de_constrained_primary 0.106 0.039 0.179 N/A
NLE_IWSLT25_IF_SHORT_en-it_constrained_primary 0.106 N/A 0.188 N/A
NLE_IWSLT25_IF_SHORT_en-de_constrained_primary 0.095 N/A 0.178 N/A
CUNI-NL_IWSLT25_IF_SHORT_en-de_constrained_contrastive 0.091 0.061 0.173 N/A
NLE_IWSLT25_IF_SHORT_en-zh_constrained_primary 0.088 N/A 0.191 🏆 N/A
IST_IWSLT25_IF_SHORT_en-de_unconstrained_primary 0.055 N/A 0.086 N/A
CUNI-NL_IWSLT25_IF_SHORT_en-de_constrained_contrastive 0.054 0.038 N/A N/A
IST_IWSLT25_IF_SHORT_en-zh_unconstrained_primary 0.053 N/A 0.086 N/A
MEETWEEN_IWSLT25_IF_SHORT_EN-EN_UNCONSTRAINED_PRIMARY 0.043 0.046 N/A N/A
IST_IWSLT25_IF_SHORT_en-en_unconstrained_primary 0.036 0.037 N/A N/A