Instruction-Following Short Leaderboard
| Models | IWSLT25INSTRUCT | |||
|---|---|---|---|---|
| SSUM-BERTScore | ST-COMET | ASR-WER | SQA-BERTScore | |
| NLE_IWSLT25_IF_SHORT_en-en_constrained_primary | N/A | N/A | 0.032 | 0.126 |
| CUNI-NL_IWSLT25_IF_SHORT_en-de_constrained_primary | N/A | 0.179 | 0.039 | 0.106 |
| NLE_IWSLT25_IF_SHORT_en-it_constrained_primary | N/A | 0.188 | N/A | 0.106 |
| NLE_IWSLT25_IF_SHORT_en-de_constrained_primary | N/A | 0.178 | N/A | 0.095 |
| CUNI-NL_IWSLT25_IF_SHORT_en-de_constrained_contrastive | N/A | 0.173 | 0.061 | 0.091 |
| NLE_IWSLT25_IF_SHORT_en-zh_constrained_primary | N/A | 0.191 | N/A | 0.088 |
| IST_IWSLT25_IF_SHORT_en-de_unconstrained_primary | N/A | 0.086 | N/A | 0.055 |
| CUNI-NL_IWSLT25_IF_SHORT_en-de_constrained_contrastive | N/A | N/A | 0.038 | 0.054 |
| IST_IWSLT25_IF_SHORT_en-zh_unconstrained_primary | N/A | 0.086 | N/A | 0.053 |
| MEETWEEN_IWSLT25_IF_SHORT_EN-EN_UNCONSTRAINED_PRIMARY | N/A | N/A | 0.046 | 0.043 |
| IST_IWSLT25_IF_SHORT_en-en_unconstrained_primary | N/A | N/A | 0.037 | 0.036 |