Machine translation: ACL6060 Leaderboard
| Models | Average | |||||
|---|---|---|---|---|---|---|
| bleu | chrf | ter | comet | characTER | bleurt | |
| MK test | 50.000 | 50.000 | 0.000 | 0.472 | N/A | 0.490 |
| SpeechLMM_v1.0_L_MT | 22.790 | 53.445 | 71.095 | 0.713 | 0.474 | 0.554 |
| SpeechLMM_v1.0_L base | 34.170 | 62.195 | 53.395 | 0.791 | 0.388 | 0.664 |
| Models | en → fr | |||||
|---|---|---|---|---|---|---|
| bleu | chrf | ter | comet | characTER | bleurt | |
| MK test | 100.000 | 100.000 | 0.000 | 0.944 | N/A | 0.979 |
| SpeechLMM_v1.0_L_MT | 24.860 | 56.230 | 71.830 | 0.717 | 0.448 | 0.516 |
| SpeechLMM_v1.0_L base | 35.520 | 63.740 | 52.600 | 0.790 | 0.374 | 0.642 |
| Models | en → de | |||||
|---|---|---|---|---|---|---|
| bleu | chrf | ter | comet | characTER | bleurt | |
| MK test | N/A | N/A | N/A | N/A | N/A | N/A |
| SpeechLMM_v1.0_L_MT | 20.720 | 50.660 | 70.360 | 0.708 | 0.501 | 0.592 |
| SpeechLMM_v1.0_L base | 32.820 | 60.650 | 54.190 | 0.792 | 0.402 | 0.686 |