Machine translation: ACL6060 Leaderboard
| Models | Average | |||||
|---|---|---|---|---|---|---|
| bleu | chrf | ter | comet | characTER | bleurt | |
| SpeechLMM_v1.0_L_MT | 22.790 | 53.445 | 71.095 | 0.713 | 0.474 | 0.554 |
| SpeechLMM_v1.0_L base 🏆 | 34.170 | 62.195 🏆 | 53.395 | 0.791 🏆 | 0.388 🏆 | 0.664 🏆 |
| MK test | 50.000 🏆 | 50.000 | 0.000 🏆 | 0.472 | N/A | 0.490 |
| Models | en → fr | |||||
|---|---|---|---|---|---|---|
| bleu | chrf | ter | comet | characTER | bleurt | |
| SpeechLMM_v1.0_L_MT | 24.860 | 56.230 | 71.830 | 0.717 | 0.448 | 0.516 |
| SpeechLMM_v1.0_L base | 35.520 | 63.740 | 52.600 | 0.790 | 0.374 🏆 | 0.642 |
| MK test 🏆 | 100.000 🏆 | 100.000 🏆 | 0.000 🏆 | 0.944 🏆 | N/A | 0.979 🏆 |
| Models | en → de | |||||
|---|---|---|---|---|---|---|
| bleu | chrf | ter | comet | characTER | bleurt | |
| SpeechLMM_v1.0_L_MT | 20.720 | 50.660 | 70.360 | 0.708 | 0.501 | 0.592 |
| SpeechLMM_v1.0_L base 🏆 | 32.820 🏆 | 60.650 🏆 | 54.190 🏆 | 0.792 🏆 | 0.402 🏆 | 0.686 🏆 |