Machine translation: ACL6060 Leaderboard

Models Average
bleu chrf ter comet characTER bleurt
MK test 50.000 50.000 0.000 0.472 N/A 0.490
SpeechLMM_v1.0_L base 34.170 62.195 53.395 0.791 0.388 0.664
SpeechLMM_v1.0_L_MT 22.790 53.445 71.095 0.713 0.474 0.554
Models en → fr
bleu chrf ter comet characTER bleurt
MK test 100.000 100.000 0.000 0.944 N/A 0.979
SpeechLMM_v1.0_L base 35.520 63.740 52.600 0.790 0.374 0.642
SpeechLMM_v1.0_L_MT 24.860 56.230 71.830 0.717 0.448 0.516
Models en → de
bleu chrf ter comet characTER bleurt
MK test N/A N/A N/A N/A N/A N/A
SpeechLMM_v1.0_L base 32.820 60.650 54.190 0.792 0.402 0.686
SpeechLMM_v1.0_L_MT 20.720 50.660 70.360 0.708 0.501 0.592