Machine translation: FLORES Leaderboard

Models Average
bleu chrf ter comet characTER bleurt
SpeechLMM_v1.0_L base 25.943 55.470 63.808 0.814 0.495 0.661
SpeechLMM_v1.0_L_MT 17.330 48.460 80.880 0.710 0.569 0.529
Models en → fr
bleu chrf ter comet characTER bleurt
SpeechLMM_v1.0_L base 31.920 61.380 59.960 0.811 0.409 0.636
SpeechLMM_v1.0_L_MT 21.750 53.660 78.600 0.706 0.492 0.479
Models en → it
bleu chrf ter comet characTER bleurt
SpeechLMM_v1.0_L base 20.130 51.090 72.260 0.810 0.568 0.652
SpeechLMM_v1.0_L_MT 11.580 43.540 95.100 0.685 0.639 0.502
Models en → de
bleu chrf ter comet characTER bleurt
SpeechLMM_v1.0_L base 29.420 58.100 58.150 0.824 0.450 0.697
SpeechLMM_v1.0_L_MT 19.970 50.770 69.810 0.721 0.539 0.582
Models en → es
bleu chrf ter comet characTER bleurt
SpeechLMM_v1.0_L base 22.300 51.310 64.860 0.811 0.553 0.660
SpeechLMM_v1.0_L_MT 16.020 45.870 80.010 0.727 0.605 0.552