Machine translation: FLORES Leaderboard
| Models | Average | |||||
|---|---|---|---|---|---|---|
| bleu | chrf | ter | comet | characTER | bleurt | |
| SpeechLMM_v1.0_L base 🏆 | 25.943 🏆 | 55.470 🏆 | 63.808 🏆 | 0.814 🏆 | 0.495 🏆 | 0.661 🏆 |
| SpeechLMM_v1.0_L_MT | 17.330 | 48.460 | 80.880 | 0.710 | 0.569 | 0.529 |
| Models | en → fr | |||||
|---|---|---|---|---|---|---|
| bleu | chrf | ter | comet | characTER | bleurt | |
| SpeechLMM_v1.0_L base 🏆 | 31.920 🏆 | 61.380 🏆 | 59.960 🏆 | 0.811 🏆 | 0.409 🏆 | 0.636 🏆 |
| SpeechLMM_v1.0_L_MT | 21.750 | 53.660 | 78.600 | 0.706 | 0.492 | 0.479 |
| Models | en → it | |||||
|---|---|---|---|---|---|---|
| bleu | chrf | ter | comet | characTER | bleurt | |
| SpeechLMM_v1.0_L base 🏆 | 20.130 🏆 | 51.090 🏆 | 72.260 🏆 | 0.810 🏆 | 0.568 🏆 | 0.652 🏆 |
| SpeechLMM_v1.0_L_MT | 11.580 | 43.540 | 95.100 | 0.685 | 0.639 | 0.502 |
| Models | en → de | |||||
|---|---|---|---|---|---|---|
| bleu | chrf | ter | comet | characTER | bleurt | |
| SpeechLMM_v1.0_L base 🏆 | 29.420 🏆 | 58.100 🏆 | 58.150 🏆 | 0.824 🏆 | 0.450 🏆 | 0.697 🏆 |
| SpeechLMM_v1.0_L_MT | 19.970 | 50.770 | 69.810 | 0.721 | 0.539 | 0.582 |
| Models | en → es | |||||
|---|---|---|---|---|---|---|
| bleu | chrf | ter | comet | characTER | bleurt | |
| SpeechLMM_v1.0_L base 🏆 | 22.300 🏆 | 51.310 🏆 | 64.860 🏆 | 0.811 🏆 | 0.553 🏆 | 0.660 🏆 |
| SpeechLMM_v1.0_L_MT | 16.020 | 45.870 | 80.010 | 0.727 | 0.605 | 0.552 |