Machine translation: FLORES Leaderboard
| Models | Average | |||||
|---|---|---|---|---|---|---|
| bleu | chrf | ter | comet | characTER | bleurt | |
| SpeechLMM_v1.0_L base | 25.943 | 55.470 | 63.808 | 0.814 | 0.495 | 0.661 |
| SpeechLMM_v1.0_L_MT | 17.330 | 48.460 | 80.880 | 0.710 | 0.569 | 0.529 |
| Models | en → fr | |||||
|---|---|---|---|---|---|---|
| bleu | chrf | ter | comet | characTER | bleurt | |
| SpeechLMM_v1.0_L base | 31.920 | 61.380 | 59.960 | 0.811 | 0.409 | 0.636 |
| SpeechLMM_v1.0_L_MT | 21.750 | 53.660 | 78.600 | 0.706 | 0.492 | 0.479 |
| Models | en → it | |||||
|---|---|---|---|---|---|---|
| bleu | chrf | ter | comet | characTER | bleurt | |
| SpeechLMM_v1.0_L base | 20.130 | 51.090 | 72.260 | 0.810 | 0.568 | 0.652 |
| SpeechLMM_v1.0_L_MT | 11.580 | 43.540 | 95.100 | 0.685 | 0.639 | 0.502 |
| Models | en → de | |||||
|---|---|---|---|---|---|---|
| bleu | chrf | ter | comet | characTER | bleurt | |
| SpeechLMM_v1.0_L base | 29.420 | 58.100 | 58.150 | 0.824 | 0.450 | 0.697 |
| SpeechLMM_v1.0_L_MT | 19.970 | 50.770 | 69.810 | 0.721 | 0.539 | 0.582 |
| Models | en → es | |||||
|---|---|---|---|---|---|---|
| bleu | chrf | ter | comet | characTER | bleurt | |
| SpeechLMM_v1.0_L base | 22.300 | 51.310 | 64.860 | 0.811 | 0.553 | 0.660 |
| SpeechLMM_v1.0_L_MT | 16.020 | 45.870 | 80.010 | 0.727 | 0.605 | 0.552 |