Machine translation: FLORES Leaderboard
Models | bleu | chrf | ter | bleurt | comet | characTER | en → fr | en → it | en → de | en → es | ||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
bleu | chrf | ter | bleurt | comet | characTER | bleu | chrf | ter | bleurt | comet | characTER | bleu | chrf | ter | bleurt | comet | characTER | bleu | chrf | ter | bleurt | comet | characTER | |||||||
SpeechLMM_v1.0_L_MT | 17.330 | 48.460 | 80.880 | 0.529 | 0.710 | 0.569 | 21.750 | 53.660 | 78.600 | 0.479 | 0.706 | 0.492 | 11.580 | 43.540 | 95.100 | 0.502 | 0.685 | 0.639 | 19.970 | 50.770 | 69.810 | 0.582 | 0.721 | 0.539 | 16.020 | 45.870 | 80.010 | 0.552 | 0.727 | 0.605 |
SpeechLMM_v1.0_L base | 25.943 | 55.470 | 63.808 | 0.661 | 0.814 | 0.495 | 31.920 | 61.380 | 59.960 | 0.636 | 0.811 | 0.409 | 20.130 | 51.090 | 72.260 | 0.652 | 0.810 | 0.568 | 29.420 | 58.100 | 58.150 | 0.697 | 0.824 | 0.450 | 22.300 | 51.310 | 64.860 | 0.660 | 0.811 | 0.553 |