Machine translation Leaderboard
| Models | FLORES | |||||
|---|---|---|---|---|---|---|
| bleu | chrf | ter | comet | bleurt | characTER | |
| SpeechLMM_v1.0_L base 🏆 | 25.943 🏆 | 55.470 🏆 | 63.808 🏆 | 0.814 🏆 | 0.661 🏆 | 0.495 🏆 |
| SpeechLMM_v1.0_L_MT | 17.330 | 48.460 | 80.880 | 0.710 | 0.529 | 0.569 |
| Models | ACL6060 | |||||
|---|---|---|---|---|---|---|
| bleu | chrf | ter | comet | bleurt | characTER | |
| SpeechLMM_v1.0_L base 🏆 | 34.170 | 62.195 🏆 | 53.395 | 0.791 🏆 | 0.664 🏆 | 0.388 🏆 |
| SpeechLMM_v1.0_L_MT | 22.790 | 53.445 | 71.095 | 0.713 | 0.554 | 0.474 |
| MK test | 50.000 🏆 | 50.000 | 0.000 🏆 | 0.472 | 0.490 | N/A |