Summarization Leaderboard
| Models | ICSI | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| R-1_F1 | R-1_precision | R-1_recall | R-2_F1 | R-2_precision | R-2_recall | R-L_F1 | R-L_precision | R-L_recall | |
| SpeechLMM_v1.0_L base | 26.200 | 49.000 | 20.000 | 3.200 | 6.700 | 2.400 | 23.300 | 43.000 | 17.900 |
| SpeechLMM_v1.0_L_TSUM 🏆 | 32.100 🏆 | 51.700 🏆 | 26.500 🏆 | 4.500 🏆 | 7.800 🏆 | 3.500 🏆 | 29.500 🏆 | 47.700 🏆 | 24.200 🏆 |
| Models | AUTOMIN | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| R-1_F1 | R-1_precision | R-1_recall | R-2_F1 | R-2_precision | R-2_recall | R-L_F1 | R-L_precision | R-L_recall | |
| SpeechLMM_v1.0_L base | 28.300 | 48.700 🏆 | 22.400 | 2.900 | 4.900 | 2.400 | 25.900 | 44.800 🏆 | 20.400 |
| SpeechLMM_v1.0_L_TSUM 🏆 | 31.400 🏆 | 47.400 | 26.500 🏆 | 4.600 🏆 | 7.100 🏆 | 3.900 🏆 | 29.400 🏆 | 44.300 | 24.800 🏆 |