Sumarization Leaderboard
| Models | ICSI | AUTOMIN | ||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| R-L_recall | R-L_precision | R-L_F1 | R-2_recall | R-2_precision | R-2_F1 | R-1_recall | R-1_precision | R-1_F1 | R-L_recall | R-L_precision | R-L_F1 | R-2_recall | R-2_precision | R-2_F1 | R-1_recall | R-1_precision | R-1_F1 | |
| SpeechLMM_v1.0_L_TSUM | 24.200 | 47.700 | 29.500 | 3.500 | 7.800 | 4.500 | 26.500 | 51.700 | 32.100 | 24.800 | 44.300 | 29.400 | 3.900 | 7.100 | 4.600 | 26.500 | 47.400 | 31.400 |
| SpeechLMM_v1.0_L base | 17.900 | 43.000 | 23.300 | 2.400 | 6.700 | 3.200 | 20.000 | 49.000 | 26.200 | 20.400 | 44.800 | 25.900 | 2.400 | 4.900 | 2.900 | 22.400 | 48.700 | 28.300 |