Summarization: AUTOMIN Leaderboard

Models Average
R-1_F1 R-1_precision R-1_recall R-2_F1 R-2_precision R-2_recall R-L_F1 R-L_precision R-L_recall
SpeechLMM_v1.0_L base 28.300 48.700 🏆 22.400 2.900 4.900 2.400 25.900 44.800 🏆 20.400
SpeechLMM_v1.0_L_TSUM 🏆 31.400 🏆 47.400 26.500 🏆 4.600 🏆 7.100 🏆 3.900 🏆 29.400 🏆 44.300 24.800 🏆
Models en → en
R-1_F1 R-1_precision R-1_recall R-2_F1 R-2_precision R-2_recall R-L_F1 R-L_precision R-L_recall
SpeechLMM_v1.0_L base 28.300 48.700 🏆 22.400 2.900 4.900 2.400 25.900 44.800 🏆 20.400
SpeechLMM_v1.0_L_TSUM 🏆 31.400 🏆 47.400 26.500 🏆 4.600 🏆 7.100 🏆 3.900 🏆 29.400 🏆 44.300 24.800 🏆