Spoken Language Understanding Leaderboard

Models SLURP SPEECHMASSIVE
intent_accuracy_mean slot_type_f1 slot_value_cer intent_accuracy_standard_error intent_accuracy_mean slot_type_f1 slot_value_cer intent_accuracy_standard_error
SpeechLMM_v1.0_L_SLU 0.746 0.000 1.000 0.008 0.817 0.000 1.000 0.007
SpeechLMM_v1.0_L base 0.781 0.000 1.000 0.008 0.857 0.000 1.000 0.006