Spoken Language Understanding Leaderboard

Models SLURP SPEECHMASSIVE
slot_type_f1 slot_value_cer intent_accuracy_mean intent_accuracy_standard_error slot_type_f1 slot_value_cer intent_accuracy_mean intent_accuracy_standard_error
SpeechLMM_v1.0_L base 0.000 1.000 0.781 0.008 0.000 1.000 0.857 0.006
SpeechLMM_v1.0_L_SLU 0.000 1.000 0.746 0.008 0.000 1.000 0.817 0.007