Spoken Language Understanding: SPEECHMASSIVE Leaderboard

Models Average
intent_accuracy_standard_error slot_value_cer slot_type_f1 intent_accuracy_mean
SpeechLMM_v1.0_L_SLU 0.007 1.000 0.000 0.817
SpeechLMM_v1.0_L base 0.006 1.000 0.000 0.857
Models fr → fr
intent_accuracy_standard_error slot_value_cer slot_type_f1 intent_accuracy_mean
SpeechLMM_v1.0_L_SLU 0.007 1.000 0.000 0.821
SpeechLMM_v1.0_L base 0.006 1.000 0.000 0.867
Models de → de
intent_accuracy_standard_error slot_value_cer slot_type_f1 intent_accuracy_mean
SpeechLMM_v1.0_L_SLU 0.007 1.000 0.000 0.813
SpeechLMM_v1.0_L base 0.007 1.000 0.000 0.847