Model Compression Leaderboard

Reset
Models ACL6060
comet
APG_IWSLT26_ModelCompression_en-zh_constrained_primary 0.339
TalTech_IWSLT26_ModelCompression_en-de_constrained_primary 0.319
KIT_IWSLT26_ModelCompression_en-de_unconstrained_contrastive1 0.756
KIT_IWSLT26_ModelCompression_en-de_unconstrained_contrastive2 0.767
Qwen2-Audio 4-bit 0.593
Models CHALLENGEACCENT
comet
TalTech_IWSLT26_ModelCompression_en-de_constrained_primary 0.668
KIT_IWSLT26_ModelCompression_en-de_unconstrained_contrastive1 0.364
KIT_IWSLT26_ModelCompression_en-de_unconstrained_contrastive2 0.363
Qwen2-Audio 4-bit 0.491
Models YOUTUBE
comet
TalTech_IWSLT26_ModelCompression_en-de_constrained_primary 0.150
KIT_IWSLT26_ModelCompression_en-de_unconstrained_contrastive1 0.519
KIT_IWSLT26_ModelCompression_en-de_unconstrained_contrastive2 0.504
Qwen2-Audio 4-bit 0.408
Models BUSINESSNEWS
comet
TalTech_IWSLT26_ModelCompression_en-de_constrained_primary 0.122
KIT_IWSLT26_ModelCompression_en-de_unconstrained_contrastive1 0.616
KIT_IWSLT26_ModelCompression_en-de_unconstrained_contrastive2 0.630
Qwen2-Audio 4-bit 0.405
Models CALLCENTER
comet
TalTech_IWSLT26_ModelCompression_en-de_constrained_primary 0.155
KIT_IWSLT26_ModelCompression_en-de_unconstrained_contrastive1 0.627
KIT_IWSLT26_ModelCompression_en-de_unconstrained_contrastive2 0.617
Qwen2-Audio 4-bit 0.462
Models TVSERIES
comet
TalTech_IWSLT26_ModelCompression_en-de_constrained_primary 0.169
KIT_IWSLT26_ModelCompression_en-de_unconstrained_contrastive1 0.490
KIT_IWSLT26_ModelCompression_en-de_unconstrained_contrastive2 0.474
Qwen2-Audio 4-bit 0.414