Model Compression Leaderboard

Models ACL6060
comet
APG_IWSLT26_ModelCompression_en-zh_constrained_primary 0.339
TalTech_IWSLT26_ModelCompression_en-de_constrained_primary 0.319
KIT_IWSLT26_ModelCompression_en-de_unconstrained_contrastive1 0.756
KIT_IWSLT26_ModelCompression_en-de_unconstrained_contrastive2 🏆 0.767 🏆
Qwen2-Audio 4-bit 0.593
Models CHALLENGEACCENT
comet
TalTech_IWSLT26_ModelCompression_en-de_constrained_primary 🏆 0.668 🏆
KIT_IWSLT26_ModelCompression_en-de_unconstrained_contrastive1 0.364
KIT_IWSLT26_ModelCompression_en-de_unconstrained_contrastive2 0.363
Qwen2-Audio 4-bit 0.491
Models YOUTUBE
comet
TalTech_IWSLT26_ModelCompression_en-de_constrained_primary 0.150
KIT_IWSLT26_ModelCompression_en-de_unconstrained_contrastive1 🏆 0.519 🏆
KIT_IWSLT26_ModelCompression_en-de_unconstrained_contrastive2 0.504
Qwen2-Audio 4-bit 0.408
Models BUSINESSNEWS
comet
TalTech_IWSLT26_ModelCompression_en-de_constrained_primary 0.122
KIT_IWSLT26_ModelCompression_en-de_unconstrained_contrastive1 0.616
KIT_IWSLT26_ModelCompression_en-de_unconstrained_contrastive2 🏆 0.630 🏆
Qwen2-Audio 4-bit 0.405
Models CALLCENTER
comet
TalTech_IWSLT26_ModelCompression_en-de_constrained_primary 0.155
KIT_IWSLT26_ModelCompression_en-de_unconstrained_contrastive1 🏆 0.627 🏆
KIT_IWSLT26_ModelCompression_en-de_unconstrained_contrastive2 0.617
Qwen2-Audio 4-bit 0.462
Models TVSERIES
comet
TalTech_IWSLT26_ModelCompression_en-de_constrained_primary 0.169
KIT_IWSLT26_ModelCompression_en-de_unconstrained_contrastive1 🏆 0.490 🏆
KIT_IWSLT26_ModelCompression_en-de_unconstrained_contrastive2 0.474
Qwen2-Audio 4-bit 0.414