Offline: IWSLT25INSTRUCT Leaderboard

Models Average
ter comet chrf bleu characTER bleurt
KIT_IWSLT25_Offline_en-de_unconstrained_primary 23.520 0.421 33.995 20.445 0.168 0.368
KIT_IWSLT25_Offline_en-de_unconstrained_contrastive1 24.375 0.417 33.540 19.415 0.173 0.363
NYA_IWSLT25_Offline_en-de_unconstrained_contrastive1 24.400 0.417 33.275 19.310 0.176 0.362
NYA_IWSLT25_Offline_en-de_unconstrained_contrastive3 24.465 0.420 33.185 19.210 0.174 0.365
NYA_IWSLT25_Offline_en-de_unconstrained_primary 24.465 0.420 33.185 19.210 0.174 0.365
KIT_IWSLT25_Offline_en-de_unconstrained_contrastive2 24.610 0.419 33.420 19.145 0.174 0.366
NYA_IWSLT25_Offline_en-de_unconstrained_contrastive4 24.705 0.410 32.950 18.885 0.179 0.356
NYA_IWSLT25_Offline_en-de_unconstrained_contrastive2 24.890 0.417 32.895 18.605 0.178 0.362
AIB_IWSLT25_Offline_en-de_unconstrained_contrastive2 25.695 0.411 32.300 17.330 0.186 0.354
AIB_IWSLT25_Offline_en-de_unconstrained_contrastive1 26.085 0.409 32.450 17.910 0.185 0.351
AIB_IWSLT25_Offline_en-de_unconstrained_primary 28.025 0.402 30.480 15.010 0.209 0.344
CUNI-NL_IWSLT25_Offline_en-de_constrained_primary 28.550 0.386 29.695 14.950 0.226 0.319
NAIST_IWSLT25_Offline_en-de_unconstrained_primary 29.490 0.383 29.245 14.300 0.224 0.315
CUNI-NL_IWSLT25_Offline_en-de_constrained_contrastive 30.285 0.377 28.125 13.405 0.248 0.308
CUNI-NL_IWSLT25_Offline_en-de_constrained_contrastive 31.330 0.365 27.500 12.355 0.252 0.293
NAIST_IWSLT25_Offline_en-de_constrained_primary 33.565 0.355 26.085 11.415 0.277 0.275
NYA_IWSLT25_Offline_en-zh_unconstrained_contrastive4 49.185 0.419 23.680 27.835 0.214 0.349
NYA_IWSLT25_Offline_en-zh_unconstrained_contrastive1 49.210 0.425 23.510 27.530 0.218 0.351
AIB_IWSLT25_Offline_en-zh_unconstrained_primary 49.345 0.428 24.530 27.840 0.214 0.360
Bigwatermelon_IWSLT25_Offline_en-zh_unconstrained_CONTRASTIVE 49.375 0.422 24.620 28.050 0.219 0.352
NYA_IWSLT25_Offline_en-zh_unconstrained_contrastive3 49.400 0.430 24.530 28.360 0.209 0.357
NYA_IWSLT25_Offline_en-zh_unconstrained_primary 49.400 0.430 24.530 28.360 0.209 0.357
NYA_IWSLT25_Offline_en-zh_unconstrained_contrastive2 49.485 0.426 23.745 27.375 0.220 0.351
Bigwatermelon_IWSLT25_Offline_en-zh_unconstrained_PRIMARY 49.565 0.422 24.730 28.085 0.218 0.352
AIB_IWSLT25_Offline_en-zh_unconstrained_contrastive1 49.590 0.407 22.410 25.520 0.248 0.328
NAIST_IWSLT25_Offline_en-zh_unconstrained_primary 49.835 0.386 16.690 20.075 0.300 0.295
AIB_IWSLT25_Offline_en-zh_unconstrained_contrastive2 49.890 0.396 14.580 15.485 0.310 0.307
NAIST_IWSLT25_Offline_en-zh_constrained_primary 49.920 0.355 13.280 15.480 0.362 0.243
NeMo_IWSLT25_Offline_en-de-zh-ar_unconstrained_primary 73.995 0.836 53.470 42.355 0.418 0.708
Models en → de
ter comet chrf bleu characTER bleurt
KIT_IWSLT25_Offline_en-de_unconstrained_primary 47.040 0.842 67.990 40.890 0.337 0.735
KIT_IWSLT25_Offline_en-de_unconstrained_contrastive1 48.750 0.835 67.080 38.830 0.347 0.725
NYA_IWSLT25_Offline_en-de_unconstrained_contrastive1 48.800 0.835 66.550 38.620 0.353 0.723
NYA_IWSLT25_Offline_en-de_unconstrained_contrastive3 48.930 0.840 66.370 38.420 0.348 0.730
NYA_IWSLT25_Offline_en-de_unconstrained_primary 48.930 0.840 66.370 38.420 0.348 0.730
KIT_IWSLT25_Offline_en-de_unconstrained_contrastive2 49.220 0.838 66.840 38.290 0.347 0.733
NYA_IWSLT25_Offline_en-de_unconstrained_contrastive4 49.410 0.820 65.900 37.770 0.357 0.711
NYA_IWSLT25_Offline_en-de_unconstrained_contrastive2 49.780 0.834 65.790 37.210 0.356 0.725
AIB_IWSLT25_Offline_en-de_unconstrained_contrastive2 51.390 0.822 64.600 34.660 0.372 0.709
AIB_IWSLT25_Offline_en-de_unconstrained_contrastive1 52.170 0.817 64.900 35.820 0.370 0.702
AIB_IWSLT25_Offline_en-de_unconstrained_primary 56.050 0.804 60.960 30.020 0.418 0.688
CUNI-NL_IWSLT25_Offline_en-de_constrained_primary 57.100 0.772 59.390 29.900 0.453 0.638
NAIST_IWSLT25_Offline_en-de_unconstrained_primary 58.980 0.766 58.490 28.600 0.448 0.630
CUNI-NL_IWSLT25_Offline_en-de_constrained_contrastive 60.570 0.754 56.250 26.810 0.496 0.616
CUNI-NL_IWSLT25_Offline_en-de_constrained_contrastive 62.660 0.730 55.000 24.710 0.504 0.586
NAIST_IWSLT25_Offline_en-de_constrained_primary 67.130 0.710 52.170 22.830 0.554 0.550
NeMo_IWSLT25_Offline_en-de-zh-ar_unconstrained_primary 48.970 0.828 66.320 38.380 0.355 0.718
Models en → zh
ter comet chrf bleu characTER bleurt
NYA_IWSLT25_Offline_en-zh_unconstrained_contrastive4 98.370 0.837 47.360 55.670 0.429 0.697
NYA_IWSLT25_Offline_en-zh_unconstrained_contrastive1 98.420 0.850 47.020 55.060 0.435 0.702
AIB_IWSLT25_Offline_en-zh_unconstrained_primary 98.690 0.856 49.060 55.680 0.427 0.719
Bigwatermelon_IWSLT25_Offline_en-zh_unconstrained_CONTRASTIVE 98.750 0.845 49.240 56.100 0.438 0.703
NYA_IWSLT25_Offline_en-zh_unconstrained_contrastive3 98.800 0.860 49.060 56.720 0.418 0.713
NYA_IWSLT25_Offline_en-zh_unconstrained_primary 98.800 0.860 49.060 56.720 0.418 0.713
NYA_IWSLT25_Offline_en-zh_unconstrained_contrastive2 98.970 0.851 47.490 54.750 0.440 0.702
Bigwatermelon_IWSLT25_Offline_en-zh_unconstrained_PRIMARY 99.130 0.845 49.460 56.170 0.436 0.703
AIB_IWSLT25_Offline_en-zh_unconstrained_contrastive1 99.180 0.814 44.820 51.040 0.495 0.655
NAIST_IWSLT25_Offline_en-zh_unconstrained_primary 99.670 0.771 33.380 40.150 0.600 0.590
AIB_IWSLT25_Offline_en-zh_unconstrained_contrastive2 99.780 0.793 29.160 30.970 0.620 0.615
NAIST_IWSLT25_Offline_en-zh_constrained_primary 99.840 0.711 26.560 30.960 0.724 0.487
NeMo_IWSLT25_Offline_en-de-zh-ar_unconstrained_primary 99.020 0.844 40.620 46.330 0.481 0.699