Offline Leaderboard

Reset
Models IWSLT25INSTRUCT
comet ter chrf bleu bleurt characTER
NAIST_IWSLT25_Offline_en-de_constrained_primary 0.355 33.565 26.085 11.415 0.275 0.277
CUNI-NL_IWSLT25_Offline_en-de_constrained_contrastive 0.365 31.330 27.500 12.355 0.293 0.252
CUNI-NL_IWSLT25_Offline_en-de_constrained_contrastive 0.377 30.285 28.125 13.405 0.308 0.248
NAIST_IWSLT25_Offline_en-de_unconstrained_primary 0.383 29.490 29.245 14.300 0.315 0.224
CUNI-NL_IWSLT25_Offline_en-de_constrained_primary 0.386 28.550 29.695 14.950 0.319 0.226
AIB_IWSLT25_Offline_en-de_unconstrained_primary 0.402 28.025 30.480 15.010 0.344 0.209
NAIST_IWSLT25_Offline_en-zh_constrained_primary 0.355 49.920 13.280 15.480 0.243 0.362
AIB_IWSLT25_Offline_en-zh_unconstrained_contrastive2 0.396 49.890 14.580 15.485 0.307 0.310
AIB_IWSLT25_Offline_en-de_unconstrained_contrastive2 0.411 25.695 32.300 17.330 0.354 0.186
AIB_IWSLT25_Offline_en-de_unconstrained_contrastive1 0.409 26.085 32.450 17.910 0.351 0.185
NYA_IWSLT25_Offline_en-de_unconstrained_contrastive2 0.417 24.890 32.895 18.605 0.362 0.178
NYA_IWSLT25_Offline_en-de_unconstrained_contrastive4 0.410 24.705 32.950 18.885 0.356 0.179
KIT_IWSLT25_Offline_en-de_unconstrained_contrastive2 0.419 24.610 33.420 19.145 0.366 0.174
NYA_IWSLT25_Offline_en-de_unconstrained_contrastive3 0.420 24.465 33.185 19.210 0.365 0.174
NYA_IWSLT25_Offline_en-de_unconstrained_primary 0.420 24.465 33.185 19.210 0.365 0.174
NYA_IWSLT25_Offline_en-de_unconstrained_contrastive1 0.417 24.400 33.275 19.310 0.362 0.176
KIT_IWSLT25_Offline_en-de_unconstrained_contrastive1 0.417 24.375 33.540 19.415 0.363 0.173
NAIST_IWSLT25_Offline_en-zh_unconstrained_primary 0.386 49.835 16.690 20.075 0.295 0.300
KIT_IWSLT25_Offline_en-de_unconstrained_primary 0.421 23.520 33.995 20.445 0.368 0.168
AIB_IWSLT25_Offline_en-zh_unconstrained_contrastive1 0.407 49.590 22.410 25.520 0.328 0.248
NYA_IWSLT25_Offline_en-zh_unconstrained_contrastive2 0.426 49.485 23.745 27.375 0.351 0.220
NYA_IWSLT25_Offline_en-zh_unconstrained_contrastive1 0.425 49.210 23.510 27.530 0.351 0.218
NYA_IWSLT25_Offline_en-zh_unconstrained_contrastive4 0.419 49.185 23.680 27.835 0.349 0.214
AIB_IWSLT25_Offline_en-zh_unconstrained_primary 0.428 49.345 24.530 27.840 0.360 0.214
Bigwatermelon_IWSLT25_Offline_en-zh_unconstrained_CONTRASTIVE 0.422 49.375 24.620 28.050 0.352 0.219
Bigwatermelon_IWSLT25_Offline_en-zh_unconstrained_PRIMARY 0.422 49.565 24.730 28.085 0.352 0.218
NYA_IWSLT25_Offline_en-zh_unconstrained_contrastive3 0.430 49.400 24.530 28.360 0.357 0.209
NYA_IWSLT25_Offline_en-zh_unconstrained_primary 0.430 49.400 24.530 28.360 0.357 0.209
NeMo_IWSLT25_Offline_en-de-zh-ar_unconstrained_primary 0.836 73.995 53.470 42.355 0.708 0.418
Models TVSERIES
comet ter chrf bleu bleurt characTER
NAIST_IWSLT25_Offline_en-de_constrained_primary 0.491 97.460 25.390 6.880 0.249 0.786
CUNI-NL_IWSLT25_Offline_en-de_constrained_contrastive 0.527 86.010 27.870 8.980 0.297 0.795
CUNI-NL_IWSLT25_Offline_en-de_constrained_contrastive 0.546 83.340 29.720 10.750 0.317 0.780
NAIST_IWSLT25_Offline_en-de_unconstrained_primary 0.513 93.820 25.660 8.180 0.287 0.787
CUNI-NL_IWSLT25_Offline_en-de_constrained_primary 0.544 83.330 29.730 10.620 0.318 0.778
AIB_IWSLT25_Offline_en-de_unconstrained_primary 0.401 120.650 17.940 2.570 0.172 0.788
AIB_IWSLT25_Offline_en-de_unconstrained_contrastive2 0.662 79.510 40.170 16.530 0.487 0.603
AIB_IWSLT25_Offline_en-de_unconstrained_contrastive1 0.704 76.020 44.710 20.630 0.550 0.544
NYA_IWSLT25_Offline_en-de_unconstrained_contrastive2 0.703 78.870 42.630 18.700 0.552 0.563
NYA_IWSLT25_Offline_en-de_unconstrained_contrastive4 0.689 77.960 42.160 19.480 0.542 0.566
KIT_IWSLT25_Offline_en-de_unconstrained_contrastive2 0.713 79.150 42.330 18.280 0.565 0.560
NYA_IWSLT25_Offline_en-de_unconstrained_contrastive3 0.703 78.800 42.870 19.060 0.550 0.564
NYA_IWSLT25_Offline_en-de_unconstrained_primary 0.704 78.440 42.890 19.050 0.551 0.564
NYA_IWSLT25_Offline_en-de_unconstrained_contrastive1 0.701 76.750 42.870 19.930 0.551 0.560
KIT_IWSLT25_Offline_en-de_unconstrained_contrastive1 0.706 79.250 42.100 17.780 0.551 0.565
KIT_IWSLT25_Offline_en-de_unconstrained_primary 0.722 74.740 44.330 21.810 0.579 0.546
NeMo_IWSLT25_Offline_en-de-zh-ar_unconstrained_primary 0.695 75.790 42.210 19.780 0.546 0.571
Models CHALLENGEACCENT
comet ter chrf bleu bleurt characTER
NAIST_IWSLT25_Offline_en-de_constrained_primary 0.672 86.750 43.780 13.720 0.518 0.628
CUNI-NL_IWSLT25_Offline_en-de_constrained_contrastive 0.582 87.560 37.240 12.160 0.419 0.705
CUNI-NL_IWSLT25_Offline_en-de_constrained_contrastive 0.624 83.830 38.880 14.360 0.479 0.686
NAIST_IWSLT25_Offline_en-de_unconstrained_primary 0.695 81.190 46.840 16.670 0.551 0.598
CUNI-NL_IWSLT25_Offline_en-de_constrained_primary 0.628 80.520 40.590 15.290 0.473 0.676
AIB_IWSLT25_Offline_en-de_unconstrained_primary 0.688 79.680 50.190 19.440 0.533 0.569
AIB_IWSLT25_Offline_en-de_unconstrained_contrastive2 0.671 85.890 46.710 14.870 0.516 0.599
AIB_IWSLT25_Offline_en-de_unconstrained_contrastive1 0.680 79.550 51.040 20.050 0.527 0.563
NYA_IWSLT25_Offline_en-de_unconstrained_contrastive2 0.735 80.180 51.570 20.110 0.593 0.551
NYA_IWSLT25_Offline_en-de_unconstrained_contrastive4 0.705 76.590 51.620 21.110 0.569 0.544
KIT_IWSLT25_Offline_en-de_unconstrained_contrastive2 0.725 85.250 50.880 18.620 0.593 0.548
NYA_IWSLT25_Offline_en-de_unconstrained_contrastive3 0.741 78.200 52.030 20.750 0.594 0.545
NYA_IWSLT25_Offline_en-de_unconstrained_primary 0.742 78.260 52.040 20.710 0.595 0.543
NYA_IWSLT25_Offline_en-de_unconstrained_contrastive1 0.735 76.470 51.600 20.770 0.590 0.546
KIT_IWSLT25_Offline_en-de_unconstrained_contrastive1 0.725 84.990 50.930 18.590 0.596 0.548
KIT_IWSLT25_Offline_en-de_unconstrained_primary 0.733 76.160 52.280 21.820 0.603 0.540
NeMo_IWSLT25_Offline_en-de-zh-ar_unconstrained_primary 0.712 92.510 51.020 18.390 0.579 0.549