Ranking and plot based on the Scribendi score.

Scribendi scores

Czech

NatWebInf

Rank Team GLEU Precision Recall F0.5 Scribendi
1 UAM-CSI 70.04 71.05 64.28 69.58 0.79
2 baseline 51.59 28.32 34.97 29.44 0.25
3 Rum-Cull 40.47 3.92 1.29 2.78 0.18

Romani

Rank Team GLEU Precision Recall F0.5 Scribendi
1 UAM-CSI 60.23 59.23 50.18 57.17 0.91
2 baseline 48.55 33.4 33.82 33.48 0.57
3 Rum-Cull 26.49 6.92 1.34 3.78 0.24

SecLearn

Rank Team GLEU Precision Recall F0.5 Scribendi
1 UAM-CSI 55.16 62.21 46.5 58.27 0.99
2 baseline 47.7 45.08 36.54 43.07 0.92
3 Rum-Cull 21.92 11.17 2.77 6.96 0.34

NatForm

Rank Team GLEU Precision Recall F0.5 Scribendi
1 UAM-CSI 81.07 68.71 46.82 62.83 0.95
2 baseline 76.63 35.45 33.39 35.02 0.82
3 Rum-Cull 67.18 1.82 1.16 1.63 -0.46

Average

Rank Team GLEU Precision Recall F0.5 Scribendi
1 UAM-CSI 66.63 65.3 51.95 61.96 0.91
2 baseline 56.12 35.56 34.68 35.25 0.64
3 Rum-Cull 39.02 5.96 1.64 3.79 0.07

English

Write & Improve 2024

Rank Team GLEU Precision Recall F0.5 Scribendi
1 UAM-CSI 80.67 62.57 48.67 59.19 0.98
2 baseline 65.86 24.55 40.85 26.68 0.89
3 Rum-Cull 60.2 9.63 3.8 7.37 0.34

Estonian

EIC

Rank Team GLEU Precision Recall F0.5 Scribendi
1 UAM-CSI 57.89 56.79 38.6 51.9 1.0
2 baseline 39.14 31.88 15.6 26.38 0.77
3 Rum-Cull 29.06 6.83 2.06 4.66 -0.04

EKIL2

Rank Team GLEU Precision Recall F0.5 Scribendi
1 UAM-CSI 68.23 56.66 42.86 53.23 1.0
2 baseline 50.64 30.57 20.42 27.8 0.81
3 Rum-Cull 42.82 7.47 2.16 5.0 0.4

Average

Rank Team GLEU Precision Recall F0.5 Scribendi
1 UAM-CSI 63.06 56.72 40.73 52.56 1.0
2 baseline 44.89 31.23 18.01 27.09 0.79
3 Rum-Cull 35.94 7.15 2.11 4.83 0.18

German

Merlin

Rank Team GLEU Precision Recall F0.5 Scribendi
1 UAM-CSI 81.23 67.42 66.28 67.19 0.96
2 baseline 60.67 44.32 50.6 45.45 0.75
3 Rum-Cull 39.25 12.18 4.34 8.95 0.44

Greek

GLCII

Rank Team GLEU Precision Recall F0.5 Scribendi
1 baseline 48.27 44.76 35.1 42.43 0.92
2 UAM-CSI 55.96 53.62 44.12 51.4 0.9
3 Rum-Cull 24.92 12.53 1.95 6.0 0.54

Icelandic

IceEC

Rank Team GLEU Precision Recall F0.5 Scribendi
1 UAM-CSI 85.09 61.76 9.03 28.48 0.72
2 baseline 76.16 10.44 8.88 10.08 0.33
3 Rum-Cull 81.18 0.85 0.43 0.71 0.22

IceL2EC

Rank Team GLEU Precision Recall F0.5 Scribendi
1 UAM-CSI 43.62 41.18 4.13 14.73 0.74
2 baseline 40.08 17.86 5.01 11.81 0.37
3 Rum-Cull 39.77 2.77 0.39 1.25 -0.26

Average

Rank Team GLEU Precision Recall F0.5 Scribendi
1 UAM-CSI 64.36 51.47 6.58 21.61 0.73
2 baseline 58.12 14.15 6.95 10.95 0.35
3 Rum-Cull 60.47 1.81 0.41 0.98 -0.02

Italian

Merlin

Rank Team GLEU Precision Recall F0.5 Scribendi
1 UAM-CSI 79.97 67.45 56.67 64.98 1.0
2 baseline 59.03 32.06 39.89 33.37 0.83
3 Rum-Cull 50.04 11.13 4.5 8.6 0.23

Latvian

LaVA

Rank Team GLEU Precision Recall F0.5 Scribendi
1 UAM-CSI 84.65 79.76 78.54 79.51 1.0
2 baseline 50.92 45.57 38.92 44.07 0.94
3 Rum-Cull 23.18 10.23 2.72 6.59 0.29

Russian

RULEC-GEC

Rank Team GLEU Precision Recall F0.5 Scribendi
1 UAM-CSI 82.65 62.3 30.94 51.8 0.43
2 baseline 73.63 24.02 37.37 25.87 0.41
3 Rum-Cull 73.23 6.34 3.22 5.31 0.41

Slovene

Solar-Eval

Rank Team GLEU Precision Recall F0.5 Scribendi
1 UAM-CSI 66.32 54.14 29.77 46.52 1.0
2 baseline 59.42 30.84 20.58 28.04 1.0
3 Rum-Cull 49.52 3.64 0.93 2.3 0.41

Swedish

SweLL_gold

Rank Team GLEU Precision Recall F0.5 Scribendi
1 UAM-CSI 69.62 55.29 46.69 53.32 1.0
2 baseline 58.41 36.62 34.0 36.06 0.84
3 Rum-Cull 38.28 14.02 3.6 8.88 0.56

Ukrainian

UA-GEC

Rank Team GLEU Precision Recall F0.5 Scribendi
1 UAM-CSI 79.82 74.65 55.02 69.68 0.8
2 baseline 65.56 19.41 18.45 19.21 0.7
3 Rum-Cull 65.38 3.15 1.18 2.36 0.62