Ranking based on the ERRANT-based F0.5 score

Czech

NatWebInf

Rank Team GLEU Precision Recall F0.5 Scribendi
1 UAM-CSI 75.64 67.25 62.7 66.29 0.76
2 Lattice 77.64 49.31 58.35 50.88 -0.55
3 baseline 60.9 33.85 33.75 33.83 0.44

Romani

Rank Team GLEU Precision Recall F0.5 Scribendi
1 UAM-CSI 64.71 56.88 51.64 55.75 0.92
2 Lattice 58.02 46.18 43.49 45.62 0.6
3 baseline 55.14 37.14 34.89 36.67 0.83

SecLearn

Rank Team GLEU Precision Recall F0.5 Scribendi
1 UAM-CSI 58.33 60.66 49.67 58.09 0.99
2 Lattice 52.63 48.79 41.49 47.13 0.94
3 baseline 46.35 46.76 34.94 43.79 0.97

NatForm

Rank Team GLEU Precision Recall F0.5 Scribendi
1 UAM-CSI 84.41 63.32 49.79 60.05 0.95
2 baseline 81.16 44.56 36.32 42.62 0.8
3 Lattice 79.52 40.58 36.14 39.61 -0.02

Average

Rank Team GLEU Precision Recall F0.5 Scribendi
1 UAM-CSI 70.77 62.03 53.45 60.05 0.91
2 Lattice 66.95 46.21 44.87 45.81 0.24
3 baseline 60.89 40.58 34.98 39.23 0.76

English

Write & Improve 2024

Rank Team GLEU Precision Recall F0.5 Scribendi
1 UAM-CSI 82.6 62.62 49.86 59.57 0.99
2 Lattice 79.44 54.35 40.2 50.78 0.36
3 baseline 76.43 39.25 42.24 39.82 0.98

Estonian

EIC

Rank Team GLEU Precision Recall F0.5 Scribendi
1 UAM-CSI 55.5 50.52 33.84 45.98 1.0
2 Lattice 49.54 32.36 27.51 31.26 0.31
3 baseline 36.01 32.08 10.8 23.01 0.92

EKIL2

Rank Team GLEU Precision Recall F0.5 Scribendi
1 UAM-CSI 66.89 52.45 37.08 48.43 0.98
2 Lattice 57.71 36.48 21.86 32.17 0.35
3 baseline 54.48 34.81 15.15 27.64 0.84

Average

Rank Team GLEU Precision Recall F0.5 Scribendi
1 UAM-CSI 61.19 51.48 35.46 47.2 0.99
2 Lattice 53.63 34.42 24.69 31.71 0.33
3 baseline 45.25 33.45 12.98 25.32 0.88

German

Merlin

Rank Team GLEU Precision Recall F0.5 Scribendi
1 UAM-CSI 80.31 67.23 63.76 66.51 0.94
2 baseline 69.16 51.89 50.55 51.61 0.9
3 Lattice 0.0 31.8 3.35 11.79 -0.92

Greek

GLCII

Rank Team GLEU Precision Recall F0.5 Scribendi
1 UAM-CSI 57.57 53.56 44.7 51.52 0.84
2 Lattice 54.68 48.47 40.17 46.55 0.74
3 baseline 47.68 49.83 33.17 45.29 0.9

Icelandic

IceEC

Rank Team GLEU Precision Recall F0.5 Scribendi
1 UAM-CSI 88.62 34.57 6.53 18.59 0.5
2 baseline 85.3 9.84 7.23 9.18 0.22
3 Lattice 0.88 0.0 0.0 0.0 -1.0

IceL2EC

Rank Team GLEU Precision Recall F0.5 Scribendi
1 baseline 45.05 26.78 6.18 16.06 0.16
2 UAM-CSI 48.19 22.87 3.99 11.75 0.89
3 Lattice 2.52 0.4 1.25 0.46 -0.89

Average

Rank Team GLEU Precision Recall F0.5 Scribendi
1 UAM-CSI 68.4 28.72 5.26 15.17 0.7
2 baseline 65.17 18.31 6.71 12.62 0.19
3 Lattice 1.7 0.2 0.62 0.23 -0.95

Italian

Merlin

Rank Team GLEU Precision Recall F0.5 Scribendi
1 UAM-CSI 80.27 68.3 60.9 66.68 0.98
2 Lattice 77.15 53.78 58.11 54.6 0.58
3 baseline 66.5 50.66 43.83 49.13 0.85

Latvian

LaVA

Rank Team GLEU Precision Recall F0.5 Scribendi
1 UAM-CSI 83.89 81.32 78.62 80.76 1.0
2 Lattice 69.09 61.73 61.33 61.65 0.94
3 baseline 47.3 48.44 38.14 45.96 0.98

Russian

RULEC-GEC

Rank Team GLEU Precision Recall F0.5 Scribendi
1 UAM-CSI 84.68 52.98 35.63 48.28 0.37
2 baseline 77.82 24.84 36.54 26.54 0.43
3 Lattice 79.35 21.03 36.86 23.01 -0.86

Slovene

Solar-Eval

Rank Team GLEU Precision Recall F0.5 Scribendi
1 UAM-CSI 67.22 57.4 32.89 49.95 1.0
2 baseline 59.55 37.2 18.86 31.14 1.0
3 Lattice 29.69 14.17 6.77 11.63 -0.12

Swedish

SweLL_gold

Rank Team GLEU Precision Recall F0.5 Scribendi
1 UAM-CSI 72.01 58.83 50.61 56.98 1.0
2 baseline 56.48 48.46 30.79 43.47 0.92
3 Lattice 59.95 45.02 35.33 42.68 0.88

Ukrainian

UA-GEC

Rank Team GLEU Precision Recall F0.5 Scribendi
1 UAM-CSI 77.62 70.34 49.31 64.81 0.9
2 Lattice 66.01 33.96 27.53 32.45 -0.33
3 baseline 67.29 25.15 16.61 22.81 0.64