Leaderboard
We open any submission for each category listed below. Please follow
this instruction 😊
POS and NER
| Method |
POS (Acc) |
NER-UGM (F1) |
NER-UI (F1) |
| IndoBERT (Koto et al., 2020) |
96.8 |
74.9 |
90.1 |
| MalayBERT |
96.8 |
73.2 |
87.4 |
| mBERT |
96.8 |
71.6 |
82.2 |
| BiLSTM (Lample et al., 2016) |
95.4 |
70.9 |
82.2 |
Dependency Parsing
| Method |
Indo-GSD |
Indo-PUD |
| UAS |
LAS |
UAS |
LAS |
| IndoBERT (Koto et al., 2020) |
87.1 |
82.3 |
89.2 |
83.9 |
| MalayBERT |
86.9 |
81.8 |
88.9 |
83.6 |
| mBERT |
86.9 |
81.8 |
90.6 |
85.4 |
| Kondratyuk and Straka (2019) |
86.5 |
80.1 |
77.5 |
56.9 |
Semantic
| Method |
Sentiment |
IndoSum |
Liputan6 (Sum) |
| F1 |
R1 |
R2 |
RL |
R1 |
R2 |
RL |
| IndoBERT (Koto et al., 2020) |
84.1 |
69.9 |
62.9 |
69.2 |
41.1 |
22.9 |
38.9 |
| MalayBERT |
82.0 |
68.4 |
61.4 |
67.7 |
-- |
-- |
-- |
| mBERT |
76.6 |
68.4 |
61.7 |
47.8 |
39.8 |
21.8 |
37.0 |
| BiLSTM |
71.6 |
67.9 |
61.7 |
67.2 |
36.1 |
19.2 |
33.6 |
Discourse Coherency
| Method |
NTP (Acc) |
Tweet Ordering (ρ) |
| IndoBERT (Koto et al., 2020) |
93.7 |
0.59 |
| MalayBERT |
93.1 |
0.51 |
| mBERT |
92.4 |
0.53 |
| BiLSTM |
73.6 |
0.45 |