Challenge winners


Entity Resolution - Domain Knowledge

Result Team name Istitution Participant names Monitor F-Measure Notebook F-Measure Final F-Measure
Winner JNU_Cyber Jinan University, Guangzhou Haizhou Ye
Jianhui Huang
Jiawei Wang
0,922 0,299 0,610
Runner up SimSkipReloaded University of Magdeburg Gabriel Campero Durand
Vinayak Kumar
Shivalika Suman
Anshu Daur
Prafulla Diwesh
Chinmaya Hegde
Disha Setlur
David Broneske
Gunter Saake
0,921 0,000 0,460

Schema Matching - Domain Knowledge

Result Team name Istitution Participant names Monitor F-Measure Notebook F-Measure Final F-Measure
Winner SimSkipReloaded University of Magdeburg Gabriel Campero Durand
Altaf Mohammed Aftab
Sajad Karim
Syed Md Ismail
David Broneske
Gunter Saake
0,316 0,000 0,158

Schema Matching - Supervised Machine Learning

Result Team name Istitution Participant names Monitor F-Measure Notebook F-Measure Final F-Measure
Winner SimSkipReloaded University of Magdeburg Gabriel Campero Durand
Altaf Mohammed Aftab
Sajad Karim
Syed Md Ismail
David Broneske
Gunter Saake
0,254 0,223 0,238

Challenge leaderboard


The leaderboard is updated twice a week. Teams are ranked by the F-measure of their last submission before the leaderboard last update time.

In addition to the last submission F-measure, we also show the best F-measure achieved in the leaderboard by each team since the contest beginning.

Suppose that you submit three consecutive files A, B and C and the leaderboard is updated twice, once after B and once after C. Note that only B and C are evaluated, and thus we will report C as the last submission and the best between B anc C as the best submission.

If your last subissioon does not correspond to your best submission, you can resubmit the best submission in order to recover your best F-measure for the ranking. To this end, please refer to the "best submitted" timestamp.

Finally, together with the last F-measure, we also report the corresponding precision, recall and submission timestamp.

Last leaderboard update: 07/08/2020 16.05

Round One: MONITOR

Entity Resolution

Supervised Machine Learning
Rank Team Best F-Measure Best Submitted Last Precision Last Recall Last F-Measure Last Submitted
#1 JNU_Cyber 0.613 2020-05-13 12:44:54 0.448 0.97 0.613 2020-05-13 12:44:54

Supervised Machine Learning + Domain Knowledge
Rank Team Best F-Measure Best Submitted Last Precision Last Recall Last F-Measure Last Submitted
#1 JNU_Cyber 0.935 2020-06-30 17:47:36 0.915 0.956 0.935 2020-06-30 17:47:36
#2 SimSkipReloaded 0.525 2020-06-30 08:13:22 0.408 0.736 0.525 2020-06-30 08:13:22
#3 * ww14 0.928 2020-05-30 16:25:26 0.860 0.965 0.909 2020-06-05 12:08:21
#4 * nine 0.935 2020-06-02 04:21:40 0.859 0.933 0.895 2020-06-10 09:43:20
#5 * LackingData 0.934 2020-06-06 05:58:24 0.000 0.000 0.000 2020-06-30 17:49:08

* anonymous teams are not elegible for winning.


Domain Knowledge
Rank Team Best F-Measure Best Submitted Last Precision Last Recall Last F-Measure Last Submitted
#1 SimSkipReloaded 0.945 2020-07-06 11:08:13 0.971 0.920 0.945 2020-07-06 11:08:13
#2 JNU_Cyber 0.940 2020-07-06 14:01:30 0.912 0.932 0.922 2020-07-08 13:58:41
#3 * ww14 0.940 2020-07-02 17:57:54 0.915 0.967 0.940 2020-07-02 17:57:54
#4 * LackingData 0.925 2020-07-02 16:43:05 0.955 0.897 0.925 2020-07-02 16:43:05
* anonymous teams are not elegible for winning.


Schema Matching

Supervised Machine Learning
Rank Team Best F-Measure Best Submitted Last Precision Last Recall Last F-Measure Last Submitted
#1 SimSkipReloaded 0.347 2020-06-30 22:47:28 0.371 0.293 0.328 2020-07-07 19:43:55

Supervised Machine Learning + Domain Knowledge
Rank Team Best F-Measure Best Submitted Last Precision Last Recall Last F-Measure Last Submitted
#1 SimSkipReloaded 0.415 2020-07-01 01:01:39 0.482 0.364 0.415 2020-07-01 01:01:39

Domain Knowledge
Rank Team Best F-Measure Best Submitted Last Precision Last Recall Last F-Measure Last Submitted
#1 SimSkipReloaded 0.316 2020-07-08 12:23:27 0.238 0.473 0.316 2020-07-08 12:23:27





Round Two: NOTEBOOK

Entity Resolution

Supervised Machine Learning + Domain Knowledge
Rank Team Best F-Measure Best Submitted Last Precision Last Recall Last F-Measure Last Submitted
#1 JNU_Cyber 0.080 2020-07-01 17:52:11 0.351 0.045 0.080 2020-07-01 17:52:11
#2 * nine 0.399 2020-07-01 16:19:17 0.676 0.283 0.399 2020-07-01 16:19:17

* anonymous teams are not elegible for winning.


Domain Knowledge
Rank Team Best F-Measure Best Submitted Last Precision Last Recall Last F-Measure Last Submitted
#1 JNU_Cyber 0.474 2020-07-06 07:25:37 0.323 0.278 0.299 2020-07-07 17:19:17
#2 * nine 0.443 2020-07-04 10:30:21 0.294 0.892 0.443 2020-07-04 10:30:21
#3 * ww14 0.325 2020-07-06 11:09:29 0.350 0.304 0.325 2020-07-06 11:09:29

* anonymous teams are not elegible for winning.


Schema Matching

Supervised Machine Learning
Rank Team Best F-Measure Best Submitted Last Precision Last Recall Last F-Measure Last Submitted
#1 SimSkipReloaded 0.28 2020-07-08 05:32:53 0.4 0.216 0.28 2020-07-08 05:32:53