The Third DIHARD Speech Diarization Challenge


DIHARD III has officially concluded. Final leaderboards and system descriptions are available at here.


Leaderboard

DIHARDIII_Task1_CORE

Updated: 2021-02-11 19:21:50 -0500
RANKING TEAM NAME SUBMISSION ID DER JER SUBMISSION DATE
1 Team_0054 830 13.450 34.940 2020-12-31_06:51:04-05:00
2 Team_00115 815 14.090 38.250 2020-12-31_06:01:48-05:00
3 Clova 811 15.400 43.070 2020-12-31_04:01:12-05:00
4 Team_0050 816 15.430 37.270 2020-12-31_05:27:00-05:00
5 Team_0055 793 15.460 38.490 2020-12-30_19:57:11-05:00
6 Team_0051 392 16.070 37.220 2020-12-12_15:57:02-05:00
7 Team_007 639 16.440 37.400 2020-12-25_02:51:40-05:00
8 RoyalFlush 702 17.590 42.500 2020-12-27_20:10:39-05:00
9 Team_0080 770 18.070 42.820 2020-12-30_05:51:31-05:00
10 Team_0052 311 18.250 43.110 2020-11-20_01:17:14-05:00
11 Team_00106 400 18.400 46.310 2020-12-13_23:28:29-05:00
12 Team_0060 743 18.660 42.230 2020-12-28_17:06:23-05:00
13 dh_SAIL_USC 761 19.760 43.030 2020-12-30_00:03:05-05:00
14 dh_DiaboLIIc 478 20.610 48.380 2020-12-18_13:02:35-05:00
15 DIHARD 635 20.650 47.740 2020-12-24_17:29:22-05:00
16 Team_0094 396 21.770 38.460 2020-12-13_21:58:01-05:00
17 Team_00123 558 22.070 48.390 2020-12-21_09:30:03-05:00
18 Team_0067 541 22.950 54.260 2020-12-20_21:22:10-05:00
19 Team_0014 610 23.330 42.090 2020-12-23_09:43:39-05:00
20 Team_0096 603 26.300 44.500 2020-12-27_00:12:25-05:00
21 Team_0093 772 33.060 67.670 2020-12-30_09:33:10-05:00
22 Team_0074 476 43.080 53.190 2020-12-18_12:25:21-05:00
23 Team_0056 427 49.410 64.760 2020-12-16_04:55:30-05:00

DIHARDIII_Task1_FULL

Updated: 2021-02-11 19:22:06 -0500
RANKING TEAM NAME SUBMISSION ID DER JER SUBMISSION DATE
1 Team_0054 830 11.300 29.940 2020-12-31_06:51:04-05:00
2 Team_00115 815 11.580 32.370 2020-12-31_06:01:48-05:00
3 Team_0055 793 13.290 33.350 2020-12-30_19:57:11-05:00
4 Team_0050 816 13.390 32.140 2020-12-31_05:27:00-05:00
5 Clova 811 13.950 37.430 2020-12-31_04:01:12-05:00
6 Team_0051 392 14.060 32.050 2020-12-12_15:57:02-05:00
7 Team_0080 770 14.880 36.730 2020-12-30_05:51:31-05:00
8 Team_00106 400 15.120 39.320 2020-12-13_23:28:29-05:00
9 Team_007 639 15.500 33.350 2020-12-25_02:51:40-05:00
10 RoyalFlush 702 15.590 37.400 2020-12-27_20:10:39-05:00
11 Team_0060 743 17.200 37.730 2020-12-28_17:06:23-05:00
12 Team_0052 311 17.260 38.610 2020-11-20_01:17:14-05:00
13 dh_SAIL_USC 761 18.190 38.330 2020-12-30_00:03:05-05:00
14 dh_DiaboLIIc 478 18.890 42.980 2020-12-18_13:02:35-05:00
15 DIHARD 635 19.250 42.450 2020-12-24_17:29:22-05:00
16 Team_00123 558 19.870 42.320 2020-12-21_09:30:03-05:00
17 Team_0094 396 20.160 34.790 2020-12-13_21:58:01-05:00
18 Team_0067 541 20.890 48.350 2020-12-20_21:22:10-05:00
19 Team_0014 610 23.420 38.760 2020-12-23_09:43:39-05:00
20 Team_0096 603 23.470 39.780 2020-12-27_00:12:25-05:00
21 Team_0093 772 31.690 63.610 2020-12-30_09:33:10-05:00
22 Team_0056 427 44.690 59.560 2020-12-16_04:55:30-05:00
23 Team_0074 476 45.550 52.240 2020-12-18_12:25:21-05:00

DIHARDIII_Task2_CORE

Updated: 2021-02-11 19:21:18 -0500
RANKING TEAM NAME SUBMISSION ID DER JER SUBMISSION DATE
1 Team_0054 828 19.370 39.220 2020-12-31_06:44:10-05:00
2 Team_00115 799 20.010 41.780 2020-12-31_06:01:35-05:00
3 Team_0050 784 21.630 41.800 2020-12-30_17:45:38-05:00
4 Team_0051 545 22.650 43.040 2020-12-20_22:34:26-05:00
5 dh_DiaboLIIc 755 22.960 47.170 2020-12-29_21:13:41-05:00
6 Team_00106 398 23.860 48.850 2020-12-13_22:49:56-05:00
7 Clova 822 24.310 49.220 2020-12-31_06:06:41-05:00
8 Team_0055 785 24.620 44.490 2020-12-30_18:24:41-05:00
9 Team_0080 769 24.990 45.130 2020-12-30_05:50:39-05:00
10 DIHARD 343 27.340 51.910 2020-12-03_15:22:09-05:00
11 Team_0014 612 28.100 53.730 2020-12-23_14:40:38-05:00
12 Team_0067 388 28.570 56.250 2020-12-10_06:05:15-05:00
13 Team_0074 477 43.080 53.190 2020-12-18_12:25:43-05:00
14 Team_0096 706 45.080 61.050 2020-12-27_21:40:51-05:00

DIHARDIII_Task2_FULL

Updated: 2021-02-11 19:21:36 -0500
RANKING TEAM NAME SUBMISSION ID DER JER SUBMISSION DATE
1 Team_0054 828 16.780 34.420 2020-12-31_06:44:10-05:00
2 Team_00115 799 16.940 36.310 2020-12-31_06:01:35-05:00
3 Team_0050 784 18.900 36.690 2020-12-30_17:45:38-05:00
4 Team_00106 398 20.050 42.060 2020-12-13_22:49:56-05:00
5 Team_0051 545 20.060 37.950 2020-12-20_22:34:26-05:00
6 Team_0055 785 21.090 39.280 2020-12-30_18:24:41-05:00
7 Team_0080 769 21.090 39.540 2020-12-30_05:50:39-05:00
8 dh_DiaboLIIc 755 21.180 42.580 2020-12-29_21:13:41-05:00
9 Clova 822 21.860 43.780 2020-12-31_06:06:41-05:00
10 DIHARD 343 25.360 46.950 2020-12-03_15:22:09-05:00
11 Team_0014 612 25.870 49.030 2020-12-23_14:40:38-05:00
12 Team_0067 388 26.910 51.090 2020-12-10_06:05:15-05:00
13 Team_0096 706 39.580 55.080 2020-12-27_21:40:51-05:00
14 Team_0074 477 45.550 52.240 2020-12-18_12:25:43-05:00
Contact Us

For more information about DIHARD III, please join the mailing list or contact the organizers via email at dihardchallenge@gmail.com.

DIHARD III has officially concluded. Final leaderboards and system descriptions are available at here.


Overview
For the first time OpenSAT will be partnering with Linguistic Data Consortium (LDC) in hosting the Third DIHARD Speech Diarization Challenge (DIHARD III). All DIHARD III evaluation activities (registration, results submission, scoring, and leaderboard display) will be conducted through web-interfaces hosted by OpenSAT.

Challenge
For additional information about DIHARD III, including registration, schedule, data, tasks, and scoring, please consult the official DIHARD III website.

Workshop

The results of the challenge will be presented at a dedicated post-evaluation workshop, to be held on January 23rd, 2021. All participants are invited to submit 2 page extended abstracts describing their submissions and results on the DIHARD III development and evaluation sets. Due to continued COVID-19 related disruption, this workshop will be entirely virtual. For additional details, please see the workshop website.

2020 Tentative Schedule

Milestone
2020
30MAR
Registration opens and Development and training data released
1MAY
Evaluation data released
30JUN
Last date to upload system output from evaluation data to NIST server
TBDAUG
NIST workshop


Registration Instructions
To register for the challenge, please follow the instructions at: https://dihardchallenge.github.io/dihard3/registration
To submit system results, please follow the instructions at: https://dihardchallenge.github.io/dihard3/submission
Tools are available on this page: https://dihardchallenge.github.io/dihard3/software
FAQ


Questions? Email questions to dihardchallenge@gmail.com.