Official websites use .gov
A
.gov website belongs to an official government
organization in the United States.
Secure .gov websites use HTTPS
A
lock (
) or https:// means you’ve safely connected to
the .gov website. Share sensitive information only on official,
secure websites.
News
Registration for OpenCCU is now open!
The Third DIHARD Speech Diarization Challenge
DIHARD III has officially concluded. Final leaderboards and system descriptions are available at here.
Leaderboard
DIHARDIII_Task1_CORE
Updated: 2021-02-11 19:21:50 -0500
| RANKING | TEAM NAME | SUBMISSION ID | DER | JER | SUBMISSION DATE |
|---|---|---|---|---|---|
| 1 | Team_0054 | 830 | 13.450 | 34.940 | 2020-12-31_06:51:04-05:00 |
| 2 | Team_00115 | 815 | 14.090 | 38.250 | 2020-12-31_06:01:48-05:00 |
| 3 | Clova | 811 | 15.400 | 43.070 | 2020-12-31_04:01:12-05:00 |
| 4 | Team_0050 | 816 | 15.430 | 37.270 | 2020-12-31_05:27:00-05:00 |
| 5 | Team_0055 | 793 | 15.460 | 38.490 | 2020-12-30_19:57:11-05:00 |
| 6 | Team_0051 | 392 | 16.070 | 37.220 | 2020-12-12_15:57:02-05:00 |
| 7 | Team_007 | 639 | 16.440 | 37.400 | 2020-12-25_02:51:40-05:00 |
| 8 | RoyalFlush | 702 | 17.590 | 42.500 | 2020-12-27_20:10:39-05:00 |
| 9 | Team_0080 | 770 | 18.070 | 42.820 | 2020-12-30_05:51:31-05:00 |
| 10 | Team_0052 | 311 | 18.250 | 43.110 | 2020-11-20_01:17:14-05:00 |
| 11 | Team_00106 | 400 | 18.400 | 46.310 | 2020-12-13_23:28:29-05:00 |
| 12 | Team_0060 | 743 | 18.660 | 42.230 | 2020-12-28_17:06:23-05:00 |
| 13 | dh_SAIL_USC | 761 | 19.760 | 43.030 | 2020-12-30_00:03:05-05:00 |
| 14 | dh_DiaboLIIc | 478 | 20.610 | 48.380 | 2020-12-18_13:02:35-05:00 |
| 15 | DIHARD | 635 | 20.650 | 47.740 | 2020-12-24_17:29:22-05:00 |
| 16 | Team_0094 | 396 | 21.770 | 38.460 | 2020-12-13_21:58:01-05:00 |
| 17 | Team_00123 | 558 | 22.070 | 48.390 | 2020-12-21_09:30:03-05:00 |
| 18 | Team_0067 | 541 | 22.950 | 54.260 | 2020-12-20_21:22:10-05:00 |
| 19 | Team_0014 | 610 | 23.330 | 42.090 | 2020-12-23_09:43:39-05:00 |
| 20 | Team_0096 | 603 | 26.300 | 44.500 | 2020-12-27_00:12:25-05:00 |
| 21 | Team_0093 | 772 | 33.060 | 67.670 | 2020-12-30_09:33:10-05:00 |
| 22 | Team_0074 | 476 | 43.080 | 53.190 | 2020-12-18_12:25:21-05:00 |
| 23 | Team_0056 | 427 | 49.410 | 64.760 | 2020-12-16_04:55:30-05:00 |
DIHARDIII_Task1_FULL
Updated: 2021-02-11 19:22:06 -0500
| RANKING | TEAM NAME | SUBMISSION ID | DER | JER | SUBMISSION DATE |
|---|---|---|---|---|---|
| 1 | Team_0054 | 830 | 11.300 | 29.940 | 2020-12-31_06:51:04-05:00 |
| 2 | Team_00115 | 815 | 11.580 | 32.370 | 2020-12-31_06:01:48-05:00 |
| 3 | Team_0055 | 793 | 13.290 | 33.350 | 2020-12-30_19:57:11-05:00 |
| 4 | Team_0050 | 816 | 13.390 | 32.140 | 2020-12-31_05:27:00-05:00 |
| 5 | Clova | 811 | 13.950 | 37.430 | 2020-12-31_04:01:12-05:00 |
| 6 | Team_0051 | 392 | 14.060 | 32.050 | 2020-12-12_15:57:02-05:00 |
| 7 | Team_0080 | 770 | 14.880 | 36.730 | 2020-12-30_05:51:31-05:00 |
| 8 | Team_00106 | 400 | 15.120 | 39.320 | 2020-12-13_23:28:29-05:00 |
| 9 | Team_007 | 639 | 15.500 | 33.350 | 2020-12-25_02:51:40-05:00 |
| 10 | RoyalFlush | 702 | 15.590 | 37.400 | 2020-12-27_20:10:39-05:00 |
| 11 | Team_0060 | 743 | 17.200 | 37.730 | 2020-12-28_17:06:23-05:00 |
| 12 | Team_0052 | 311 | 17.260 | 38.610 | 2020-11-20_01:17:14-05:00 |
| 13 | dh_SAIL_USC | 761 | 18.190 | 38.330 | 2020-12-30_00:03:05-05:00 |
| 14 | dh_DiaboLIIc | 478 | 18.890 | 42.980 | 2020-12-18_13:02:35-05:00 |
| 15 | DIHARD | 635 | 19.250 | 42.450 | 2020-12-24_17:29:22-05:00 |
| 16 | Team_00123 | 558 | 19.870 | 42.320 | 2020-12-21_09:30:03-05:00 |
| 17 | Team_0094 | 396 | 20.160 | 34.790 | 2020-12-13_21:58:01-05:00 |
| 18 | Team_0067 | 541 | 20.890 | 48.350 | 2020-12-20_21:22:10-05:00 |
| 19 | Team_0014 | 610 | 23.420 | 38.760 | 2020-12-23_09:43:39-05:00 |
| 20 | Team_0096 | 603 | 23.470 | 39.780 | 2020-12-27_00:12:25-05:00 |
| 21 | Team_0093 | 772 | 31.690 | 63.610 | 2020-12-30_09:33:10-05:00 |
| 22 | Team_0056 | 427 | 44.690 | 59.560 | 2020-12-16_04:55:30-05:00 |
| 23 | Team_0074 | 476 | 45.550 | 52.240 | 2020-12-18_12:25:21-05:00 |
DIHARDIII_Task2_CORE
Updated: 2021-02-11 19:21:18 -0500
| RANKING | TEAM NAME | SUBMISSION ID | DER | JER | SUBMISSION DATE |
|---|---|---|---|---|---|
| 1 | Team_0054 | 828 | 19.370 | 39.220 | 2020-12-31_06:44:10-05:00 |
| 2 | Team_00115 | 799 | 20.010 | 41.780 | 2020-12-31_06:01:35-05:00 |
| 3 | Team_0050 | 784 | 21.630 | 41.800 | 2020-12-30_17:45:38-05:00 |
| 4 | Team_0051 | 545 | 22.650 | 43.040 | 2020-12-20_22:34:26-05:00 |
| 5 | dh_DiaboLIIc | 755 | 22.960 | 47.170 | 2020-12-29_21:13:41-05:00 |
| 6 | Team_00106 | 398 | 23.860 | 48.850 | 2020-12-13_22:49:56-05:00 |
| 7 | Clova | 822 | 24.310 | 49.220 | 2020-12-31_06:06:41-05:00 |
| 8 | Team_0055 | 785 | 24.620 | 44.490 | 2020-12-30_18:24:41-05:00 |
| 9 | Team_0080 | 769 | 24.990 | 45.130 | 2020-12-30_05:50:39-05:00 |
| 10 | DIHARD | 343 | 27.340 | 51.910 | 2020-12-03_15:22:09-05:00 |
| 11 | Team_0014 | 612 | 28.100 | 53.730 | 2020-12-23_14:40:38-05:00 |
| 12 | Team_0067 | 388 | 28.570 | 56.250 | 2020-12-10_06:05:15-05:00 |
| 13 | Team_0074 | 477 | 43.080 | 53.190 | 2020-12-18_12:25:43-05:00 |
| 14 | Team_0096 | 706 | 45.080 | 61.050 | 2020-12-27_21:40:51-05:00 |
DIHARDIII_Task2_FULL
Updated: 2021-02-11 19:21:36 -0500
| RANKING | TEAM NAME | SUBMISSION ID | DER | JER | SUBMISSION DATE |
|---|---|---|---|---|---|
| 1 | Team_0054 | 828 | 16.780 | 34.420 | 2020-12-31_06:44:10-05:00 |
| 2 | Team_00115 | 799 | 16.940 | 36.310 | 2020-12-31_06:01:35-05:00 |
| 3 | Team_0050 | 784 | 18.900 | 36.690 | 2020-12-30_17:45:38-05:00 |
| 4 | Team_00106 | 398 | 20.050 | 42.060 | 2020-12-13_22:49:56-05:00 |
| 5 | Team_0051 | 545 | 20.060 | 37.950 | 2020-12-20_22:34:26-05:00 |
| 6 | Team_0055 | 785 | 21.090 | 39.280 | 2020-12-30_18:24:41-05:00 |
| 7 | Team_0080 | 769 | 21.090 | 39.540 | 2020-12-30_05:50:39-05:00 |
| 8 | dh_DiaboLIIc | 755 | 21.180 | 42.580 | 2020-12-29_21:13:41-05:00 |
| 9 | Clova | 822 | 21.860 | 43.780 | 2020-12-31_06:06:41-05:00 |
| 10 | DIHARD | 343 | 25.360 | 46.950 | 2020-12-03_15:22:09-05:00 |
| 11 | Team_0014 | 612 | 25.870 | 49.030 | 2020-12-23_14:40:38-05:00 |
| 12 | Team_0067 | 388 | 26.910 | 51.090 | 2020-12-10_06:05:15-05:00 |
| 13 | Team_0096 | 706 | 39.580 | 55.080 | 2020-12-27_21:40:51-05:00 |
| 14 | Team_0074 | 477 | 45.550 | 52.240 | 2020-12-18_12:25:43-05:00 |
Contact Us
For more information about DIHARD III, please join the mailing list or contact the organizers via email at dihardchallenge@gmail.com.
DIHARD III has officially concluded. Final leaderboards and system descriptions are available at here.
Overview
For the first time OpenSAT will be partnering with Linguistic Data Consortium (LDC) in hosting the Third DIHARD Speech Diarization Challenge (DIHARD III). All DIHARD III evaluation activities (registration, results submission, scoring, and leaderboard display) will be conducted through web-interfaces hosted by OpenSAT.
Challenge
For additional information about DIHARD III, including registration, schedule, data, tasks, and scoring, please consult the official DIHARD III website.
Workshop
The results of the challenge will be presented at a dedicated post-evaluation workshop, to be held on January 23rd, 2021. All participants are invited to submit 2 page extended abstracts describing their submissions and results on the DIHARD III development and evaluation sets. Due to continued COVID-19 related disruption, this workshop will be entirely virtual. For additional details, please see the workshop website.
2020 Tentative Schedule
Milestone
2020
30MAR
Registration opens and Development and training data released
1MAY
Evaluation data released
30JUN
Last date to upload system output from evaluation data to NIST server
TBDAUG
NIST workshop
Registration Instructions
To register for the challenge, please follow the instructions at: https://dihardchallenge.github.io/dihard3/registration
To submit system results, please follow the instructions at: https://dihardchallenge.github.io/dihard3/submission
Tools are available on this page: https://dihardchallenge.github.io/dihard3/software
FAQ