NTCIR Dialogue Evaluation Task

Last updated: December 2, 2021.
Twitter: @ntcirdialeval


We have released the test data to the participants!
The DialEval-2 task details page has been released!
The NTCIR-16 DialEval-2 task definition (unchanged from previous rounds) is here!
The Dialogue Evaluation (DialEval-2) Task has been accepted by the
NTCIR-16 Programme Committee! (January 16, 2021)

Task Details

Details of the DialEval-2 task, including the information about training data, can be found here.

Important Dates (Timezone: Japan (UTC+9))

April 2021 Task registrations open: training data given to participants
April-May 2021 Annotating the test dialogues
December 1 2021 Test dialogues released/Task registrations due
January 15 2022 Run submissions due
February 1, 2022 Evaluation results released
February 1, 2022 Draft task overview paper released
March 1, 2022 Draft participant paper submissions due
May 1, 2022 All camera-ready paper submissions due
June 14-17, 2022 NTCIR-16 Conference in NII, Tokyo, Japan



Tetsuya Sakai (Waseda University, Japan)
Sijie Tao (Waseda University)
Inho Kang (Naver Corporation)


Past Rounds

NTCIR-15 Dialogue Evaluation (DialEval-1) Task
NTCIR-15 Short Text Conversation (STC-3) Task