---

Updates

Aug 22, 2025: Check out the R2C2 introduction slides for the NTCIR-19 Kickoff event (Sep 3): slides
Jul 25, 2025: Check out this one-minute introduction to the NTCIR-19 R2C2 (RAG Responses: Confidence and Correct?) Task! (video)

---

Important Dates AoE for participants and organisers (tentative)

Sep 3, 2025 Task registration begins/NTCIR-19 kickoff event
Oct 1, 2025 Dry run topics released
Nov 1, 2025 Dry run PR-runs due; directly shared to participants;
Dec 1, 2025 Dry run AC-runs due
Dec 10, 2025 BREV-RAG workshop at SIGIR-AP 2025
Feb 1, 2026 Dry run results released
Mar 13, 2026 Topics released
Apr 17, 2026 PR-runs due; directly shared to participants; task registrations due
May 15, 2026 AC-runs due
Aug 1, 2026 evaluation results and draft overview released
Sep 1, 2026 draft participant papers due
Nov 1, 2026 all camera ready papers due
Dec 2026 NTCIR-19

---

Organisers

Tetsuya Sakai (Waseda University/Naver Corporation)
Sijie Tao (Waseda University)
Atsuya Ishikawa (Waseda University)
Hanpei Fang (Waseda University)
Ziliang Zhao (Renmin University of China)
Yujia Zhou (Tsinghua University)
Nuo Chen (The Hong Kong Polytechnic University)
Young-In Song (Naver Corporation)

Contact

ntcir19r2c2org at list.waseda.jp

---

Links

NTCIR-19
BREV RAG (Beyond Relevance-based EValuation of RAG systems) workshop