---

Updates

Sep 30, 2025: The dry run schedule has been postponed to November!
Sep 12, 2025: Tentative dry run submission instructions, with toy run files, can be found on this page
Aug 22, 2025: Check out the R2C2 introduction slides for the NTCIR-19 Kickoff event (Sep 3): slides
Jul 25, 2025: Check out this one-minute introduction to the NTCIR-19 R2C2 (RAG Responses: Confidence and Correct?) Task! (video)

---

Important Dates AoE for participants and organisers (tentative: updated Sep 30, 2025)

Nov 7, 2025 Corpus, organisers’ passages, and dry run topics released
Nov 21, 2025 Sample dry run PR-runs released
Dec 10, 2025 BREV-RAG workshop at SIGIR-AP 2025
Dec 22, 2025 Dry run PR-runs and AC-runs due
Feb 13, 2026 Dry run results released
Mar 13, 2026 Topics released
Apr 17, 2026 PR-runs due; directly shared to participants; task registrations due
May 15, 2026 AC-runs due
Aug 1, 2026 evaluation results and draft overview released
Sep 1, 2026 draft participant papers due
Nov 1, 2026 all camera ready papers due
Dec 8-10, 2026 NTCIR-19

---

Organisers

Tetsuya Sakai (Waseda University/Naver Corporation)
Sijie Tao (Waseda University)
Atsuya Ishikawa (Waseda University)
Hanpei Fang (Waseda University)
Ziliang Zhao (Renmin University of China)
Yujia Zhou (Tsinghua University)
Nuo Chen (The Hong Kong Polytechnic University)
Young-In Song (Naver Corporation)

Contact

ntcir19r2c2org at list.waseda.jp

---

Run submission instructions

Please visit this page for dry run submission instructions.

---

Links

NTCIR-19
BREV RAG (Beyond Relevance-based EValuation of RAG systems) workshop