---

Updates

Dec 20, 2025: Please register to our task through the NTCIR task registration page to obtain our Wikipedia/Wookieepedia corpus!
Dec 19, 2025: Dry run submission instructions updated! Dry run submission extended to Jan 10!
Dec 17, 2025: Paper and slides of our BREV-RAG@SIGIR-AP2025 paper are available now!
Nov 8, 2025: The corpus and the organisers’ passages are available to participants! The dry run topics are here.
Aug 22, 2025: Check out the R2C2 introduction slides for the NTCIR-19 Kickoff event (Sep 3): slides
Jul 25, 2025: Check out this one-minute introduction to the NTCIR-19 R2C2 (RAG Responses: Confidence and Correct?) Task! (video)

---

Important Dates AoE for participants and organisers (tentative: updated Sep 30, 2025)

Nov 8, 2025 Corpus, organisers’ passages, and dry run topics are ready
Nov 21, 2025 Sample dry run PR-runs released
Dec 10, 2025 BREV-RAG workshop at SIGIR-AP 2025
Jan 10, 2026 Dry run PR-runs and AC-runs due (EXTENDED!)
Feb 13, 2026 Dry run results released
Mar 13, 2026 Topics released
Apr 17, 2026 PR-runs due; directly shared to participants; task registrations due
May 15, 2026 AC-runs due
Aug 1, 2026 evaluation results and draft overview released
Sep 1, 2026 draft participant papers due
Nov 1, 2026 all camera ready papers due
Dec 8-10, 2026 NTCIR-19

---

Organisers

Tetsuya Sakai (Waseda University/Naver Corporation)
Sijie Tao (Waseda University)
Atsuya Ishikawa (Waseda University)
Hanpei Fang (Waseda University)
Ziliang Zhao (Renmin University of China)
Yujia Zhou (Tsinghua University)
Nuo Chen (The Hong Kong Polytechnic University)
Young-In Song (Naver Corporation)

Contact

ntcir19r2c2org at list.waseda.jp

---

Run submission instructions

Please visit this page for dry run submission instructions.

---

Links

NTCIR-19
BREV RAG (Beyond Relevance-based EValuation of RAG systems) workshop