The Sakai Laboratory, Department of Computer Science and Engineering, Waseda University

  • Professor Tetsuya Sakai

  • Here are the early draft chapters of the upcoming Springer book: Evaluating Information Retrieval and Access Tasks: NTCIR’s Legacy of Research Impact, edited by Noriko Kando, Douglas Oard, and Tetsuya Sakai, to be published in 2020.

    Please have a look and send your constructive comments to by August 15, 2019 (AoE). Meanwhile, the chapters will also go through a reviewing process. We plan to give a copy of the Springer book to every NTCIR-15 participant in December 2020!

    Last updated: 16th May, 2019 by Tetsuya Sakai.

    Foreword (Mark Sanderson)

    Evolution of Information Access Evaluation and NTCIR (Noriko Kando)

    Graded Relevance (Tetsuya Sakai)
    LONG VERSION OF THE ABOVE CHAPTER (not part of the book): Graded Relevance Assessments and Graded Relevance Measures of NTCIR: A Survey of the First Twenty Years, arXiv:1903.11272, 2019.

    Document-Linked Comparable Corpora for Researches of Cross-Lingual Information Retrieval Focusing on CJK Languages (Kazuaki Kishida and Kuang-Hua Chen)

    Text Summarization Challenge (TSC): Yet Another Evaluation Program for Text Summarization (Manabu Okumura, Hidetsugu Nanba, Tsutomu Hirao and Takahiro Fukushima)

    Challenges in Patent Retrieval (Makoto Iwayama, Atsushi Fujii and Hidetsugu Nanba)

    Multi-Modal Summarization (Tsuneaki Kato)

    Opinion Analysis Corpora Across Languages (Yohei Seki)

    Patent Translation (Isao Goto)

    Component Evaluation for Question Answering (Teruko Mitamura and Eric Nyberg)

    Temproal Information Access (Masaharu Yoshioka and Hideo Joho)

    SogouQ: the first large-scale test collection with click streams used in a shared-task evaluation (Ruihua Song, Min Zhang, Cheng Luo, Tetsuya Sakai, Yiqun Liu and Zhicheng Dou)

    Efficient Information Access with Smartphones (Makoto P. Kato)

    Mathematical Information Retrieval (Akiko Aizawa and Michael Kohlhase)

    Early Progress in Lifelog Organisation and Retrieval at NTCIR (Cathal Gurrin, Hideo Joho, Frank Hopfgartner, Liting Zhou, Rami Albatal and Duc-Tien Dang-Nguyen)

    The Future of Information Retrieval Evaluation (Douglas Oard)