The Sakai Laboratory, Department of Computer Science and Engineering, Waseda University


  • sakailab.com
  • sakailab.com/english/
  • Professor Tetsuya Sakai

    • Here are the early draft chapters of the upcoming Springer book: Evaluating Information Retrieval and Access Tasks: NTCIR’s Legacy of Research Impact, edited by Noriko Kando, Douglas Oard, and Tetsuya Sakai, to be published in 2020.

    A short paper on this book was presented at EVIA2019@NTCIR-14:
    Oard, D.W., Sakai, T., and Kando, N.: Celebrating 20 Years of NTCIR: The Book, Proceedings of EVIA 2019. pdf

    Please have a look and send your constructive comments to ntcirbookfeedback@list.waseda.jp by August 15, 2019 (AoE). Alternatively, you can tweet what you think using hashtag #ntcirbook . Meanwhile, the chapters will also go through a reviewing process. We plan to give a copy of the Springer book to every NTCIR-15 participant in December 2020!

    Last updated: 18th June, 2019 by Tetsuya Sakai.

    Foreword (Mark Sanderson)

    Evolution of Information Access Evaluation and NTCIR (Noriko Kando)

    Graded Relevance (Tetsuya Sakai)
    LONG VERSION OF THE ABOVE CHAPTER (not part of the book): Graded Relevance Assessments and Graded Relevance Measures of NTCIR: A Survey of the First Twenty Years, arXiv:1903.11272, 2019.
    Slides of Sakai’s presentation given at EVIA2019@NTCIR-14 are available HERE

    Document-Linked Comparable Corpora for Researches of Cross-Lingual Information Retrieval Focusing on CJK Languages (Kazuaki Kishida and Kuang-Hua Chen)

    Text Summarization Challenge (TSC): Yet Another Evaluation Program for Text Summarization (Manabu Okumura, Hidetsugu Nanba, Tsutomu Hirao and Takahiro Fukushima)

    Challenges in Patent Retrieval (Makoto Iwayama, Atsushi Fujii and Hidetsugu Nanba)

    Multi-Modal Summarization (Tsuneaki Kato)

    Opinion Analysis Corpora Across Languages (Yohei Seki)

    Patent Translation (Isao Goto)

    Component Evaluation for Question Answering (Teruko Mitamura and Eric Nyberg)

    Temproal Information Access (Masaharu Yoshioka and Hideo Joho)

    SogouQ: the first large-scale test collection with click streams used in a shared-task evaluation (Ruihua Song, Min Zhang, Cheng Luo, Tetsuya Sakai, Yiqun Liu and Zhicheng Dou)

    Efficient Information Access with Smartphones (Makoto P. Kato)

    Mathematical Information Retrieval (Akiko Aizawa and Michael Kohlhase)

    Early Progress in Lifelog Organisation and Retrieval at NTCIR (Cathal Gurrin, Hideo Joho, Frank Hopfgartner, Liting Zhou, Rami Albatal and Duc-Tien Dang-Nguyen)

    The Future of Information Retrieval Evaluation (Douglas Oard)