Last updated: 17th December, 2024
red=invited/editor/book author; purple=non-refereed
Nuo Chen, Jiqun Liu, Hanpei Fang, Yuankai Luo, Tetsuya Sakai, and Xiao-Ming Wu: Decoy Effect In Search Interaction: Understanding User Behavior and Measuring System Vulnerability, ACM TOIS, to appear, 2025.
Tetsuya Sakai: Evaluating System Responses Based On Overconfidence and Underconfidence, Joint Proceedings of the SIGIR-AP 2024 Workshops EMTCIR 2024 and UM-CIR 2024, 2024. pdf slides
Yuxiang Zhang, Xin Fan, Junjie Wang, Chongxian Chen, Fan Mo, Tetsuya Sakai, and Hayato Yamana: Data-Efficient Massive Tool Retrieval: A Reinforcement Learning Approach for Query-Tool Alignment with Large Language Models, Proceedings of ACM SIGIR-AP 2024, pp.226-235, 2024.
Nuo Chen, Jiqun Liu, Xiaoyu Dong, Qijiong Liu, Tetsuya Sakai, and Xiao-Ming Wu: AI Can Be Cognitively Biased: An Exploratory Study on Threshold Priming in LLM-Based Batch Relevance Assessment, Proceedings of ACM SIGIR-AP 2024, pp.56-63, 2024.
Tetsuya Sakai, Emi Ishita, Hiroaki Ohshima, Faegheh Hasibi, Jiaxin Mao, Joemon Jose (eds.): SIGIR-AP 2024: Proceedings of the 2024 Annual International ACM SIGIR Conference on Research and Development in Information Retrieval in the Asia Pacific Region, 2024.
Kelong Mao, Chenlong Deng, Haonan Chen, Fengran Mo, Zheng Liu, Tetsuya Sakai, and Zhicheng Dou: ChatRetriever: Adapting Large Language Models for Generalized and Robust Conversational Dense Retrieval, Proceedings of EMLNLP 2024, pp.1227-1240, 2024. pdf
Yuxiang Zhang, Jing Chen, Junjie Wang, Yaxin Liu, Cheng Yang, Chufan Shi, Xinyu Zhu, Zihao Lin, Hanwen WAN, Yujiu Yang, Tetsuya Sakai, Tian Feng, and Hayato Yamana: ToolBeHonest: A Multi-level Hallucination Diagnostic Benchmark for Tool-Augmented Large Language Models, Proceedings of EMLNLP 2024, pp. 11388–11422, 2024. pdf
酒井哲也, Sijie Tao, Hanpei Fang, Yuxiang Zhang: FairWeb-2: グループフェアなウェブ検索と会話型検索, 情報処理学会研究報告 2024-DBS-179/2024-IFAT-156, No.22, 2024. paper pdf slides
Haoxiang Shi, Jiaan Wang, Jiarong Xu, Cen Wang, and Tetsuya Sakai: CT-Eval: Benchmarking Chinese Text-to-Table Performance in Large Language Models, arxiv:2405.12174, 2024.
Yuxiang Zhang, Junjie, Wang, Xinyu Zhu, Tetsuya Sakai, and Hayato Yamana: SSR: Solving Named Entity Recognition Problems via a Single-stream Reasoner, ACM TOIS, Volume 42, Number 5, Article No.138, 2024. doi
Qijiong Liu, Nuo Chen, Tetsuya Sakai, and Xiao-Ming Wu: ONCE: Boosting Content-based Recommendation with Both Open- and Closed-source Large Language Models, Proceedings of ACM WSDM 2024, pp.452-461, 2024. doi
Haoxiang Shi and Tetsuya Sakai: Enhancing Parameter Efficiency in Model Inference using an Ultralight Inter-Transformer Linear Structure, IEEE Access, vol.12, pp.43734-43746, 2024. pdf
Junjie Wang, Yatai, Ji, Yuxiang Zhang, Yanru Zhu, and Tetsuya Sakai: Modeling Multimodal Uncertainties via Probability Distribution Encoders included Vision-Language Models, IEEE Access, vol.12, pp.420-434, 2024. pdf
Hanpei Fang and Tetsuya Sakai: Cross-lingual Relevance Estimation with Soft and Hard Prompts, DEIM 2024, to appear, 2024.
Kai-xin Chang and Tetsuya Sakai: A Study on Automatic Nugget Weight Generation with LLMs, DEIM 2024, to appear, 2024.
劉 明明, 酒井 哲也: 中間音楽生成のための Transformer モデル, DEIM 2024, to appear, 2024.
吉越 玲士, 酒井 哲也: 思い出せない映画に特化した情報検索システムの作成, DEIM 2024, to appear, 2024.
Reo Yoshikoshi and Tetsuya Sakai: RSLTOT at the TREC 2023 ToT Track, Proceedings of TREC 2023, 2024. pdf
Junjie Wang, Ping Yang, Ruxi Gan, Yuxiang Zhang, Jiaxing Zhang, and Tetsuya Sakai: Zero-Shot Learners for Natural Language Understanding via a Unified Multiple-Choice Perspective, IEEE Access, vol.11, pp.142829-142845, 2023. pdf
Tetsuya Sakai: Evaluating Parrots and Sociopathic Liars: A keynote at ICTIR 2023, SIGIR Forum 57(2), 2023. pdf
Fan Li, Kaize Shi, Kenta Inaba, Sijie Tao, Nuo Chen, and Tetsuya Sakai: RSLFW at the NTCIR-17 FairWeb 1 Task, Proceedings of NTCIR-17, p.310-313, 2023. pdf
Sijie Tao, Nuo Chen, Tetsuya Sakai, Zhumin Chu, Hiromi Arai, Ian Soboroff, Nicola Ferro, Maria Maistro: Overview of the NTCIR-17 FairWeb-1 Task, Proceedings of NTCIR-17, pp.284-305, 2023. pdf
Nuo Chen, Jiqun Liu, Tetsuya Sakai, and Xiao-Ming Wu: Decoy Effect in Search Interaction: A Pilot Study, Proceedings of EVIA 2023, pp.14-19, 2023. pdf youtube (from around 00:20)
Tetsuya Sakai: Fairness-based Evaluation of Conversational Search: A Pilot Study, Proceedings of EVIA 2023, pp.5-13, 2023. pdf slides youtube (from around 27:20) data (EVIA2023PACK)
Zhumin Chu, Tetsuya Sakai, Qingyao Ai, and Yiqun Liu: Chuweb21D: A Deduped English Document Collection for Web Search Tasks, Proceedings of ACM SIGIR-AP 2023, pp.63-72, 2023. pdf
Rikiya Takehi, Akihisa Watanabe, and Tetsuya Sakai: Open-Domain Dialogue Quality Evaluation: Deriving Nugget-level Scores from Turn-level Scores, ACM SIGIR-AP 2023, pp.40-45, 2023. pdf
Yiyao Yu, Junjie Wang, Yuxiang Zhang, Lin Zhang, Yujiu Yang, and Tetsuya Sakai: Ethical Alignment Meets Conversational Information Retrieval, ACM SIGIR-AP 2023, pp.32-39, 2023. pdf
Qingyao Ai, Yiqin Liu, Alistair Moffat, Xuanjing Huang, Tetsuya Sakai, and Justin Zobel (eds.): SIGIR-AP ’23: Proceedings of the Annual International ACM SIGIR Conference on Research and Development in Information Retrieval in the Asia Pacific Region, 2023.
吉越 玲士, 酒井 哲也: 思い出せない映画に特化した情報検索システムの作成, WebDB夏のワークショップ2023, 情報処理学会研究報告, 2023-IFAT-152(14)/2023-DBS-177(14), 2023. 学生奨励賞
酒井 哲也: 「確率的鸚鵡」の監査に向けた「確率的白鳥」構想について, WebDB夏のワークショップ2023, 情報処理学会研究報告, 2023-IFAT-152(13)/2023-DBS-177(13), 2023. slides
Tetsuya Sakai, Sijie Tao, Nuo Chen, Yujing Li, Maria Maistro, Zhumin Chu, and Nicola Ferro: On the Ordering of Pooled Web Pages, Gold Assessments, and Bronze Assessments, ACM TOIS 42(1), Article 23, 2023. open access pdf SIGIR-AP 2024 slides
Kevin Roitero and David La Barbera and Michael Soprano and Gianluca Demartini and Stefano Mizzaro and Tetsuya Sakai: How Many Crowd Workers Do I Need? On Statistical Power When Crowdsourcing Relevance Judgments, ACM TOIS 42(1), Article 21, 2023. open access pdf
Tetsuya Sakai, Jin Young Kim, and Inho Kang: A Versatile Framework for Evaluating Ranked Lists in terms of Group Fairness and Relevance, ACM TOIS 42(1), Article 11, 2023. open access pdf SIGIR-AP 2024 slides
Haoxiang Shi and Tetsuya Sakai: Self-supervised and Few-shot Contrastive Learning Frameworks for Text Clustering, IEEE Access, Volume 11, pp.84134-84143, 2023. open access pdf
Haoxiang Shi, Sumio Fujita, and Tetsuya Sakai: Towards Consistency Filtering-Free Unsupervised Learning for Dense Retrieval, SIGIR 2023 Workshop on Reaching Efficiency in Neural Information Retrieval (ReNeuIR 2023), 2023. pdf
Nuo Chen, Donghyun Park, Hyungae Park, Kijun Choi, Tetsuya Sakai and Jinyoung Kim: Practice and Challenges in Building a Business-oriented Search Engine Quality Metric, SIGIR 2023, pp.3295–3299, 2023.
Tetsuya Sakai: Evaluating Parrots and Sociopathic Liars (keynote), Proceedings of ACM ICTIR 2023, p.1. extended abstract slides
Tetsuya Sakai: On A Few Responsibilities of (IR) Researchers (Fairness, Awareness, and Sustainability): A keynote at ECIR 2023, SIGIR Forum, 57(1), 2023. pdf
Yatai Ji, Junjie Wang, Yuan Gong, Lin Zhang, Yanru Zhu, Hongfa Wang, Jiaxing Zhang, Tetsuya Sakai, and Yujiu Yang: MAP: Multimodal Uncertainty-Aware Vision-Language Pre-training Model, CVPR 2023, pp.23262-23271, 2023. pdf
Tetsuya Sakai: SWAN: A Generic Framework for Auditing Textual Conversational Systems, arxiv:2305.08290, 2023.
Nuo Chen, Jiqun Liu, and Tetsuya Sakai: A Reference-Dependent Model for Web Search Evaluation, The 2023 ACM Web Conference, pp.3396–3405, 2023. pdf
Tetsuya Sakai: On A Few Responsibilities of (IR) Researchers: Fairness, Awareness, and Sustainability (keynote), ECIR 2023, LNCS13980, p.xxiii, 2023. slides
稲葉 健太, 酒井 哲也: ウェブ検索結果がユーザの意見形成に及ぼす影響の調査, DEIM 2023, 2023. pdf
Ping Yang, Junjie Wang, Ruyi Gan, Xinyu Zhu, Lin Zhang, Ziwei Wu, Xinyu Gao, Jiaxing Zhang, and Tetsuya Sakai: Zero-Shot Learners for Natural Language Understanding via a Unified Multiple Choice Perspective, EMNLP 2022, pp.7042-7055, 2022. ACL Anthology pdf
Tetsuya Sakai, Sijie Tao, and Zhaohao Zeng: Relevance Assessments for Web Search Evaluation: Should We Randomise or Prioritise the Pooled Documents? (CORRECTED VERSION), arXiv:2211.00981, 2022.
Atsuko Natatsuka, Ryo Iijima, Takuya Watanabe, Mitsuaki Akiyama, Tetsuya Sakai, and Tatsuya Mori: Understanding the Behavior Transparency of Voice Assistant Applications Using the ChatterBox Framework, Proceedings of RAID 2022, pp.143-159, 2022. open access pdf
Yatai Ji, Junjie Wang, Yuan Gong, Lin Zhang, Yanru Zhu, Hongfa Wang, Jiaxing Zhang, Tetsuya Sakai, and Yujiu Yang: MAP: Modality-Agnostic Uncertainty-Aware Vision-Language Pre-training Model, arXiv:2210.05335, 2022.
Tetsuya Sakai, Sijie Tao, Maria Maistro, Zhumin Chu, Yujing Li, Nuo Chen, Nicola Ferro, Junjie Wang, Ian Soboroff, and Yiqun Liu: Corrected Evaluation Results of the NTCIR WWW-2, WWW-3, and WWW-4 English Subtasks, arXiv:2210.10266, 2022.
Haoxiang Shi, Rongsheng Zhang, Jiaan Wang, Cen Wang, Guandan Chen, Yinhe Zheng, and Tetsuya Sakai: LayerConnect: Hypernetwork-Assisted Inter-Layer Connector to Enhance Parameter Efficiency, Proceedings of COLING 2022, pp.3120-3126, 2022. ACL Anthology pdf
酒井哲也: グループフェアネスを考慮したウェブ検索タスク, 情報処理学会研究報告 2022-DBS-175/2022-IFAT-148, No.6, 2022. pdf slides
Rei Shimizu, Sumio Fujita, and Tetsuya Sakai: Do Extractive Summarization Algorithms Amplify Lexical Bias in News Articles?, Proceedings of ACM ICTIR 2022, pp.133-137, 2022. preprint slides 17-minute video
Nuo Chen, Fan Zhang, Tetsuya Sakai: Constructing Better Evaluation Metrics by Incorporating the Anchoring Effect into the User Model, ACM SIGIR 2022, pp.2709-2714, 2022. preprint free access pdf
Yuji Naraki, Tetsuya Sakai, Yoshihiko Hayashi: Evaluating the Effects of Embedding with Speaker Identity Information in Dialogue Summarization, LREC 2022, pp.298-304, 2022. pdf
Riku Togashi, Mayu Otani, Yuta Nakashima, Esa Rahtu, Janne Heikkilä, Tetsuya Sakai: AxIoU: An Axiomatically Justified Measure for Video Moment Retrieval, Proceedings of CVPR 2022, pp.21076-21085, 2022. pdf
Yuya Ubukata, Masaki Muraoka, Sijie Tao, and Tetsuya Sakai: SLWWW at the NTCIR-16 WWW-4 Task, Proceedings of NTCIR-16, pp.246-249, 2022. pdf NTCIR-16 Best Oral Presentation Award
Tetsuya Sakai, Sijie Tao, Zhumin Chu, Maria Maistro, Yujing Li, Nuo Chen, Nicola Ferro, Junjie Wang, Ian Soboroff, and Yiqun Liu: Overview of the NTCIR-16 We Want Web with CENTRE (WWW-4) Task, Proceedings of NTCIR-16, pp.234-245, 2022. pdf slides
Fan Li and Tetsuya Sakai: RSLDE at the NTCIR-16 DialEval-2 Task, Proceedings of NTCIR-16, pp.66-70, 2022. pdf NTCIR-16 Best Oral Presentation Award and NTCIR-16 Best Poster Presentation Award
Sijie Tao and Tetsuya Sakai: Overview of the NTCIR-16 Dialogue Evaluation (DialEval-2) Task, Proceedings of NTCIR-16, pp.51-65, 2022. pdf slides
Tetsuya Sakai: Evaluating Evaluation Measures, Evaluating Information Access Systems, Designing and Constructing Test Collections, and Evaluating Again (invited tutorial), Proceedings of NTCIR-16, p.11, 2022. abstract pdf slides videos
雨宮佑基, 酒井哲也: スタンス検出タスクにおける評価方法の選定 (研究会推薦論文), 電子情報通信学会和文論文誌D「データ工学と情報マネジメント特集」, Vol.J105-D, No.5, pp.337-347, 2022.
Tetsuya Sakai: On Variants of Root Normalised Order-aware Divergence and a Divergence based on Kendall’s Tau, arXiv:2204.07304, 2022.
Tetsuya Sakai, Jin Young Kim, and Inho Kang: A Versatile Framework for Evaluating Ranked Lists in terms of Group Fairness and Relevance, arXiv:2204.00280, 2022.
吉越玲士, 酒井哲也: Transformerを用いた文書の自動品質評価, DEIM 2022, 2022. 学生プレゼンテーション賞 pdf
Tetsuya Sakai, Sijie Tao, and Zhaohao Zeng: Relevance Assessments for Web Search Evaluation: Should We Randomise or Prioritise the Pooled Documents? ACM TOIS, 40(4), Article 76, 2022. open access pdf CORRIGENDUM
Junjie Wang, Yatai Ji, Jiaqi Sun, Yujiu Yang, and Tetsuya Sakai: MIRTT: Learning Multimodal Interaction Representations from Trilinear Transformers for Visual Question Answering, Findings of the Association for Computational Linguistics: EMNLP 2021, pp.2280-2292, 2021. ACL Anthology pdf
Tetsuya Sakai: A Closer Look at Evaluation Measures for Ordinal Quantification, Proceedings of the CIKM 2021 Workshops, 2021. pdf slides
Zhumin Chu, Jiaxin Mao, Fan Zhang, Yiqun Liu, Tetsuya Sakai, Min Zhang, Shaoping Ma: Evaluating Relevance Judgments with Pairwise Discriminative
Power, Proceedings of ACM CIKM 2021, pp.261-270, 2021.
Jia Chen, Yiqun Liu, Jiaxin Mao, Fan Zhang, Tetsuya Sakai, Weizhi Ma, Min Zhang, and Shaoping Ma: Incorporating Query Reformulating Behavior into Web Search
Evaluation, Proceedings of ACM CIKM 2021, pp.171-180, 2021.
Haoxiang Shi and Cen Wang and Tetsuya Sakai: A Simple and Effective Usage of Self-supervised Contrastive Learning for Text Clustering, Proceedings of IEEE SMC 2021, pp.315-320, 2021.
酒井哲也: NTCIR-16ウェブ検索・再現可能性タスク (WWW-4) および対話評価タスク (DialEval-2)への誘い, 情報処理学会研究報告 2021-DBS-173/2021-IFAT-144, 2021.
楢木悠士, 酒井哲也, 林 良彦: 対話要約における話者情報を持つEmbeddingの効果, FIT2021講演論文集, E-042, to appear, 2021. FIT 2021奨励賞
Tetsuya Sakai: Evaluating Evaluation Measures for Ordinal Classification and Ordinal Quantification, Proceedings of ACL-IJCNLP 2021, pp.2759-2769, 2021. ACL Anthology pdf lots of videos and slides
Tetsuya Sakai, Sijie Tao and Zhaohao Zeng: WWW3E8: 259,000 Relevance Labels for Studying the Effect of Document Presentation Order for Relevance Assessors, Proceedings of ACM SIGIR 2021, pp.2376–2382, 2021. preprint slides 6-minute video
Tetsuya Sakai: On the Two-Sample Randomisation Test for IR Evaluation, Proceedings of ACM SIGIR 2021, pp.1980–1984, 2021. corrected pdf slides 5-minute video
Riku Togashi, Masahiro Kato, Mayu Otani, Tetsuya Sakai and Shin’Ichi Satoh: Scalable Personalised Item Ranking through Parametric Density Estimation, Proceedings of ACM SIGIR 2021, pp.921–931, 2021. preprint
Fernando, Diaz, Chirag Shah, Torsten Suel, Pablo Castells, Rosie Jones, Tetsuya Sakai, Alejandro Bellogín, and Masaharu Yoshioka (eds.): Proceedings of ACM SIGIR 2021, 2021 ACM DL page
Rikiya Suzuki and Tetsuya Sakai: Fast and Exact Randomisation Test for Comparing Two Systems with Paired Data, Proceedings of ACM ICTIR 2021, pp.239–243, 2021. preprint slides 11-minute video
Zhaohao Zeng and Tetsuya Sakai: DCH-2: A Parallel Customer-Helpdesk Dialogue Corpus with Distributions of Annotators’ Labels, arXiv:2104.08755, 2021.
Yuki Amemiya, Tomohiro Manabe, Sumio Fujita, and Tetsuya Sakai: How Do Users Revise Zero-Hit Product Search Queries?, Proceedings of ECIR 2021 Part II (LNCS 12657), pp.185-192, 2021. preprint
Tetsuya Sakai: On the Instability of Diminishing Return IR Measures, Proceedings of ECIR 2021 Part I (LNCS 12656), pp.572-586, 2021. preprint 20-minute video
Chih-hao Wang, Sosuke Kato and Tetsuya Sakai: RSL19BD at DBDC4: Ensemble of Decision Tree-Based and LSTM-Based Models, Increasing Naturalness and Flexibility in Spoken Dialogue Interaction: 10th International Workshop on Spoken Dialogue Systems (LNEE 714), pp.429-441, Springer, 2021.
Sijie Tao and Tetsuya Sakai: RealSakaiLab at the TREC 2020 Health Misinformation Track, Proceedings of TREC 2020, 2021. pdf
楢木悠士, 酒井哲也: 話者情報を認識した対話要約, 言語処理学会第27回年次大会発表論文集, pp.1259-1263, 2021. pdf
刀塚敦子, 飯島涼, 渡邉卓弥, 秋山満昭, 酒井哲也, 森達哉: Voice Assistantアプリの対話型解析システムの開発, 電子情報通信学会 第54回情報通信システムセキュリティ研究会, pp.132-137, 2021.
栗林峻, 酒井哲也: モバイルアプリケーションにおけるUIデザイン自動評価の検討, DEIM 2021, 2021. pdf
雨宮佑基, 酒井哲也: スタンス検出タスクにおける評価方法の選定, DEIM 2021, 2021. pdf DEIM 2021 優秀論文賞
清水嶺, 酒井哲也: 日経新聞の記事からの日経ラジオ用読み原稿の自動生成, DEIM 2021, 2021. pdf 学生プレゼンテーション賞
小橋賢介, 雨宮佑基, 酒井哲也: 有用なレビューを抽出するための比較文フィルタリングの検討, DEIM 2021, 2021. pdf
Tetsuya Sakai, Sijie Tao, and Zhaohao Zeng: Relevance Assessments for Web Search Evaluation: Should We Randomise or Prioritise the Pooled Documents?, 情報処理学会研究報告 2019-IFAT-141(1), 2021.
Tetsuya Sakai and Zhaohao Zeng: Retrieval Evaluation Measures that Agree with Users’ SERP Preferences: Traditional, Preference-based, and Diversity Measures, ACM TOIS, 39(2), Article No.14, 2020. pdf slides used at SIGIR 2021 11-minute video used at SIGIR 2021 data (TOIS2020PACK)
Yuji Naraki and Tetsuya Sakai: selt Team’s Entity Linking System at the NTCIR-15 QALab-PoliInfo2, Proceedings of NTCIR-15, pp.142-144, 2020. pdf
Masaki Muraoka, Zhaohao Zeng, and Tetsuya Sakai: SLWWW at the NTCIR-15WWW-3 Task, Proceedings of NTCIR-15, pp.243-246, 2020. pdf
Tetsuya Sakai, Sijie Tao, Zhaohao Zeng, Yukun Zheng, Jiaxin Mao, Zhumin Chu, Yiqun Liu, Maria Maistro, Zhicheng Dou, Nicola Ferro, Ian Soboroff: Overview of the NTCIR-15 We Want Web with CENTRE (WWW-3) Task, Proceedings of NTCIR-15, pp.219-234, 2020. pdf
Ting Cao, Fan Zhang, Haoxiang Shi, Zhaohao Zeng, Sosuke Kato, Tetsuya Sakai, Injae Lee, Kyungduk Kim, and Inho Kang: RSLNV at the NTCIR-15 Dialogue Evaluation (DialEval-1) Task, Proceedings of NTCIR-15, pp.57-61, 2020. pdf
Junjie Wang, Yuxiang Zhang, Tetsuya Sakai, and Hayato Yamana: SKYMN at the NTCIR-15 DialEval-1 Task, Proceedings of NTCIR-15, pp.40-46, 2020. pdf
Zhaohao Zeng, Sosuke Kato, Tetsuya Sakai, and Inho Kang: Overview of the NTCIR-15 Dialogue Evaluation (DialEval-1) Task, Proceedings of NTCIR-15, pp.13-34, 2020. pdf
Haoxiang Shi, Cen Wang, and Tetsuya Sakai: A Siamese CNN Architecture for Learning Chinese Sentence Similarity, Proceedings of AACL-IJCNLP 2020 Student Research Workshop (SRW), pp.24-29, 2020. pdf
Riku Togashi, Sumio Fujita, and Tetsuya Sakai: Automatic Evaluation of Iconic Image Retrieval based on Colour, Shape, and Texture, Proceedings of ACM ICMR 2020, p.346–354, 2020. preprint
Ruihua Song, Min Zhang, Cheng Luo, Tetsuya Sakai, Yiqun Liu, Zhicheng Dou: SogouQ: The First Large-Scale Test Collection with Click Streams Used in a Shared-Task Evaluation, Evaluating Information Retrieval and Access Tasks: NTCIR’s Legacy of Research Impact, Springer, pp.143-150, 2020. open access chapter pdf
Tetsuya Sakai: Graded Relevance, Evaluating Information Retrieval and Access Tasks: NTCIR’s Legacy of Research Impact, Springer, pp.1-20, 2020. open access chapter pdf
Tetsuya Sakai, Douglas W. Oard, and Noriko Kando (eds.): Evaluating Information Retrieval and Access Tasks: NTCIR’s Legacy of Research Impact, Springer, 2020. open access book pdf
酒井哲也, Zhaohao Zeng: ユーザの感覚に近い多様化検索評価指標, FIT2020講演論文集, CD-002, 2020. FIT 2020 論文賞 pdf
Riku Togashi and Tetsuya Sakai: Visual Intents vs. Clicks, Likes, and Purchases in E-commerce, Proceedings of ACM SIGIR 2020, pp.1869-1872, 2020.
Tetsuya Sakai and Zhaohao Zeng: Good Evaluation Measures based on Document Preferences, Proceedings of ACM SIGIR 2020, pp.359-368, 2020. preprint slides 15-minute video
Timo Breuer, Nicola Ferro, Norbert Fuhr, Maria Maistro, Tetsuya Sakai, Philipp Schaer, and Ian Soboroff: How to Measure the Reproducibility of System-oriented IR Experiments, Proceedings of ACM SIGIR 2020, pp.349-358, 2020. preprint
Ian Soboroff, Nicola Ferro, Maria Maistro, and Tetsuya Sakai: Overview of the TREC 2018 CENTRE Track, Proceedings of TREC 2018, 2020. pdf
Tetsuya Sakai: On Fuhr’s Guideline for IR Evaluation, SIGIR Forum, 54(1), 2020. pdf
三王慶太, 酒井哲也: 文書分類技術に基づくエントリーシートからの業界推薦, 日本データベース学会和文論文誌, Vol.18-J, Article No.11, 2020. pdf
Peng Xiao, Joo-Young Lee, Sijie Tao, Young-Sook Hwang, and Tetsuya Sakai: Generating Short Product Descriptors based on Very Little Training Data, Proceedings of AIRS 2019 (LNCS 12004), pp.133-144, 2020.
Tetsuya Sakai and Peng Xiao: Randomised vs. Prioritised Pools for Relevance Assessments: Sample Size Considerations, Proceedings of AIRS 2019 (LNCS 12004), pp.94-105, 2020.
Rikiya Suzuki, Sumio Fujita, and Tetsuya Sakai: Arc Loss: Softmax with Additive Angular Margin for Answer Retrieval, Proceedings of AIRS 2019 (LNCS 12004), pp.34-40, 2020.
Sosuke Kato, Toru Shimizu, Sumio Fujita, and Tetsuya Sakai: Unsupervised Answer Retrieval with Data Fusion for Community Question Answering, Proceedings of AIRS 2019 (LNCS 12004), pp.10-21, 2020.
Hsin-Wen Liu, Sumio Fujita, and Tetsuya Sakai: Towards Automatic Evaluation of Reused Answers in Community Question Answering, Proceedings of AIRS 2019 (LNCS 12004), pp.3-9, 2020.
Sijie Tao and Tetsuya Sakai: Improving Concept Representations for Short Text Classification, 言語処理学会第26回年次大会発表論文集, pp.251-254, 2020.
Shiyoh Goetsu and Tetsuya Sakai: Different Types of Voice User Interface Failures May Cause Different Degrees of Frustration, インタラクション 2020, pp.473-477, 2020. pdf
小橋賢介, 酒井哲也: 商品比較のための文脈つき評価軸抽出の検討, DEIM 2020, 2020. pdf
小島智樹, 酒井哲也: Androidアプリの権限要求に対する説明十分性の自動確認システムの提案, DEIM 2020, 2020. pdf
Quanyu Piao, Joo-Young Lee, and Tetsuya Sakai: Purchase Prediction based on Recurrent Neural Networks with an Emphasis on Recent User Activities, DEIM 2020, 2020. pdf
Haoxiang Shi, Cen Wang, and Tetsuya Sakai: Experiments on Unsupervised Text Classification based on Graph Neural Networks, DEIM 2020, 2020. pdf
Lingfeng Zhang and Tetsuya Sakai: Do Neural Models for Response Generation Fully Exploit the Input Natural Language Text? DEIM 2020, 2020. pdf
雨宮佑基, 真鍋知博, 藤田澄男, 酒井哲也: 商品検索におけるゼロマッチ解消のためのデータセット構築の検討, DEIM 2020, 2020. オンラインプレゼンテーション賞. pdf
村田憲俊, 酒井哲也: 解釈可能な内部表現を使用したタスク指向ニューラル対話システムの試作, DEIM 2020, 2020. オンラインプレゼンテーション賞. pdf
Wanqi Wu and Tetsuya Sakai: Response Generation based on the Big Five Personality Traits, DEIM 2020, 2020. pdf
Shiyoh Goetsu and Tetsuya Sakai: Different Types of Voice User Interface Failures May Cause Different Degrees of Frustration, arXiv:2002.03582, 2020.
Zhicheng Dou, Xue Yang, Diya Li, Ji-Rong Wen, and Tetsuya Sakai: Low-cost, Bottom-up Measures for Evaluating Search Result Diversification, Information Retrieval Journal, 23, pp.86-113, 2020. springerlink
Zhaohao Zeng, Ruihua Song, Pingping Lin, and Tetsuya Sakai: Attitude Detection for One-Round Conversation: Jointly Extracting Target-Polarity Pairs, Journal of Information Processing, Volume 27, pp.742-751, 2019. pdf
Atsuko Natatsuka, Mitsuaki Akiyama, Ryo Iijima, Tetsuya Sakai, Takuya Watanabe, and Tatsuya Mori: A First Look at the Privacy Risks of Voice Assistant Apps, ACM CCS 2019 Posters & Demos, pp.2633-2635, 2019.
Shiyoh Goetsu and Tetsuya Sakai: Voice Input Interface Failures and Frustration: Developer and User Perspectives, ACM UIST 2019 Adjunct, pp.24-26, 2019.
刀塚敦子, 飯島涼, 渡邉卓弥, 秋山満昭, 酒井哲也, 森達哉: Voice Assistant アプリの大規模実態調査, コンピュータセキュリティシンポジウム 2019. CSS2019最優秀論文賞
Tetsuya Sakai: How to Run an Evaluation Task: with a Primary Focus on Ad Hoc Information Retrieval, Information Retrieval Evaluation in a Changing World: Lessons Learned from 20 Years of CLEF, Springer, pp.71-102, 2019. springerlink
Chao-Chung Wu, Ruihua Song, Tetsuya Sakai, Wen-Feng Cheng, Xing Xie, and Shou-De Lin: Evaluating Image-Inspired Poetry Generation, Proceedings of NLPCC 2019, 2019. pdf
Shigeichi Hirasawa, Gendo Kumoi, Hideki Yagi, Manabu Kobayashi, Masayuki Goto, Tetsuya Sakai, and Hiroshige Inazumi: System Evaluation of Ternary Error-Correcting Output Codes for Multiclass Classification Problems, IEEE SMC 2019, pp. 2893-2898, 2019. preprint
Riku Togashi and Tetsuya Sakai: Generalising Kendall’s Tau for Noisy and Incomplete Preference Judgements, Proceedings of ACM ICTIR 2019, pp.193-196, 2019.
酒井哲也: NTCIR-15ウェブ検索・再現可能性タスク (WWW-3) および対話評価タスク (DialEval-1)への誘い, 情報処理学会研究報告 2019-IFAT-136(20), 2019. slides
Nicola Ferro, Norbert Fuhr, Maria Maistro, Tetsuya Sakai, and Ian Soboroff: CENTRE@CLEF2019: Sequel in the Systematic Reproducibility Realm, Proceedings of CLEF 2019 (LNCS 11696), pp.287-300, 2019.
Nicola Ferro, Norbert Fuhr, Maria Maistro, Tetsuya Sakai, and Ian Soboroff: CENTRE@CLEF2019: Overview of the Replicability and Reproducibility Tasks (invited paper), CLEF 2019 Working Notes, 2019. pdf
Xiaoyu Qi, Ruihua Song, Chunting Wang, Jin Zhou, and Tetsuya Sakai: Composing a Picture Book by Automatic Story Understanding and Visualization, Proceedings of the Second Storytelling Workshop (StoryNLP @ ACL2019), pp.1-10, 2019. pdf
Zhaohao Zeng and Tetsuya Sakai: BM25 Pseudo Relevance Feedback Using Anserini at Waseda University, Proceedings of OSIRRC 2019, pp.62-63, 2019. pdf
Ryan Clancy, Nicola Ferro, Claudia Hauff, Jimmy Lin, Tetsuya Sakai, Ze Zhong Wu: Overview of the 2019 Open-Source IR Replicability Challenge (OSIRRC 2019), Proceedings of OSIRRC 2019, pp.1-7, 2019. pdf
Ryan Clancy, Nicola Ferro, Claudia Hauff, Jimmy Lin, Tetsuya Sakai, Ze Zhong Wu (eds.): Proceedings of the Open-Source IR Replicability Challenge (OSIRRC 2019), 2019. ceur-ws.org/Vol-2409/
Ryan Clancy, Nicola Ferro, Claudia Hauff, Jimmy Lin, Tetsuya Sakai, Ze Zhong Wu The SIGIR 2019 Open-Source IR Replicability Challenge (OSIRRC 2019), Proceedings of ACM SIGIR 2019, pp.1432-1434, 2019.
Tetsuya Sakai and Zhaohao Zeng: Which Diversity Evaluation Measures Are “Good”?, Proceedings of ACM SIGIR 2019, pp.595-604, 2019. preprint slides
Chih-hao Wang, Sosuke Kato, and Tetsuya Sakai: RSL19BD at DBDC4: Ensemble of Decision Tree-based and LSTM-based Models, Proceedings of Chatbots and Conversational Agents and Dialogue Breakdown Detection Challenge (WOCHAT+DBDC), IWSDS 2019, 2019. pdf
Peng Xiao and Tetsuya Sakai: SLWWW at the NTCIR-14 We Want Web Task, Proceedings of NTCIR-14, pp.490-493, 2019. pdf
Sosuke Kato, Rikiya Suzuki, Zhaohao Zeng, and Tetsuya Sakai: SLSTC at the NTCIR-14 STC-3 Dialogue Quality and Nugget Detection Subtasks, Proceedings of NTCIR-14, pp.355-361, 2019. pdf
Zhaohao Zeng, Sosuke Kato, and Tetsuya Sakai: Overview of the NTCIR-14 Short Text Conversation Task: Dialogue Quality and Nugget Detection Subtasks, Proceedings of NTCIR-14, pp.289-315, 2019. pdf
Jiaxin Mao, Tetsuya Sakai, Cheng Luo, Peng Xiao, Yiqun Liu, and Zhicheng Dou: Overview of the NTCIR-14 We Want Web Task, Proceedings of NTCIR-14, pp.455-467, 2019. pdf
Tetsuya Sakai, Nicola Ferro, Ian Soboroff, Zhaohao Zeng, Peng Xiao, and Maria Maistro: Overview of the NTCIR-14 CENTRE Task, Proceedings of NTCIR-14, pp.494-509, 2019. pdf slides
Douglas W. Oard, D.W., Tetsuya Sakai, and Noriko Kando: Celebrating 20 Years of NTCIR: The Book, Proceedings of EVIA 2019, p.3, 2019. pdf
Chih-hao Wang, Sosuke Kato, and Tetsuya Sakai: RSL19BD at DBDC4: Ensemble of Decision Tree-based and LSTM-based Models, arXiv:1905.01799, 2019.
Nicola Ferro, Norbert Fuhr, Maria Maistro, Tetsuya Sakai, and Ian Soboroff: CENTRE@CLEF 2019, Proceedings of ECIR 2019 Part II (LNCS 11438), pp.283-290, 2019.
Tetsuya Sakai: Conducting Laboratory Experiments Properly with Statistical Tools: An Easy Hands-on Tutorial, Proceedings of ECIR 2019 Part II (LNCS 11438), pp.405-407, 2019. slides
Tetsuya Sakai: Graded Relevance Assessments and Graded Relevance Measures of NTCIR: A Survey of the First Twenty Years, arXiv:1903.11272, 2019. slides from EVIA 2019
Yuliska and Tetsuya Sakai: A Comparative Study of Deep Learning Approaches for Extractive Query-Focused Multi-Document Summarization, Proceedings of IEEE ICICT 2019, pp.153-157, 2019.
三王慶太,酒井哲也: 文書分類技術に基づくエントリーシートからの業界推薦, DEIM 2019, 2019. 学生プレゼンテーション賞. pdf
村田憲俊,酒井哲也: Twitterコーパスに基づく雑談対話システムにおける多様性の獲得, DEIM 2019, 2019. 学生プレゼンテーション賞. pdf
河東宗祐,酒井哲也: Dialogue Quality Distribution Prediction based on a Loss that Compares Adjacent Probability Bins, DEIM 2019, 2019. pdf
黒澤瞭佑,酒井哲也: 能動学習を利用した未知語アノテーションの検討, DEIM 2019, 2019. pdf
小島智樹,酒井哲也: Androidアプリの権限要求に対するユーザーへの説明の補完, DEIM 2019, 2019. pdf
Sijie Tao and Tetsuya Sakai: Exploring Multi-label Classification Using Text Graph Convolutional Networks on the NTCIR-13 MedWeb Dataset, DEIM 2019, 2019. pdf
Yuliska and Tetsuya Sakai: Query-Focused Extractive Summarization based on Deep Learning: Comparison of Similarity Measures for Pseudo Ground Truth Generation, DEIM 2019, 2019. pdf
呉越思瑶,酒井哲也: 音声ユーザインタフェースにおける処理エラーによるユーザフラストレーションに関する調査, DEIM 2019, 2019. pdf
雨宮佑基,酒井哲也: Convolutional Neural Networkを用いたFake News Challengeの検討, DEIM 2019, 2019. pdf
坂本凜,酒井哲也: FigureQAタスクにおける抽象画像を考慮したアプローチ, DEIM 2019, 2019. pdf
小橋賢介, 酒井哲也: 擬似アノテーションにもとづく日本語ツイートの極性判定, DEIM 2019, 2019. pdf
Zhaohao Zeng, Ruihua Song, Pingping Lin, and Tetsuya Sakai: Attitude Detection for One-Round Conversation: Jointly Extracting Target-Polarity Pairs, Proceedings of ACM WSDM 2019, pp.285-293, 2019.
Tetsuya Sakai: Conducting Laboratory Experiments Properly with Statistical Tools: An Easy Hands-on Tutorial, Proceedings of ACM WSDM 2019, pp.830-831, 2019.
Tetsuya Sakai: Advanced Information Retrieval Measures. In: Liu L., Özsu M. (eds) Encyclopedia of Database Systems (Second Edition), Springer, 2018. springerlink
Tetsuya Sakai: alpha-nDCG. In: Ling Liu and M. Tamer Özsu (eds) Encyclopedia of Database Systems (Second Edition), Springer, 2018. springerlink
Tetsuya Sakai: D-Measure. In: Ling Liu and M. Tamer Özsu (eds) Encyclopedia of Database Systems (Second Edition), Springer, 2018. springerlink
Tetsuya Sakai: ERR-IA. In: Ling Liu and M. Tamer Özsu (eds) Encyclopedia of Database Systems (Second Edition), Springer, 2018. springerlink
Tetsuya Sakai: Expected Reciprocal Rank. In: Ling Liu and M. Tamer Özsu (eds) Encyclopedia of Database Systems (Second Edition), Springer, 2018. springerlink
Tetsuya Sakai: Q-Measure. In: Ling Liu and M. Tamer Özsu (eds) Encyclopedia of Database Systems (Second Edition), Springer, 2018. springerlink
Tetsuya Sakai: U-Measure. In: Ling Liu and M. Tamer Özsu (eds) Encyclopedia of Database Systems (Second Edition), Springer, 2018. springerlink
Yuen-Hsien Tseng, Tetsuya Sakai, Jing Jiang, Lun-Wei Ku, Dae Hoon Park, Jui-Feng Yeh, Liang-Chih Yu, Lung-Hao Lee, Zhi-Hong Chen: Proceedings of AIRS 2018 (LNCS 11292), 2018.
Takuya Watanabe, Akiyama Mitsuki, Tetsuya Sakai, Hironori Washizaki, and Tatsuya Mori: Understanding the Inconsistency between Behaviors and Descriptions of Mobile Apps, IEICE Transactions, Vol.E101-D, No.11, pp.2584-2599, 2018.
Guoshuai Zhao, Hao Fu, Ruihua Song, Tetsuya Sakai, Xing Xie, and Xueming Qian: Why You Should Listen to This Song: Reason Generation for Explainable Recommendation, 2018 IEEE International Conference on Data Mining Workshops (ICDMW), 2018, pp. 1316-1322, 2018.
Tetsuya Sakai: Laboratory Experiments in Information Retrieval: Sample Sizes, Effect Sizes, and Statistical Power, Springer, 2018. Springer Page The Book Page
Nicola Ferro, Maria Maistro, Tetsuya Sakai, and Ian Soboroff: Overview of CENTRE@CLEF 2018: a First Tale in the Systematic Reproducibility Realm, Proceedings of CLEF 2018 (LNCS 11018), pp.239-246, 2018.
Zhaohao Zeng, Cheng Luo, Lifeng Shang, Hang Li, and Tetsuya Sakai: Towards Automatic Evaluation of Customer-Helpdesk Dialogues, Journal of Information Processing, Volume 26, pp.768-778, 2018. WebDB Forum 2018 Best Paper Runner-up pdf
川崎真未, Inho Kang, 酒井哲也: 放棄セッションにおけるユーザ操作に着目したモバイル検索カードの順位付け, IPSJ TOD 11(3), pp.1-11, 2018.
小島智樹, 酒井哲也: Androidアプリのレビューを用いたユーザーへの権限説明の補完, 情報処理学会研究報告, 2018-NL-237 (4), 2018.
Kenta Tamaki, Riku Togashi, Sosuke Kato, Sumio Fujita, Hideyuki Maeda, and Tetsuya Sakai: Classifying Community QA Questions That Contain an Image, Proceedings of ACM ICTIR 2018, pp.219-222, 2018. preprint
Sakai. T.: Topic Set Size Design for Paired and Unpaired Data, Proceedings of ACM ICTIR 2018, pp.199-202, 2018. preprint
富樫陸, 藤田澄男, 酒井哲也: 色・形状・テクスチャに基づく画像検索の自動評価と多様化, 情報処理学会研究報告, 2018-IFAT-132 (12), 2018. WebDB Forum 2018 学生奨励賞.
河東宗祐, 酒井哲也: 対話破綻検出コーパスに対する学習データ選別の検討, 情報処理学会研究報告, 2018-IFAT-132 (28), 2018. WebDB Forum 2018 FRONTEO Award
Hsin-Wen Liu, Avikalp Srivastava, Sumio Fujita, Toru Shimizu, Riku Togashi, and Tetsuya Sakai: A Comparative Study of Deep Learning Approaches for Visual Question Classification in Community QA, IPSJ SIG Technical Report, 2018-IFAT-132 (17), 2018.
Nicola Ferro, Maria Maistro, Tetsuya Sakai, and Ian Soboroff: CENTRE@CLEF2018: Overview of the Replicability Task (invited paper), CLEF 2018 Working Notes, 2018. pdf
Tetsuya Sakai: Comparing Two Binned Probability Distributions for Information Access Evaluation, Proceedings of ACM SIGIR 2018, pp.1073-1076, 2018. pdf
Tetsuya Sakai: Conducting Laboratory Experiments Properly with Statistical Tools: An Easy Hands-on Tutorial, Proceedings of ACM SIGIR 2018, pp.1369-1370, 2018. preprint
Yiqun Liu, Makoto P. Kato, Charles L.A. Clarke, Noriko Kando, and Tetsuya Sakai: Report on NTCIR-13: The Thirteenth Round of NII Testbeds and Community for Information Access Research, SIGIR Forum, 52(1), 2018. pdf
呉越思瑶, 酒井哲也: ユーザーのニーズに合わせたインタラクティブな推薦システムの提案, DEIM 2018, 2018. pdf
Kenta Tamaki, Riku Togashi, Sumio Fujita, Hideyuki Maeda, Tetsuya Sakai: Classifying Community QA QuestionsThat Contain an Image, DEIM 2018, 2018. 学生プレゼンテーション賞. pdf
村田憲俊, 酒井哲也: 単語レベルと文字レベルの情報を用いた日本語対話システムの試作, DEIM 2018, 2018. 学生プレゼンテーション賞. pdf
小島智樹, 酒井哲也: Generative Adversarial Nets を用いた文書分類の検証, DEIM 2018, 2018. pdf
川崎真未, Inho Kang, 酒井哲也: クリックと放棄に基づくモバイルバーティカルの順位付け, DEIM 2018, 2018. pdf
Xiaojie Wang, Ji-Rong Wen, Zhicheng Dou, Tetsuya Sakai,and Rui Zhang: Search Result Diversity Evaluation based on Intent Hierarchies, IEEE TKDE, 30(1), pp.156-169, 2018.
Sosuke Kato and Tetsuya Sakai: RSL17BD at DBDC3: Computing Utterance Similarities based on Term Frequency and Word Embedding Vectors, Proceedings of DSTC6, 2017. pdf
Tetsuya Sakai: Unanimity-Aware Gain for Highly Subjective Assessments, Proceedings of EVIA 2017, pp.39-42, 2017. pdf
Tetsuya Sakai: The Effect of Inter-Assessor Disagreement on IR System Evaluation: A Case Study with Lancers and Students, Proceedings of EVIA 2017, pp.31-38 2017. pdf
Tetsuya Sakai: Towards Automatic Evaluation of Multi-Turn Dialogues: A Task Design that Leverages Inherently Subjective Annotations, Proceedings of EVIA 2017, pp.24-30, 2017. pdf
Tetsuya Sakai: Evaluating Evaluation Measures with Worst-Case Confidence Interval Widths, Proceedings of EVIA 2017, pp.16-19, 2017. pdf
Zhaohao Zeng, Cheng Luo, Lifeng Shang, Hang Li, and Tetsuya Sakai: Test Collections and Measures for Evaluating Customer-Helpdesk Dialogues, Proceedings of EVIA 2017, pp.1-9, 2017. pdf
Peng Xiao, Lingtao Li, Yimeng Fan, and Tetsuya Sakai: SLWWW at the NTCIR-13 WWW Task, Proceedings of NTCIR-13, pp.419-421, 2017. pdf
Jun Guan and Tetsuya Sakai: SLSTC at the NTCIR-13 STC Task, Proceedings of NTCIR-13, pp.231-232, 2017. pdf
Kou Sato and Tetsuya Sakai: SLQAL at the NTCIR-13 QA Lab-3 Task, Proceedings of NTCIR-13, pp.143-145, 2017. pdf
Ryo Kashimura and Tetsuya Sakai: SLOLQ at the NTCIR-13 OpenLiveQ Task, Proceedings of NTCIR-13, pp.101-104, 2017. pdf
Cheng Luo, Tetsuya Sakai, Yiqun Liu, Zhicheng Dou, Chenyan Xiong, and Jingfang Xu: Overview of the NTCIR-13 We Want Web Task, Proceedings of NTCIR-13, pp.394-401, 2017. pdf
Lifeng Shang, Tetsuya Sakai, Hang Li, Ryuichiro Higashinaka, Yusuke Miyao, Yuki Arase, and Masako Nomoto: Overview of the NTCIR-13 Short Text Conversation Task, Proceedings of NTCIR-13, pp.194-210, 2017. pdf
Mami Kawasaki, Inho Kang, and Tetsuya Sakai: Ranking Rich Mobile Verticals based on Clicks and Abandonment, Proceedings of ACM CIKM 2017, pp.2127-2130, 2017. corrected_pdf
Yuta Kadotami, Yasuaki Yoshida, Sumio Fujita, and Tetsuya Sakai: Mobile Vertical Ranking based on Preference Graphs, Proceedings of ACM ICTIR 2017, pp.225-228, 2017. preprint
Sosuke Kato, Riku Togashi, Hideyuki Maeda, Sumio Fujita, and Tetsuya Sakai: LSTM vs. BM25 for Open-domain QA: A Hands-on Comparison of Effectiveness and Efficiency, Proceedings of ACM SIGIR 2017, pp.1309-1312, 2017.
Cheng Luo, Yiqun Liu, Tetsuya Sakai, Fan Zhang, Min Zhang, Shaoping Ma: Evaluating Mobile Search with Height-Biased Gain, Proceedings of ACM SIGIR 2017, pp.435-444, 2017. preprint
Tetsuya Sakai: The Probability That Your Hypothesis Is Correct, Credible Intervals, and Effect Sizes for IR Evaluation, Proceedings of ACM SIGIR 2017, pp.25-34, 2017. preprint slides
Noriko Kando, Tetsuya Sakai, Hideo Joho, Hang Li, Arjen P. de Vries, A.P., Ryen W. White (eds.): Proceedings of ACM SIGIR 2017, 2017.
Mami Kawasaki, Inho Kang, and Tetsuya Sakai: Ranking Rich Mobile Verticals based on Clicks and Abandonment, 情報処理学会研究報告 2017-IFAT-127, pp.1-6, 2017.
Zhaohao Zeng, Cheng Luo, Lifeng Shang, Hang Li, and Tetsuya Sakai: Test Collections and Measures for Evaluating Customer-Helpdesk Dialogues, 情報処理学会研究報告 2017-NL-232, pp.1-7, 2017.
Donna Harman and Diane Kelly (eds.); James Allan, Nicholas J. Belkin, Paul Bennett, Jamie Callan, Charles Clarke, Fernando Diaz, Susan Dumais, Nicola Ferro, Donna Harman, Djoerd Hiemstra, Ian Ruthven, Tetsuya Sakai, Mark D. Smucker, Justin Zobel: Overview of Special Issue, SIGIR Forum, 51(2), 2017.
人工知能学会(編): 人工知能学大事典, 共立出版, 分担執筆, 2017.
Cheng Luo, Xue Li, Yiqun Liu, Tetsuya Sakai, Fan Zhang, Min Zhang, and Shaoping Ma: Investigating Users’ Time Perception during Web Search, Proceedings of CHIIR 2017, pp.127-136, 2017.
飯島聡美, 酒井哲也: 協調型ヘルスケア -複数人で睡眠習慣改善に臨む際の人間関係と協調の効果-, DEIM 2017, 2017. 学生プレゼンテーション賞. pdf
門田見侑大, 吉田泰明, 藤田澄男, 酒井哲也: クリックに基づく選好グラフを用いたバーティカル適合性推定, DEIM 2017, 2017. pdf
犬塚眞太郎, 酒井哲也: 拡張クエリを用いたレシピ検索のパーソナライゼーション, DEIM 2017, 2017. pdf
河東宗祐, 酒井哲也: アノテーション分布を考慮した対話破綻検出, DEIM 2017, 2017. pdf
玉置賢太, 酒井哲也: 英日言語横断検索におけるクエリ拡張結果の詳細分析, DEIM 2017, 2017. pdf
佐藤航, 酒井哲也: 解答検証を利用した選択式問題への自動解答, DEIM 2017, 2017. pdf
黒澤瞭佑, 酒井哲也: ツイートにおける周辺単語の感情極性値を用いた新語の感情推定, DEIM 2017, 2017. pdf
Cheng Luo, Yiqun Liu, Tetsuya Sakai, Ke Zhou, Fan Zhang, Xue Li, and Shaoping Ma: Does Document Relevance Affect the Searcher’s Perception of Time?, Proceedings of ACM WSDM 2017, pp.141-150, 2017.
Makoto P. Kato, Kazuaki Kishida, Noriko Kando, Tetsuya Sakai, and Mark Sanderson: Report on NTCIR-12: The Twelfth Round of NII Testbeds and Community for Information Access Research, SIGIR Forum 50 (2), pp.18-27, 2016.
酒井哲也: 評価実験の設計と論文での結果報告: きちんとやっていますか?, 第3回自然言語処理シンポジウム, 招待講演, 2016. abstract slides
Tetsuya Sakai: The Effect of Score Standardisation on Topic Set Size Design, AIRS 2016 (LNCS 9994), pp.16-28, 2016. preprint slides
河東宗祐, 酒井哲也: word2vecによる発話ベクトルの類似度を用いた対話破綻予測, 人工知能学会 音声・言語理解と対話処理研究会（SLUD）第78回研究会 (第7回対話システムシンポジウム), 2016.
Shunsuke Inegaga, Kunihiko Sadakane, and Tetsuya Sakai (eds.): Proceedings of SPIRE 2016 (LNCS 9954), Springer, 2016.
Tetsuya Sakai, Zhaohao Zeng, and Cheng Luo: Evaluating Helpdesk Dialogues: Initial Considerations from An Information Access Perspective, 情報処理学会研究報告 2016-NL-228, pp.1-10, 2016. preprint slides
Tetsuya Sakai: A Simple and Effective Approach to Score Standardisation, ACM ICTIR 2016, pp.95-104, 2016. preprnt slides
Tetsuya Sakai: Topic Set Size Design and Power Analysis in Practice (Tutorial Abstract), ACM ICTIR 2016, pp.9-10, 2016. preprint
Laure Soulier, Lynda Tamine, Tetsuya Sakai, Leif Azzopardi, and Jeremy Pickens: Report on the First International Workshop on the Evaluation on Collaborative Information Seeking and Retrieval (ECol’2015), SIGIR Forum, 50(1), 2016. pdf
Tetsuya Sakai: Two Sample T-tests for IR Evaluation: Student or Welch?, Proceedings of ACM SIGIR 2016, pp.1045-1048, 2016. preprint
Xiaojie Wang, Zhicheng Dou, Tetsuya Sakai, and Ji-Rong Wen: Evaluating Search Result Diversity using Intent Hierarchies, Proceedings of ACM SIGIR 2016, pp.415-424, 2016. preprint
Tetsuya Sakai: Statistical Significance, Power, and Sample Sizes: A Systematic Review of SIGIR and TOIS, 2006-2015, Proceedings of ACM SIGIR 2016, pp.5-14, 2016. preprint slides
Tetsuya Sakai: Topic Set Size Design, Information Retrieval Journal, 19(3), pp. 256-283, 2016. Open Access. pdf html
Satomi Iijima and Tetsuya Sakai: SLLL at the NTCIR-12 Lifelog Task: Sleepflower and the LIT Subtask, Proceedings of NTCIR-12, pp.390-391, 2016. pdf
Hiroto Denawa, Tomoaki Sano, Yuta Kadotami, Sosuke Kato, and Tetsuya Sakai: SLSTC at the NTCIR-12 STC Task, Proceedings of NTCIR-12, pp.549-551, 2016. pdf
Shin Higuchi and Tetsuya Sakai: SLQAL at the NTCIR-12 QALab-2 Task, Proceedings of NTCIR-12, pp.456-458, 2016. pdf
Hidetsugu Nanba, Tetsuya Sakai, Noriko Kando, Atsushi Keyaki, Koji Eguchi, Kenji Hatano, Toshiyuki Shimizu, Yu Hirate, and Atsushi Fujii: NEXTI at NTCIR-12 IMine-2 Task, Proceedings of NTCIR-12, pp.27-30, 2016. pdf
Makoto P. Kato, Tetsuya Sakai, Takehiro Yamamoto, Virgil Pavlu, Hajime Morita, and Sumio Fujita: Overview of the NTCIR-12 MobileClick Task, Proceedings of NTCIR-12, pp.104-114, 2016. pdf
Lifeng Shang, Tetsuya Sakai, Zhengdong Lu, Hang Li, Ryuichiro Higashinaka, and Yusuke Miyao: Overview of the NTCIR-12 Short Text Conversation Task, Proceedings of NTCIR-12, pp.473-484, 2016. pdf
Makoto P. Kato, Virgil Pavlu, Tetsuya Sakai, Takehiro Yamamoto, and Hajime Morita: Two-layered Summaries for Mobile Search: Does the Evaluation Measure Reflect User Preferences?, Proceedings of EVIA 2016, pp.29-32, 2016. pdf
Tetsuya Sakai and Lifeng Shang: On Estimating Variances for Topic Set Size Design, Proceedings of EVIA 2016, pp.9-12, 2016. pdf slides
飯島聡美, 酒井哲也: 協調型ヘルスケア -規則正しい睡眠による日中の生産性向上-, DEIM 2016, 2016. 学生プレゼンテーション賞. pdf
玉置賢太, 林佑明, 酒井哲也: 言語の分散表現と擬似適合性フィードバックを用いた英日言語横断検索, DEIM 2016, 2016. pdf
門田見侑大, 吉田泰明, 藤田澄男, 酒井哲也: コンテキスト付き検索ログを用いた要求ヴァーティカルの分析, DEIM 2016, 2016. pdf
出縄弘人, Young-In Song, 酒井哲也: ショッピングサイトにおける購入予測のための行動パターン分析, DEIM 2016, 2016. pdf
河東宗祐, 酒井哲也: 発話者を考慮した学習に基づく対話システムの検討, DEIM 2016, 2016. 学生プレゼンテーション賞. pdf
難波英嗣, 酒井哲也, 神門典子: Project Next IR -情報検索の失敗分析-, 情報処理, Vol.57, No.1, pp.24-25, 2016.
Tetsuya Sakai, Lifeng Shang, Zhengdong Lu, and Hang Li: Topic Set Size Design with the Evaluation Measures for Short Text Conversation, AIRS 2015, LNCS 9460, pp.319-331, 2015. preprint slides
Leif Azzopardi, Jeremy Pickens, Tetsuya Sakai, Laure Soulier, Lynda Tamine: ECol 2015: First International Workshop on the Evaluation of Collaborative Information Seeking and Retrieval, ACM CIKM 2015, 2015.
Sha Hu, Zhicheng Dou, Xiaojie Wang, Tetsuya Sakai, and Ji-Rong Wen: Search Result Diversification based on Hierarchical Intents, Proceedings of ACM CIKM 2015, 2015. ACM page
Tetsuya Sakai: Topic Set Size Design with the Evaluation Measures for Short Text Conversation, 情報処理学会研究報告 2015-IFAT-119/2015-DBS-161, 2015.
Yanan Qian, Qinghua Zheng, Tetsuya Sakai, Junting Ye, and Jun Liu: Dynamic Author Name Disambiguation for Growing Digital Libraries, Information Retrieval, Volume 8, Issue 5, pp.379-412, 2015. springerlink
Takuya Watanabe, Mitsuaki Akiyama, Tetsuya Sakai, Hironori Washizaki, and Tatsuya: Understanding the Inconsistencies between Text Descriptions and the Use of Privacy-sensitive Resources of Mobile Apps, SOUPS 2015, pp.241-255, 2015. pdf
酒井哲也: 情報アクセス評価方法論～検索エンジンの進歩のために～,コロナ社, 2015. The Book Page Amazon
難波英嗣，酒井哲也: 情報検索のエラー分析，言語処理学会第２１回年次大会ワークショップ, 2015.
林佑明, 酒井哲也: 言語の分散表現による文脈情報を利用した言語横断情報検索, DEIM Forum 2015, 2015. pdf
Javed Aslam, Fernando Diaz, Matthew Ekstrand-Abueg, Richard McCreadie, and Tetsuya Sakai: TREC 2014 Temporal Summarization Track Overview, TREC 2014 Proceedings, 2015. pdf
Makoto P. Kato, Matthew Ekstrand-Abueg, Virgil Pavlu, Tetsuya Sakai, Takehiro Yamamoto, and Mayu Iwata: Overview of the NTCIR-11 MobileClick Task, NTCIR-11 Proceedings, pp.195-207, 2014. pdf
Tetsuay Sakai: Topic Set Size Design with Variance Estimates from Two-Way ANOVA, EVIA 2014 Proceedings, pp.1-8, 2014. pdf slides
Tetsuya Sakai: Designing Test Collections for Comparing Many Systems, Proceedings of ACM CIKM 2014, pp.61-70, 2014.
渡邉卓弥, 秋山満昭, 酒井哲也, 鷲崎弘宜, 森達哉: Androidアプリの説明文とプライバシー情報アクセスの相関分析,マルウェア対策研究人材育成ワークショップ 2014, 2014. CSS2014学生論文賞
Haojian Jin, Tetsuya Sakai, and Koji Yatani: ReviewCollage: A Mobile Interface for Direct Comparison Using Online Reviews, Proceedings of ACM MobileHCI 2014, pp.349-358, 2014. Honorable Mention. ACM page
Tetsuya Sakai: Designing Test Collections That Provide Tight Confidence Intervals, Forum on Information Technology 2014, RD-003, 2014. preprint slides
Tetsuya Sakai: Statistical Reform in Information Retrieval?, SIGIR Forum, 48(1), pp.3-12, 2014. pdf
渡邉卓弥, 森達哉, 酒井哲也: 映像入力デバイスを悪用する Android アプリの解析と対策法, 信学技報 ICSS2013-78(2014-3), pp.119-124, 2014.
Javd Aslam, Fernando Diaz, Matthew Ekstrand-Abueg, Virgil Pavlu, and Tetsuya Sakai: TREC 2013 Temporal Summarization, TREC 2013 Proceedings, 2014. pdf
Tetsuya Sakai: Metrics, Statistics, Tests (invited paper), PROMISE Winter School 2013: Bridging between Information Retrieval and Databases (LNCS 8173), pp.116-163, Springer, 2014. preprint