The Sakai Laboratory, Department of Computer Science and Engineering, Waseda University


  • sakailab.com
  • sakailab.com/english/
  • Professor Tetsuya Sakai
  •  


    Sakai Lab’s publications (2014-)


    Last updated: July 12, 2021


    red=invited/editor/book author; purple=non-refereed


    2021

    楢木悠士, 酒井哲也, 林 良彦: 対話要約における話者情報を持つEmbeddingの効果, FIT2021講演論文集, E-042, to appear, 2021.

    Tetsuya Sakai: Evaluating Evaluation Measures for Ordinal Classification and Ordinal Quantification, Proceedings of ACL-IJCNLP 2021, to appear, 2021. links to preprint, slides, videos, including tutorials on evaluation measures

    Tetsuya Sakai, Sijie Tao and Zhaohao Zeng: WWW3E8: 259,000 Relevance Labels for Studying the Effect of Document Presentation Order for Relevance Assessors, Proceedings of ACM SIGIR 2021, to appear, 2021. preprint slides 6-minute video

    Tetsuya Sakai: On the Two-Sample Randomisation Test for IR Evaluation, Proceedings of ACM SIGIR 2021, to appear, 2021. corrected pdf slides 5-minute video

    Riku Togashi, Masahiro Kato, Mayu Otani, Tetsuya Sakai and Shin’Ichi Satoh: Scalable Personalised Item Ranking through Parametric Density Estimation, Proceedings of ACM SIGIR 2021, to appear, 2021. preprint

    Fernando, Diaz, Chirag Shah, Torsten Suel, Pablo Castells, Rosie Jones, Tetsuya Sakai, Alejandro Bellogín, and Masaharu Yoshioka (eds.): Proceedings of ACM SIGIR 2021, 2021 ACM DL page

    Rikiya Suzuki and Tetsuya Sakai: Fast and Exact Randomisation Test for Comparing Two Systems with Paired Data, Proceedings of ACM ICTIR 2021, to appear, 2021. preprint slides 11-minute video

    Zhaohao Zeng and Tetsuya Sakai: DCH-2: A Parallel Customer-Helpdesk Dialogue Corpus with Distributions of Annotators’ Labels, arXiv:2104.08755, 2021.

    Yuki Amemiya, Tomohiro Manabe, Sumio Fujita, and Tetsuya Sakai: How Do Users Revise Zero-Hit Product Search Queries?, Proceedings of ECIR 2021 Part II (LNCS 12657), pp.185-192, 2021. preprint

    Tetsuya Sakai: On the Instability of Diminishing Return IR Measures, Proceedings of ECIR 2021 Part I (LNCS 12656), pp.572-586, 2021. preprint 20-minute video

    Chih-hao Wang, Sosuke Kato and Tetsuya Sakai: RSL19BD at DBDC4: Ensemble of Decision Tree-Based and LSTM-Based Models, Increasing Naturalness and Flexibility in Spoken Dialogue Interaction: 10th International Workshop on Spoken Dialogue Systems (LNEE 714), pp.429-441, Springer, 2021.

    Sijie Tao and Tetsuya Sakai: RealSakaiLab at the TREC 2020 Health Misinformation Track, Proceedings of TREC 2020, 2021. pdf

    楢木悠士, 酒井哲也: 話者情報を認識した対話要約, 言語処理学会第27回年次大会発表論文集, pp.1259-1263, 2021. pdf

    刀塚敦子, 飯島涼, 渡邉卓弥, 秋山満昭, 酒井哲也, 森達哉: Voice Assistantアプリの対話型解析システムの開発, 電子情報通信学会 第54回情報通信システムセキュリティ研究会, pp.132-137, 2021.

    栗林峻, 酒井哲也: モバイルアプリケーションにおけるUIデザイン自動評価の検討, DEIM 2021, 2021. pdf

    雨宮佑基, 酒井哲也: スタンス検出タスクにおける評価方法の選定, DEIM 2021, 2021. pdf DEIM 2021 優秀論文賞

    清水嶺, 酒井哲也: 日経新聞の記事からの日経ラジオ用読み原稿の自動生成, DEIM 2021, 2021. pdf 学生プレゼンテーション賞

    小橋賢介, 雨宮佑基, 酒井哲也: 有用なレビューを抽出するための比較文フィルタリングの検討, DEIM 2021, 2021. pdf

    Tetsuya Sakai, Sijie Tao, and Zhaohao Zeng: Relevance Assessments for Web Search Evaluation: Should We Randomise or Prioritise the Pooled Documents?, 情報処理学会研究報告 2019-IFAT-141(1), 2021.

    2020

    Tetsuya Sakai and Zhaohao Zeng: Retrieval Evaluation Measures that Agree with Users’ SERP Preferences: Traditional, Preference-based, and Diversity Measures, ACM TOIS, 39(2), Article No.14, 2020. pdf slides used at SIGIR 2021 11-minute video used at SIGIR 2021

    Yuji Naraki and Tetsuya Sakai: selt Team’s Entity Linking System at the NTCIR-15 QALab-PoliInfo2, Proceedings of NTCIR-15, pp.142-144, 2020. pdf

    Masaki Muraoka, Zhaohao Zeng, and Tetsuya Sakai: SLWWW at the NTCIR-15WWW-3 Task, Proceedings of NTCIR-15, pp.243-246, 2020. pdf

    Tetsuya Sakai, Sijie Tao, Zhaohao Zeng, Yukun Zheng, Jiaxin Mao, Zhumin Chu, Yiqun Liu, Maria Maistro, Zhicheng Dou, Nicola Ferro, Ian Soboroff: Overview of the NTCIR-15 We Want Web with CENTRE (WWW-3) Task, Proceedings of NTCIR-15, pp.219-234, 2020. pdf

    Ting Cao, Fan Zhang, Haoxiang Shi, Zhaohao Zeng, Sosuke Kato, Tetsuya Sakai, Injae Lee, Kyungduk Kim, and Inho Kang: RSLNV at the NTCIR-15 Dialogue Evaluation (DialEval-1) Task, Proceedings of NTCIR-15, pp.57-61, 2020. pdf

    Junjie Wang, Yuxiang Zhang, Tetsuya Sakai, and Hayato Yamana: SKYMN at the NTCIR-15 DialEval-1 Task, Proceedings of NTCIR-15, pp.40-46, 2020. pdf

    Zhaohao Zeng, Sosuke Kato, Tetsuya Sakai, and Inho Kang: Overview of the NTCIR-15 Dialogue Evaluation (DialEval-1) Task, Proceedings of NTCIR-15, pp.13-34, 2020. pdf

    Haoxiang Shi, Cen Wang, and Tetsuya Sakai: A Siamese CNN Architecture for Learning Chinese Sentence Similarity, Proceedings of AACL-IJCNLP 2020 Student Research Workshop (SRW), pp.24-29, 2020. pdf

    Riku Togashi, Sumio Fujita, and Tetsuya Sakai: Automatic Evaluation of Iconic Image Retrieval based on Colour, Shape, and Texture, Proceedings of ACM ICMR 2020, p.346–354, 2020. preprint

    Ruihua Song, Min Zhang, Cheng Luo, Tetsuya Sakai, Yiqun Liu, Zhicheng Dou: SogouQ: The First Large-Scale Test Collection with Click Streams Used in a Shared-Task Evaluation, Evaluating Information Retrieval and Access Tasks: NTCIR’s Legacy of Research Impact, Springer, pp.143-150, 2020. open access chapter pdf

    Tetsuya Sakai: Graded Relevance, Evaluating Information Retrieval and Access Tasks: NTCIR’s Legacy of Research Impact, Springer, pp.1-20, 2020. open access chapter pdf

    Tetsuya Sakai, Douglas W. Oard, and Noriko Kando (eds.): Evaluating Information Retrieval and Access Tasks: NTCIR’s Legacy of Research Impact, Springer, 2020. open access book pdf

    酒井哲也, Zhaohao Zeng: ユーザの感覚に近い多様化検索評価指標, FIT2020講演論文集, CD-002, 2020. FIT 2020 論文賞

    Riku Togashi and Tetsuya Sakai: Visual Intents vs. Clicks, Likes, and Purchases in E-commerce, Proceedings of ACM SIGIR 2020, pp.1869-1872, 2020.

    Tetsuya Sakai and Zhaohao Zeng: Good Evaluation Measures based on Document Preferences, Proceedings of ACM SIGIR 2020, pp.359-368, 2020. preprint slides 15-minute video

    Timo Breuer, Nicola Ferro, Norbert Fuhr, Maria Maistro, Tetsuya Sakai, Philipp Schaer, and Ian Soboroff: How to Measure the Reproducibility of System-oriented IR Experiments, Proceedings of ACM SIGIR 2020, pp.349-358, 2020. preprint

    Ian Soboroff, Nicola Ferro, Maria Maistro, and Tetsuya Sakai: Overview of the TREC 2018 CENTRE Track, Proceedings of TREC 2018, 2020. pdf

    Tetsuya Sakai: On Fuhr’s Guideline for IR Evaluation, SIGIR Forum, 54(1), 2020. pdf

    三王慶太, 酒井哲也: 文書分類技術に基づくエントリーシートからの業界推薦, 日本データベース学会和文論文誌, Vol.18-J, Article No.11, 2020. pdf

    Peng Xiao, Joo-Young Lee, Sijie Tao, Young-Sook Hwang, and Tetsuya Sakai: Generating Short Product Descriptors based on Very Little Training Data, Proceedings of AIRS 2019 (LNCS 12004), pp.133-144, 2020.

    Tetsuya Sakai and Peng Xiao: Randomised vs. Prioritised Pools for Relevance Assessments: Sample Size Considerations, Proceedings of AIRS 2019 (LNCS 12004), pp.94-105, 2020.

    Rikiya Suzuki, Sumio Fujita, and Tetsuya Sakai: Arc Loss: Softmax with Additive Angular Margin for Answer Retrieval, Proceedings of AIRS 2019 (LNCS 12004), pp.34-40, 2020.

    Sosuke Kato, Toru Shimizu, Sumio Fujita, and Tetsuya Sakai: Unsupervised Answer Retrieval with Data Fusion for Community Question Answering, Proceedings of AIRS 2019 (LNCS 12004), pp.10-21, 2020.

    Hsin-Wen Liu, Sumio Fujita, and Tetsuya Sakai: Towards Automatic Evaluation of Reused Answers in Community Question Answering, Proceedings of AIRS 2019 (LNCS 12004), pp.3-9, 2020.

    Sijie Tao and Tetsuya Sakai: Improving Concept Representations for Short Text Classification, 言語処理学会第26回年次大会発表論文集, pp.251-254, 2020.

    Shiyoh Goetsu and Tetsuya Sakai: Different Types of Voice User Interface Failures May Cause Different Degrees of Frustration, インタラクション 2020, pp.473-477, 2020. pdf

    小橋賢介, 酒井哲也: 商品比較のための文脈つき評価軸抽出の検討, DEIM 2020, 2020. pdf

    小島智樹, 酒井哲也: Androidアプリの権限要求に対する説明十分性の自動確認システムの提案, DEIM 2020, 2020. pdf

    Quanyu Piao, Joo-Young Lee, and Tetsuya Sakai: Purchase Prediction based on Recurrent Neural Networks with an Emphasis on Recent User Activities, DEIM 2020, 2020. pdf

    Haoxiang Shi, Cen Wang, and Tetsuya Sakai: Experiments on Unsupervised Text Classification based on Graph Neural Networks, DEIM 2020, 2020. pdf

    Lingfeng Zhang and Tetsuya Sakai: Do Neural Models for Response Generation Fully Exploit the Input Natural Language Text? DEIM 2020, 2020. pdf

    雨宮佑基, 真鍋知博, 藤田澄男, 酒井哲也: 商品検索におけるゼロマッチ解消のためのデータセット構築の検討, DEIM 2020, 2020. オンラインプレゼンテーション賞. pdf

    村田憲俊, 酒井哲也: 解釈可能な内部表現を使用したタスク指向ニューラル対話システムの試作, DEIM 2020, 2020. オンラインプレゼンテーション賞. pdf

    Wanqi Wu and Tetsuya Sakai: Response Generation based on the Big Five Personality Traits, DEIM 2020, 2020. pdf

    Shiyoh Goetsu and Tetsuya Sakai: Different Types of Voice User Interface Failures May Cause Different Degrees of Frustration, arXiv:2002.03582, 2020.

    Zhicheng Dou, Xue Yang, Diya Li, Ji-Rong Wen, and Tetsuya Sakai: Low-cost, Bottom-up Measures for Evaluating Search Result Diversification, Information Retrieval Journal, 23, pp.86-113, 2020. springerlink

    2019

    Zhaohao Zeng, Ruihua Song, Pingping Lin, and Tetsuya Sakai: Attitude Detection for One-Round Conversation: Jointly Extracting Target-Polarity Pairs, Journal of Information Processing, Volume 27, pp.742-751, 2019. pdf

    Atsuko Natatsuka, Mitsuaki Akiyama, Ryo Iijima, Tetsuya Sakai, Takuya Watanabe, and Tatsuya Mori: A First Look at the Privacy Risks of Voice Assistant Apps, ACM CCS 2019 Posters & Demos, to appear, 2019.

    Shiyoh Goetsu and Tetsuya Sakai: Voice Input Interface Failures and Frustration: Developer and User Perspectives, ACM UIST 2019 Adjunct, to appear, 2019.

    刀塚敦子, 飯島涼, 渡邉卓弥, 秋山満昭, 酒井哲也, 森達哉: Voice Assistant アプリの大規模実態調査, コンピュータセキュリティシンポジウム 2019. CSS2019最優秀論文賞

    Tetsuya Sakai: How to Run an Evaluation Task: with a Primary Focus on Ad Hoc Information Retrieval, Information Retrieval Evaluation in a Changing World: Lessons Learned from 20 Years of CLEF, Springer, pp.71-102, 2019. springerlink

    Chao-Chung Wu, Ruihua Song, Tetsuya Sakai, Wen-Feng Cheng, Xing Xie, and Shou-De Lin: Evaluating Image-Inspired Poetry Generation, Proceedings of NLPCC 2019, 2019. pdf

    Shigeichi Hirasawa, Gendo Kumoi, Hideki Yagi, Manabu Kobayashi, Masayuki Goto, Tetsuya Sakai, and Hiroshige Inazumi: System Evaluation of Ternary Error-Correcting Output Codes for Multiclass Classification Problems, IEEE SMC 2019, 2019. preprint

    Riku Togashi and Tetsuya Sakai: Generalising Kendall’s Tau for Noisy and Incomplete Preference Judgements, Proceedings of ACM ICTIR 2019, 2019.

    酒井哲也: NTCIR-15ウェブ検索・再現可能性タスク (WWW-3) および対話評価タスク (DialEval-1)への誘い, 情報処理学会研究報告 2019-IFAT-136(20), 2019. slides

    Nicola Ferro, Norbert Fuhr, Maria Maistro, Tetsuya Sakai, and Ian Soboroff: CENTRE@CLEF2019: Sequel in the Systematic Reproducibility Realm, Proceedings of CLEF 2019 (LNCS 11696), pp.287-300, 2019.

    Nicola Ferro, Norbert Fuhr, Maria Maistro, Tetsuya Sakai, and Ian Soboroff: CENTRE@CLEF2019: Overview of the Replicability and Reproducibility Tasks (invited paper), CLEF 2019 Working Notes, 2019. pdf

    Xiaoyu Qi, Ruihua Song, Chunting Wang, Jin Zhou, and Tetsuya Sakai: Composing a Picture Book by Automatic Story Understanding and Visualization, Proceedings of the Second Storytelling Workshop (StoryNLP @ ACL2019), pp.1-10, 2019. pdf

    Zhaohao Zeng and Tetsuya Sakai: BM25 Pseudo Relevance Feedback Using Anserini at Waseda University, Proceedings of OSIRRC 2019, pp.62-63, 2019. pdf

    Ryan Clancy, Nicola Ferro, Claudia Hauff, Jimmy Lin, Tetsuya Sakai, Ze Zhong Wu: Overview of the 2019 Open-Source IR Replicability Challenge (OSIRRC 2019), Proceedings of OSIRRC 2019, pp.1-7, 2019. pdf

    Ryan Clancy, Nicola Ferro, Claudia Hauff, Jimmy Lin, Tetsuya Sakai, Ze Zhong Wu (eds.): Proceedings of the Open-Source IR Replicability Challenge (OSIRRC 2019), 2019. ceur-ws.org/Vol-2409/

    Ryan Clancy, Nicola Ferro, Claudia Hauff, Jimmy Lin, Tetsuya Sakai, Ze Zhong Wu The SIGIR 2019 Open-Source IR Replicability Challenge (OSIRRC 2019), Proceedings of ACM SIGIR 2019, pp.1432-1434, 2019.

    Tetsuya Sakai and Zhaohao Zeng: Which Diversity Evaluation Measures Are “Good”?, Proceedings of ACM SIGIR 2019, pp.595-604, 2019. preprint slides

    Chih-hao Wang, Sosuke Kato, and Tetsuya Sakai: RSL19BD at DBDC4: Ensemble of Decision Tree-based and LSTM-based Models, Proceedings of Chatbots and Conversational Agents and Dialogue Breakdown Detection Challenge (WOCHAT+DBDC), IWSDS 2019, 2019. pdf

    Peng Xiao and Tetsuya Sakai: SLWWW at the NTCIR-14 We Want Web Task, Proceedings of NTCIR-14, pp.490-493, 2019. pdf

    Sosuke Kato, Rikiya Suzuki, Zhaohao Zeng, and Tetsuya Sakai: SLSTC at the NTCIR-14 STC-3 Dialogue Quality and Nugget Detection Subtasks, Proceedings of NTCIR-14, pp.355-361, 2019. pdf

    Zhaohao Zeng, Sosuke Kato, and Tetsuya Sakai: Overview of the NTCIR-14 Short Text Conversation Task: Dialogue Quality and Nugget Detection Subtasks, Proceedings of NTCIR-14, pp.289-315, 2019. pdf

    Jiaxin Mao, Tetsuya Sakai, Cheng Luo, Peng Xiao, Yiqun Liu, and Zhicheng Dou: Overview of the NTCIR-14 We Want Web Task, Proceedings of NTCIR-14, pp.455-467, 2019. pdf

    Tetsuya Sakai, Nicola Ferro, Ian Soboroff, Zhaohao Zeng, Peng Xiao, and Maria Maistro: Overview of the NTCIR-14 CENTRE Task, Proceedings of NTCIR-14, pp.494-509, 2019. pdf slides

    Douglas W. Oard, D.W., Tetsuya Sakai, and Noriko Kando: Celebrating 20 Years of NTCIR: The Book, Proceedings of EVIA 2019, p.3, 2019. pdf

    Chih-hao Wang, Sosuke Kato, and Tetsuya Sakai: RSL19BD at DBDC4: Ensemble of Decision Tree-based and LSTM-based Models, arXiv:1905.01799, 2019.

    Nicola Ferro, Norbert Fuhr, Maria Maistro, Tetsuya Sakai, and Ian Soboroff: CENTRE@CLEF 2019, Proceedings of ECIR 2019 Part II (LNCS 11438), pp.283-290, 2019.

    Tetsuya Sakai: Conducting Laboratory Experiments Properly with Statistical Tools: An Easy Hands-on Tutorial, Proceedings of ECIR 2019 Part II (LNCS 11438), pp.405-407, 2019. slides

    Tetsuya Sakai: Graded Relevance Assessments and Graded Relevance Measures of NTCIR: A Survey of the First Twenty Years, arXiv:1903.11272, 2019. slides from EVIA 2019

    Yuliska and Tetsuya Sakai: A Comparative Study of Deep Learning Approaches for Extractive Query-Focused Multi-Document Summarization, Proceedings of IEEE ICICT 2019, 2019.

    三王慶太,酒井哲也: 文書分類技術に基づくエントリーシートからの業界推薦, DEIM 2019, 2019. 学生プレゼンテーション賞. pdf

    村田憲俊,酒井哲也: Twitterコーパスに基づく雑談対話システムにおける多様性の獲得, DEIM 2019, 2019. 学生プレゼンテーション賞. pdf

    河東宗祐,酒井哲也: Dialogue Quality Distribution Prediction based on a Loss that Compares Adjacent Probability Bins, DEIM 2019, 2019. pdf

    黒澤瞭佑,酒井哲也: 能動学習を利用した未知語アノテーションの検討, DEIM 2019, 2019. pdf

    小島智樹,酒井哲也: Androidアプリの権限要求に対するユーザーへの説明の補完, DEIM 2019, 2019. pdf

    Sijie Tao and Tetsuya Sakai: Exploring Multi-label Classification Using Text Graph Convolutional Networks on the NTCIR-13 MedWeb Dataset, DEIM 2019, 2019. pdf

    Yuliska and Tetsuya Sakai: Query-Focused Extractive Summarization based on Deep Learning: Comparison of Similarity Measures for Pseudo Ground Truth Generation, DEIM 2019, 2019. pdf

    呉越思瑶,酒井哲也: 音声ユーザインタフェースにおける処理エラーによるユーザフラストレーションに関する調査, DEIM 2019, 2019. pdf

    雨宮佑基,酒井哲也: Convolutional Neural Networkを用いたFake News Challengeの検討, DEIM 2019, 2019. pdf

    坂本凜,酒井哲也: FigureQAタスクにおける抽象画像を考慮したアプローチ, DEIM 2019, 2019. pdf

    小橋賢介, 酒井哲也: 擬似アノテーションにもとづく日本語ツイートの極性判定, DEIM 2019, 2019. pdf

    Zhaohao Zeng, Ruihua Song, Pingping Lin, and Tetsuya Sakai: Attitude Detection for One-Round Conversation: Jointly Extracting Target-Polarity Pairs, Proceedings of ACM WSDM 2019, pp.285-293, 2019.

    Tetsuya Sakai: Conducting Laboratory Experiments Properly with Statistical Tools: An Easy Hands-on Tutorial, Proceedings of ACM WSDM 2019, pp.830-831, 2019.

    2018

    Tetsuya Sakai: Advanced Information Retrieval Measures. In: Liu L., Özsu M. (eds) Encyclopedia of Database Systems (Second Edition), Springer, 2018. springerlink

    Tetsuya Sakai: alpha-nDCG. In: Ling Liu and M. Tamer Özsu (eds) Encyclopedia of Database Systems (Second Edition), Springer, 2018. springerlink

    Tetsuya Sakai: D-Measure. In: Ling Liu and M. Tamer Özsu (eds) Encyclopedia of Database Systems (Second Edition), Springer, 2018. springerlink

    Tetsuya Sakai: ERR-IA. In: Ling Liu and M. Tamer Özsu (eds) Encyclopedia of Database Systems (Second Edition), Springer, 2018. springerlink

    Tetsuya Sakai: Expected Reciprocal Rank. In: Ling Liu and M. Tamer Özsu (eds) Encyclopedia of Database Systems (Second Edition), Springer, 2018. springerlink

    Tetsuya Sakai: Q-Measure. In: Ling Liu and M. Tamer Özsu (eds) Encyclopedia of Database Systems (Second Edition), Springer, 2018. springerlink

    Tetsuya Sakai: U-Measure. In: Ling Liu and M. Tamer Özsu (eds) Encyclopedia of Database Systems (Second Edition), Springer, 2018. springerlink

    Yuen-Hsien Tseng, Tetsuya Sakai, Jing Jiang, Lun-Wei Ku, Dae Hoon Park, Jui-Feng Yeh, Liang-Chih Yu, Lung-Hao Lee, Zhi-Hong Chen: Proceedings of AIRS 2018 (LNCS 11292), 2018.

    Takuya Watanabe, Akiyama Mitsuki, Tetsuya Sakai, Hironori Washizaki, and Tatsuya Mori: Understanding the Inconsistency between Behaviors and Descriptions of Mobile Apps, IEICE Transactions, Vol.E101-D, No.11, pp.2584-2599, 2018.

    Guoshuai Zhao, Hao Fu, Ruihua Song, Tetsuya Sakai, Xing Xie, and Xueming Qian: Why You Should Listen to This Song: Reason Generation for Explainable Recommendation, 1st Workshop on Scalable and Applicable Recommendation Systems (SAREC 2018), to appear, 2018.

    Tetsuya Sakai: Laboratory Experiments in Information Retrieval: Sample Sizes, Effect Sizes, and Statistical Power, Springer, 2018. Springer Page The Book Page

    Nicola Ferro, Maria Maistro, Tetsuya Sakai, and Ian Soboroff: Overview of CENTRE@CLEF 2018: a First Tale in the Systematic Reproducibility Realm, Proceedings of CLEF 2018 (LNCS 11018), pp.239-246, 2018.

    Zhaohao Zeng, Cheng Luo, Lifeng Shang, Hang Li, and Tetsuya Sakai: Towards Automatic Evaluation of Customer-Helpdesk Dialogues, Journal of Information Processing, Volume 26, pp.768-778, 2018. WebDB Forum 2018 Best Paper Runner-up pdf

    川崎真未, Inho Kang, 酒井哲也: 放棄セッションにおけるユーザ操作に着目したモバイル検索カードの順位付け, IPSJ TOD 11(3), pp.1-11, 2018.

    小島智樹, 酒井哲也: Androidアプリのレビューを用いたユーザーへの権限説明の補完, 情報処理学会研究報告, 2018-NL-237 (4), 2018.

    Kenta Tamaki, Riku Togashi, Sosuke Kato, Sumio Fujita, Hideyuki Maeda, and Tetsuya Sakai: Classifying Community QA Questions That Contain an Image, Proceedings of ACM ICTIR 2018, pp.219-222, 2018. preprint

    Sakai. T.: Topic Set Size Design for Paired and Unpaired Data, Proceedings of ACM ICTIR 2018, pp.199-202, 2018. preprint

    富樫陸, 藤田澄男, 酒井哲也: 色・形状・テクスチャに基づく画像検索の自動評価と多様化, 情報処理学会研究報告, 2018-IFAT-132 (12), 2018. WebDB Forum 2018 学生奨励賞.

    河東宗祐, 酒井哲也: 対話破綻検出コーパスに対する学習データ選別の検討, 情報処理学会研究報告, 2018-IFAT-132 (28), 2018. WebDB Forum 2018 FRONTEO Award

    Hsin-Wen Liu, Avikalp Srivastava, Sumio Fujita, Toru Shimizu, Riku Togashi, and Tetsuya Sakai: A Comparative Study of Deep Learning Approaches for Visual Question Classification in Community QA, IPSJ SIG Technical Report, 2018-IFAT-132 (17), 2018.

    Nicola Ferro, Maria Maistro, Tetsuya Sakai, and Ian Soboroff: CENTRE@CLEF2018: Overview of the Replicability Task (invited paper), CLEF 2018 Working Notes, 2018. pdf

    Tetsuya Sakai: Comparing Two Binned Probability Distributions for Information Access Evaluation, Proceedings of ACM SIGIR 2018, pp.1073-1076, 2018. preprint

    Tetsuya Sakai: Conducting Laboratory Experiments Properly with Statistical Tools: An Easy Hands-on Tutorial, Proceedings of ACM SIGIR 2018, pp.1369-1370, 2018. preprint slides

    Yiqun Liu, Makoto P. Kato, Charles L.A. Clarke, Noriko Kando, and Tetsuya Sakai: Report on NTCIR-13: The Thirteenth Round of NII Testbeds and Community for Information Access Research, SIGIR Forum, 52(1), 2018. pdf

    呉越思瑶, 酒井哲也: ユーザーのニーズに合わせたインタラクティブな推薦システムの提案, DEIM 2018, 2018. pdf

    Kenta Tamaki, Riku Togashi, Sumio Fujita, Hideyuki Maeda, Tetsuya Sakai: Classifying Community QA QuestionsThat Contain an Image, DEIM 2018, 2018. 学生プレゼンテーション賞. pdf

    村田憲俊, 酒井哲也: 単語レベルと文字レベルの情報を用いた日本語対話システムの試作, DEIM 2018, 2018. 学生プレゼンテーション賞. pdf

    小島智樹, 酒井哲也: Generative Adversarial Nets を用いた文書分類の検証, DEIM 2018, 2018. pdf

    川崎真未, Inho Kang, 酒井哲也: クリックと放棄に基づくモバイルバーティカルの順位付け, DEIM 2018, 2018. pdf

    Xiaojie Wang, Ji-Rong Wen, Zhicheng Dou, Tetsuya Sakai,and Rui Zhang: Search Result Diversity Evaluation based on Intent Hierarchies, IEEE TKDE, 30(1), pp.156-169, 2018.

    2017

    Sosuke Kato and Tetsuya Sakai: RSL17BD at DBDC3: Computing Utterance Similarities based on Term Frequency and Word Embedding Vectors, Proceedings of DSTC6, 2017. pdf

    Tetsuya Sakai: Unanimity-Aware Gain for Highly Subjective Assessments, Proceedings of EVIA 2017, pp.39-42, 2017. pdf

    Tetsuya Sakai: The Effect of Inter-Assessor Disagreement on IR System Evaluation: A Case Study with Lancers and Students, Proceedings of EVIA 2017, pp.31-38 2017. pdf

    Tetsuya Sakai: Towards Automatic Evaluation of Multi-Turn Dialogues: A Task Design that Leverages Inherently Subjective Annotations, Proceedings of EVIA 2017, pp.24-30, 2017. pdf

    Tetsuya Sakai: Evaluating Evaluation Measures with Worst-Case Confidence Interval Widths, Proceedings of EVIA 2017, pp.16-19, 2017. pdf

    Zhaohao Zeng, Cheng Luo, Lifeng Shang, Hang Li, and Tetsuya Sakai: Test Collections and Measures for Evaluating Customer-Helpdesk Dialogues, Proceedings of EVIA 2017, pp.1-9, 2017. pdf

    Peng Xiao, Lingtao Li, Yimeng Fan, and Tetsuya Sakai: SLWWW at the NTCIR-13 WWW Task, Proceedings of NTCIR-13, pp.419-421, 2017. pdf

    Jun Guan and Tetsuya Sakai: SLSTC at the NTCIR-13 STC Task, Proceedings of NTCIR-13, pp.231-232, 2017. pdf

    Kou Sato and Tetsuya Sakai: SLQAL at the NTCIR-13 QA Lab-3 Task, Proceedings of NTCIR-13, pp.143-145, 2017. pdf

    Ryo Kashimura and Tetsuya Sakai, T.: SLOLQ at the NTCIR-13 OpenLiveQ Task, Proceedings of NTCIR-13, pp.101-104, 2017. pdf

    Cheng Luo, Tetsuya Sakai, Yiqun Liu, Zhicheng Dou, Chenyan Xiong, and Jingfang Xu: Overview of the NTCIR-13 We Want Web Task, Proceedings of NTCIR-13, pp.394-401, 2017. pdf

    Lifeng Shang, Tetsuya Sakai, Hang Li, Ryuichiro Higashinaka, Yusuke Miyao, Yuki Arase, and Masako Nomoto: Overview of the NTCIR-13 Short Text Conversation Task, Proceedings of NTCIR-13, pp.194-210, 2017. pdf

    Mami Kawasaki, Inho Kang, and Tetsuya Sakai: Ranking Rich Mobile Verticals based on Clicks and Abandonment, Proceedings of ACM CIKM 2017, pp.2127-2130, 2017. corrected_pdf

    Yuta Kadotami, Yasuaki Yoshida, Sumio Fujita, and Tetsuya Sakai: Mobile Vertical Ranking based on Preference Graphs, Proceedings of ACM ICTIR 2017, pp.225-228, 2017. preprint

    Sosuke Kato, Riku Togashi, Hideyuki Maeda, Sumio Fujita, and Tetsuya Sakai: LSTM vs. BM25 for Open-domain QA: A Hands-on Comparison of Effectiveness and Efficiency, Proceedings of ACM SIGIR 2017, pp.1309-1312, 2017.

    Cheng Luo, Yiqun Liu, Tetsuya Sakai, Fan Zhang, Min Zhang, Shaoping Ma: Evaluating Mobile Search with Height-Biased Gain, Proceedings of ACM SIGIR 2017, pp.435-444, 2017. preprint

    Tetsuya Sakai: The Probability That Your Hypothesis Is Correct, Credible Intervals, and Effect Sizes for IR Evaluation, Proceedings of ACM SIGIR 2017, pp.25-34, 2017. preprint slides

    Noriko Kando, Tetsuya Sakai, Hideo Joho, Hang Li, Arjen P. de Vries, A.P., Ryen W. White (eds.): Proceedings of ACM SIGIR 2017, 2017.

    Mami Kawasaki, Inho Kang, and Tetsuya Sakai: Ranking Rich Mobile Verticals based on Clicks and Abandonment, 情報処理学会研究報告 2017-IFAT-127, pp.1-6, 2017.

    Zhaohao Zeng, Cheng Luo, Lifeng Shang, Hang Li, and Tetsuya Sakai: Test Collections and Measures for Evaluating Customer-Helpdesk Dialogues, 情報処理学会研究報告 2017-NL-232, pp.1-7, 2017.

    Donna Harman and Diane Kelly (eds.); James Allan, Nicholas J. Belkin, Paul Bennett, Jamie Callan, Charles Clarke, Fernando Diaz, Susan Dumais, Nicola Ferro, Donna Harman, Djoerd Hiemstra, Ian Ruthven, Tetsuya Sakai, Mark D. Smucker, Justin Zobel: Overview of Special Issue, SIGIR Forum, 51(2), 2017.

    人工知能学会(編): 人工知能学大事典, 共立出版, 分担執筆, 2017.

    Cheng Luo, Xue Li, Yiqun Liu, Tetsuya Sakai, Fan Zhang, Min Zhang, and Shaoping Ma: Investigating Users’ Time Perception during Web Search, Proceedings of CHIIR 2017, pp.127-136, 2017.

    飯島聡美, 酒井哲也: 協調型ヘルスケア -複数人で睡眠習慣改善に臨む際の人間関係と協調の効果-, DEIM 2017, 2017. 学生プレゼンテーション賞. pdf

    門田見侑大, 吉田泰明, 藤田澄男, 酒井哲也: クリックに基づく選好グラフを用いたバーティカル適合性推定, DEIM 2017, 2017. pdf

    犬塚眞太郎, 酒井哲也: 拡張クエリを用いたレシピ検索のパーソナライゼーション, DEIM 2017, 2017. pdf

    河東宗祐, 酒井哲也: アノテーション分布を考慮した対話破綻検出, DEIM 2017, 2017. pdf

    玉置賢太, 酒井哲也: 英日言語横断検索におけるクエリ拡張結果の詳細分析, DEIM 2017, 2017. pdf

    佐藤航, 酒井哲也: 解答検証を利用した選択式問題への自動解答, DEIM 2017, 2017. pdf

    黒澤瞭佑, 酒井哲也: ツイートにおける周辺単語の感情極性値を用いた新語の感情推定, DEIM 2017, 2017. pdf

    Cheng Luo, Yiqun Liu, Tetsuya Sakai, Ke Zhou, Fan Zhang, Xue Li, and Shaoping Ma: Does Document Relevance Affect the Searcher’s Perception of Time?, Proceedings of ACM WSDM 2017, pp.141-150, 2017.

    2016

    Makoto P. Kato, Kazuaki Kishida, Noriko Kando, Tetsuya Sakai, and Mark Sanderson: Report on NTCIR-12: The Twelfth Round of NII Testbeds and Community for Information Access Research, SIGIR Forum 50 (2), pp.18-27, 2016.

    酒井哲也: 評価実験の設計と論文での結果報告: きちんとやっていますか?, 第3回自然言語処理シンポジウム, 招待講演, 2016. abstract slides

    Tetsuya Sakai: The Effect of Score Standardisation on Topic Set Size Design, AIRS 2016 (LNCS 9994), pp.16-28, 2016. preprint slides

    河東宗祐, 酒井哲也: word2vecによる発話ベクトルの類似度を用いた対話破綻予測, 人工知能学会 音声・言語理解と対話処理研究会(SLUD)第78回研究会 (第7回対話システムシンポジウム), 2016.

    Shunsuke Inegaga, Kunihiko Sadakane, and Tetsuya Sakai (eds.): Proceedings of SPIRE 2016 (LNCS 9954), Springer, 2016.

    Tetsuya Sakai, Zhaohao Zeng, and Cheng Luo: Evaluating Helpdesk Dialogues: Initial Considerations from An Information Access Perspective, 情報処理学会研究報告 2016-NL-228, pp.1-10, 2016. slides

    Tetsuya Sakai: A Simple and Effective Approach to Score Standardisation, ACM ICTIR 2016, pp.95-104, 2016. preprnt slides

    Tetsuya Sakai: Topic Set Size Design and Power Analysis in Practice (Tutorial Abstract), ACM ICTIR 2016, pp.9-10, 2016. preprint slides

    Laure Soulier, Lynda Tamine, Tetsuya Sakai, Leif Azzopardi, and Jeremy Pickens: Report on the First International Workshop on the Evaluation on Collaborative Information Seeking and Retrieval (ECol’2015), SIGIR Forum, 50(1), 2016. pdf

    Tetsuya Sakai: Two Sample T-tests for IR Evaluation: Student or Welch?, Proceedings of ACM SIGIR 2016, pp.1045-1048, 2016. preprint

    Xiaojie Wang, Zhicheng Dou, Tetsuya Sakai, and Ji-Rong Wen: Evaluating Search Result Diversity using Intent Hierarchies, Proceedings of ACM SIGIR 2016, pp.415-424, 2016. preprint

    Tetsuya Sakai: Statistical Significance, Power, and Sample Sizes: A Systematic Review of SIGIR and TOIS, 2006-2015, Proceedings of ACM SIGIR 2016, pp.5-14, 2016. preprint slides

    Tetsuya Sakai: Topic Set Size Design, Information Retrieval Journal, 19(3), pp. 256-283, 2016. Open Access. pdf html

    Satomi Iijima and Tetsuya Sakai: SLLL at the NTCIR-12 Lifelog Task: Sleepflower and the LIT Subtask, Proceedings of NTCIR-12, pp.390-391, 2016. pdf

    Hiroto Denawa, Tomoaki Sano, Yuta Kadotami, Sosuke Kato, and Tetsuya Sakai: SLSTC at the NTCIR-12 STC Task, Proceedings of NTCIR-12, pp.549-551, 2016. pdf

    Shin Higuchi and Tetsuya Sakai: SLQAL at the NTCIR-12 QALab-2 Task, Proceedings of NTCIR-12, pp.456-458, 2016. pdf

    Hidetsugu Nanba, Tetsuya Sakai, Noriko Kando, Atsushi Keyaki, Koji Eguchi, Kenji Hatano, Toshiyuki Shimizu, Yu Hirate, and Atsushi Fujii: NEXTI at NTCIR-12 IMine-2 Task, Proceedings of NTCIR-12, pp.27-30, 2016. pdf

    Makoto P. Kato, Tetsuya Sakai, Takehiro Yamamoto, Virgil Pavlu, Hajime Morita, and Sumio Fujita: Overview of the NTCIR-12 MobileClick Task, Proceedings of NTCIR-12, pp.104-114, 2016. pdf

    Lifeng Shang, Tetsuya Sakai, Zhengdong Lu, Hang Li, Ryuichiro Higashinaka, and Yusuke Miyao: Overview of the NTCIR-12 Short Text Conversation Task, Proceedings of NTCIR-12, pp.473-484, 2016. pdf

    Makoto P. Kato, Virgil Pavlu, Tetsuya Sakai, Takehiro Yamamoto, and Hajime Morita: Two-layered Summaries for Mobile Search: Does the Evaluation Measure Reflect User Preferences?, Proceedings of EVIA 2016, pp.29-32, 2016. pdf

    Tetsuya Sakai and Lifeng Shang: On Estimating Variances for Topic Set Size Design, Proceedings of EVIA 2016, pp.9-12, 2016. pdf slides

    飯島聡美, 酒井哲也: 協調型ヘルスケア -規則正しい睡眠による日中の生産性向上-, DEIM 2016, 2016. 学生プレゼンテーション賞. pdf

    玉置賢太, 林佑明, 酒井哲也: 言語の分散表現と擬似適合性フィードバックを用いた英日言語横断検索, DEIM 2016, 2016. pdf

    門田見侑大, 吉田泰明, 藤田澄男, 酒井哲也: コンテキスト付き検索ログを用いた要求ヴァーティカルの分析, DEIM 2016, 2016. pdf

    出縄弘人, Young-In Song, 酒井哲也: ショッピングサイトにおける購入予測のための行動パターン分析, DEIM 2016, 2016. pdf

    河東宗祐, 酒井哲也: 発話者を考慮した学習に基づく対話システムの検討, DEIM 2016, 2016. 学生プレゼンテーション賞. pdf

    難波英嗣, 酒井哲也, 神門典子: Project Next IR -情報検索の失敗分析-, 情報処理, Vol.57, No.1, pp.24-25, 2016.

    2015

    Tetsuya Sakai, Lifeng Shang, Zhengdong Lu, and Hang Li: Topic Set Size Design with the Evaluation Measures for Short Text Conversation, AIRS 2015, LNCS 9460, pp.319-331, 2015. preprint slides

    Leif Azzopardi, Jeremy Pickens, Tetsuya Sakai, Laure Soulier, Lynda Tamine
    ECol 2015: First International Workshop on the Evaluation of Collaborative Information Seeking and Retrieval, ACM CIKM 2015, 2015.

    Sha Hu, Zhicheng Dou, Xiaojie Wang, Tetsuya Sakai, and Ji-Rong Wen: Search Result Diversification based on Hierarchical Intents, Proceedings of ACM CIKM 2015, 2015. ACM page

    Tetsuya Sakai: Topic Set Size Design with the Evaluation Measures for Short Text Conversation, 情報処理学会研究報告 2015-IFAT-119/2015-DBS-161, 2015.

    Yanan Qian, Qinghua Zheng, Tetsuya Sakai, Junting Ye, and Jun Liu: Dynamic Author Name Disambiguation for Growing Digital Libraries, Information Retrieval, Volume 8, Issue 5, pp.379-412, 2015. springerlink

    Takuya Watanabe, Mitsuaki Akiyama, Tetsuya Sakai, Hironori Washizaki, and Tatsuya: Understanding the Inconsistencies between Text Descriptions and the Use of Privacy-sensitive Resources of Mobile Apps, SOUPS 2015, 2015. pdf

    酒井哲也: 情報アクセス評価方法論~検索エンジンの進歩のために~,コロナ社, 2015. The Book Page Amazon

    難波英嗣,酒井哲也: 情報検索のエラー分析,言語処理学会第21回年次大会ワークショップ, 2015.

    林佑明, 酒井哲也: 言語の分散表現による文脈情報を利用した言語横断情報検索, DEIM Forum 2015, 2015. pdf

    Javed Aslam, Fernando Diaz, Matthew Ekstrand-Abueg, Richard McCreadie, and Tetsuya Sakai: TREC 2014 Temporal Summarization Track Overview, TREC 2014 Proceedings, 2015. pdf

    2014

    Makoto P. Kato, Matthew Ekstrand-Abueg, Virgil Pavlu, Tetsuya Sakai, Takehiro Yamamoto, and Mayu Iwata: Overview of the NTCIR-11 MobileClick Task, NTCIR-11 Proceedings, pp.195-207, 2014. pdf

    Tetsuay Sakai: Topic Set Size Design with Variance Estimates from Two-Way ANOVA, EVIA 2014 Proceedings, pp.1-8, 2014. slides pdf

    Tetsuay Sakai: Designing Test Collections for Comparing Many Systems, Proceedings of ACM CIKM 2014, pp.61-70, 2014. preprint slides ACM page

    渡邉卓弥, 秋山満昭, 酒井哲也, 鷲崎弘宜, 森達哉: Androidアプリの説明文とプライバシー情報アクセスの相関分析,マルウェア対策研究人材育成ワークショップ 2014, 2014. CSS2014学生論文賞

    Haojian Jin, Tetsuya Sakai, and Koji Yatani: ReviewCollage: A Mobile Interface for Direct Comparison Using Online Reviews, Proceedings of ACM MobileHCI 2014, pp.349-358, 2014. Honorable Mention. ACM page

    Tetsuya Sakai: Designing Test Collections That Provide Tight Confidence Intervals, Forum on Information Technology 2014, RD-003, 2014. preprint slides

    Tetsuya Sakai: Statistical Reform in Information Retrieval?, SIGIR Forum, 48(1), pp.3-12, 2014. pdf

    渡邉卓弥, 森達哉, 酒井哲也: 映像入力デバイスを悪用する Android アプリの解析と対策法, 信学技報 ICSS2013-78(2014-3), pp.119-124, 2014.

    Javd Aslam, Fernando Diaz, Matthew Ekstrand-Abueg, Virgil Pavlu, and Tetsuya Sakai: TREC 2013 Temporal Summarization, TREC 2013 Proceedings, 2014. pdf

    Tetsuya Sakai: Metrics, Statistics, Tests (invited paper), PROMISE Winter School 2013: Bridging between Information Retrieval and Databases (LNCS 8173), pp.116-163, Springer, 2014. preprint

    See also Tetsuya Sakai’s publications (1994-2013)