The Sakai Laboratory, Department of Computer Science and Engineering, Waseda University


  • sakailab.com
  • sakailab.com/english/
  • Professor Tetsuya Sakai

  • Sakai Lab’s publications (2014-)


    Last updated: 23rd November 2018


    red=author/editor/invited; purple=non-refereed


    2019

    Sakai, T.: How to Run an Evaluation Task: with a Primary Focus on Ad Hoc Information Retrieval (CLEF20 book chapter), to appear, 2019.

    Soboroff, I., Ferro, N., and Sakai, T.: Overview of the TREC 2018 CENTRE Track, Proceedings of TREC 2018, to appear, 査読なし, 2019.

    Sakai, T.: Conducting Laboratory Experiments Properly with Statistical Tools: An Easy Hands-on Tutorial, Proceedings of ECIR 2019, to appear, 査読あり, 2019.

    Zeng, Z., Song, R., Lin, P., and Sakai, T.: Attitude Detection for One-Round Conversation: Jointly Extracting Target-Polarity Pairs, Proceesings of ACM WSDM 2019, to appear, 査読あり, 2019.

    Sakai, T.: Conducting Laboratory Experiments Properly with Statistical Tools: An Easy Hands-on Tutorial, Proceesings of ACM WSDM 2019, to appear, 査読あり, 2019.

    2018

    Tseng, Y.-H., Sakai, T., Jiang, J., Ku, L.-W., Park, D.H., Yeh, J.-F., Yu, L.-C., Lee, L.-H., and Chen, Z.-H.: Proceedings of AIRS 2018 (LNCS 11292), エディタ, 2018.

    Watanabe, T., Akiyama, M., Sakai, T., Washizaki, H., and Mori, T.: Understanding the Inconsistency between Behaviors and Descriptions of Mobile Apps, IEICE Transactions, Vol.E101-D, No.11, pp.2584-2599, 査読あり, 2018.

    Zhao, G., Fu, H., Song, R., Sakai, T., Xie, X., and Qian, X.: Why You Should Listen to This Song: Reason Generation for Explainable Recommendation, 1st Workshop on Scalable and Applicable Recommendation Systems (SAREC 2018), to appear, 査読あり, 2018.

    Sakai, T.: Laboratory Experiments in Information Retrieval: Sample Sizes, Effect Sizes, and Statistical Power, Springer, 2018. Springer Page The Book Page

    Ferro, N., Maistro, M., Sakai, T., and Soboroff, I.: Overview of CENTRE@CLEF 2018: a First Tale in the Systematic Reproducibility Realm, Proceedings of CLEF 2018 (LNCS 11018), to appear, 査読あり, 2018.

    Zeng, Z., Luo, C., Shang, L., Li, H., and Sakai, T.: Towards Automatic Evaluation of Customer-Helpdesk Dialogues, Journal of Information Processing, Volume 26, pp.768-778, 査読あり, 2018. WebDB Forum 2018 Best Paper Runner-up pdf

    川崎真未, Inho Kang, 酒井哲也: 放棄セッションにおけるユーザ操作に着目したモバイル検索カードの順位付け, IPSJ TOD 11(3), pp.1-11, 査読あり, 2018.

    小島智樹, 酒井哲也: Androidアプリのレビューを用いたユーザーへの権限説明の補完, 情報処理学会研究報告, 2018-NL-237 (4), 査読なし, 2018.

    Tamaki, K., Togashi, R., Kato, S., Fujita, S., Maeda, H., and Sakai, T.: Classifying Community QA Questions That Contain an Image, Proceedings of ACM ICTIR 2018, pp.219-222, 査読あり, 2018. preprint

    Sakai. T.: Topic Set Size Design for Paired and Unpaired Data, Proceedings of ACM ICTIR 2018, pp.199-202, 査読あり, 2018. preprint

    富樫陸, 藤田澄男, 酒井哲也: 色・形状・テクスチャに基づく画像検索の自動評価と多様化, 情報処理学会研究報告, 2018-IFAT-132 (12), 査読なし, 2018. WebDB Forum 2018 学生奨励賞.

    河東宗祐, 酒井哲也: 対話破綻検出コーパスに対する学習データ選別の検討, 情報処理学会研究報告, 2018-IFAT-132 (28), 査読なし, 2018. WebDB Forum 2018 FRONTEO Award

    Liu, H.-W., Srivastava, A., Fujita, S., Shimizu, T., Togashi, R., Sakai, T.: A Comparative Study of Deep Learning Approaches for Visual Question Classification in Community QA, IPSJ SIG Technical Report, 2018-IFAT-132 (17), 査読なし, 2018.

    Ferro, N., Maistro, M., Sakai, T., and Soboroff, I.: CENTRE@CLEF2018: Overview of the Replicability Task, CLEF 2018 Working Notes, 招待論文, 2018. pdf

    Sakai, T.: Comparing Two Binned Probability Distributions for Information Access Evaluation, Proceedings of ACM SIGIR 2018, pp.1073-1076, 査読あり, 2018. preprint

    Sakai, T.: Conducting Laboratory Experiments Properly with Statistical Tools: An Easy Hands-on Tutorial, Proceedings of ACM SIGIR 2018, pp.1369-1370, 査読あり, 2018. preprint slides

    Liu, Y., Kato, M.P., Clarke, C.L.A., Kando, N., and Sakai,T.: Report on NTCIR-13: The Thirteenth Round of NII Testbeds and Community for Information Access Research, SIGIR Forum, 52(1), 査読なし, 2018. pdf

    呉越思瑶, 酒井哲也: ユーザーのニーズに合わせたインタラクティブな推薦システムの提案, DEIM 2018, 査読なし, 2018. pdf

    Kenta Tamaki, Riku Togashi, Sumio Fujita, Hideyuki Maeda, Tetsuya Sakai: Classifying Community QA QuestionsThat Contain an Image, DEIM 2018, 査読なし, 2018. 学生プレゼンテーション賞. pdf

    村田憲俊, 酒井哲也: 単語レベルと文字レベルの情報を用いた日本語対話システムの試作, DEIM 2018, 査読なし, 2018. 学生プレゼンテーション賞. pdf

    小島智樹, 酒井哲也: Generative Adversarial Nets を用いた文書分類の検証, DEIM 2018, 査読なし, 2018. pdf

    川崎真未, Inho Kang, 酒井哲也: クリックと放棄に基づくモバイルバーティカルの順位付け, DEIM 2018, 査読なし, 2018. pdf

    Wang, X., Wen,J., Dou, Z., Sakai, T., and Zhang, R.: Search Result Diversity Evaluation based on Intent Hierarchies, IEEE TKDE, 30(1), pp.156-169, 査読あり, 2018.

    2017

    Kato, S. and Sakai, T.: RSL17BD at DBDC3: Computing Utterance Similarities based on Term Frequency and Word Embedding Vectors, Proceedings of DSTC6, 査読あり, 2017. pdf

    Sakai, T.: Unanimity-Aware Gain for Highly Subjective Assessments, Proceedings of EVIA 2017, pp.39-42, 査読あり, 2017. pdf

    Sakai, T.: The Effect of Inter-Assessor Disagreement on IR System Evaluation: A Case Study with Lancers and Students, Proceedings of EVIA 2017, pp.31-38 査読あり, 2017. pdf

    Sakai, T.: Towards Automatic Evaluation of Multi-Turn Dialogues: A Task Design that Leverages Inherently Subjective Annotations, Proceedings of EVIA 2017, pp.24-30, 査読あり, 2017. pdf

    Sakai, T.: Evaluating Evaluation Measures with Worst-Case Confidence Interval Widths, Proceedings of EVIA 2017, pp.16-19, 査読あり, 2017. pdf

    Zeng, Z., Luo, C., Shang, L., Li, H., and Sakai, T.: Test Collections and Measures for Evaluating Customer-Helpdesk Dialogues, Proceedings of EVIA 2017, pp.1-9, 査読あり, 2017. pdf

    Xiao, P., Li, L., Fan, Y., and Sakai, T.: SLWWW at the NTCIR-13 WWW Task, Proceedings of NTCIR-13, pp.419-421, 査読なし, 2017. pdf

    Guan, J. and Sakai, T.: SLSTC at the NTCIR-13 STC Task, Proceedings of NTCIR-13, pp.231-232, 査読なし, 2017. pdf

    Sato, K. and Sakai, T.: SLQAL at the NTCIR-13 QA Lab-3 Task, Proceedings of NTCIR-13, pp.143-145, 査読なし, 2017. pdf

    Kashimura, R. and Sakai, T.: SLOLQ at the NTCIR-13 OpenLiveQ Task, Proceedings of NTCIR-13, pp.101-104, 査読なし, 2017. pdf

    Luo, C., Sakai, T., Liu, Y., Dou, Z., Xiong, C., and Xu, J.: Overview of the NTCIR-13 We Want Web Task, Proceedings of NTCIR-13, pp.394-401, 査読なし, 2017. pdf

    Shang, L., Sakai, T., Li, H., Higashinaka, R., Miyao, Y., Arase, Y., and Nomoto,M.: Overview of the NTCIR-13 Short Text Conversation Task, Proceedings of NTCIR-13, pp.194-210, 査読なし, 2017. pdf

    Kawasaki, M., Kang, I., and Sakai, T.: Ranking Rich Mobile Verticals based on Clicks and Abandonment, Proceedings of ACM CIKM 2017, pp.2127-2130, 査読あり, 2017. corrected_pdf

    Kadotami, Y., Yoshida, Y., Fujita, S., and Sakai, T.: Mobile Vertical Ranking based on Preference Graphs, Proceedings of ACM ICTIR 2017, pp.225-228, 査読あり, 2017. preprint

    Kato, S., Togashi, R., Maeda, H., Fujita, S., and Sakai, T.: LSTM vs. BM25 for Open-domain QA: A Hands-on Comparison of Effectiveness and Efficiency, Proceedings of ACM SIGIR 2017, pp.1309-1312, 査読あり, 2017.

    Luo, C., Liu, Y., Sakai, T., Zhang, F., Zhang, M., and Ma, S.: Evaluating Mobile Search with Height-Biased Gain, Proceedings of ACM SIGIR 2017, pp.435-444, 査読あり, 2017. preprint

    Sakai, T.: The Probability That Your Hypothesis Is Correct, Credible Intervals, and Effect Sizes for IR Evaluation, Proceedings of ACM SIGIR 2017, pp.25-34, 査読あり, 2017. preprint

    Kando, N., Sakai, T., Joho, H., Li, H., de Vries, A.P. (eds.): Proceedings of ACM SIGIR 2017, エディタ, 2017.

    Kawasaki, M., Kang, I., and Sakai, T.: Ranking Rich Mobile Verticals based on Clicks and Abandonment, 情報処理学会研究報告 2017-IFAT-127, pp.1-6, 査読なし, 2017.

    Zeng, Z., Luo, C., Shang, L., Li, H., and Sakai, T.: Test Collections and Measures for Evaluating Customer-Helpdesk Dialogues, 情報処理学会研究報告 2017-NL-232, pp.1-7, 査読なし, 2017.

    Harman, D. and Kelly, D. (eds.); Allan, J., Belkin, N., Bennett, P., Callan, J., Clarke, C., Diaz, F., Dumais, S., Ferro, N., Harman, D., Hiemstra, D., Ruthven, I., Sakai, T., Smucker, M., Zobel, J.: Overview of Special Issue, SIGIR Forum, 51(2), 査読なし, 2017.

    人工知能学会(編): 人工知能学大事典, 共立出版, 分担執筆, 2017.

    Luo, C., Li, X., Liu, Y., Sakai, T., Zhang, F., Zhang, M., and Ma, S.: Investigating Users’ Time Perception during Web Search, Proceedings of CHIIR 2017, pp.127-136, 査読あり, 2017.

    飯島聡美, 酒井哲也: 協調型ヘルスケア -複数人で睡眠習慣改善に臨む際の人間関係と協調の効果-, DEIM 2017, 査読なし, 2017. 学生プレゼンテーション賞. pdf

    門田見侑大, 吉田泰明, 藤田澄男, 酒井哲也: クリックに基づく選好グラフを用いたバーティカル適合性推定, DEIM 2017, 査読なし, 2017. pdf

    犬塚眞太郎, 酒井哲也: 拡張クエリを用いたレシピ検索のパーソナライゼーション, DEIM 2017, 査読なし, 2017. pdf

    河東宗祐, 酒井哲也: アノテーション分布を考慮した対話破綻検出, DEIM 2017, 査読なし, 2017. pdf

    玉置賢太, 酒井哲也: 英日言語横断検索におけるクエリ拡張結果の詳細分析, DEIM 2017, 査読なし, 2017. pdf

    佐藤航, 酒井哲也: 解答検証を利用した選択式問題への自動解答, DEIM 2017, 査読なし, 2017. pdf

    黒澤瞭佑, 酒井哲也: ツイートにおける周辺単語の感情極性値を用いた新語の感情推定, DEIM 2017, 査読なし, 2017. pdf

    Luo, C., Liu, Y., Sakai, T., Zhou, K., Zhang, F., Li, X., and Ma, S.: Does Document Relevance Affect the Searcher’s Perception of Time?, Proceedings of ACM WSDM 2017, pp.141-150, 査読あり, 2017.

    2016

    Kato, M.P., Kishida, K., Kando, N., Sakai, T., and Sanderson, M.: Report on NTCIR-12: The Twelfth Round of NII Testbeds and Community for Information Access Research, SIGIR Forum 50 (2), pp.18-27, 2016.

    酒井哲也: 評価実験の設計と論文での結果報告: きちんとやっていますか?, 第3回自然言語処理シンポジウム, 招待講演, 2016. abstract slides

    Sakai, T.: The Effect of Score Standardisation on Topic Set Size Design, AIRS 2016 (LNCS 9994), pp.16-28, 査読あり, 2016. preprint slides

    河東宗祐, 酒井哲也: word2vecによる発話ベクトルの類似度を用いた対話破綻予測, 人工知能学会 音声・言語理解と対話処理研究会(SLUD)第78回研究会 (第7回対話システムシンポジウム), 査読なし, 2016.

    Inegaga, S., Sadakane, K. and Sakai, T. (eds.): Proceedings of SPIRE 2016 (LNCS 9954), Springer, 2016.

    Sakai, T., Zeng, Z. and Luo, C.: Evaluating Helpdesk Dialogues: Initial Considerations from An Information Access Perspective, 情報処理学会研究報告 2016-NL-228, pp.1-10, 査読なし, 2016. slides

    Sakai, T.: A Simple and Effective Approach to Score Standardisation, ACM ICTIR 2016, pp.95-104, 査読あり, 2016. preprnt slides

    Sakai, T.: Topic Set Size Design and Power Analysis in Practice (Tutorial Abstract), ACM ICTIR 2016, pp.9-10, 査読あり, 2016. preprint slides

    Soulier, L., Tamine, L., Sakai, T., Azzopardi, L., and Pickens, J.: Report on the First International Workshop on the Evaluation on Collaborative Information Seeking and Retrieval (ECol’2015), SIGIR Forum, 50(1), 査読あり, 2016. pdf

    Sakai. T.: Two Sample T-tests for IR Evaluation: Student or Welch?, Proceedings of ACM SIGIR 2016, pp.1045-1048, 査読あり, 2016. preprint

    Wang, X., Dou, Z., Sakai, T., and Wen, J.-R.: Evaluating Search Result Diversity using Intent Hierarchies, Proceedings of ACM SIGIR 2016, pp.415-424, 査読あり, 2016. preprint

    Sakai, T.: Statistical Significance, Power, and Sample Sizes: A Systematic Review of SIGIR and TOIS, 2006-2015, Proceedings of ACM SIGIR 2016, pp.5-14, 査読あり, 2016. preprint slides

    Sakai, T.: Topic Set Size Design, Information Retrieval Journal, 19(3), pp. 256-283, 査読あり, 2016. Open Access. pdf html

    Iijima, S. and Sakai, T.: SLLL at the NTCIR-12 Lifelog Task: Sleepflower and the LIT Subtask, Proceedings of NTCIR-12, pp.390-391, 査読なし, 2016. pdf

    Denawa, H., Sano, T., Kadotami, Y., Kato, S. and Sakai, T.: SLSTC at the NTCIR-12 STC Task, Proceedings of NTCIR-12, pp.549-551, 査読なし, 2016. pdf

    Higuchi, S. and Sakai, T.: SLQAL at the NTCIR-12 QALab-2 Task, Proceedings of NTCIR-12, pp.456-458, 査読なし, 2016. pdf

    Nanba, H., Sakai, T., Kando, N., Keyaki, A., Eguchi, K., Hatano, K., Shimizu, T., Hirate, Y. and Fujii, A.: NEXTI at NTCIR-12 IMine-2 Task, Proceedings of NTCIR-12, pp.27-30, 査読なし, 2016. pdf

    Kato, M.P., Sakai, T., Yamamoto, T., Pavlu, V., Morita, H. and Fujita, S.: Overview of the NTCIR-12 MobileClick Task, Proceedings of NTCIR-12, pp.104-114, 査読なし, 2016. pdf

    Shang, L., Sakai, T., Lu, Z., Li, H., Higashinaka, R. and Miyao, Y.: Overview of the NTCIR-12 Short Text Conversation Task, Proceedings of NTCIR-12, pp.473-484, 査読なし, 2016. pdf

    Kato, M.P., Pavlu, V., Sakai, T., Yamamoto, T. and Morita, H.: Two-layered Summaries for Mobile Search: Does the Evaluation Measure Reflect User Preferences?, Proceedings of EVIA 2016, 査読あり, pp.29-32, 2016. pdf

    Sakai, T. and Shang, L: On Estimating Variances for Topic Set Size Design, Proceedings of EVIA 2016, 査読あり, pp.9-12, 2016. pdf slides

    飯島聡美, 酒井哲也: 協調型ヘルスケア -規則正しい睡眠による日中の生産性向上-, DEIM 2016, 査読なし, 2016. 学生プレゼンテーション賞. pdf

    玉置賢太, 林佑明, 酒井哲也: 言語の分散表現と擬似適合性フィードバックを用いた英日言語横断検索, DEIM 2016, 査読なし, 2016. pdf

    門田見侑大, 吉田泰明, 藤田澄男, 酒井哲也: コンテキスト付き検索ログを用いた要求ヴァーティカルの分析, DEIM 2016, 査読なし, 2016. pdf

    出縄弘人, Young-In Song, 酒井哲也: ショッピングサイトにおける購入予測のための行動パターン分析, DEIM 2016, 査読なし, 2016. pdf

    河東宗祐, 酒井哲也: 発話者を考慮した学習に基づく対話システムの検討, DEIM 2016, 査読なし, 2016. 学生プレゼンテーション賞. pdf

    難波, 酒井, 神門: Project Next IR -情報検索の失敗分析-, 情報処理, Vol.57, No.1, pp.24-25, 2016.

    2015

    Sakai, T., Shang, L., Lu, Z. and Li, H.: Topic Set Size Design with the Evaluation Measures for Short Text Conversation, AIRS 2015, LNCS 9460, pp.319-331, 査読あり, 2015. preprint slides

    Azzopardi, L., Pickens, J., Sakai, T., Soulier, L. and Tamine, L.: ECol 2015: First International Workshop on the Evaluation of Collaborative Information Seeking and Retrieval, ACM CIKM 2015, 査読なし, 2015.

    Hu, S., Dou, Z., Wang, X., Sakai, T. and Wen, Ji-Rong: Search Result Diversification based on Hierarchical Intents, Proceedings of ACM CIKM 2015, 査読あり, 2015. ACM page

    Sakai, T.: Topic Set Size Design with the Evaluation Measures for Short Text Conversation, 情報処理学会研究報告 2015-IFAT-119/2015-DBS-161, 査読なし, 2015.

    Qian, Y., Zheng, Q., Sakai, T., Junting Ye and Jun Liu: Dynamic Author Name Disambiguation for Growing Digital Libraries, Information Retrieval, Volume 8, Issue 5, pp.379-412, 査読あり, 2015. springerlink

    Watanabe, T., Akiyama, M., Sakai, T., Washizaki, H. and Mori, T.: Understanding the Inconsistencies between Text Descriptions and the Use of Privacy-sensitive Resources of Mobile Apps, SOUPS 2015, 査読あり, 2015. pdf

    酒井哲也: 情報アクセス評価方法論~検索エンジンの進歩のために~,コロナ社, 2015. The Book Page Amazon

    難波英嗣,酒井哲也: 情報検索のエラー分析,言語処理学会第21回年次大会ワークショップ, 査読なし, 2015.

    林佑明, 酒井哲也: 言語の分散表現による文脈情報を利用した言語横断情報検索, DEIM Forum 2015, 査読なし, 2015. pdf

    Aslam, J., Diaz, F., Ekstrand-Abueg, M., McCreadie, R. and Sakai, T.: TREC 2014 Temporal Summarization Track Overview, TREC 2014 Proceedings, 査読なし, 2015. pdf

    2014

    Kato, M.P., Ekstrand-Abueg, M., Pavlu, V., Sakai, T., Yamamoto, T. and Iwata, M.: Overview of the NTCIR-11 MobileClick Task, NTCIR-11 Proceedings, 査読なし, pp.195-207, 2014. pdf

    Sakai, T.: Topic Set Size Design with Variance Estimates from Two-Way ANOVA, EVIA 2014 Proceedings, 査読あり, pp.1-8, 2014. slides pdf

    Sakai, T.: Designing Test Collections for Comparing Many Systems, Proceedings of ACM CIKM 2014, 査読あり, pp.61-70, 2014. preprint slides ACM page

    渡邉卓弥, 秋山満昭, 酒井哲也, 鷲崎弘宜, 森達哉: Androidアプリの説明文とプライバシー情報アクセスの相関分析,マルウェア対策研究人材育成ワークショップ 2014, 査読なし, 2014. CSS2014学生論文賞

    Jin, H., Sakai, T. and Yatani, K.: ReviewCollage: A Mobile Interface for Direct Comparison Using Online Reviews, Proceedings of ACM MobileHCI 2014, 査読あり, pp.349-358, 2014. Honorable Mention. ACM page

    Sakai, T.: Designing Test Collections That Provide Tight Confidence Intervals, Forum on Information Technology 2014, RD-003, 査読あり, 2014. preprint slides

    Sakai, T.: Statistical Reform in Information Retrieval?, SIGIR Forum, 48(1), 査読あり, pp.3-12, 2014. pdf

    渡邉卓弥, 森達哉, 酒井哲也: 映像入力デバイスを悪用する Android アプリの解析と対策法, 信学技報 ICSS2013-78(2014-3), 査読なし, pp.119-124, 2014.

    Aslam, J., Diaz, F., Ekstrand-Abueg, M., Pavlu, V. and Sakai, T.: TREC 2013 Temporal Summarization, TREC 2013 Proceedings, 査読なし, 2014. pdf

    Sakai, T.: Metrics, Statistics, Tests, PROMISE Winter School 2013: Bridging between Information Retrieval and Databases (LNCS 8173), 招待論文, pp.116-163, Springer, 2014. preprint

    See also Tetsuya Sakai’s publications (1994-2013)