About me

I am a research assistant professor at the School of Computer Science and Technology of Beijing Jiaotong University, forming the Language Intelligence Explorer (LIE) Lab. I received ACL 2023 Outstanding Paper Award. I was a postdoc at the Institute for AI Industry Research (AIR) of Tsinghua University, working with Prof. Yang Liu. I obtained a Ph.D. degree in the School of Computer Science at Dalian University of Technology (09.2021), advised by Prof. Degen Huang. Specifically, I favor the following research perspectives on natural language processing, including Multilingual AI, Large Language Model (LLM), Continual Learning, Neural Machine Translation (NMT), Conversational Information Retrieval (CIR), etc.

Selected Publication

  • Kaiyu Huang, Fengran Mo, Hongliang Li, You Li, Yuanchi Zhang, Weijian Yi, Yulong Mao, Jinchen Liu, Yuzhuang Xu, Jinan Xu, Jian-Yun Nie, Yang Liu. A Survey on Large Language Models with Multilingualism: Recent Advances and New Frontiers. arXiv:2405.10936.
  • Yulong Mao*, Kaiyu Huang*, Changhao Guan, Ganglin Bao, Fengran Mo, Jinan Xu. DoRA: Enhancing Parameter-Efficient Fine-Tuning with Dynamic Rank Distribution. In Proceedings of ACL 2024.
  • Hao Yu, Kaiyu Huang*, Anqi Zhao, Junpeng Liu, Degen Huang. Context-Aware Non-Autoregressive Document-Level Translation with Sentence-Aligned Connectionist Temporal Classification. In Proceedings of LREC-COLING 2024.
  • Kaiyu Huang, Peng Li, Jin Ma, Ting Yao, Yang Liu. Knowledge Transfer in Incremental Learning for Multilingual Neural Machine Translation. In Proceedings of ACL 2023. (ACL 2023 Outstanding Paper Award)
  • Fengran Mo, Kelong Mao, Yutao Zhu, Yihong Wu, Kaiyu Huang*, Jian-Yun Nie*. ConvGQR: Generative Query Reformulation for Conversational Search. In Proceedings of ACL 2023.
  • Kaiyu Huang, Peng Li, Junpeng Liu, Maosong Sun, Yang Liu. Learn and Consolidate: Continual Adaptation for Zero-Shot and Multilingual Neural Machine Translation. In Proceedings of EMNLP 2023.
  • Fengran Mo, Jian-Yun Nie*, Kaiyu Huang*, Kelong Mao, Yutao Zhu, Peng Li, Yang Liu. Learning to Relate to Previous Turns in Conversational Search. In Proceedings of SIGKDD 2023.
  • Kaiyu Huang, Peng Li, Jin Ma, Yang Liu. Entropy-Based Vocabulary Substitution for Incremental Learning in Multilingual Neural Machine Translation. In Proceedings of EMNLP 2022.
  • Kaiyu Huang, Keli Xiao, Fengran Mo, Bo Jin, Zhuang Liu, Degen Huang. Domain-Aware Word Segmentation for Chinese Language: A Document-Level Context-Aware Model. ACM Transactions on Asian and Low-Resource Language Information Processing (TALLIP).
  • Kaiyu Huang, Degen Huang, Zhuang Liu, Fengran Mo. A Joint Multiple Criteria Model in Transfer Learning for Cross-domain Chinese Word Segmentation. In Proceedings of EMNLP 2020.

Education & Experience

  • B.S., Computer Science and Technology and Japanese, Dalian University of Technology, 09/2011-06/2016
  • M.S., Computer Science and Technology, Dalian University of Technology, 09/2016-09/2018
  • Ph.D., Computer Application Technology, Dalian University of Technology, 09/2018-09/2021
  • Postdoc, Institute for AI Industry Research, Tsinghua University, 11/2021-11/2023
  • Assistant Professor, Computer Science and Technology, Beijing Jiaotong University, 11/2023-now

Last-updated: May 27, 2024.