论文标题

用多级单词适配器注入单词信息,以了解中文语言理解

Injecting Word Information with Multi-Level Word Adapter for Chinese Spoken Language Understanding

论文作者

Teng, Dechuan, Qin, Libo, Che, Wanxiang, Zhao, Sendong, Liu, Ting

论文摘要

在本文中,我们通过注入单词信息来提高中文语言理解(SLU)。先前对中国slu的研究没有考虑信息一词,无法检测到有益于意图检测和插槽填充的单词边界。 To address this issue, we propose a multi-level word adapter to inject word information for Chinese SLU, which consists of (1) sentence-level word adapter, which directly fuses the sentence representations of the word information and character information to perform intent detection and (2) character-level word adapter, which is applied at each character for selectively controlling weights on word information as well as character information.两个中国SLU数据集的实验结果表明,我们的模型可以捕获有用的单词信息并实现最先进的性能。

In this paper, we improve Chinese spoken language understanding (SLU) by injecting word information. Previous studies on Chinese SLU do not consider the word information, failing to detect word boundaries that are beneficial for intent detection and slot filling. To address this issue, we propose a multi-level word adapter to inject word information for Chinese SLU, which consists of (1) sentence-level word adapter, which directly fuses the sentence representations of the word information and character information to perform intent detection and (2) character-level word adapter, which is applied at each character for selectively controlling weights on word information as well as character information. Experimental results on two Chinese SLU datasets show that our model can capture useful word information and achieve state-of-the-art performance.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源