Journal of Information Security Research

DLINE Journals portal

Home

New Journals

Browse Journals

Journal Prices

For Authors

Print ISSN: 0976-4143
Online ISSN: 0976-4151

About JISR
	DLINE Portal Home Home Aims & Scope Editorial Board Current Issue Next Issue Previous Issue Sample Issue Upcoming Conferences Self-archiving policy Alert Services Be a Reviewer Publisher Paper Submission Subscription Contact us

How To Order
	Order Online Price Information Request for Complimentary Print Copy

For Authors
	Guidelines for Contributors Online Submission Call for Papers Author Rights

RELATED JOURNALS

Journal of Digital Information Management (JDIM)

International Journal of Computational Linguistics Research (IJCL)

International Journal of Web Application (IJWA)

Journal of Information Security Research

A Multiple Utterances based Neural Network Model for Joint Intent Detection and Slot Filling

Lingfeng Pan, Yi Zhang, Feiliang Ren, Yining Hou, Yan Li, Xiaobo Liang, Yongkang Liu
School of Computer Science and Engineering Northeastern University Shenyang, 110169, China

Abstract: Spoken language understanding(SLU), which usually involves slot filling and intent detection, is an important task in natural language processing. Most of the state-of-the-art methods are usually take single utterance as input, which would introduce much ambiguity because the loss of context information. To address this issue, we propose a new neural network based joint intent detection and slot filling model which takes multiple utterances as input. In our method, we use an utterance2utterance attention mechanism to combine the information of multiple continuous utterances. We also combine the intent information to the slot filling process with a gating mechanism. Using this proposed model, we participated in the task2 of CCKS2018. Finally, our model ranks NO.2 among the hugely competitive models.

Keywords: Intent Detection, Slot Filling, Neural Network, Attention Mechanism A Multiple Utterances based Neural Network Model for Joint Intent Detection and Slot Filling

DOI:https://doi.org/10.6025/jisr/2020/11/2/54-60

Full_Text PDF 579 KB Download: 367 times

References:

[1] Tur G, Hakkani-Tür, D., Heck, L., et al. (2011). Sentence simplification for spoken language understanding[C]// IEEE International Conference on Acoustics, Speech and Signal Processing. IEEE, 2011:5628-5631.

[2] Haffner, P., Tur, G., Wright, J. H. (2003). Optimizing SVMs for complex call classification[J]. Icassp, 2003, 1:I-632-I-635 vol.1.

[3] Mccallum, A., Freitag, D., Pereira, F C N. (2000). Maximum entropy markov models for information extraction and segmentation[J]. Icml, 2000:591—598.

[4] Puyang Xu., Ruhi Sarikaya. (2013). Convolutional neural network based triangular crf for joint intent detection and slot filling. In ASRU, 2013: 78-83.

[5] Mesnil, G., Dauphin, Y., Yao, K., et al. (2015). Using Recurrent Neural Networks for Slot Filling in Spoken Language Understanding[J]. IEEE/ACM Transactions on Audio Speech & Language Processing, 2015, 23(3):530-539.

[6] Bing Liu., Ian Lane. (2016). Attention-based recurrent neural network models for joint intent detection and slot filling. In Proceedings of INTERSPEECH, 2016

[7] Sarikaya, R., Hinton, G E., Ramabhadran, B. (2011). Deep belief nets for natural language callrouting[ C]// IEEE International Conference on Acoustics, Speech and Signal Processing. IEEE, 2011:5680-5683..

[8] Tur, G., Deng, L., Hakkani-Tür, D., et al. (2012). Towards deeper understanding: Deep convex networks for semantic utterance classification[C]// IEEE International Conference on Acoustics, Speech and Signal Processing. IEEE, 2012:5045-5048.

[9] Daniel Guo., Gokhan Tur., Wen-tau Yih., and Geoffrey Zweig. (2014). Joint semantic utterance classification and slot filling with recursive neural networks. In: IEEE Spoken Language Technology Workshop (SLT), 2014: 55-59

[10] Bahdanau, D., Cho, K., and Bengio, Y. (2014). Neural Machine translation by jointly learning to align and translate, “ arXiv preprint arXiv; 1409.554-559

[11] Liyun Wen., Xiaojie Wang., Zhenjiang Dong., and Hong Chen. (2017). Jointly Modeling Intent Identification and Slot Filling with Contextual and Hierarchical Information. In NLPCC 2017: 3-15.
[12] Chih-Wen Goo., Guang Gao., Yun-Kai Hsu., Chih-Li Huo., Tsung-Chieh Chen., Keng-Wei Hsu., Yun-Nung Chen. (2018). Slot- Gated Modeling for Joint Slot Filling and Intent Prediction. In NAACL-HLT, 2018: 753-757.
[13] Huang Z, Xu W, Yu K. Bidirectional LSTM-CRF Models for Sequence Tagging[J]. Computer Science, 2015.

DLINE Journals portal