Home| Contact Us| New Journals| Browse Journals| Journal Prices| For Authors|

Print ISSN: 0976-4143
Online ISSN:

  About JISR
  DLINE Portal Home
Aims & Scope
Editorial Board
Current Issue
Next Issue
Previous Issue
Sample Issue
Upcoming Conferences
Self-archiving policy
Alert Services
Be a Reviewer
Paper Submission
Contact us
  How To Order
  Order Online
Price Information
Request for Complimentary
Print Copy
  For Authors
  Guidelines for Contributors
Online Submission
Call for Papers
Author Rights
Journal of Digital Information Management (JDIM)
International Journal of Computational Linguistics Research (IJCL)
International Journal of Web Application (IJWA)


Journal of Information Security Research

A Multiple Utterances based Neural Network Model for Joint Intent Detection and Slot Filling
Lingfeng Pan, Yi Zhang, Feiliang Ren, Yining Hou, Yan Li, Xiaobo Liang, Yongkang Liu
School of Computer Science and Engineering Northeastern University Shenyang, 110169, China
Abstract: Spoken language understanding(SLU), which usually involves slot filling and intent detection, is an important task in natural language processing. Most of the state-of-the-art methods are usually take single utterance as input, which would introduce much ambiguity because the loss of context information. To address this issue, we propose a new neural network based joint intent detection and slot filling model which takes multiple utterances as input. In our method, we use an utterance2utterance attention mechanism to combine the information of multiple continuous utterances. We also combine the intent information to the slot filling process with a gating mechanism. Using this proposed model, we participated in the task2 of CCKS2018. Finally, our model ranks NO.2 among the hugely competitive models.
Keywords: Intent Detection, Slot Filling, Neural Network, Attention Mechanism A Multiple Utterances based Neural Network Model for Joint Intent Detection and Slot Filling
Full_Text   PDF 579 KB   Download:   56  times

[1] Tur G, Hakkani-Tür, D., Heck, L., et al. (2011). Sentence simplification for spoken language understanding[C]// IEEE International Conference on Acoustics, Speech and Signal Processing. IEEE, 2011:5628-5631.

[2] Haffner, P., Tur, G., Wright, J. H. (2003). Optimizing SVMs for complex call classification[J]. Icassp, 2003, 1:I-632-I-635 vol.1. 

[3] Mccallum, A., Freitag, D., Pereira, F C N. (2000). Maximum entropy markov models for information extraction and segmentation[J]. Icml, 2000:591—598.

[4] Puyang Xu., Ruhi Sarikaya. (2013). Convolutional neural network based triangular crf for joint intent detection and slot filling. In ASRU, 2013: 78-83.

[5] Mesnil, G., Dauphin, Y., Yao, K., et al. (2015). Using Recurrent Neural Networks for Slot Filling in Spoken Language Understanding[J]. IEEE/ACM Transactions on Audio Speech & Language Processing, 2015, 23(3):530-539.

[6] Bing Liu., Ian Lane. (2016). Attention-based recurrent neural network models for joint intent detection and slot filling. In Proceedings of INTERSPEECH, 2016

[7] Sarikaya, R., Hinton, G E., Ramabhadran, B. (2011). Deep belief nets for natural language callrouting[ C]// IEEE International Conference on Acoustics, Speech and Signal Processing. IEEE, 2011:5680-5683..

[8] Tur, G., Deng, L., Hakkani-Tür, D., et al. (2012). Towards deeper understanding: Deep convex networks for semantic utterance classification[C]// IEEE International Conference on Acoustics, Speech and Signal Processing. IEEE, 2012:5045-5048.

[9] Daniel Guo., Gokhan Tur., Wen-tau Yih., and Geoffrey Zweig. (2014). Joint semantic utterance classification and slot filling with recursive neural networks. In: IEEE Spoken Language Technology Workshop (SLT), 2014: 55-59

[10] Bahdanau, D., Cho, K., and Bengio, Y. (2014). Neural Machine translation by jointly learning to align and translate, “ arXiv preprint arXiv; 1409.554-559

[11] Liyun Wen., Xiaojie Wang., Zhenjiang Dong., and Hong Chen. (2017). Jointly Modeling Intent Identification and Slot Filling with Contextual and Hierarchical Information. In NLPCC 2017: 3-15.
[12] Chih-Wen Goo., Guang Gao., Yun-Kai Hsu., Chih-Li Huo., Tsung-Chieh Chen., Keng-Wei Hsu., Yun-Nung Chen. (2018). Slot- Gated Modeling for Joint Slot Filling and Intent Prediction. In NAACL-HLT, 2018: 753-757.
[13] Huang Z, Xu W, Yu K. Bidirectional LSTM-CRF Models for Sequence Tagging[J]. Computer Science, 2015.

Home | Aim & Scope | Editorial Board | Author Guidelines | Publisher | Subscription | Previous Issue | Contact Us |Upcoming Conferences|Sample Issues|Library Recommendation Form|


Copyright 2011 dline.info