Home| Contact Us| New Journals| Browse Journals| Journal Prices| For Authors|

Print ISSN: 0974-7710
Online ISSN:
0974-7729


  About IJWA
  Aims & Scope
Editorial Board
Contact us
Current Issue
Next Issue
Previous Issue
Sample Issue
Be a Reviewer
Publisher
Subscription
 
  How To Order
  Order Online
Price Information
Request for Complimentary
Print Copy
 
  For Authors
  Guidelines for Contributors
Online Submission
Call for Papers
Author Rights
 
 
RELATED JOURNALS
Journal of Digital Information Management (JDIM)
Journal of E-Technology(JET)

 

 
International Journal of Web Applications

Identifying Depression in Tweets Using CNN-deep and BILSTM with Attention Model
Fatima Boumahdi, Amina Madani, Ibrahim Cheurfa, Hamza Hentabli
Saad Dahlab University Algeria, UTM University Malaysia
Abstract: Mental health is considered as one of today’s world’s most prominent plagues. Therefore, our work aims to use the potential of social media platforms to solve one of mental health’s biggest issues, which is depression identification. We propose a new deep learning model that we train on a depression-dedicated dataset in order to detect such mental illness from an individual’s tweets. Our main contributions lie in the three following points: (1) We trained our own word embeddings using a depression-dedicated dataset. (2) We combined a Convolutional Neural Networks model with the Message-level Sentiment Analysis model in order to improve the feature extraction process and enhance the model’s performance. (3) We analyzed through different experiments the performance of three deep learning models in order to provide more perspectives and insights for depression researches. Our model achieved a 99 % accuracy, outperforming any statistical or deep learning models found in literature currently.
Keywords: Depression Identification, Mental Health, Deep Learning, Sentiment Analysis, Message-level Sentiment Analysis Identifying Depression in Tweets Using CNN-deep and BILSTM with Attention Model
DOI:https://doi.org/10.6025/ijwa/2020/12/2/47-61
Full_Text   PDF 743 KB   Download:   126  times
References:

[1] Andrade, Laura., Caraveo-Anduaga, Jorge J., Berglund, Patricia., Bijl, Rob V., De Graaf, Ron., Vollebergh, Wilma., Dragomirecka, Eva Kohn, Robert., Keller, Martin., Kessler, Ronald C. (2003). The epidemiology of major depressive episodes: results from the international consortium of psychiatric epidemiology (icpe) surveys. International Journal of Methods in Psychiatric Research, 12(1) 3–21.
[2] Araque, Oscar., Corcuera-Platas, Ignacio., Sanchez-Rada, J Fernando., A Iglesias, Carlos. (2017). Enhancing deep learning sentiment analysis with ensemble techniques in social applications. Expert Systems with Applications, 77. 236–246.
[3] Christos Baziotis., Nikos Pelekis., Christos Doulkeridis. (2017). Datastories at semeval-2017 task 4: Deep lstm with attention for message-level and topic-based sentiment analysis. In: Proceedings of the 11th International Workshop on Semantic Evaluation (SemEval-2017), p. 747–754, 2017.
[4] Aaron T Beck., Calvin H Ward., Mock Mendelson., Jeremiah Mock., John Erbaugh. (1961). An inventory for measuring depression. Archives of General Psychiatry, 4 (6) 561–571, 1961.
[5] Bengio, Yoshua., Aaron Courville., Pascal Vincent. (2013). Representation learning: A review and new perspectives. IEEE Transactions on Pattern Analysis and Machine Intelligence, 35(8) 1798–1828, 2013.
[6] Chen, Xuetong., Sykora, Martin D., Jackson, Thomas W, Elayan, Suzanne. (2018). What about mood swings: Identifying depression on twitter with temporal measures of emotions. In: Companion Proceedings of the The Web Conference 2018, WWW ’18, p. 1653– 1660. International World Wide Web Conferences Steering Committee, 2018.
[7] Cho, Kyunghyun., Merriënboer, Bart Van., Gulcehre, Caglar., Bahdanau, Dzmitry., Fethi Bougares., Holger Schwenk., Yoshua Bengio. (2014). Learning phrase representations using rnn encoder-decoder for statistical machine translation. arXiv preprint arXiv:1406.1078, 2014.
[8] Munmun De Choudhury., Michael Gamon., Scott Counts., Eric Horvitz. (2013). Predicting depression via social media. In: Proceedings of the Seventh International Conference on Weblogs and Social Media, ICWSM 2013, Cambridge, Massachusetts, USA, July 8-11, 2013.
[9] Collobert, Ronan., Weston, Jason. (2008). A unified architecture for natural language processing: Deep neural networks with multitask learning. In: Proceedings of the 25th International Conference on Machine Learning, ICML ’08, p. 160–167, New York, NY, USA, 2008. ACM.
[10] Ronan Collobert., Jason Weston., Léon Bottou., Michael Karlen., Koray Kavukcuoglu., Pavel Kuksa. (2011). Natural language processing (almost) from scratch. Journal of Machine Learning Research, 12. 2493–2537.
[11] Coppersmith, Glen., Dredze, Mark., Harman, Craig. (2014). Quantifying mental health signals in twitter. In Proceedings of the Workshop on Computational Linguistics and Clinical Psychology: From Linguistic Signal to Clinical Reality, p. 51–60. Association for Computational Linguistics.
[12] Coppersmith, Glen., Dredze, Mark., Harman, Craig., Hollingshead, Kristy. (2015). From adhd to sad: Analyzing the language of mental health on twitter through self-reported diagnoses. In: Proceedings of the 2nd Workshop on Computational Linguistics and Clinical Psychology: From Linguistic Signal to Clinical Reality, p. 1–10. Association for Computational Linguistics, 2015.
[13] Coppersmith, Glen., Dredze, Mark., Harman, Craig., Hollingshead, Kristy., Mitchell, Margaret. (2015). Clpsych 2015 shared task: Depression and ptsd on twitter. In Proceedings of the 2nd Workshop on Computational Linguistics and Clinical Psychology: From Linguistic Signal to Clinical Reality, p. 31–39. Association for Computational Linguistics.
[14] De Choudhury, Munmun., Counts, Scott., Horvitz, Eric. (2013). Social media as a measurement tool of depression in populations. In: Proceedings of the 5th Annual ACM Web Science Conference, WebSci ’13, p. 47–56. ACM, 2013.
[15] Fischer, Thomas., Krauss, Christopher. (2018). Deep learning with long short-term memory networks for financial market predictions. European Journal of Operational Research, 270 (2) 654 – 669.
[16] Guntuku, Sharath Chandra., Yaden, David B., Kern, Margaret., Ungar, Lyle H., Eichstaedt, Johannes C. (2017). Detecting depression and mental illness on social media: an integrative review. 18, p. 43–49. Elsevier, 2017.
[17] Hochreiter, Sepp., Schmidhuber, Jürgen. (1997). Long short-term memory. Neural computation, 9 (8)1735–1780.
[18] Orabi, Ahmed Husseini., Buddhitha, Prasadith., Orabi, Mahmoud Husseini., Inkpen, Diana. (2018). Deep learning for depression detection of twitter users. In: Proceedings of the Fifth Workshop on Computational Linguistics and Clinical Psychology: From Keyboard to Clinic, p. 88–97. Association for Computational Linguistics, 2018.
[19] Zunaira Jamil., Diana Inkpen., Prasadith Buddhitha., Kenton White. (2017). Monitoring tweets for depression to detect atrisk users. In: Proceedings of the Fourth Workshop on Computational Linguistics and Clinical Psychology — From Linguistic Signal to Clinical Reality, p. 32–40. Association for Computational Linguistics, 2017.
[20] Jo, Hwiyeol., Kim, Soo-Min., Ryu, Jeong. (2017). What we really want to find by sentiment analysis: The relationship between computational models and psychological state. arXiv preprint arXiv:1704.03407, 2017.
[21] Kim, Yoon. (2014). Convolutional neural networks for sentence classification. In: Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing, EMNLP 2014, October 25-29, 2014, Doha, Qatar, A meeting of SIGDAT, a Special Interest Group of the ACL, p. 1746–1751, 2014.
[22] Kumar, Jitendra., Goomer, Rimsha., Singh, Ashutosh Kumar. (2018). Long short term memory recurrent neural network (lstmrnn) based workload forecasting model for cloud datacenters. Procedia Computer Science, 125:676 – 682, 2018. The 6th International Conference on Smart Computing and Communications.
[23] LeCun, Yann., Bengio, Yoshua., et al. (1995). Convolutional networks for images, speech, and time series. The handbook of brain theory and neural networks, 3361(10).
[24] Li, Changliang., Xu, Bo., Wu, Gaowei., He, Saike., Tian, Guanhua., Zhou , Yujun. (2015). Parallel recursive deep model for sentiment analysis. In: Pacific-Asia Conference on Knowledge Discovery and Data Mining, p. 15–26. Springer, 2015.
[25] Li, Wenwen., Chau, Michael. (2018). Applying deep learning in depression detection. In: 22nd Pacific Asia Conference on Information Systems, PACIS 2018, Yokohama, Japan, June 26-30, p. 333, 2018.
[26] Mikolov, Tomas., Sutskever, Ilya., Chen, Kai., Corrado, Greg., Dean, Jeffrey. (2013). Distributed representations of words and phrases and their compositionality. In: Proceedings of the 26th International Conference on Neural Information Processing Systems - Volume 2, NIPS’13, p. 3111–3119, USA, 2013. Curran Associates Inc. \
[27] Nadeem, Moin. (2016). Identifying depression on twitter. arXiv preprint arXiv:1607.07384, 2016.
[28] Plank, Barbara., Søgaard, Anders., Goldberg, Yoav. (2016). Multilingual part-of-speech tagging with bidirectional long shortterm memory models and auxiliary loss. In: Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), p. 412–418. Association for Computational Linguistics, 2016.
[29] Sawyer Radloff, Lenore. (1977). The ces-d scale: A self-report depression scale for research in the general population. Applied psychological measurement, 1 (3) 385–401.
[30] Severyn, Aliaksei., Moschitti, Alessandro. (2015). Twitter sentiment analysis with deep convolutional neural networks. In: Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval, p. 959–962. ACM, 2015.
[31] Shen, Guangyao., Jia, Jiang., Nie, Liqiang., Feng, Fuli., Zhang, Cunjun., Hu, Tianrui., Chua, Tat-Seng., Zhu, Wenwu. (2017). Depression detection via harvesting social media: A multimodal dictionary learning solution. In Proceedings of the 26th International Joint Conference on Artificial Intelligence, IJCAI’ 17, p. 3838–3844. AAAI Press.
[32] Shickel, Benjamin., Heesacker, Martin., Benton, Sherry., Ebadi, Ashkan., Nickerso, Paul., Rashidi, Parisa. (2016). Self-reflective sentiment analysis. In: Proceedings of the Third Workshop on Computational Lingusitics and Clinical Psychology, p. 23–32, 2016.
[33] Richard Socher., Alex Perelygin., Jean Wu., Jason Chuang., Christopher D Manning., Andrew Ng., Christopher Potts. (2013). Recursive deep models for semantic compositionality over a sentiment treebank. In: Proceedings of the 2013 conference on empirical methods in natural language processing, p. 1631–1642, 2013.
[34] Su, Zengcai., Xu, Hua., Zhang, Dongwen., Xu, Yunfeng. (2014). Chinese sentiment classification using a neural network tool—word2vec. In: Multisensor Fusion and Information Integration for Intelligent Systems (MFI), 2014 International Conference on, p. 1– 6. IEEE, 2014.
[35] Suhara, Yoshihiko., Xu, Yinzhan. (2017). Alex ’Sandy’ Pentland. Deepmood: Forecasting depressed mood based on selfreported histories via recurrent neural networks. In: Proceedings of the 26th International Conference on World Wide Web, 72 WWW ’17, p.715–724. International World Wide Web Conferences Steering Committee, 2017.
[36] Tang, Duyu., Wei, Furu., Qin, Bing., Liu, Ting., Zhou, Ming. (2014). Coooolll: A deep learning system for twitter sentiment classification. In: Proceedings of the 8th international workshop on semantic evaluation (SemEval 2014) p. 208–212.
[37] Yla, R., Tausczik., James., Pennebaker, W. (2010), The psychological meaning of words: Liwc and computerized text analysis methods. Journal of Language and Social Psychology, 29 (1) 24–5.
[38] Tsugawa, Sho., Kikuchi, Yusuk e., Kishino, Fumio., Nakajima, Kosuke., Itoh, Yuichi., Ohsaki, Hiroyuki. (2015). Recognizing depression from twitter activity. In: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, CHI ’15, p. 3187–3196. ACM, 2015.
[39] Vo, Duy-Tin., Zhang, Yue. (2015). Target-dependent twitter sentiment classification with rich automatic features. In: Proceedings of the 24th International Conference on Artificial Intelligence, IJCAI’15, p. 1347–1353. AAAI Press, 2015.
[40] Singh, Diveesh., Wang, Aileen. Detecting depression through tweets.
[41] Yoo, Minjoo., Lee, Sangwon., Ha, Taehyun. (2018). Semantic network analysis for understanding user experiences of bipolar and depressive disorders on reddit. Information Processing and Management, Xiaolong Press, 2018.
[42] Lei Zhang., Shuai Wang., Bing Liu. (2018). Deep learning for sentiment analysis: A survey. In Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery. John Wiley and Sons Inc., 1 2018 Xiaolong press.
[43] Zhang, You., Wang, Jin., Zhang, Xuejie. (2018). Ynuhpcc at semeval-2018 task 1: Bilstm with attention based sentiment analysis for affect in tweets. In: Proceedings of The 12th International Workshop on Semantic Evaluation, p. 273–278. Association for Computational Linguistics, 2018.
[44] Zhou, Peng., Shi, Wei., Jun Tian., Qi, Zhenyu., Li, Bingchen., Hao , Hongwei., Bo Xu. (2016). Attention-based bidirectional long short-term memory networks for relation classification. In: Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics Volume 2: Short Papers, p. 207–212. Association for Computational Linguistics, 2016.
[45] Zhou, Shusen., Chen, Qingcai., Wang, Xiaolong. (2013). Active deep learning method for semi-supervised sentiment classification. Neurocomputing, 120. 536–546.
[46] Zung, William WK., Richards, Carolyn B., Short, Marvin J. (1965). Self-rating depression scale in an outpatient clinic: further validation of the sds. Archives of General Psychiatry, 13(6) 508–515.


Home | Aim & Scope | Editorial Board | Author Guidelines | Publisher | Subscription | Previous Issue | Contact Us |Upcoming Conferences|Sample Issues|Library Recommendation Form|

 

Copyright © 2010 dline.info