Sentiment classification using N-ary tree-structured gated recurrent unit networks

Research output: Chapter in Book/Report/Conference proceedingConference contribution

19 Downloads (Pure)

Abstract

Recurrent Neural Networks(RNN) is a good way of modeling sequences. However this type of Artificial Neural Networks(ANN) has two major drawbacks, it is not good at capturing long range connections and it is not robust at the vanishing gradient problem(Hochreiter, 1998). Luckily, there have been invented RNNs that can deal with these problems. Namely, Gated Recurrent Units(GRU) networks(Chung et al., 2014)(Gülçehre et al., 2013) and Long Short Term Memory(LSTM) networks(Hochreiter and Schmidhuber, 1997). Many problems in Natural Language Processing can be approximated with a sequence model. But, it is known that the syntactic rules of natural language have a recursive structure(Socher et al., 2011b). Therefore a Recursive Neural Network(Goller and Kuchler, 1996) can be a great alternative. Kai Sheng Tai (Tai et al., 2015) has come up with an architecture that gives the good properties of LSTM in a Recursive Neural Network. In this report, we will present another alternative of Recursive Neural Networks combined with GRU which performs very similar on binary and fine-grained Sentiment Classification (on Stanford Sentiment Treebank dataset) with N-ary Tree-Structured LSTM but is trained faster.

Original languageEnglish
Title of host publicationProceedings of the 10th International Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge Management (IC3K 2018)
EditorsAna Fred, Joaquim Filipe
PublisherSciTePress
Pages149-154
Number of pages6
Volume1
ISBN (Electronic)9789897583308
Publication statusPublished - 1 Jan 2018
Event10th International Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge Management, IC3K 2018 - Seville, Spain
Duration: 18 Sep 201820 Sep 2018

Conference

Conference10th International Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge Management, IC3K 2018
CountrySpain
CitySeville
Period18/09/1820/09/18

Keywords

  • Gated recurrent units
  • Natural language processing
  • Recursive neural network
  • Sentiment classification

Fingerprint Dive into the research topics of 'Sentiment classification using N-ary tree-structured gated recurrent unit networks'. Together they form a unique fingerprint.

Cite this