Catalog Home Page

Reinforced memory network for question answering

Nugaliyadde, A., Wong, K.W., Sohel, F. and Xie, H. (2017) Reinforced memory network for question answering. Lecture Notes in Computer Science, 10635 . pp. 482-490.

Link to Published Version: https://doi.org/10.1007/978-3-319-70096-0_50
*Subscription may be required

Abstract

Deep learning techniques have shown to perform well in Question Answering (QA) tasks. We present a framework that combines Memory Network (MN) and Reinforcement Learning (Q-learning) to perform QA, termed Reinforced MN (R-MN). We investigate the proposed framework by the use of Long Short Term Memory Network (LSTM) and Dynamic Memory Network (DMN). We call them Reinforced LSTM (R-LSTM) and Reinforced DMN (R-DMN), respectively. The input text sequence and question are passed to both MN and Q-Learning. The output of the MN is then fed to Q-Learning as a second input for refinement. The R-MN is trained end-to-end. We evaluated R-MNs on the bAbI 1 K QA dataset for all of the 20 tasks. We achieve superior performance when compared to conventional method of RL, LSTM and the state of the art technique, DMN. Using only half of the training data, both R-LSTM and R-DMN achieved all of the bAbI tasks with high accuracies. The experimental results demonstrated that the proposed framework of combining MN and Q-learning enhances the QA tasks while using less training data.

Publication Type: Journal Article
Murdoch Affiliation: School of Engineering and Information Technology
Publisher: Springer Verlag
Copyright: © 2017 Springer International Publishing AG
URI: http://researchrepository.murdoch.edu.au/id/eprint/39822
Item Control Page Item Control Page