Institute of Information Science Academia Sinica
Topic: Stochastic Markov Recurrent Neural Networks
Speaker: Prof. Jen-Tzung Chien (Department of Electrical and Computer Engineering, National Chiao Tung University)
Date: 2019-03-26 (Tue) 10:00 – 12:00
Location: Auditorium106 at IIS new Building
Host: Keh-Yih Su


This talk will introduce a new stochastic Markov recurrent neural network for deep sequential learning. This work aims to strengthen the learning capability in sequential prediction where the trajectory of sequential patterns is driven by a stochastic Markov process with the state transitions are carried out by a multiple-state long short-term memory model. Such a latent state machine is capable of identifying the complicated latent structure in heterogeneous sequential data. Gumbel-softmax is developed to implement the stochastic backpropagation algorithm with discrete states. Some extensions to structural learning, self-attention and multi-stream fusion will be discussed.


Jen-Tzung Chien is now with the Department of Electrical and Computer Engineering, National Chiao Tung University, Taiwan. His interests include machine learning, deep learning, natural language processing and computer vision.