This week at MCQLL, Yikang Shen and Zhouhan Lin will present on previous and ongoing work.
Title: Ordered Neurons and syntactically supervised structural neural language models.
Abstract: In this talk, we will first present the ONLSTM model, which is a language model that learns syntactic distances through an extra master input gate and a master forget gate. In the second part of the talk, we will present a way of incorporating supervised syntactic trees to the neural language model, also through the syntactic distances. Experimental results reveal that for neural models this way of injecting supervised tree structure helps the language model to yield better results.
The meeting is Wednesday from 14:30-16:00 in Room 117. A late lunch will be provided.