Exploring LSTMs
Edwin Chen
MAY 29, 2017
Note: if you're already familiar with neural networks and LSTMs, skip to the middle – the first half of this post is a tutorial.). The jth hidden neuron outputs (h_j = phi(sum_i w_{ij} x_i)) , where (phi) is an activation function. In matrix notation: $$h = phi(Wx)$$. $$y wm_t = focus_t circ phi(ltm_t)$$.
94 
Let's personalize your content