Unfolding RNNs II

Vanilla, GRU, LSTM RNNs from scratch in Tensorflow

The first article in this series focused on the general mechanism of RNN, architectures, variants and applications. The objective was to abstract away the details and illustrate the high-level concepts in RNN. Naturally, the next step is to dive into the details. In this article, we will follow a... [Read More]

Unfolding RNNs

RNN : Concepts and Architectures

Update : Part 2 is now available at Unfolding RNNs II : Vanilla, GRU, LSTM RNNs from scratch in Tensorflow. RNN is one of those toys that eluded me for a long time. I just couldn’t figure out how to make it work. Ever since I read Andrej Karpathy’s... [Read More]