Memory, attention, sequences(towardsdatascience.com)
towardsdatascience.com
Memory, attention, sequences
https://towardsdatascience.com/memory-attention-sequences-37456d271992
3 comments
I saw it yesterday too. I'm interested in attention models, but I'm not a skilled enough practitioner to say anything meaningful about them yet.
Someone linked me the author's more recent article [1] yesterday which claims hierarchical attention models totally outclass traditional RNNs/LSTMs. I really want to read an empirical comparison or a HN thread with experts chiming in.
[1] https://towardsdatascience.com/the-fall-of-rnn-lstm-2d1594c7...
Someone linked me the author's more recent article [1] yesterday which claims hierarchical attention models totally outclass traditional RNNs/LSTMs. I really want to read an empirical comparison or a HN thread with experts chiming in.
[1] https://towardsdatascience.com/the-fall-of-rnn-lstm-2d1594c7...
Someone is probably cheating at HN and giving boosts to topics that seem machine learning related. Or perhaps a hidden number of clicks is used.
Now many hours later it's still on the front page with 74 upvotes and absolutely zero comments. What's going on here? I've never seen this happen.