Learning to (Learn at Test Time): RNNs with Expressive Hidden States
Gabriel Mongaras Gabriel Mongaras
8.62K subscribers
2,318 views
79

 Published On Jul 11, 2024

Paper here: https://arxiv.org/abs/2407.04620
Code!: https://github.com/test-time-training...

Notes: https://drive.google.com/file/d/127a1...

00:00 Intro
04:40 Problem with RNNs
06:38 Meta learning and method idea
09:13 Update rule and RNN inner loop
15:07 Learning the loss function outer loop
21:21 Parallelizing training
30:05 Results

show more

Share/Embed