Incredible flex from the OG
This is an old hat. That's exactly what the neural fast weight programmers did in the 1990s (including the 1991 unnormalised linear Transformer). Overview with links to the original papers: people.idsia.ch/~juergen/fast-…
Quote
18h
Rikiya Takehi
@rikiyatakehi
