Open source implementation of google's nested learning paper
-
Updated
Dec 10, 2025 - Python
Open source implementation of google's nested learning paper
Google latest research paper "Nested Learning: The Illusion of Deep Learning Architectures" : Implemented in pytorch with handwritten notes. Do give a star if you find this valuable.
Independent implementation of memory-augmented prompt optimization
A CPU-only measurement instrument for the timescale spectrum and aging dynamics of a model's memory (continual learning / long-term memory). Is your memory really multi-timescale, or secretly single-speed? MIT.
This experiment was inspired by my (so far partial) lecture on Nested Learning: The Illusion of Deep Learning Architecture. The basic idea (at least what I understood) to motivate this experiment is that the Momentum optimizer mechanic is a long-term memory mechanism.
Add a description, image, and links to the nested-learning topic page so that developers can more easily learn about it.
To associate your repository with the nested-learning topic, visit your repo's landing page and select "manage topics."