transformers.py contains the code to train the model. Grokking_Analysis.ipynb contains the code to load the saved checkpoints for the mainline run, calculate the progress metrics on it, and plots the figures. Non_Modular_Addition_Grokking_Tasks.ipynb contains training code for the non-modular addition experiments.
-
Notifications
You must be signed in to change notification settings - Fork 16
mechanistic-interpretability-grokking/progress-measures-paper
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
No description, website, or topics provided.
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published