Skip to content

Commit

Permalink
fix typo ( params -> tokens)
Browse files Browse the repository at this point in the history
  • Loading branch information
PWhiddy authored Jan 19, 2023
1 parent 8dd2061 commit ff9085d
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion scaling_laws.ipynb
Original file line number Diff line number Diff line change
Expand Up @@ -566,7 +566,7 @@
"source": [
"In the plot above, basically the models on the left of best are too small and trained for too long. The models on the right of best are way too large and trained for too little. The model at the red line is just right.\n",
"\n",
"Now, the Chinchilla paper says that best model size for this flop budget is 400M params and 9.2B tokens (instead of 316M params 11.65B params) so there is some unresolved disagreement here too..."
"Now, the Chinchilla paper says that best model size for this flop budget is 400M params and 9.2B tokens (instead of 316M params and 11.65B tokens) so there is some unresolved disagreement here too..."
]
},
{
Expand Down

0 comments on commit ff9085d

Please sign in to comment.