adding lstms notes

sammmeeeer · Aug 26, 2024 · 44983e2 · 44983e2
1 parent 4938f8e
commit 44983e2
Showing 1 changed file with 1 addition and 3 deletions.
diff --git a/03-sequence-modeling/02-lstm/lstm.ipynb b/03-sequence-modeling/02-lstm/lstm.ipynb
@@ -65,12 +65,10 @@
     "4. output gate: \n",
     "   - uses sigmoid activation\n",
     "   - filters the updated cell state to produce the final output\n",
+    "   - the cell state is passed through a tanh function and multiplied by the output gate\n",
     "\n",
     "![image-2.png](attachment:image-2.png)\n",
     "\n",
-    "5. final output: combines the output gate with the updated cell state\n",
-    "   - the cell state is passed through a tanh function and multiplied by the output gate\n",
-    "\n",
     "this architecture allows LSTMs to maintain relevant information over long sequences,\n",
     "selectively update or forget information, and produce relevant outputs at each time step.\n",
     "\n",