Merge pull request #267 from linrock/SFNNv8

Add SFNNv8 architecture and diagrams
official-stockfish · Oct 7, 2023 · c15e33c · c15e33c
2 parents 3a100d5 + 1e17931
commit c15e33c
Show file tree

Hide file tree

Showing 7 changed files with 2,724 additions and 2 deletions.
diff --git a/docs/img/SFNNv8_architecture.drawio b/docs/img/SFNNv8_architecture.drawio
diff --git a/docs/img/SFNNv8_architecture.svg b/docs/img/SFNNv8_architecture.svg
diff --git a/docs/img/SFNNv8_architecture_detailed.drawio b/docs/img/SFNNv8_architecture_detailed.drawio
diff --git a/docs/img/SFNNv8_architecture_detailed.svg b/docs/img/SFNNv8_architecture_detailed.svg
diff --git a/docs/img/SFNNv8_architecture_detailed_v2.drawio b/docs/img/SFNNv8_architecture_detailed_v2.drawio
diff --git a/docs/img/SFNNv8_architecture_detailed_v2.svg b/docs/img/SFNNv8_architecture_detailed_v2.svg
diff --git a/docs/nnue.md b/docs/nnue.md
@@ -127,6 +127,7 @@ What this document DOES NOT contain:
     + [A part of the feature transformer directly forwarded to the output.](#a-part-of-the-feature-transformer-directly-forwarded-to-the-output)
     + [Multiple PSQT outputs and multiple subnetworks](#multiple-psqt-outputs-and-multiple-subnetworks)
 * [Historical Stockfish evaluation network architectures](#historical-stockfish-evaluation-network-architectures)
+    + ["SFNNv8" architecture](#sfnnv8-architecture)
     + ["SFNNv7" architecture](#sfnnv7-architecture)
     + ["SFNNv6" architecture](#sfnnv6-architecture)
     + ["SFNNv5" architecture](#sfnnv5-architecture)
@@ -2957,11 +2958,21 @@ y = self.layer_stacks(l0_, layer_stack_indices) + (wpsqt - bpsqt) * (us - 0.5)
 
 ## Historical Stockfish evaluation network architectures
 
+### "SFNNv8" architecture
+
+Same as "SFNNv5" with L1 size increased to 2560.
+
+2023-09-22 - *
+
+[Commit 782c32223583d7774770fc56e50bd88aae35cd1a](https://github.com/official-stockfish/Stockfish/commit/70ba9de85cddc5460b1ec53e0a99bee271e26ece)
+
+![](img/SFNNv8_architecture_detailed_v2.svg)
+
 ### "SFNNv7" architecture
 
-Same as "SFNNv6" with L1 size increased from 1536 to 2048.
+Same as "SFNNv5" with L1 size increased to 2048.
 
-2023-07-01 - *
+2023-07-01 - 2023-09-22
 
 [Commit 915532181f11812c80ef0b57bc018de4ea2155ec](https://github.com/official-stockfish/Stockfish/commit/915532181f11812c80ef0b57bc018de4ea2155ec)