3 Pull requests merged by 2 people

• Rewrites parts of the inference section.

  #29 merged Feb 9, 2025

• Adds new roofline question

  #28 merged Feb 8, 2025

• Fix typo in MoE note.

  #27 merged Feb 7, 2025

1 Pull request opened by 1 person

• Do flop/param calculations for general GQA attention

  #30 opened Feb 9, 2025

1 Issue closed by 2 people

• On the training FLOPs of DeepSeek-V3

  #31 closed Feb 14, 2025