Commits

Branch selector

 main

User selector

All users

Datepicker

All time

Commit History

Commits on Feb 16, 2025

• Downgrade jax/qax, get code back up

  neverix

  committed
  e570fff

  Copy full SHA for e570fff

Commits on Feb 14, 2025

• Try updating qax

  neverix

  committed
  5a3accd

  Copy full SHA for 5a3accd

Commits on Jan 27, 2025

• Run Ruff

  neverix

  committed
  530455a

  Copy full SHA for 530455a

• Reaping works

  neverix

  committed
  73c781d

  Copy full SHA for 73c781d

• Very slow sowing

  neverix

  committed
  4ba4e88

  Copy full SHA for 4ba4e88

Commits on Jan 25, 2025

• Remove QuantMatrix in most places, better set up harvest

  neverix

  committed
  6fd5ac3

  Copy full SHA for 6fd5ac3

Commits on Jan 9, 2025

• Compare training methods

  neverix

  committed
  1454443

  Copy full SHA for 1454443

Commits on Jan 8, 2025

• Write spatial sparsity metric, investigate feasibility of on-device caching

  neverix

  committed
  46aa1c2

  Copy full SHA for 46aa1c2

Commits on Jan 7, 2025

• Save fluxes separately, allow extra arguments

  neverix

  committed
  c8f19a3

  Copy full SHA for c8f19a3

Commits on Jan 5, 2025

• Image saver mode

  neverix

  committed
  7023d33

  Copy full SHA for 7023d33

Commits on Jan 2, 2025

• Unify cacher image indices

  neverix

  committed
  58c0690

  Copy full SHA for 58c0690

Commits on Jan 1, 2025

• Implement PCA

  neverix

  committed
  92de528

  Copy full SHA for 92de528

Commits on Dec 30, 2024

• Fix saver bugs

  neverix

  committed
  7802b28

  Copy full SHA for 7802b28

Commits on Dec 29, 2024

• Try Hadamard, it's bad

  neverix

  committed
  fc8e2d6

  Copy full SHA for fc8e2d6

• Come up with slightly better AuxK hyperparameters

  neverix

  committed
  6ee9e66

  Copy full SHA for 6ee9e66

Commits on Dec 28, 2024

• Batch normalization seems to improve dead features

  neverix

  committed
  f18779f

  Copy full SHA for f18779f

• Try Fry plots, fix frequency calculation, run on different layers and sites

  neverix

  committed
  5727fa1

  Copy full SHA for 5727fa1

Commits on Dec 22, 2024

• Proper VAE, try fixing training

  neverix

  committed
  5b2e445

  Copy full SHA for 5b2e445

Commits on Dec 20, 2024

• Improve finetuning

  neverix

  committed
  4762498

  Copy full SHA for 4762498

• Training seems to run

  neverix

  committed
  e8f6fe6

  Copy full SHA for e8f6fe6

Commits on Dec 19, 2024

• Fix typo; get OOM

  neverix

  committed
  2c1ac2e

  Copy full SHA for 2c1ac2e

• Get gradient to compute

  neverix

  committed
  1675b18

  Copy full SHA for 1675b18

Commits on Dec 17, 2024

• Try to optimize finetune training, run into qax bug

  neverix

  committed
  03ad9ce

  Copy full SHA for 03ad9ce

• OOM for finetuning

  neverix

  committed
  b771dd9

  Copy full SHA for b771dd9

• Introduce activation buffer

  neverix

  committed
  17ec822

  Copy full SHA for 17ec822

Commits on Dec 16, 2024

• As expected, Flux has weird PCA even compared to 4-bit Llama 3 8B

  neverix

  committed
  1249699

  Copy full SHA for 1249699

• Major refactor, remove weights/logic separations, change finetuning lora, fix CPU activation saving and start exploring flux residuals

  neverix

  committed
  e259fb1

  Copy full SHA for e259fb1

Commits on Dec 12, 2024

• Reap on CPU properly

  neverix

  committed
  aba705b

  Copy full SHA for aba705b

Commits on Dec 11, 2024

• It seems circular imports don't work

  neverix

  committed
  e0572fa

  Copy full SHA for e0572fa

• It seems jax uses a different context

  neverix

  committed
  558936e

  Copy full SHA for 558936e

Commits on Dec 9, 2024

• Try to switch to host callback-based interface. Mishax doesn't work

  neverix

  committed
  fef2098

  Copy full SHA for fef2098

• Try to make features activate stronger

  neverix

  committed
  9a70326

  Copy full SHA for 9a70326

Commits on Dec 8, 2024

• Need to remove logic from flux

  neverix

  committed
  a055d5b

  Copy full SHA for a055d5b

• Try out lorax

  neverix

  committed
  e670800

  Copy full SHA for e670800

Commits on Dec 7, 2024

• Implement proper AuxK, compute loss, fiddle with hyperparams

  neverix

  committed
  e86a161

  Copy full SHA for e86a161

Pagination

Previous

Next