Skip to content

Commit

Permalink
Update README.md
Browse files Browse the repository at this point in the history
  • Loading branch information
BeeGass authored Feb 22, 2022
1 parent 94668e8 commit 7f51c6d
Showing 1 changed file with 28 additions and 26 deletions.
54 changes: 28 additions & 26 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -57,38 +57,40 @@ TBA
<b>First Order Results</b><br>
</h2>

| Model | Code | Config | Paper | Animations | Samples |
|-----------------------------------------|-------|---------|---------------------------------------------------|----------------|---------|
| Gradient Descent |&#9744;| &#9744; | [Link]() | **TBA** | **TBA** |
| Stochastic Gradient Descent |&#9744;| &#9744; | [Link]() | **TBA** | **TBA** |
| Batch Gradient Descent |&#9744;| &#9744; | [Link]() | **TBA** | **TBA** |
| Mini-Batch Gradient Descent |&#9744;| &#9744; | [Link]() | **TBA** | **TBA** |
| SGD w/ Momentum |&#9744;| &#9744; | [Link]() | **TBA** | **TBA** |
| Nesterov's Gradient Acceleration |&#9744;| &#9744; | [Link]() | **TBA** | **TBA** |
| AdaGrad(Adaptive Gradient Descent) |&#9744;| &#9744; | [Link]() | **TBA** | **TBA** |
| AdaDelta |&#9744;| &#9744; | [Link]() | **TBA** | **TBA** |
| RMS-Prop (Root Mean Square Propagation) |&#9744;| &#9744; | [Link]() | **TBA** | **TBA** |
| Adam(Adaptive Moment Estimation) |&#9744;| &#9744; | [Link]() | **TBA** | **TBA** |
| Adamw |&#9744;| &#9744; | [Link]() | **TBA** | **TBA** |

| Model | PyTorch | Jax/Flax | Flux | Config | Paper | Animations | Samples |
|:--------------------------------------- |:-------:|:--------:|:-------:|:-------:|:-------- |:----------:|:-------:|
| Gradient Descent | &#9744; | &#9744; | &#9744; | &#9744; | [Link]() | **TBA** | **TBA** |
| Stochastic Gradient Descent | &#9744; | &#9744; | &#9744; | &#9744; | [Link]() | **TBA** | **TBA** |
| Batch Gradient Descent | &#9744; | &#9744; | &#9744; | &#9744; | [Link]() | **TBA** | **TBA** |
| Mini-Batch Gradient Descent | &#9744; | &#9744; | &#9744; | &#9744; | [Link]() | **TBA** | **TBA** |
| SGD w/ Momentum | &#9744; | &#9744; | &#9744; | &#9744; | [Link]() | **TBA** | **TBA** |
| Nesterov's Gradient Acceleration | &#9744; | &#9744; | &#9744; | &#9744; | [Link]() | **TBA** | **TBA** |
| AdaGrad(Adaptive Gradient Descent) | &#9744; | &#9744; | &#9744; | &#9744; | [Link]() | **TBA** | **TBA** |
| AdaDelta | &#9744; | &#9744; | &#9744; | &#9744; | [Link]() | **TBA** | **TBA** |
| RMS-Prop (Root Mean Square Propagation) | &#9744; | &#9744; | &#9744; | &#9744; | [Link]() | **TBA** | **TBA** |
| Adam(Adaptive Moment Estimation) | &#9744; | &#9744; | &#9744; | &#9744; | [Link]() | **TBA** | **TBA** |
| Adamw | &#9744; | &#9744; | &#9744; | &#9744; | [Link]() | **TBA** | **TBA** |

----
<h2 align="center">
<b>Second Order Results</b><br>
</h2>

| Model | Code | Config | Paper | Animations | Samples |
|-----------------------------------------|-------|---------|---------------------------------------------------|----------------|---------|
| Newton's Method |&#9744;| &#9744; | [Link]() | **TBA** | **TBA** |
| Secant Method |&#9744;| &#9744; | [Link]() | **TBA** | **TBA** |
| Davidson-Fletcher-Powell (DFP) |&#9744;| &#9744; | [Link]() | **TBA** | **TBA** |
| Broyden-Fletcher-Goldfarb-Shanno (BFGS) |&#9744;| &#9744; | [Link]() | **TBA** | **TBA** |
| Limited-memory BFGS (L-BFGS) |&#9744;| &#9744; | [Link]() | **TBA** | **TBA** |
| Newton-Raphson |&#9744;| &#9744; | [Link]() | **TBA** | **TBA** |
| Levenberg-Marquardt |&#9744;| &#9744; | [Link]() | **TBA** | **TBA** |
| Powell's method |&#9744;| &#9744; | [Link]() | **TBA** | **TBA** |
| Steepest Descent |&#9744;| &#9744; | [Link]() | **TBA** | **TBA** |
| Truncated Newton |&#9744;| &#9744; | [Link]() | **TBA** | **TBA** |
| Fletcher-Reeves |&#9744;| &#9744; | [Link]() | **TBA** | **TBA** |

| Model | PyTorch | Jax/Flax | Flux | Config | Paper | Animations | Samples |
|:--------------------------------------- |:-------:|:--------:|:-------:|:-------:|:-------- |:----------:|:-------:|
| Newton's Method | &#9744; | &#9744; | &#9744; | &#9744; | [Link]() | **TBA** | **TBA** |
| Secant Method | &#9744; | &#9744; | &#9744; | &#9744; | [Link]() | **TBA** | **TBA** |
| Davidson-Fletcher-Powell (DFP) | &#9744; | &#9744; | &#9744; | &#9744; | [Link]() | **TBA** | **TBA** |
| Broyden-Fletcher-Goldfarb-Shanno (BFGS) | &#9744; | &#9744; | &#9744; | &#9744; | [Link]() | **TBA** | **TBA** |
| Limited-memory BFGS (L-BFGS) | &#9744; | &#9744; | &#9744; | &#9744; | [Link]() | **TBA** | **TBA** |
| Newton-Raphson | &#9744; | &#9744; | &#9744; | &#9744; | [Link]() | **TBA** | **TBA** |
| Levenberg-Marquardt | &#9744; | &#9744; | &#9744; | &#9744; | [Link]() | **TBA** | **TBA** |
| Powell's method | &#9744; | &#9744; | &#9744; | &#9744; | [Link]() | **TBA** | **TBA** |
| Steepest Descent | &#9744; | &#9744; | &#9744; | &#9744; | [Link]() | **TBA** | **TBA** |
| Truncated Newton | &#9744; | &#9744; | &#9744; | &#9744; | [Link]() | **TBA** | **TBA** |
| Fletcher-Reeves | &#9744; | &#9744; | &#9744; | &#9744; | [Link]() | **TBA** | **TBA** |

### Citation
```bib
Expand Down

0 comments on commit 7f51c6d

Please sign in to comment.