Skip to content

Commit

Permalink
Add information about presets to the UI
Browse files Browse the repository at this point in the history
  • Loading branch information
oobabooga committed Jul 4, 2023
1 parent 373555c commit 5545754
Show file tree
Hide file tree
Showing 3 changed files with 24 additions and 0 deletions.
4 changes: 4 additions & 0 deletions css/main.css
Original file line number Diff line number Diff line change
Expand Up @@ -150,4 +150,8 @@ button {

.checkboxgroup-table div {
display: grid !important;
}

.markdown ul ol {
font-size: 100% !important;
}
1 change: 1 addition & 0 deletions docs/Generation-parameters.md
Original file line number Diff line number Diff line change
Expand Up @@ -23,6 +23,7 @@ ExLlama only uses the following parameters:
* top_p
* top_k
* repetition_penalty
* repetition_penalty_range
* typical_p

### RWKV
Expand Down
19 changes: 19 additions & 0 deletions server.py
Original file line number Diff line number Diff line change
Expand Up @@ -356,6 +356,25 @@ def create_settings_menus(default_preset):
For a technical description of the parameters, the [transformers documentation](https://huggingface.co/docs/transformers/main_classes/text_generation#transformers.GenerationConfig) is a good reference.
The best presets, according to the [Preset Arena](https://github.com/oobabooga/oobabooga.github.io/blob/main/arena/results.md) experiment, are:
* Instruction following:
1) Divine Intellect
2) Big O
3) simple-1
4) Space Alien
5) StarChat
6) Titanic
7) tfs-with-top-a
8) Asterism
9) Contrastive Search
* Chat:
1) Midnight Enigma
2) Yara
3) Shortwave
4) Kobold-Godlike
### Temperature
Primary factor to control randomness of outputs. 0 = deterministic (only the most likely token is used). Higher value = more randomness.
### top_p
Expand Down

0 comments on commit 5545754

Please sign in to comment.