Skip to content

Commit

Permalink
[Minor] require torch>=2.0.0
Browse files Browse the repository at this point in the history
  • Loading branch information
ys-2020 committed Jul 24, 2023
1 parent e56bd25 commit 7d4a3e2
Show file tree
Hide file tree
Showing 2 changed files with 2 additions and 2 deletions.
2 changes: 1 addition & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -49,7 +49,7 @@ pip install -e .
* For **edge devices** like Orin, before running the commands above, please:

1. Modify [pyproject.toml](pyproject.toml) by commenting out [this line](https://github.com/mit-han-lab/llm-awq/blob/3fce69061682fdd528824e5da3d03a8a8b545f2a/pyproject.toml#L17).
2. Manually install precompiled PyTorch binaries from [NVIDIA](https://forums.developer.nvidia.com/t/pytorch-for-jetson/72048).
2. Manually install precompiled PyTorch binaries (>=2.0.0) from [NVIDIA](https://forums.developer.nvidia.com/t/pytorch-for-jetson/72048).
3. Set the appropriate Python version for conda environment (e.g., `conda create -n awq python=3.8 -y` for JetPack 5).

3. Install efficient W4A16 (4-bit weight, 16-bit activation) CUDA kernel and optimized FP16 kernels (e.g. layernorm, positional encodings).
Expand Down
2 changes: 1 addition & 1 deletion pyproject.toml
Original file line number Diff line number Diff line change
Expand Up @@ -14,7 +14,7 @@ classifiers = [
]
dependencies = [
"accelerate", "sentencepiece", "tokenizers>=0.12.1",
"torch", "torchvision",
"torch>=2.0.0", "torchvision",
"transformers>=4.31.0",
"lm_eval", "texttable",
"toml", "attributedict",
Expand Down

0 comments on commit 7d4a3e2

Please sign in to comment.