forked from AI4Finance-Foundation/FinGPT
-
Notifications
You must be signed in to change notification settings - Fork 0
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
- Loading branch information
Showing
6 changed files
with
130 additions
and
2 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,89 @@ | ||
usage: train.py [-h] | ||
[--actor-model {1.3b,6.7b,13b,66b,llama-13b,sent-1.3b,sent-llama-7b,sent-llama2-7b}] | ||
[--actor-zero-stage {,0,1,2,3}] [--output-dir OUTPUT_DIR] | ||
[--deployment-type {single_gpu,single_node,multi_node}] | ||
train.py: error: argument --actor-model: invalid choice: 'facebook/sent-opt-1.3b' (choose from '1.3b', '6.7b', '13b', '66b', 'llama-13b', 'sent-1.3b', 'sent-llama-7b', 'sent-llama2-7b') | ||
---=== Running Step Instruction Tuning ===--- | ||
bash /hpcfs/users/a1232991/FinGPT/fingpt/FinGPT_sentiment/instruct-FinGPT/training/supervised_finetuning/training_scripts/single_node/run_sent-1.3b.sh /hpcfs/users/a1232991/FinGPT/fingpt/FinGPT_sentiment/instruct-FinGPT/checkpoints/actor-models/sent-1.3b | ||
Running: | ||
bash /hpcfs/users/a1232991/FinGPT/fingpt/FinGPT_sentiment/instruct-FinGPT/training/supervised_finetuning/training_scripts/single_node/run_sent-1.3b.sh /hpcfs/users/a1232991/FinGPT/fingpt/FinGPT_sentiment/instruct-FinGPT/checkpoints/actor-models/sent-1.3b | ||
Traceback (most recent call last): | ||
File "/hpcfs/users/a1232991/FinGPT/fingpt/FinGPT_sentiment/instruct-FinGPT/train.py", line 158, in <module> | ||
main(args) | ||
File "/hpcfs/users/a1232991/FinGPT/fingpt/FinGPT_sentiment/instruct-FinGPT/train.py", line 146, in main | ||
launch_cmd(args, step_num, cmd) | ||
File "/hpcfs/users/a1232991/FinGPT/fingpt/FinGPT_sentiment/instruct-FinGPT/train.py", line 123, in launch_cmd | ||
raise RuntimeError('\n\n'.join(( | ||
RuntimeError: Step 1 exited with non-zero status 1 | ||
|
||
Launch command: bash /hpcfs/users/a1232991/FinGPT/fingpt/FinGPT_sentiment/instruct-FinGPT/training/supervised_finetuning/training_scripts/single_node/run_sent-1.3b.sh /hpcfs/users/a1232991/FinGPT/fingpt/FinGPT_sentiment/instruct-FinGPT/checkpoints/actor-models/sent-1.3b | ||
|
||
Log output: /hpcfs/users/a1232991/FinGPT/fingpt/FinGPT_sentiment/instruct-FinGPT/checkpoints/actor-models/sent-1.3b/training.log | ||
|
||
Please see our tutorial at https://github.com/microsoft/DeepSpeedExamples/tree/master/applications/DeepSpeed-Chat/training/supervised_finetuning | ||
|
||
Please check that you have installed our requirements: `pip install -r requirements.txt` | ||
|
||
If you are seeing an OOM error, try modifying /hpcfs/users/a1232991/FinGPT/fingpt/FinGPT_sentiment/instruct-FinGPT/training/supervised_finetuning/training_scripts/single_node/run_sent-1.3b.sh: | ||
|
||
- Reduce `--per_device_*_batch_size` | ||
|
||
- Increase `--zero_stage {0,1,2,3}` on multi-gpu setups | ||
|
||
- Enable `--gradient_checkpointing` or `--only_optimizer_lora` | ||
---=== Running Step Instruction Tuning ===--- | ||
bash /hpcfs/users/a1232991/FinGPT/fingpt/FinGPT_sentiment/instruct-FinGPT/training/supervised_finetuning/training_scripts/single_gpu/run_sent-1.3b.sh /hpcfs/users/a1232991/FinGPT/fingpt/FinGPT_sentiment/instruct-FinGPT/checkpoints/actor-models/sent-1.3b | ||
Running: | ||
bash /hpcfs/users/a1232991/FinGPT/fingpt/FinGPT_sentiment/instruct-FinGPT/training/supervised_finetuning/training_scripts/single_gpu/run_sent-1.3b.sh /hpcfs/users/a1232991/FinGPT/fingpt/FinGPT_sentiment/instruct-FinGPT/checkpoints/actor-models/sent-1.3b | ||
Traceback (most recent call last): | ||
File "/hpcfs/users/a1232991/FinGPT/fingpt/FinGPT_sentiment/instruct-FinGPT/train.py", line 158, in <module> | ||
main(args) | ||
File "/hpcfs/users/a1232991/FinGPT/fingpt/FinGPT_sentiment/instruct-FinGPT/train.py", line 146, in main | ||
launch_cmd(args, step_num, cmd) | ||
File "/hpcfs/users/a1232991/FinGPT/fingpt/FinGPT_sentiment/instruct-FinGPT/train.py", line 123, in launch_cmd | ||
raise RuntimeError('\n\n'.join(( | ||
RuntimeError: Step 1 exited with non-zero status 2 | ||
|
||
Launch command: bash /hpcfs/users/a1232991/FinGPT/fingpt/FinGPT_sentiment/instruct-FinGPT/training/supervised_finetuning/training_scripts/single_gpu/run_sent-1.3b.sh /hpcfs/users/a1232991/FinGPT/fingpt/FinGPT_sentiment/instruct-FinGPT/checkpoints/actor-models/sent-1.3b | ||
|
||
Log output: /hpcfs/users/a1232991/FinGPT/fingpt/FinGPT_sentiment/instruct-FinGPT/checkpoints/actor-models/sent-1.3b/training.log | ||
|
||
Please see our tutorial at https://github.com/microsoft/DeepSpeedExamples/tree/master/applications/DeepSpeed-Chat/training/supervised_finetuning | ||
|
||
Please check that you have installed our requirements: `pip install -r requirements.txt` | ||
|
||
If you are seeing an OOM error, try modifying /hpcfs/users/a1232991/FinGPT/fingpt/FinGPT_sentiment/instruct-FinGPT/training/supervised_finetuning/training_scripts/single_gpu/run_sent-1.3b.sh: | ||
|
||
- Reduce `--per_device_*_batch_size` | ||
|
||
- Increase `--zero_stage {0,1,2,3}` on multi-gpu setups | ||
|
||
- Enable `--gradient_checkpointing` or `--only_optimizer_lora` | ||
---=== Running Step Instruction Tuning ===--- | ||
bash /hpcfs/users/a1232991/FinGPT/fingpt/FinGPT_sentiment/instruct-FinGPT/training/supervised_finetuning/training_scripts/single_gpu/run_sent-1.3b.sh /hpcfs/users/a1232991/FinGPT/fingpt/FinGPT_sentiment/instruct-FinGPT/checkpoints/actor-models/sent-1.3b | ||
Running: | ||
bash /hpcfs/users/a1232991/FinGPT/fingpt/FinGPT_sentiment/instruct-FinGPT/training/supervised_finetuning/training_scripts/single_gpu/run_sent-1.3b.sh /hpcfs/users/a1232991/FinGPT/fingpt/FinGPT_sentiment/instruct-FinGPT/checkpoints/actor-models/sent-1.3b | ||
Traceback (most recent call last): | ||
File "/hpcfs/users/a1232991/FinGPT/fingpt/FinGPT_sentiment/instruct-FinGPT/train.py", line 158, in <module> | ||
main(args) | ||
File "/hpcfs/users/a1232991/FinGPT/fingpt/FinGPT_sentiment/instruct-FinGPT/train.py", line 146, in main | ||
launch_cmd(args, step_num, cmd) | ||
File "/hpcfs/users/a1232991/FinGPT/fingpt/FinGPT_sentiment/instruct-FinGPT/train.py", line 123, in launch_cmd | ||
raise RuntimeError('\n\n'.join(( | ||
RuntimeError: Step 1 exited with non-zero status 1 | ||
|
||
Launch command: bash /hpcfs/users/a1232991/FinGPT/fingpt/FinGPT_sentiment/instruct-FinGPT/training/supervised_finetuning/training_scripts/single_gpu/run_sent-1.3b.sh /hpcfs/users/a1232991/FinGPT/fingpt/FinGPT_sentiment/instruct-FinGPT/checkpoints/actor-models/sent-1.3b | ||
|
||
Log output: /hpcfs/users/a1232991/FinGPT/fingpt/FinGPT_sentiment/instruct-FinGPT/checkpoints/actor-models/sent-1.3b/training.log | ||
|
||
Please see our tutorial at https://github.com/microsoft/DeepSpeedExamples/tree/master/applications/DeepSpeed-Chat/training/supervised_finetuning | ||
|
||
Please check that you have installed our requirements: `pip install -r requirements.txt` | ||
|
||
If you are seeing an OOM error, try modifying /hpcfs/users/a1232991/FinGPT/fingpt/FinGPT_sentiment/instruct-FinGPT/training/supervised_finetuning/training_scripts/single_gpu/run_sent-1.3b.sh: | ||
|
||
- Reduce `--per_device_*_batch_size` | ||
|
||
- Increase `--zero_stage {0,1,2,3}` on multi-gpu setups | ||
|
||
- Enable `--gradient_checkpointing` or `--only_optimizer_lora` |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
28 changes: 28 additions & 0 deletions
28
...struct-FinGPT/training/supervised_finetuning/training_scripts/single_gpu/run_sent-1.3b.sh
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,28 @@ | ||
#!/bin/bash | ||
# Copyright (c) Microsoft Corporation. | ||
# SPDX-License-Identifier: Apache-2.0 | ||
|
||
# DeepSpeed Team | ||
OUTPUT=$1 | ||
if [ "$OUTPUT" == "" ]; then | ||
OUTPUT=./output | ||
fi | ||
mkdir -p $OUTPUT | ||
|
||
deepspeed --num_gpus 1 main.py \ | ||
--data_path zeroshot/twitter-financial-news-sentiment chiapudding/kaggle-financial-sentiment \ | ||
--data_split 2,4,4 \ | ||
--model_name_or_path facebook/opt-1.3b \ | ||
--per_device_train_batch_size 8 \ | ||
--per_device_eval_batch_size 8 \ | ||
--max_seq_len 512 \ | ||
--learning_rate 9.65e-6 \ | ||
--weight_decay 0.1 \ | ||
--num_train_epochs 2 \ | ||
--gradient_accumulation_steps 1 \ | ||
--lr_scheduler_type cosine \ | ||
--num_warmup_steps 0 \ | ||
--seed 1234 \ | ||
--deepspeed \ | ||
--output_dir $OUTPUT \ | ||
&> $OUTPUT/training.log |