Refactor TransNormerLLM-7B && Add Qwen1.5 vLLM

Clarence5 · Apr 16, 2024 · 7513c8e · 7513c8e
1 parent 25fd196
commit 7513c8e
Show file tree

Hide file tree

Showing 15 changed files with 7 additions and 6 deletions.
diff --git a/README.md b/README.md
@@ -66,19 +66,20 @@
   - [ ] gemma-7b-it WebDemo 部署 @东东 ddl=3月底
   - [ ] gemma-7b-it Peft Lora 微调 @东东 ddl=3月底
 
-- [TransNormerLLM](https://github.com/OpenNLPLab/TransnormerLLM.git)
-  - [X] [TransNormerLLM-7B-Chat FastApi 部署调用](./TransNormer/01-TransNormer-7B%20FastApi%20部署调用.md) @[ml67](https://github.com/mlw67) ddl=3月底
-  - [X] [TransNormerLLM-7B-Chat langchain 接入](./TransNormer/02-TransNormer-7B%20接入langchain搭建知识库助手.md) @[ml67](https://github.com/mlw67) ddl=3月底
-  - [X] [TransNormerLLM-7B-Chat WebDemo 部署](./TransNormer/03-TransNormer-7B%20WebDemo.md) @[ml67](https://github.com/mlw67) ddl=3月底
-  - [x] [TransNormerLLM-7B-Chat Lora 微调](./TransNormer/04-TrasnNormer-7B%20Lora%20微调.md) @[ml67](https://github.com/mlw67) ddl=3月底ß
-
 - [Qwen 1.5](https://github.com/QwenLM/Qwen1.5.git)
   - [x] [Qwen1.5-7B-chat FastApi 部署调用](./Qwen1.5/01-Qwen1.5-7B-Chat%20FastApi%20部署调用.md) @颜鑫
   - [x] [Qwen1.5-7B-chat langchain 接入](./Qwen1.5/02-Qwen1.5-7B-Chat%20接入langchain搭建知识库助手.md) @颜鑫
   - [x] [Qwen1.5-7B-chat WebDemo 部署](./Qwen1.5/03-Qwen1.5-7B-Chat%20WebDemo.md) @颜鑫
   - [x] [Qwen1.5-7B-chat Lora 微调](./Qwen1.5/04-Qwen1.5-7B-chat%20Lora%20微调.md) @不要葱姜蒜
   - [x] [Qwen1.5-72B-chat-GPTQ-Int4 部署环境](./Qwen1.5/05-Qwen1.5-7B-Chat-GPTQ-Int4%20%20WebDemo.md) @[byx020119](https://github.com/byx020119)
   - [x] [Qwen1.5-MoE-chat Transformers 部署调用](./Qwen1.5/06-Qwen1.5-MoE-A2.7B.md) @[丁悦](https://github.com/dingyue772)
+  - [x] [Qwen1.5-7B-chat vLLM推理部署](./Qwen1.5/07-Qwen1.5-7B-Chat%20vllm%20推理部署调用.md) @[立业](https://github.com/0-yy-0)
+
+- [TransNormerLLM](https://github.com/OpenNLPLab/TransnormerLLM.git)
+  - [X] [TransNormerLLM-7B-Chat FastApi 部署调用](./TransNormer/01-TransNormer-7B%20FastApi%20部署调用.md) @[ml67](https://github.com/mlw67) ddl=3月底
+  - [X] [TransNormerLLM-7B-Chat langchain 接入](./TransNormer/02-TransNormer-7B%20接入langchain搭建知识库助手.md) @[ml67](https://github.com/mlw67) ddl=3月底
+  - [X] [TransNormerLLM-7B-Chat WebDemo 部署](./TransNormer/03-TransNormer-7B%20WebDemo.md) @[ml67](https://github.com/mlw67) ddl=3月底
+  - [x] [TransNormerLLM-7B-Chat Lora 微调](./TransNormer/04-TrasnNormer-7B%20Lora%20微调.md) @[ml67](https://github.com/mlw67) ddl=3月底ß
 
 - [BlueLM Vivo 蓝心大模型](https://github.com/vivo-ai-lab/BlueLM.git)
   - [x] [BlueLM-7B-Chat FatApi 部署调用](./BlueLM/01-BlueLM-7B-Chat%20FastApi%20部署.md) @[acwwt](https://github.com/acwwt) ddl=3月底

diff --git a/...sNormer/01-TransNormer-7B FastApi 部署调用.md → ...rLLM/01-TransNormerLLM-7B FastApi 部署调用.md b/...sNormer/01-TransNormer-7B FastApi 部署调用.md → ...rLLM/01-TransNormerLLM-7B FastApi 部署调用.md
diff --git a/...r/02-TransNormer-7B 接入langchain搭建知识库助手.md → ...2-TransNormerLLM-7B 接入langchain搭建知识库助手.md b/...r/02-TransNormer-7B 接入langchain搭建知识库助手.md → ...2-TransNormerLLM-7B 接入langchain搭建知识库助手.md
diff --git a/TransNormer/03-TransNormer-7B WebDemo.md → ...NormerLLM/03-TransNormerLLM-7B WebDemo.md b/TransNormer/03-TransNormer-7B WebDemo.md → ...NormerLLM/03-TransNormerLLM-7B WebDemo.md
diff --git a/...rmer/04-TransNormerLLM-7B-chat-Lora.ipynb → ...rLLM/04-TransNormerLLM-7B-chat-Lora.ipynb b/...rmer/04-TransNormerLLM-7B-chat-Lora.ipynb → ...rLLM/04-TransNormerLLM-7B-chat-Lora.ipynb
diff --git a/TransNormer/04-TrasnNormer-7B Lora 微调.md → ...NormerLLM/04-TrasnNormerLLM-7B Lora 微调.md b/TransNormer/04-TrasnNormer-7B Lora 微调.md → ...NormerLLM/04-TrasnNormerLLM-7B Lora 微调.md
diff --git a/TransNormer/images/Jupyter-response.png → TransNormerLLM/images/Jupyter-response.png b/TransNormer/images/Jupyter-response.png → TransNormerLLM/images/Jupyter-response.png
diff --git a/TransNormer/images/Machine-Config.png → TransNormerLLM/images/Machine-Config.png b/TransNormer/images/Machine-Config.png → TransNormerLLM/images/Machine-Config.png
diff --git a/TransNormer/images/TransNormer-structure.png → ...ormerLLM/images/TransNormer-structure.png b/TransNormer/images/TransNormer-structure.png → ...ormerLLM/images/TransNormer-structure.png
diff --git a/TransNormer/images/python-terminal.png → TransNormerLLM/images/python-terminal.png b/TransNormer/images/python-terminal.png → TransNormerLLM/images/python-terminal.png
diff --git a/TransNormer/images/python-terminal2.png → TransNormerLLM/images/python-terminal2.png b/TransNormer/images/python-terminal2.png → TransNormerLLM/images/python-terminal2.png
diff --git a/...er/images/question_to_the_TransNormer.png → ...LM/images/question_to_the_TransNormer.png b/...er/images/question_to_the_TransNormer.png → ...LM/images/question_to_the_TransNormer.png
diff --git a/TransNormer/images/response.png → TransNormerLLM/images/response.png b/TransNormer/images/response.png → TransNormerLLM/images/response.png
diff --git a/TransNormer/images/server-ok.png → TransNormerLLM/images/server-ok.png b/TransNormer/images/server-ok.png → TransNormerLLM/images/server-ok.png
diff --git a/TransNormer/images/start-jupyter.png → TransNormerLLM/images/start-jupyter.png b/TransNormer/images/start-jupyter.png → TransNormerLLM/images/start-jupyter.png