Skip to content

Commit

Permalink
add speed doc.
Browse files Browse the repository at this point in the history
  • Loading branch information
wangzhaode committed Mar 27, 2023
1 parent b8ff1a8 commit ca7bfca
Showing 1 changed file with 18 additions and 0 deletions.
18 changes: 18 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -11,6 +11,24 @@
目前支持命令行对话与Web UI对话两种形式的Demo
![web_demo](./resource/web/web_demo.png)

## Speed

测试平台:
- Memory: 32G (+32G Swap)
- CPU: AMD Ryzen 9 3900X 12-Core Processor
- GPU: GeForce RTX 2080 Ti

### FP Model
仅测试浮点模型(CPU: fp32/ GPU: fp16),输入`你好`,在回复完内容相同的情况下,回复时间(秒)对比如下:

| impl | GPU + CPU | CPU only |
|---------|---------------|-----------|
| MNN | 7.37 | 28.64 |
| Pytorch | out of memory | 33.59 |

### Quantize Model
`TODO`

## Usage
### 1. Compile MNN library
从源码编译MNN
Expand Down

0 comments on commit ca7bfca

Please sign in to comment.