New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

单卡a6000 50g会oom #8

Open

77281900000 opened this issue Oct 8, 2023 · 1 comment

77281900000 commented Oct 8, 2023 •

edited

Loading

你好，单卡a6000 50g上导出13b baichuan会oom，正常读取显存30g足够了，onnx导出会占用更多显存么，有无解决办法，谢谢

Owner

luchangli03 commented Oct 9, 2023

你好，单卡a6000 50g上导出13b baichuan会oom，正常读取显存30g足够了，onnx导出会占用更多显存么，有无解决办法，谢谢

fp16也不行？

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment