Skip to content

Issues: InternLM/lmdeploy

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clear current search query, filters, and sorts
37 Open 207 Closed
37 Open 207 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

[Bug] 请问如何使用自己的数据集进行lmdeploy的awq量化？量化的校对数据集只支持文字问答数据集吗？
#2931 opened Dec 20, 2024 by lzk9508
3 tasks
@AllentDan
1
[Feature] how to apply a custom calibration data set during awq quant?
#2923 opened Dec 18, 2024 by lzk9508
@AllentDan
2
[Bug] server启动模型，调用流式返回报错
#2920 opened Dec 18, 2024 by pangr
3 tasks
@AllentDan
1
[Feature] Any plans on supporting deepseek-ai/deepseek-vl2 ?
#2897 opened Dec 13, 2024 by SolomonLeon
@AllentDan
1
LLaVA INT4 quantization
#2857 opened Dec 5, 2024 by yimuu
@AllentDan
1
[Feature] 可以考虑支持THUDM/cogvlm2-llama3-chinese-chat-19B-int4模型吗
#2799 opened Nov 24, 2024 by Jerryporter
@AllentDan
1
[Bug] SystemExit: 1 asyncio.exceptions.TimeoutError
#2782 opened Nov 20, 2024 by LIUKAI0815
2 of 3 tasks
@AllentDan
15
[Bug] The quantization process of Qwen/Qwen2-VL-7B-Instruct is getting killed without throwing error.
#2770 opened Nov 19, 2024 by vjaideep08
3 tasks done
@AllentDan
2
[Bug] Accuracy of W8A8 is big different from that of the original model
#2730 opened Nov 9, 2024 by HelloCard
3 tasks done
@AllentDan
6
[Docs] LoRA 推理服务
#2686 opened Oct 31, 2024 by LIUKAI0815
@AllentDan
1
[Feature] Response Metrics
#2673 opened Oct 28, 2024 by nathan-az
@AllentDan
2
[Bug] use new 4bits quantizated models of internlm2, decoded word starts with a blank.
#2651 opened Oct 24, 2024 by zhulinJulia24
3 tasks
@AllentDan
[Feature] Metrics Endpoint
#2638 opened Oct 23, 2024 by eldhosemjoy
@AllentDan
5
[Bug] cpu 100%
#2637 opened Oct 23, 2024 by whk6688
3 tasks
@AllentDan
3
[Feature] Support chat completion stream with tool calls
#2552 opened Oct 7, 2024 by nbczb1996
@AllentDan
2
[Bug] Providing tool response back to llm for output generation is broken for llama3.1 8B
#2542 opened Sep 30, 2024 by S1LV3RJ1NX
3 tasks done
@AllentDan
2
[Feature] Will multi-modal models support W8A8 quantization in the future?
#2496 opened Sep 23, 2024 by MenglingD
@AllentDan
6
[Docs] AWQ / GPTQ 部分
#2422 opened Sep 4, 2024 by Skyseaee
@AllentDan
1
[Bug] InternLM 2.5 function calling
#2390 opened Aug 27, 2024 by coffeecode24
3 tasks done
@AllentDan
3
[Bug] error occurs when reset chat session in gradio with image uploded and get response.
#2387 opened Aug 27, 2024 by zhulinJulia24
3 tasks
@AllentDan
14
[Feature] LLaVA 1.5 WINT 8 量化
#2336 opened Aug 19, 2024 by yimuu
@AllentDan
1
[Feature] Add logits_processor to GenerationConfig
#2305 opened Aug 14, 2024 by Dan-wanna-M
@AllentDan
3
[Bug] response里需要生成空格's时，text会错误的输出
#2190 opened Jul 31, 2024 by zhongtao93
3 tasks done
@AllentDan
3
[Feature] support workers when using lite autoawq
#2167 opened Jul 28, 2024 by zhyncs
@AllentDan
1
[Bug] lmdeploy serve异步调用过快会造成死锁？该如何限制？还是说lmdeploy serve启动微调后模型会造成调度失灵？
#2115 opened Jul 23, 2024 by Volta-lemon
3 tasks done
@AllentDan
3
ProTip! Mix and match filters to narrow down what you’re looking for.