Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

cost too many time!!! #302

Open
njhouse365 opened this issue Jun 12, 2024 · 12 comments
Open

cost too many time!!! #302

njhouse365 opened this issue Jun 12, 2024 · 12 comments
Labels
algorithm Algorithm improvements & issues help wanted Extra attention is needed performance Running speed & quality

Comments

@njhouse365
Copy link

text is 勤攀书山，不畏艰辛，水击学海，勇做扁舟。愿学子们，心怀梦想，砥砺前行，握笔为剑，绘锦绣前程。扬帆起航正当时，乘风破浪展宏图。马蹄轻快春风里，一日览尽长安娇。待到金榜题名日，笑傲天涯任逍遥。最后祝诸君学业有成，蟾宫折桂，前程似锦！

Inference time: 118.2790093421936 seconds
@zemelLeong
Copy link

image

笔记本3070显卡，看起来没有等很久

@njhouse365
Copy link
Author

A100咋这么长呢

@Yuxxxy
Copy link

Yuxxxy commented Jun 12, 2024

A100咋这么长呢

同样A100也很慢，请问找到解决办法了吗

@zemelLeong
Copy link

A100，失礼了，我不配和大佬们说话

@JamesGu14
Copy link

A100，失礼了，我不配和大佬们说话

但你比大佬们都快

@zhzLuke96
Copy link

确实有点奇怪，不仅A100上速度和普通显卡一样，开半精度之后也没有速度增益，并且cpu上就可以跑20it/s但是gpu最多只能到30it/s左右

@fumiama fumiama added help wanted Extra attention is needed algorithm Algorithm improvements & issues performance Running speed & quality labels Jun 21, 2024
@fumiama fumiama added this to ChatTTS Jun 21, 2024
@fumiama fumiama moved this to Todo in ChatTTS Jun 21, 2024
@panpan123456
Copy link

请问这个问题解决了吗？同样A100，速度超慢

@Kimagure7
Copy link

请问这个问题解决了吗？A800，速度超慢
观察了一下推理的时候速度根本没跑满

@panpan123456
Copy link

同样的问题在 A100，请问有解决办法吗

@ucasiggcas
Copy link

我V100,32G的同样需要很久，感觉GPU都没用起来。

@zhzLuke96 zhzLuke96 mentioned this issue Jun 26, 2024
Closed
3 tasks
@fumiama
Copy link
Member

fumiama commented Jul 1, 2024

ref #226

This was referenced Jul 4, 2024
Closed
Closed
Closed
@fumiama
Copy link
Member

fumiama commented Aug 1, 2024

ref #612

@fumiama fumiama moved this from Todo to In Progress in ChatTTS Aug 1, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
algorithm Algorithm improvements & issues help wanted Extra attention is needed performance Running speed & quality
Projects
ChatTTS
Status: In Progress
Milestone
No milestone
Development

No branches or pull requests
9 participants
@JamesGu14 @panpan123456 @zemelLeong @ucasiggcas @Yuxxxy @zhzLuke96 @fumiama @Kimagure7 @njhouse365