NameError: name 'exllamav2_ext' is not defined

[todsj88]

The following error occurred and I haven't used any exllama in script. Only tried HF and llama-cpp.

Traceback (most recent call last):
File "C:\tts2.py", line 1, in
import outetts
File "D:\anaconda3\Lib\site-packages\outetts_init_.py", line 3, in
from .interface import InterfaceHF, InterfaceGGUF, InterfaceEXL2, display_available_models
File "D:\anaconda3\Lib\site-packages\outetts\interface.py", line 2, in
from .version.v1.interface import InterfaceHF as InterfaceHF_v1
File "D:\anaconda3\Lib\site-packages\outetts\version\v1\interface.py", line 3, in
from .model import HFModel, GGUFModel, EXL2Model, GenerationConfig
File "D:\anaconda3\Lib\site-packages\outetts\version\v1\model.py", line 13, in
from exllamav2 import ExLlamaV2, ExLlamaV2Config, ExLlamaV2Cache, ExLlamaV2Tokenizer
File "D:\anaconda3\Lib\site-packages\exllamav2\exllamav2_init.py", line 3, in
from exllamav2.model import ExLlamaV2
File "D:\anaconda3\Lib\site-packages\exllamav2\exllamav2\model.py", line 35, in
from exllamav2.config import ExLlamaV2Config
File "D:\anaconda3\Lib\site-packages\exllamav2\exllamav2\config.py", line 5, in
from exllamav2.stloader import STFile, cleanup_stfiles
File "D:\anaconda3\Lib\site-packages\exllamav2\exllamav2\stloader.py", line 5, in
from exllamav2.ext import none_tensor, exllamav2_ext as ext_c
File "D:\anaconda3\Lib\site-packages\exllamav2\exllamav2\ext.py", line 291, in
ext_c = exllamav2_ext
^^^^^^^^^^^^^

[edwko]

Seems like an issue with your exllamav2 installation. Try uninstalling it if you won't use it. You could also try upgrading or reinstalling it, here's a related issue: turboderp/exllamav2#159

Also try running this in a separate file to see what you get:

from exllamav2 import ExLlamaV2, ExLlamaV2Config, ExLlamaV2Cache, ExLlamaV2Tokenizer