Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Installation]: no module named "resources" #12425

Open
1 task done
Omni-NexusAI opened this issue Jan 25, 2025 · 2 comments
Open
1 task done

[Installation]: no module named "resources" #12425

Omni-NexusAI opened this issue Jan 25, 2025 · 2 comments
Labels
installation Installation problems

Comments

@Omni-NexusAI
Copy link

Your current environment

vllm serve "bytedance-research/UI-TARS-7B-DPO"
Traceback (most recent call last):
  File "C:\Users\yepyy\anaconda3\envs\vllm\lib\runpy.py", line 196, in _run_module_as_main
    return _run_code(code, main_globals, None,
  File "C:\Users\yepyy\anaconda3\envs\vllm\lib\runpy.py", line 86, in _run_code
    exec(code, run_globals)
  File "C:\Users\yepyy\anaconda3\envs\vllm\Scripts\vllm.exe\__main__.py", line 4, in <module>
  File "C:\Users\yepyy\anaconda3\envs\vllm\lib\site-packages\vllm\__init__.py", line 3, in <module>
    from vllm.engine.arg_utils import AsyncEngineArgs, EngineArgs
  File "C:\Users\yepyy\anaconda3\envs\vllm\lib\site-packages\vllm\engine\arg_utils.py", line 11, in <module>
    from vllm.config import (CacheConfig, CompilationConfig, ConfigFormat,
  File "C:\Users\yepyy\anaconda3\envs\vllm\lib\site-packages\vllm\config.py", line 22, in <module>
    from vllm.model_executor.layers.quantization import (QUANTIZATION_METHODS,
  File "C:\Users\yepyy\anaconda3\envs\vllm\lib\site-packages\vllm\model_executor\__init__.py", line 1, in <module>
    from vllm.model_executor.parameter import (BasevLLMParameter,
  File "C:\Users\yepyy\anaconda3\envs\vllm\lib\site-packages\vllm\model_executor\parameter.py", line 7, in <module>
    from vllm.distributed import get_tensor_model_parallel_rank
  File "C:\Users\yepyy\anaconda3\envs\vllm\lib\site-packages\vllm\distributed\__init__.py", line 1, in <module>
    from .communication_op import *
  File "C:\Users\yepyy\anaconda3\envs\vllm\lib\site-packages\vllm\distributed\communication_op.py", line 6, in <module>
    from .parallel_state import get_tp_group
  File "C:\Users\yepyy\anaconda3\envs\vllm\lib\site-packages\vllm\distributed\parallel_state.py", line 38, in <module>
    import vllm.distributed.kv_transfer.kv_transfer_agent as kv_transfer
  File "C:\Users\yepyy\anaconda3\envs\vllm\lib\site-packages\vllm\distributed\kv_transfer\kv_transfer_agent.py", line 15, in <module>
    from vllm.distributed.kv_transfer.kv_connector.factory import (
  File "C:\Users\yepyy\anaconda3\envs\vllm\lib\site-packages\vllm\distributed\kv_transfer\kv_connector\factory.py", line 3, in <module>
    from .base import KVConnectorBase
  File "C:\Users\yepyy\anaconda3\envs\vllm\lib\site-packages\vllm\distributed\kv_transfer\kv_connector\base.py", line 14, in <module>
    from vllm.sequence import IntermediateTensors
  File "C:\Users\yepyy\anaconda3\envs\vllm\lib\site-packages\vllm\sequence.py", line 16, in <module>
    from vllm.inputs import SingletonInputs, SingletonInputsAdapter
  File "C:\Users\yepyy\anaconda3\envs\vllm\lib\site-packages\vllm\inputs\__init__.py", line 7, in <module>
    from .registry import (DummyData, InputContext, InputProcessingContext,
  File "C:\Users\yepyy\anaconda3\envs\vllm\lib\site-packages\vllm\inputs\registry.py", line 13, in <module>
    from vllm.transformers_utils.tokenizer import AnyTokenizer
  File "C:\Users\yepyy\anaconda3\envs\vllm\lib\site-packages\vllm\transformers_utils\tokenizer.py", line 16, in <module>
    from vllm.utils import make_async
  File "C:\Users\yepyy\anaconda3\envs\vllm\lib\site-packages\vllm\utils.py", line 15, in <module>
    import resource
ModuleNotFoundError: No module named 'resource'

How you are installing vllm

pip install vllm

vllm serve "bytedance-research/UI-TARS-7B-DPO"

Before submitting a new issue...

  • Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.
@Omni-NexusAI Omni-NexusAI added the installation Installation problems label Jan 25, 2025
@DarkLight1337
Copy link
Member

DarkLight1337 commented Jan 25, 2025

It looks like you are running this on Windows. vLLM only officially supports Linux OS so I suggest using WSL.

@xvweirong
Copy link

I have same issue on Windows 11:

conda create -n vllmenv python=3.12 -y
conda activate vllmenv
pip install vllm
setx VLLM_USE_MODELSCOPE True
pip install modelscope
vllm serve Qwen/Qwen2.5-0.5B-Instruct

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
installation Installation problems
Projects
None yet
Development

No branches or pull requests

3 participants