too many errors in notebooks. nothing works. Perhaps just make an app.

[GaleiqTesting]

Unforutunately too many errors in the notebook examples.
Got up to this in the computer notebook::

async with Computer(
# name="my_vm", # optional, in case you want to use any other VM created using lume
display="1024x768",
memory="8GB",
cpu="4",
os="macos"
) as computer:
await computer.run()
# ... do something with the computer interface

thereafter, it just keeps loading

couldn't get cursor, keyboard etc to work thereafter.

[f-trycua]

Hi @GaleiqTesting, thanks for reporting this. Sorry you're running into issues. Could you share the error message? Feel free to ping me on Discord (https://discord.com/invite/mVnXXpdE85) so we can work through it together.

[f-trycua]

From the discord:

INFO:agent.providers.omni.parser:Initializing shared OmniDetectParser...
INFO:agent.providers.omni.parser:Using device: mps for OmniDetectParser
INFO:som.detection:Using device: mps
INFO:som.ocr:OCR processor initialized with device: mps
INFO:agent.providers.omni.parser:Preloading detection model...
INFO:som.detection:Model not found locally, downloading from Microsoft OmniParser-v2.0...
INFO:som.detection:Model downloaded to cache: /Users/pj/.cache/huggingface/hub/models--microsoft--OmniParser-v2.0/snapshots/09fae83e39987d4c19e676253380033a0603dbc3/icon_detect/model.pt
INFO:som.detection:Model copied to: /Users/pj/.pyenv/versions/3.12.8/lib/python3.12/site-packages/som/weights/icon_detect/model.pt
INFO:som.detection:Loading YOLOv8 model from /Users/pj/.pyenv/versions/3.12.8/lib/python3.12/site-packages/som/weights/icon_detect/model.pt
INFO:som.detection:Model loaded successfully with device: mps
INFO:agent.providers.omni.parser:Detection model preloaded successfully
INFO:agent.core.experiment:Created run directory: trajectories/20250317_181821
INFO:agent.core.experiment:Created turn directory: trajectories/20250317_181821/turn_001
INFO:agent.core.base_agent:Entering BaseComputerAgent context
INFO:agent.core.base_agent:Checking if computer is already initialized...
INFO:agent.core.base_agent:Initializing computer in __aenter__...
INFO:cua:Starting computer...
INFO:cua:Starting VM: macos-sequoia-cua:latest
INFO:cua:Starting VM macos-sequoia-cua_latest...
INFO:cua:VM run options: {'no_display': False, 'shared_directories': []}

Equivalent curl command:
curl -X POST 'http://localhost:3000/lume/vms/macos-sequoia-cua_latest/run' -H 'Content-Type: application/json' -d '{"noDisplay": false, "sharedDirectories": []}'


Equivalent curl command:
curl -X POST \
  'http://localhost:3000/lume/vms/macos-sequoia-cua_latest/run' \
  -H 'Content-Type: application/json' \
  -d '{"noDisplay": false, "sharedDirectories": []}'

INFO:cua:VM run response: None
INFO:cua:Waiting for VM to be ready...
INFO:cua:Waiting for VM macos-sequoia-cua_latest to be ready (timeout: 600s)...
INFO:cua:VM status changed to: stopped (after 0.0s)
INFO:cua:Still waiting for VM IP address... (elapsed: 63.8s)
INFO:cua:Still waiting for VM IP address... (elapsed: 135.3s)
INFO:cua:VM properties at attempt 30: {'name': 'macos-sequoia-cua_latest', 'status': 'stopped', 'os': 'macOS', 'cpu_count': 4, 'memory_size': 8589934592, 'disk_size': DiskInfo(total=85899345920, allocated=26313658368), 'vnc_url': None, 'ip_address': None}
INFO:cua:Still waiting for VM IP address... (elapsed: 206.7s)
INFO:cua:Still waiting for VM IP address... (elapsed: 278.4s)
INFO:cua:Still waiting for VM IP address... (elapsed: 349.9s)
INFO:cua:VM properties at attempt 60: {'name': 'macos-sequoia-cua_latest', 'status': 'stopped', 'os': 'macOS', 'cpu_count': 4, 'memory_size': 8589934592, 'disk_size': DiskInfo(total=85899345920, allocated=27496488960), 'vnc_url': None, 'ip_address': None}
INFO:cua:Still waiting for VM IP address... (elapsed: 421.5s)
INFO:cua:Still waiting for VM IP address... (elapsed: 492.9s)
INFO:cua:Still waiting for VM IP address... (elapsed: 563.8s)
ERROR:cua:VM macos-sequoia-cua_latest not ready after 606.3 seconds
ERROR:cua:Final VM status: stopped, IP: None
ERROR:cua:Error waiting for VM: VM macos-sequoia-cua_latest not ready after 606.3 seconds - IP address not assigned
ERROR:cua:Failed to initialize computer: VM failed to become ready: VM macos-sequoia-cua_latest not ready after 606.3 seconds - IP address not assigned
ERROR:agent.core.base_agent:Error initializing computer in __aenter__: Failed to initialize computer: VM failed to become ready: VM macos-sequoia-cua_latest not ready after 606.3 seconds - IP address not assigned
Traceback (most recent call last):
  File "/Users/pj/.pyenv/versions/3.12.8/lib/python3.12/site-packages/computer/computer.py", line 246, in run
    vm = await self.wait_vm_ready()
         ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/pj/.pyenv/versions/3.12.8/lib/python3.12/site-packages/computer/computer.py", line 440, in wait_vm_ready
    raise TimeoutError(
TimeoutError: VM macos-sequoia-cua_latest not ready after 606.3 seconds - IP address not assigned

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/Users/pj/.pyenv/versions/3.12.8/lib/python3.12/site-packages/computer/computer.py", line 253, in run
    raise RuntimeError(f"VM failed to become ready: {wait_error}")
RuntimeError: VM failed to become ready: VM macos-sequoia-cua_latest not ready after 606.3 seconds - IP address not assigned

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/Users/pj/cuatestnig/control.py", line 39, in <module>
    asyncio.run(main())
  File "/Users/pj/.pyenv/versions/3.12.8/lib/python3.12/asyncio/runners.py", line 194, in run
    return runner.run(main)
           ^^^^^^^^^^^^^^^^
  File "/Users/pj/.pyenv/versions/3.12.8/lib/python3.12/asyncio/runners.py", line 118, in run
    return self._loop.run_until_complete(task)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/pj/.pyenv/versions/3.12.8/lib/python3.12/asyncio/base_events.py", line 686, in run_until_complete
    return future.result()
           ^^^^^^^^^^^^^^^
  File "/Users/pj/cuatestnig/control.py", line 34, in main
    async with agent:
               ^^^^^
  File "/Users/pj/.pyenv/versions/3.12.8/lib/python3.12/site-packages/agent/core/base_agent.py", line 108, in __aenter__
    await self.computer.__aenter__()
  File "/Users/pj/.pyenv/versions/3.12.8/lib/python3.12/site-packages/computer/computer.py", line 143, in __aenter__
    await self.run()
  File "/Users/pj/.pyenv/versions/3.12.8/lib/python3.12/site-packages/computer/computer.py", line 256, in run
    raise RuntimeError(f"Failed to initialize computer: {e}")
RuntimeError: Failed to initialize computer: VM failed to become ready: VM macos-sequoia-cua_latest not ready after 606.3 seconds - IP address not assigned