You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
torch.cuda.OutOfMemoryError: CUDA out of memory. Tried to allocate 137.36 GiB. GPU 0 has a total capacity of 47.54 GiB of which 44.17 GiB is free. Process 1932274 has 3.36 GiB memory in use. Of the allocated memory 1.89 GiB is allocated by PyTorch, and 23.82 MiB is reserved by PyTorch but unallocated. If reserved but unallocated memory is large try setting PYTORCH_CUDA_ALLOC_CONF=expandable_segments:True to avoid fragmentation. See documentation for Memory Management (https://pytorch.org/docs/stable/notes/cuda.html#environment-variables)
Why it is expecting 137 GB to infer just 60 sec file? Is this model only for real time purpose?
The text was updated successfully, but these errors were encountered:
torch.cuda.OutOfMemoryError: CUDA out of memory. Tried to allocate 137.36 GiB. GPU 0 has a total capacity of 47.54 GiB of which 44.17 GiB is free. Process 1932274 has 3.36 GiB memory in use. Of the allocated memory 1.89 GiB is allocated by PyTorch, and 23.82 MiB is reserved by PyTorch but unallocated. If reserved but unallocated memory is large try setting PYTORCH_CUDA_ALLOC_CONF=expandable_segments:True to avoid fragmentation. See documentation for Memory Management (https://pytorch.org/docs/stable/notes/cuda.html#environment-variables)
Why it is expecting 137 GB to infer just 60 sec file? Is this model only for real time purpose?
The text was updated successfully, but these errors were encountered: