[Bug 286668] x11/nvidia-driver : PyTorch and Stable Diffusion and / or ComfyUI don't work with an nvidia driver greater than 535

[email protected]
Newsgroups gmane.os.freebsd.devel.x11
Message-ID <[email protected]/bugzilla/> 
https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=286668

            Bug ID: 286668
           Summary: x11/nvidia-driver : PyTorch and Stable Diffusion and /
                    or ComfyUI don't work with an nvidia driver greater
                    than 535
           Product: Ports & Packages
           Version: Latest
          Hardware: amd64
                OS: Any
            Status: New
          Severity: Affects Many People
          Priority: ---
         Component: Individual Port(s)
          Assignee: [email protected]
          Reporter: [email protected]
          Assignee: [email protected]
             Flags: maintainer-feedback?([email protected])

Hello.

I’m trying to run PyTorch and Stable Diffusion and / or ComfyUI on FreeBSD. The
whole procedure is below. Unfortunately it does not work with a nvidia driver
greater than 525 or 535 ?

marietto @ marietto:~ $ git clone h t t p s : / / g i t h u b . c o m /
outpaddling /freebsd-ports-wip . git

marietto@marietto:~ $ cd /usr/ports/wip
marietto@marietto:~ $ pkg install auto-admin
marietto@marietto:~ $ auto-ports-wip-checkout
marietto@marietto:/usr/ports/wip $ cd linux-miniconda-installer
marietto@marietto:/usr/ports/wip/linux-miniconda-installer $ ls

Makefile    distinfo    pkg-descr    work

marietto@marietto:/usr/ports/wip/linux-miniconda-installer $ make clean

===>  Cleaning for linux-miniconda-installer-0.1.0.3
===>   /usr/ports/wip/linux-miniconda-installer/work not writable, skipping

marietto @ marietto:/usr/ports/wip/linux-miniconda-installer $ su
Password:

root @ marietto:/usr/ports/wip/linux-miniconda-installer # make clean

===>  Cleaning for linux-miniconda-installer-0.1.0.3

root @ marietto:/usr/ports/wip/linux-miniconda-installer # make

===>  License BSD2CLAUSE accepted by the user
===>   linux-miniconda-installer-0.1.0.3 depends on file: /usr/local/sbin/pkg -
found
===> Fetching all distfiles required by linux-miniconda-installer-0.1.0.3 for
building
===>  Extracting for linux-miniconda-installer-0.1.0.3
=> SHA256 Checksum OK for
outpaddling-miniconda-installer-0.1.0-3-g0aa48c6_GH0.tar.gz.
===>  Patching for linux-miniconda-installer-0.1.0.3
===>   linux-miniconda-installer-0.1.0.3 depends on file:
/usr/local/bin/python3.11 - found
===>  Configuring for linux-miniconda-installer-0.1.0.3
===>  Staging for linux-miniconda-installer-0.1.0.3
===>   linux-miniconda-installer-0.1.0.3 depends on package: auto-admin>=0.8.0
- found
===>   linux-miniconda-installer-0.1.0.3 depends on package:
linux_base-rl9>=9.2 - found
===>   linux-miniconda-installer-0.1.0.3 depends on file:
/usr/local/bin/python3.11 - found
===>   Generating temporary packing list
install  -m 555
/usr/ports/wip/linux-miniconda-installer/work/miniconda-installer-0.1.0-3-g0aa48c6/miniconda-installer
/usr/ports/wip/linux-miniconda-installer/work/miniconda-installer-0.1.0-3-g0aa48c6/conda-shell
 /usr/ports/wip/linux-miniconda-installer/work/stage/usr/local/bin
====> Compressing man pages (compress-man)

root @ marietto:/usr/ports/wip/linux-miniconda-installer # make install

===>  Installing for linux-miniconda-installer-0.1.0.3
===>  Checking if linux-miniconda-installer is already installed
===>   Registering installation for linux-miniconda-installer-0.1.0.3

Installing linux-miniconda-installer-0.1.0.3...

marietto @ marietto:/$ nvidia-smi

Thu May  8 00:51:53 2025
+-----------------------------------------------------------------------------------------+
| NVIDIA-SMI 565.77                 Driver Version: 565.77         CUDA
Version: 12.7     |
|-----------------------------------------+------------------------+----------------------+
| GPU  Name                 Persistence-M | Bus-Id          Disp.A | Volatile
Uncorr. ECC |
| Fan  Temp   Perf          Pwr:Usage/Cap |           Memory-Usage | GPU-Util 
Compute M. |
|                                         |                        |           
   MIG M. |
|=========================================+========================+======================|
|   0  NVIDIA GeForce GTX 1060 3GB    Off |   00000000:01:00.0  On |           
      N/A |
| 53%   32C    P8              7W /  120W |     339MiB /   3072MiB |      8%   
  Default |
|                                         |                        |           
      N/A |
+-----------------------------------------+------------------------+----------------------+
|   1  NVIDIA GeForce RTX 2080 Ti     Off |   00000000:02:00.0 Off |           
      N/A |
| 31%   35C    P8             21W /  250W |       2MiB /  11264MiB |      0%   
  Default |
|                                         |                        |           
      N/A |
+-----------------------------------------+------------------------+----------------------+

+-----------------------------------------------------------------------------------------+
| Processes:                                                                   
          |
|  GPU   GI   CI        PID   Type   Process name                             
GPU Memory |
|        ID   ID                                                              
Usage      |
|=========================================================================================|
|    0   N/A  N/A      4116      G   /usr/local/libexec/Xorg                   
   190MiB |
|    0   N/A  N/A      4154      G   xfwm4                                     
     2MiB |
|    0   N/A  N/A      4234      G   /usr/local/lib/firefox/firefox            
   142MiB |
+-----------------------------------------------------------------------------------------+

# pkg install linux-rl9-devtools linux-rl9-libglvnd
# cd /home/marietto
# conda-shell
# source conda.sh
# conda activate
# conda create --name pytorch python=3.12
# conda activate pytorch

# pip install --pre torch torchvision torchaudio --index-url
https://download.pytorch.org/whl/nightly/cu128

# LD_PRELOAD="/home/marietto/.config/gpu/dummy-uvm.so" python3 -c 'import
torch; print(torch.cuda.is_available())'

/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages/torch/cuda/__init__.py:181:
UserWarning: CUDA initialization: Unexpected error from cudaGetDeviceCount().

Did you run some cuda functions before calling NumCudaDevices() that might have
already set an error?

Error 304: OS call failed or operation not supported on this OS (Triggered
internally at /pytorch/c10/cuda/CUDAFunctions.cpp:109.)  return
torch._C._cuda_getDeviceCount() > 0
False


$ pip install torch torchvision torchaudio --extra-index-url
https://download.pytorch.org/whl/cu127

Looking in indexes: https://pypi.org/simple,
https://download.pytorch.org/whl/cu127

Requirement already satisfied: torch in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages
(2.8.0.dev20250507+cu128)
Requirement already satisfied: torchvision in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages
(0.22.0.dev20250507+cu128)
Requirement already satisfied: torchaudio in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages
(2.6.0.dev20250507+cu128)
Requirement already satisfied: filelock in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (3.16.1)
Requirement already satisfied: typing-extensions>=4.10.0 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (4.12.2)
Requirement already satisfied: setuptools in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (78.1.1)
Requirement already satisfied: sympy>=1.13.3 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (1.13.3)
Requirement already satisfied: networkx in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (3.4.2)
Requirement already satisfied: jinja2 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (3.1.4)
Requirement already satisfied: fsspec in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (2024.10.0)
Requirement already satisfied: nvidia-cuda-nvrtc-cu12==12.8.61 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (12.8.61)
Requirement already satisfied: nvidia-cuda-runtime-cu12==12.8.57 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (12.8.57)
Requirement already satisfied: nvidia-cuda-cupti-cu12==12.8.57 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (12.8.57)
Requirement already satisfied: nvidia-cudnn-cu12==9.8.0.87 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (9.8.0.87)
Requirement already satisfied: nvidia-cublas-cu12==12.8.3.14 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (12.8.3.14)
Requirement already satisfied: nvidia-cufft-cu12==11.3.3.41 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (11.3.3.41)
Requirement already satisfied: nvidia-curand-cu12==10.3.9.55 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (10.3.9.55)
Requirement already satisfied: nvidia-cusolver-cu12==11.7.2.55 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (11.7.2.55)
Requirement already satisfied: nvidia-cusparse-cu12==12.5.7.53 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (12.5.7.53)
Requirement already satisfied: nvidia-cusparselt-cu12==0.6.3 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (0.6.3)
Requirement already satisfied: nvidia-nccl-cu12==2.26.2 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (2.26.2)
Requirement already satisfied: nvidia-nvtx-cu12==12.8.55 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (12.8.55)
Requirement already satisfied: nvidia-nvjitlink-cu12==12.8.61 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (12.8.61)
Requirement already satisfied: nvidia-cufile-cu12==1.13.0.11 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (1.13.0.11)
Requirement already satisfied: pytorch-triton==3.3.0+git96316ce5 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (3.3.0+git96316ce5)
Requirement already satisfied: numpy in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torchvision) (2.1.2)
Requirement already satisfied: pillow!=8.3.*,>=5.3.0 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torchvision) (11.0.0)
Requirement already satisfied: mpmath<1.4,>=1.1.0 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
sympy>=1.13.3->torch) (1.3.0)
Requirement already satisfied: MarkupSafe>=2.0 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
jinja2->torch) (2.1.5)

# conda install pytorch torchvision torchaudio pytorch-cuda=12.4 -c pytorch -c
nvidia

# git clone https://github.com/comfyanonymous/ComfyUI.git


(pytorch) I have no name!@marietto:/usr/home/marietto$ cd ComfyUI
(pytorch) I have no name!@marietto:/usr/home/marietto/ComfyUI$ pip install -r
requirements.txt
(pytorch) I have no name!@marietto:/usr/home/marietto/ComfyUI$ python -c
'import torch; print(torch.cuda.is_available())'

/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages/torch/cuda/__init__.py:129:
UserWarning: CUDA initialization: Unexpected error from cudaGetDeviceCount(). 

Did you run some cuda functions before calling NumCudaDevices() that might have
already set an error? 

Error 304: OS call failed or operation not supported on this OS (Triggered
internally at
/opt/conda/conda-bld/pytorch_1729647378361/work/c10/cuda/CUDAFunctions.cpp:108.)
 return torch._C._cuda_getDeviceCount() > 0

False


(pytorch) I have no name!@marietto:/usr/home/marietto/ComfyUI$
LD_PRELOAD="${HOME}/.config/gpu/dummy-uvm.so" python -c 'import torch;
print(torch.cuda.is_available())'

/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages/torch/cuda/__init__.py:129: 

UserWarning: CUDA initialization: Unexpected error from cudaGetDeviceCount().
Did you run some cuda functions before calling NumCudaDevices() that might have
already set an error? 

Error 304: OS call failed or operation not supported on this OS (Triggered
internally at
/opt/conda/conda-bld/pytorch_1729647378361/work/c10/cuda/CUDAFunctions.cpp:108.)
  return torch._C._cuda_getDeviceCount() > 0
False


(pytorch) I have no name!@marietto:/usr/home/marietto$ conda install pytorch
torchvision torchaudio pytorch-cuda=12.7 -c pytorch -c nvidia

Collecting package metadata (current_repodata.json): done
Solving environment: failed with initial frozen solve. Retrying with flexible
solve.
Collecting package metadata (repodata.json): done
Solving environment: failed with initial frozen solve. Retrying with flexible
solve.

PackagesNotFoundError: The following packages are not available from current
channels:

  - pytorch-cuda=12.7

In this thread you suggested to use cu126 :

https://discuss.pytorch.org/t/pytorch-vrsion-for-cuda-12-7/214153/2

so :

(pytorch) I have no name! @ marietto:/usr/home/marietto$ pip3 install --pre
torch torchvision torchaudio --index-url h t t p s : / / d o w n l o a d . p y 
to  r c h . o r g /w h l / nightly/ cu126

Looking in indexes: https://download.pytorch.org/whl/nightly/cu126

Requirement already satisfied: torch in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages
(2.8.0.dev20250507+cu128)
Requirement already satisfied: torchvision in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages
(0.22.0.dev20250507+cu128)
Requirement already satisfied: torchaudio in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages
(2.6.0.dev20250507+cu128)
Requirement already satisfied: filelock in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (3.16.1)
Requirement already satisfied: typing-extensions>=4.10.0 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (4.12.2)
Requirement already satisfied: setuptools in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (78.1.1)
Requirement already satisfied: sympy>=1.13.3 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (1.13.3)
Requirement already satisfied: networkx in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (3.4.2)
Requirement already satisfied: jinja2 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (3.1.4)
Requirement already satisfied: fsspec in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (2024.10.0)
Requirement already satisfied: nvidia-cuda-nvrtc-cu12==12.8.61 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (12.8.61)
Requirement already satisfied: nvidia-cuda-runtime-cu12==12.8.57 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (12.8.57)
Requirement already satisfied: nvidia-cuda-cupti-cu12==12.8.57 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (12.8.57)
Requirement already satisfied: nvidia-cudnn-cu12==9.8.0.87 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (9.8.0.87)
Requirement already satisfied: nvidia-cublas-cu12==12.8.3.14 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (12.8.3.14)
Requirement already satisfied: nvidia-cufft-cu12==11.3.3.41 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (11.3.3.41)
Requirement already satisfied: nvidia-curand-cu12==10.3.9.55 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (10.3.9.55)
Requirement already satisfied: nvidia-cusolver-cu12==11.7.2.55 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (11.7.2.55)
Requirement already satisfied: nvidia-cusparse-cu12==12.5.7.53 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (12.5.7.53)
Requirement already satisfied: nvidia-cusparselt-cu12==0.6.3 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (0.6.3)
Requirement already satisfied: nvidia-nccl-cu12==2.26.2 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (2.26.2)
Requirement already satisfied: nvidia-nvtx-cu12==12.8.55 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (12.8.55)
Requirement already satisfied: nvidia-nvjitlink-cu12==12.8.61 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (12.8.61)
Requirement already satisfied: nvidia-cufile-cu12==1.13.0.11 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (1.13.0.11)
Requirement already satisfied: pytorch-triton==3.3.0+git96316ce5 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (3.3.0+git96316ce5)
Requirement already satisfied: numpy in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torchvision) (2.1.2)
Requirement already satisfied: pillow!=8.3.*,>=5.3.0 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torchvision) (11.0.0)
Requirement already satisfied: mpmath<1.4,>=1.1.0 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
sympy>=1.13.3->torch) (1.3.0)
Requirement already satisfied: MarkupSafe>=2.0 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
jinja2->torch) (2.1.5)

no way…the only way to make work Stable diffusion is to use the nvidia driver
and the linux-nvidia-libs vers. 525.78.01 and “torch==1.12.1+cu113
--extra-index-url https://download.pytorch.org/whl/cu113” and it works like a
charme :

(pytorch) I have no name! @ marietto:/usr/home/marietto$
LD_PRELOAD="/compat/dummy-uvm.so" python3 -c 'import torch;
print(torch.cuda.is_available())'

True

(pytorch) I have no name!@marietto:/usr/home/marietto$
LD_PRELOAD="/compat/dummy-uvm.so" python3 -c 'import torch;
print(torch.cuda.get_device_name(0))'

NVIDIA GeForce RTX 2080 Ti


I've already asked all around to better understand where is the problem,without
a great success right now :


https://www.reddit.com/r/pytorch/comments/1kghunz/which_version_of_pytorch_should_i_use_with_my/

https://discuss.pytorch.org/t/trying-to-run-pytorch-and-stable-diffusion-and-or-comfyui-on-freebsd/219850

https://github.com/verm/freebsd-stable-diffusion/issues/10

https://github.com/comfyanonymous/ComfyUI/issues

https://github.com/amshafer/nvidia-driver/issues/27

https://forums.developer.nvidia.com/t/which-version-of-pytorch-should-i-use-with-my-geforce-rtx-2080-and-the-nvidia-driver-570-to-install-stable-diffusion/332405

-- 
You are receiving this mail because:
You are the assignee for the bug.
lmpx.com only provides a reader for public news (NNTP) servers. It is not affiliated with the servers or forums shown here and is not responsible for the content of articles, which is written by their respective authors.