maintainer-feedback requested: [Bug 286668] x11/nvidia-driver : PyTorch and Stable Diffusion and / or ComfyUI don't work with an nvidia driver greater than 535

[email protected]
Newsgroups gmane.os.freebsd.devel.x11
Message-ID <[email protected]/bugzilla/> 
Bugzilla Automation <[email protected]> has asked freebsd-x11 (Nobody)
<[email protected]> for maintainer-feedback:
Bug 286668: x11/nvidia-driver : PyTorch and Stable Diffusion and / or ComfyUI
don't work with an nvidia driver greater than 535
https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=286668



--- Description ---
Hello.

I’m trying to run PyTorch and Stable Diffusion and / or ComfyUI on FreeBSD. The
whole procedure is below. Unfortunately it does not work with a nvidia driver
greater than 525 or 535 ?

marietto @ marietto:~ $ git clone h t t p s : / / g i t h u b . c o m /
outpaddling /freebsd-ports-wip . git

marietto@marietto:~ $ cd /usr/ports/wip
marietto@marietto:~ $ pkg install auto-admin
marietto@marietto:~ $ auto-ports-wip-checkout
marietto@marietto:/usr/ports/wip $ cd linux-miniconda-installer
marietto@marietto:/usr/ports/wip/linux-miniconda-installer $ ls

Makefile    distinfo	pkg-descr    work

marietto@marietto:/usr/ports/wip/linux-miniconda-installer $ make clean

===>  Cleaning for linux-miniconda-installer-0.1.0.3
===>   /usr/ports/wip/linux-miniconda-installer/work not writable, skipping

marietto @ marietto:/usr/ports/wip/linux-miniconda-installer $ su
Password:

root @ marietto:/usr/ports/wip/linux-miniconda-installer # make clean

===>  Cleaning for linux-miniconda-installer-0.1.0.3

root @ marietto:/usr/ports/wip/linux-miniconda-installer # make

===>  License BSD2CLAUSE accepted by the user
===>   linux-miniconda-installer-0.1.0.3 depends on file: /usr/local/sbin/pkg -
found
===> Fetching all distfiles required by linux-miniconda-installer-0.1.0.3 for
building
===>  Extracting for linux-miniconda-installer-0.1.0.3
=> SHA256 Checksum OK for
outpaddling-miniconda-installer-0.1.0-3-g0aa48c6_GH0.tar.gz.
===>  Patching for linux-miniconda-installer-0.1.0.3
===>   linux-miniconda-installer-0.1.0.3 depends on file:
/usr/local/bin/python3.11 - found
===>  Configuring for linux-miniconda-installer-0.1.0.3
===>  Staging for linux-miniconda-installer-0.1.0.3
===>   linux-miniconda-installer-0.1.0.3 depends on package: auto-admin>=0.8.0
- found
===>   linux-miniconda-installer-0.1.0.3 depends on package:
linux_base-rl9>=9.2 - found
===>   linux-miniconda-installer-0.1.0.3 depends on file:
/usr/local/bin/python3.11 - found
===>   Generating temporary packing list
install  -m 555
/usr/ports/wip/linux-miniconda-installer/work/miniconda-installer-0.1.0-3-g0aa4
8c6/miniconda-installer
/usr/ports/wip/linux-miniconda-installer/work/miniconda-installer-0.1.0-3-g0aa4
8c6/conda-shell
 /usr/ports/wip/linux-miniconda-installer/work/stage/usr/local/bin
====> Compressing man pages (compress-man)

root @ marietto:/usr/ports/wip/linux-miniconda-installer # make install

===>  Installing for linux-miniconda-installer-0.1.0.3
===>  Checking if linux-miniconda-installer is already installed
===>   Registering installation for linux-miniconda-installer-0.1.0.3

Installing linux-miniconda-installer-0.1.0.3...

marietto @ marietto:/$ nvidia-smi

Thu May  8 00:51:53 2025
+------------------------------------------------------------------------------
-----------+
| NVIDIA-SMI 565.77		    Driver Version: 565.77	   CUDA
Version: 12.7	  |
|-----------------------------------------+------------------------+-----------
-----------+
| GPU  Name		    Persistence-M | Bus-Id	    Disp.A | Volatile
Uncorr. ECC |
| Fan  Temp   Perf	    Pwr:Usage/Cap |	      Memory-Usage | GPU-Util 
Compute M. |
|					  |			   |	       
   MIG M. |
|=========================================+========================+===========
===========|
|   0  NVIDIA GeForce GTX 1060 3GB    Off |   00000000:01:00.0	On |	       
      N/A |
| 53%	32C    P8	       7W /  120W |	339MiB /   3072MiB |	  8%   
  Default |
|					  |			   |	       
      N/A |
+-----------------------------------------+------------------------+-----------
-----------+
|   1  NVIDIA GeForce RTX 2080 Ti     Off |   00000000:02:00.0 Off |	       
      N/A |
| 31%	35C    P8	      21W /  250W |	  2MiB /  11264MiB |	  0%   
  Default |
|					  |			   |	       
      N/A |
+-----------------------------------------+------------------------+-----------
-----------+

+------------------------------------------------------------------------------
-----------+
| Processes:								       
	  |
|  GPU	 GI   CI	PID   Type   Process name			      
GPU Memory |
|	 ID   ID							      
Usage	   |
|==============================================================================
===========|
|    0	 N/A  N/A      4116	 G   /usr/local/libexec/Xorg		       
   190MiB |
|    0	 N/A  N/A      4154	 G   xfwm4				       
     2MiB |
|    0	 N/A  N/A      4234	 G   /usr/local/lib/firefox/firefox	       
   142MiB |
+------------------------------------------------------------------------------
-----------+

# pkg install linux-rl9-devtools linux-rl9-libglvnd
# cd /home/marietto
# conda-shell
# source conda.sh
# conda activate
# conda create --name pytorch python=3.12
# conda activate pytorch

# pip install --pre torch torchvision torchaudio --index-url
https://download.pytorch.org/whl/nightly/cu128

# LD_PRELOAD="/home/marietto/.config/gpu/dummy-uvm.so" python3 -c 'import
torch; print(torch.cuda.is_available())'

/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages/torch/cuda/
__init__.py:181:
UserWarning: CUDA initialization: Unexpected error from cudaGetDeviceCount().

Did you run some cuda functions before calling NumCudaDevices() that might have
already set an error?

Error 304: OS call failed or operation not supported on this OS (Triggered
internally at /pytorch/c10/cuda/CUDAFunctions.cpp:109.)  return
torch._C._cuda_getDeviceCount() > 0
False


$ pip install torch torchvision torchaudio --extra-index-url
https://download.pytorch.org/whl/cu127

Looking in indexes: https://pypi.org/simple,
https://download.pytorch.org/whl/cu127

Requirement already satisfied: torch in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages
(2.8.0.dev20250507+cu128)
Requirement already satisfied: torchvision in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages
(0.22.0.dev20250507+cu128)
Requirement already satisfied: torchaudio in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages
(2.6.0.dev20250507+cu128)
Requirement already satisfied: filelock in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (3.16.1)
Requirement already satisfied: typing-extensions>=4.10.0 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (4.12.2)
Requirement already satisfied: setuptools in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (78.1.1)
Requirement already satisfied: sympy>=1.13.3 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (1.13.3)
Requirement already satisfied: networkx in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (3.4.2)
Requirement already satisfied: jinja2 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (3.1.4)
Requirement already satisfied: fsspec in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (2024.10.0)
Requirement already satisfied: nvidia-cuda-nvrtc-cu12==12.8.61 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (12.8.61)
Requirement already satisfied: nvidia-cuda-runtime-cu12==12.8.57 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (12.8.57)
Requirement already satisfied: nvidia-cuda-cupti-cu12==12.8.57 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (12.8.57)
Requirement already satisfied: nvidia-cudnn-cu12==9.8.0.87 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (9.8.0.87)
Requirement already satisfied: nvidia-cublas-cu12==12.8.3.14 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (12.8.3.14)
Requirement already satisfied: nvidia-cufft-cu12==11.3.3.41 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (11.3.3.41)
Requirement already satisfied: nvidia-curand-cu12==10.3.9.55 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (10.3.9.55)
Requirement already satisfied: nvidia-cusolver-cu12==11.7.2.55 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (11.7.2.55)
Requirement already satisfied: nvidia-cusparse-cu12==12.5.7.53 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (12.5.7.53)
Requirement already satisfied: nvidia-cusparselt-cu12==0.6.3 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (0.6.3)
Requirement already satisfied: nvidia-nccl-cu12==2.26.2 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (2.26.2)
Requirement already satisfied: nvidia-nvtx-cu12==12.8.55 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (12.8.55)
Requirement already satisfied: nvidia-nvjitlink-cu12==12.8.61 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (12.8.61)
Requirement already satisfied: nvidia-cufile-cu12==1.13.0.11 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (1.13.0.11)
Requirement already satisfied: pytorch-triton==3.3.0+git96316ce5 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (3.3.0+git96316ce5)
Requirement already satisfied: numpy in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torchvision) (2.1.2)
Requirement already satisfied: pillow!=8.3.*,>=5.3.0 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torchvision) (11.0.0)
Requirement already satisfied: mpmath<1.4,>=1.1.0 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
sympy>=1.13.3->torch) (1.3.0)
Requirement already satisfied: MarkupSafe>=2.0 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
jinja2->torch) (2.1.5)

# conda install pytorch torchvision torchaudio pytorch-cuda=12.4 -c pytorch -c
nvidia

# git clone https://github.com/comfyanonymous/ComfyUI.git


(pytorch) I have no name!@marietto:/usr/home/marietto$ cd ComfyUI
(pytorch) I have no name!@marietto:/usr/home/marietto/ComfyUI$ pip install -r
requirements.txt
(pytorch) I have no name!@marietto:/usr/home/marietto/ComfyUI$ python -c
'import torch; print(torch.cuda.is_available())'

/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages/torch/cuda/
__init__.py:129:
UserWarning: CUDA initialization: Unexpected error from cudaGetDeviceCount(). 

Did you run some cuda functions before calling NumCudaDevices() that might have
already set an error? 

Error 304: OS call failed or operation not supported on this OS (Triggered
internally at
/opt/conda/conda-bld/pytorch_1729647378361/work/c10/cuda/CUDAFunctions.cpp:108.
)
 return torch._C._cuda_getDeviceCount() > 0

False


(pytorch) I have no name!@marietto:/usr/home/marietto/ComfyUI$
LD_PRELOAD="${HOME}/.config/gpu/dummy-uvm.so" python -c 'import torch;
print(torch.cuda.is_available())'

/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages/torch/cuda/
__init__.py:129: 

UserWarning: CUDA initialization: Unexpected error from cudaGetDeviceCount().
Did you run some cuda functions before calling NumCudaDevices() that might have
already set an error? 

Error 304: OS call failed or operation not supported on this OS (Triggered
internally at
/opt/conda/conda-bld/pytorch_1729647378361/work/c10/cuda/CUDAFunctions.cpp:108.
)
  return torch._C._cuda_getDeviceCount() > 0
False


(pytorch) I have no name!@marietto:/usr/home/marietto$ conda install pytorch
torchvision torchaudio pytorch-cuda=12.7 -c pytorch -c nvidia

Collecting package metadata (current_repodata.json): done
Solving environment: failed with initial frozen solve. Retrying with flexible
solve.
Collecting package metadata (repodata.json): done
Solving environment: failed with initial frozen solve. Retrying with flexible
solve.

PackagesNotFoundError: The following packages are not available from current
channels:

  - pytorch-cuda=12.7

In this thread you suggested to use cu126 :

https://discuss.pytorch.org/t/pytorch-vrsion-for-cuda-12-7/214153/2

so :

(pytorch) I have no name! @ marietto:/usr/home/marietto$ pip3 install --pre
torch torchvision torchaudio --index-url h t t p s : / / d o w n l o a d . p y 
to  r c h . o r g /w h l / nightly/ cu126

Looking in indexes: https://download.pytorch.org/whl/nightly/cu126

Requirement already satisfied: torch in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages
(2.8.0.dev20250507+cu128)
Requirement already satisfied: torchvision in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages
(0.22.0.dev20250507+cu128)
Requirement already satisfied: torchaudio in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages
(2.6.0.dev20250507+cu128)
Requirement already satisfied: filelock in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (3.16.1)
Requirement already satisfied: typing-extensions>=4.10.0 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (4.12.2)
Requirement already satisfied: setuptools in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (78.1.1)
Requirement already satisfied: sympy>=1.13.3 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (1.13.3)
Requirement already satisfied: networkx in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (3.4.2)
Requirement already satisfied: jinja2 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (3.1.4)
Requirement already satisfied: fsspec in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (2024.10.0)
Requirement already satisfied: nvidia-cuda-nvrtc-cu12==12.8.61 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (12.8.61)
Requirement already satisfied: nvidia-cuda-runtime-cu12==12.8.57 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (12.8.57)
Requirement already satisfied: nvidia-cuda-cupti-cu12==12.8.57 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (12.8.57)
Requirement already satisfied: nvidia-cudnn-cu12==9.8.0.87 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (9.8.0.87)
Requirement already satisfied: nvidia-cublas-cu12==12.8.3.14 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (12.8.3.14)
Requirement already satisfied: nvidia-cufft-cu12==11.3.3.41 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (11.3.3.41)
Requirement already satisfied: nvidia-curand-cu12==10.3.9.55 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (10.3.9.55)
Requirement already satisfied: nvidia-cusolver-cu12==11.7.2.55 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (11.7.2.55)
Requirement already satisfied: nvidia-cusparse-cu12==12.5.7.53 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (12.5.7.53)
Requirement already satisfied: nvidia-cusparselt-cu12==0.6.3 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (0.6.3)
Requirement already satisfied: nvidia-nccl-cu12==2.26.2 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (2.26.2)
Requirement already satisfied: nvidia-nvtx-cu12==12.8.55 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (12.8.55)
Requirement already satisfied: nvidia-nvjitlink-cu12==12.8.61 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (12.8.61)
Requirement already satisfied: nvidia-cufile-cu12==1.13.0.11 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (1.13.0.11)
Requirement already satisfied: pytorch-triton==3.3.0+git96316ce5 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torch) (3.3.0+git96316ce5)
Requirement already satisfied: numpy in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torchvision) (2.1.2)
Requirement already satisfied: pillow!=8.3.*,>=5.3.0 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
torchvision) (11.0.0)
Requirement already satisfied: mpmath<1.4,>=1.1.0 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
sympy>=1.13.3->torch) (1.3.0)
Requirement already satisfied: MarkupSafe>=2.0 in
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from
jinja2->torch) (2.1.5)

no way…the only way to make work Stable diffusion is to use the nvidia driver
and the linux-nvidia-libs vers. 525.78.01 and “torch==1.12.1+cu113
--extra-index-url https://download.pytorch.org/whl/cu113” and it works like a
charme :

(pytorch) I have no name! @ marietto:/usr/home/marietto$
LD_PRELOAD="/compat/dummy-uvm.so" python3 -c 'import torch;
print(torch.cuda.is_available())'

True

(pytorch) I have no name!@marietto:/usr/home/marietto$
LD_PRELOAD="/compat/dummy-uvm.so" python3 -c 'import torch;
print(torch.cuda.get_device_name(0))'

NVIDIA GeForce RTX 2080 Ti


I've already asked all around to better understand where is the problem,without
a great success right now :


https://www.reddit.com/r/pytorch/comments/1kghunz/which_version_of_pytorch_shou
ld_i_use_with_my/

https://discuss.pytorch.org/t/trying-to-run-pytorch-and-stable-diffusion-and-or
-comfyui-on-freebsd/219850

https://github.com/verm/freebsd-stable-diffusion/issues/10

https://github.com/comfyanonymous/ComfyUI/issues

https://github.com/amshafer/nvidia-driver/issues/27

https://forums.developer.nvidia.com/t/which-version-of-pytorch-should-i-use-wit
h-my-geforce-rtx-2080-and-the-nvidia-driver-570-to-install-stable-diffusion/332
405
lmpx.com only provides a reader for public news (NNTP) servers. It is not affiliated with the servers or forums shown here and is not responsible for the content of articles, which is written by their respective authors.