Re: Is it possible to train generative AI on CPU only?

Carl Fink <[email protected]>
Newsgroups comp.ai
Organization PANIX Public Access Internet and UNIX, NYC
Message-ID <[email protected]>
On 2024-12-02, Tristan Miller <[email protected]> wrote:

> I'm afraid I was reporting only half-remembered results from the last 
> time I looked into the question, which would have been months ago.  I 
> did a quick web search just now and came up with a couple queries from 
> the Kohya's GUI GitHub project that roughly accord with my recollection:
>
> https://github.com/bmaltais/kohya_ss/discussions/679
> https://github.com/bmaltais/kohya_ss/issues/2632
>
> The first of these claims CPU training time of about 40×, and the second 
> claims 4× for both time and memory.  They both refer to Stable Diffusion.
>
> There's also this LoRA finetuning guide for LLaMA that provides detailed 
> CPU time and memory metrics for various models: https://rentry.org/cpu-lora

Thank you!
-- 
Carl Fink                                                  [email protected] 
https://reasonablyliterate.com                           https://nitpicking.com 
If you want to make a point, somebody will take the point and stab you with it. 
	-Kenne Estes
lmpx.com only provides a reader for public news (NNTP) servers. It is not affiliated with the servers or forums shown here and is not responsible for the content of articles, which is written by their respective authors.