NVMe

Unfortunately, I'm not getting a lot of benefit from use of an NVMe;
it looks like I'm hitting other limits right away (MD5 checksumming
and thumbnail extraction) even with everything cached in memory.

With increasing thread counts, it would be very uesful to be able to
farm out checksumming and thumbnail generation.  Checksum generation
shouldn't be much of a problem; it could be computed by the scout
thread and stored in a hash, and only computed by the loader if it
doesn't exist.  Thumbnail generation is a bit trickier due to the
packed format that we use; we'd probably need to use in-memory buffers
or some such.

Thumbnail generation is usually pretty cheap for RAW files, due to the
(usually present) embedded thumbnail.  But other files don't normally
contain embedded thumbnails.
-- 
Robert Krawitz                                     <rlk-FrUbXkNCsVf2fBVCVOL8/[email protected]>

***  MIT Engineers   A Proud Tradition   http://mitathletics.com  ***
Member of the League for Programming Freedom  --  http://ProgFree.org
Project lead for Gutenprint   --    http://gimp-print.sourceforge.net

"Linux doesn't dictate how I work, I dictate how Linux works."
--Eric Crampton