Re: "scan for new items" always scans the entire collection
Gilles Caulier <[email protected]> Thu, 9 Jul 2026 13:21:47 +0200
| Newsgroups | gmane.comp.kde.digikam.user |
|---|---|
| Message-ID | <CAHFG6sG7=3KwwkPEOPuEqbiFdkykuDGjxav1eSmXGkeQcAvYcQ@mail.gmail.com> |
--000000000000faeacf06562bd52f Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Hi, Look at the comments in is report : https://bugs.kde.org/show_bug.cgi?id=3D522695 I'm not sure if it's close to the problems listed here. Best regards Gilles Caulier Le jeu. 9 juil. 2026 =C3=A0 12:41, Thomas <[email protected]> a =C3=A9crit : > > On 2026-07-09 07.33, VAL=C3=8DK Robert wrote: > > Hey there! > > > > After upgrading Digikam to version 9.1, I have also noticed this weird > > behavior. > > > > > Oh, I thought it was only me. I experience this too. Hopefully, this can > be fixed. > > A complete scan on my collection takes several days. So this has > effectively been preventing me from using DK for some time. > > In fact I think a lot could be done to improve the whole experience > regarding scanning collection. For one, the progress reporting could be > MUCH better. Currently, it has an almost useless progress bar. It gives > a percentage but nothing in terms of how many pictures/folders it has > scanned and how many remaining. (I am aware that exact number of > remaining objects might be impossible to give, but then estimate it like > other tools does, e.g. rsync will just update the number of remaining > items as it learns about them...). There is also no estimate of how long > it will take or the processing rate (how many items per minute, etc.) > All these infos would be useful. Especially if trying to make it faster > and see what works. > > I also think the scanning could be sped up quite a bit by using multiple > threads. I have my collection on a NAS. I believe a lot of the time > spent on scanning/indexing is really spent on network latency: waiting > for the samba server to list files, open file handle, etc. > > When I look at resources on the DK client machine, it is mostly idle on > both CPU, network and disk I/O. Same with the NAS server, it is mostly > idle on those resources as well. So I think a lot of time is pent > waiting for network packages. If I could allow 2, 4, 8, .., parallel > threads, I think we could see this wait time reduced significantly and > CPU/net/disk utilization increased. > > > BR > > Thomas > > --000000000000faeacf06562bd52f Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable <div dir=3D"ltr"><div>Hi,</div><div><br></div><div>Look at the comments in = is report :</div><div><br></div><div><a href=3D"https://bugs.kde.org/show_b= ug.cgi?id=3D522695">https://bugs.kde.org/show_bug.cgi?id=3D522695</a></div>= <div><br></div><div>I'm not sure if it's close to the problems list= ed here.</div><div><br></div><div>Best regards</div><div><br></div><div>Gil= les Caulier</div><div><br></div><div><br></div></div><br><div class=3D"gmai= l_quote gmail_quote_container"><div dir=3D"ltr" class=3D"gmail_attr">Le=C2= =A0jeu. 9 juil. 2026 =C3=A0=C2=A012:41, Thomas <<a href=3D"mailto:sdktda= @gmail.com">[email protected]</a>> a =C3=A9crit=C2=A0:<br></div><blockquo= te class=3D"gmail_quote" style=3D"margin:0px 0px 0px 0.8ex;border-left:1px = solid rgb(204,204,204);padding-left:1ex"><br> On 2026-07-09 07.33, VAL=C3=8DK Robert wrote:<br> > Hey there!<br> ><br> > After upgrading Digikam to version 9.1, I have also noticed this weird= <br> > behavior.<br> ><br> <br> <br> Oh, I thought it was only me. I experience this too. Hopefully, this can <b= r> be fixed.<br> <br> A complete scan on my collection takes several days. So this has <br> effectively been preventing me from using DK for some time.<br> <br> In fact I think a lot could be done to improve the whole experience <br> regarding scanning collection. For one, the progress reporting could be <br= > MUCH better. Currently, it has an almost useless progress bar. It gives <br= > a percentage but nothing in terms of how many pictures/folders it has <br> scanned and how many remaining. (I am aware that exact number of <br> remaining objects might be impossible to give, but then estimate it like <b= r> other tools does, e.g. rsync will just update the number of remaining <br> items as it learns about them...). There is also no estimate of how long <b= r> it will take or the processing rate (how many items per minute, etc.) <br> All these infos would be useful. Especially if trying to make it faster <br= > and see what works.<br> <br> I also think the scanning could be sped up quite a bit by using multiple <b= r> threads. I have my collection on a NAS. I believe a lot of the time <br> spent on scanning/indexing is really spent on network latency: waiting <br> for the samba server to list files, open file handle, etc.<br> <br> When I look at resources on the DK client machine, it is mostly idle on <br= > both CPU, network and disk I/O. Same with the NAS server, it is mostly <br> idle on those resources as well. So I think a lot of time is pent <br> waiting for network packages. If I could allow 2, 4, 8, .., parallel <br> threads, I think we could see this wait time reduced significantly and <br> CPU/net/disk utilization increased.<br> <br> <br> BR<br> <br> Thomas<br> <br> </blockquote></div> --000000000000faeacf06562bd52f--