Re: Organizing large collection

--===============6097566881535495208==
Content-Type: multipart/alternative; boundary="0000000000004ec2560635c942cf"

--0000000000004ec2560635c942cf
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

Thank you, Adam.
That makes sense.

On Thu, May 22, 2025 at 8:39=E2=80=AFPM Adam Retter <[email protected]> wro=
te:

> If you need to search all the documents each time, then it is most
> performant to have them in a single collection to avoid locking overhead
> between collections. If you only need to search a subset each time, and y=
ou
> can divide them by collection and just search one (or a few collections)
> this could be faster, but you would need to benchmark based on your own
> corpus and search requirements.
>
> Adam Retter
>
> eXist Core Developer
> { United Kingdom }
> [email protected]
>
> On Mon, 19 May 2025, 10:23 Alberto Sim=C3=B5es, <[email protected]> wro=
te:
>
>> Hello
>>
>> Are there differences in terms of performance between having a large
>> collection (150k docs) with or without a folder structure?
>>
>> I want to treat them as a single collection, but I don't know if it help=
s
>> to have sub-collections to organise them, or if that is irrelevant to eX=
ist.
>>
>> I appreciate any help you can provide.
>> Alberto
>>
>> --
>> Alberto Sim=C3=B5es
>> _______________________________________________
>> Exist-open mailing list
>> [email protected]
>> https://lists.sourceforge.net/lists/listinfo/exist-open
>>
>

--=20
Alberto Sim=C3=B5es

--0000000000004ec2560635c942cf
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr"><div>Thank you, Adam.</div><div>That makes sense.</div></d=
iv><br><div class=3D"gmail_quote gmail_quote_container"><div dir=3D"ltr" cl=
ass=3D"gmail_attr">On Thu, May 22, 2025 at 8:39=E2=80=AFPM Adam Retter &lt;=
<a href=3D"mailto:[email protected]">[email protected]</a>&gt; wrote:<br></=
div><blockquote class=3D"gmail_quote" style=3D"margin:0px 0px 0px 0.8ex;bor=
der-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir=3D"auto"><di=
v>If you need to search all the documents each time, then it is most perfor=
mant to have them in a single collection to avoid locking overhead between =
collections. If you only need to search a subset each time, and you can div=
ide them by collection and just search one (or a few collections) this coul=
d be faster, but you would need to benchmark based on your own corpus and s=
earch requirements.</div><div><br></div><div><div dir=3D"ltr"><div><div dir=
=3D"ltr"><div>Adam Retter<br><br>eXist Core Developer<br>{ United Kingdom }=
<br><a href=3D"mailto:[email protected]" target=3D"_blank">[email protected]=
g</a><br></div></div></div></div></div></div><br><div class=3D"gmail_quote"=
><div dir=3D"ltr" class=3D"gmail_attr">On Mon, 19 May 2025, 10:23 Alberto S=
im=C3=B5es, &lt;<a href=3D"mailto:[email protected]" target=3D"_blank">ha=
[email protected]</a>&gt; wrote:<br></div><blockquote class=3D"gmail_quote"=
 style=3D"margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);p=
adding-left:1ex"><div dir=3D"ltr"><div>Hello</div><div><br></div><div>Are t=
here differences in terms of performance between having a large collection =
(150k docs) with or without a folder structure?</div><div><br></div><div>I =
want to treat them as a single collection, but I don&#39;t know if it helps=
 to have sub-collections to organise them, or if that is irrelevant to eXis=
t.</div><div><br></div><div>I appreciate any help you can provide.</div><di=
v>Alberto</div><br><span class=3D"gmail_signature_prefix">-- </span><br><di=
v dir=3D"ltr" class=3D"gmail_signature"><div dir=3D"ltr">Alberto Sim=C3=B5e=
s<br></div></div></div>
_______________________________________________<br>
Exist-open mailing list<br>
<a href=3D"mailto:[email protected]" rel=3D"noreferrer" targ=
et=3D"_blank">[email protected]</a><br>
<a href=3D"https://lists.sourceforge.net/lists/listinfo/exist-open" rel=3D"=
noreferrer noreferrer" target=3D"_blank">https://lists.sourceforge.net/list=
s/listinfo/exist-open</a><br>
</blockquote></div>
</blockquote></div><div><br clear=3D"all"></div><br><span class=3D"gmail_si=
gnature_prefix">-- </span><br><div dir=3D"ltr" class=3D"gmail_signature"><d=
iv dir=3D"ltr">Alberto Sim=C3=B5es<br></div></div>

--0000000000004ec2560635c942cf--


--===============6097566881535495208==
Content-Type: text/plain; charset="us-ascii"
MIME-Version: 1.0
Content-Transfer-Encoding: 7bit
Content-Disposition: inline


--===============6097566881535495208==
Content-Type: text/plain; charset="us-ascii"
MIME-Version: 1.0
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

_______________________________________________
Exist-open mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/exist-open

--===============6097566881535495208==--