Re: Organizing large collection

Alberto Simões <[email protected]> Mon, 19 May 2025 12:12:24 +0100
Newsgroups gmane.text.xml.exist
Message-ID <CAAkRyrs_q=jYn0rP6nSVWzCxUimkCKg=4qhyGC2Aqbu2xBLjmQ@mail.gmail.com>
--===============6381826650894544748==
Content-Type: multipart/alternative; boundary="000000000000716bd606357b360a"

--000000000000716bd606357b360a
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

Hello, Michael

I cannot split them so that I can specify different collection names.
In that case, splitting does not bring any additional value?

Thanks

On Mon, May 19, 2025 at 10:25=E2=80=AFAM Michael Westbay <
[email protected]> wrote:

> Hi Alberto,
>
> collection("/db/records")/record will match all <record>...</record>
> documents under /db/records and sub-folders (sub-collections?).
>
> If you can organize them by date (year sub-folders), including that in th=
e
> collection parameter will mean less records to search. And all sub-folder=
s
> under that collection will still be included in the XPath search.
>
>
>
> 2025=E5=B9=B45=E6=9C=8819=E6=97=A5(=E6=9C=88) 17:23 Alberto Sim=C3=B5es <=
[email protected]>:
>
>> Hello
>>
>> Are there differences in terms of performance between having a large
>> collection (150k docs) with or without a folder structure?
>>
>> I want to treat them as a single collection, but I don't know if it help=
s
>> to have sub-collections to organise them, or if that is irrelevant to eX=
ist.
>>
>> I appreciate any help you can provide.
>> Alberto
>>
>> --
>> Alberto Sim=C3=B5es
>> _______________________________________________
>> Exist-open mailing list
>> [email protected]
>> https://lists.sourceforge.net/lists/listinfo/exist-open
>>
>
>
> --
> Michael Westbay
> Writer/System Administrator
> http://www.japanesebaseball.com/
>


--=20
Alberto Sim=C3=B5es

--000000000000716bd606357b360a
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr"><div>Hello, Michael</div><div><br></div><div>I cannot spli=
t them so that I can specify different collection names.</div><div>In that =
case, splitting does not bring any additional value?</div><div><br></div><d=
iv>Thanks</div></div><br><div class=3D"gmail_quote gmail_quote_container"><=
div dir=3D"ltr" class=3D"gmail_attr">On Mon, May 19, 2025 at 10:25=E2=80=AF=
AM Michael Westbay &lt;<a href=3D"mailto:[email protected]"=
>[email protected]</a>&gt; wrote:<br></div><blockquote clas=
s=3D"gmail_quote" style=3D"margin:0px 0px 0px 0.8ex;border-left:1px solid r=
gb(204,204,204);padding-left:1ex"><div dir=3D"ltr"><div>Hi Alberto,</div><d=
iv><br></div><div><span style=3D"font-family:monospace;background-color:rgb=
(238,238,238)">collection(&quot;/db/records&quot;)/record</span> will match=
 all <span style=3D"font-family:monospace;background-color:rgb(238,238,238)=
">&lt;record&gt;...&lt;/record&gt;</span> documents under /db/records and s=
ub-folders (sub-collections?).</div><div><br></div><div>If you can organize=
 them by date (year sub-folders), including that in the collection paramete=
r will mean less records to search. And all sub-folders under that collecti=
on will still be included in the XPath search.</div><div><br></div><div><br=
></div></div><br><div class=3D"gmail_quote"><div dir=3D"ltr" class=3D"gmail=
_attr">2025=E5=B9=B45=E6=9C=8819=E6=97=A5(=E6=9C=88) 17:23 Alberto Sim=C3=
=B5es &lt;<a href=3D"mailto:[email protected]" target=3D"_blank">hashashi=
[email protected]</a>&gt;:<br></div><blockquote class=3D"gmail_quote" style=3D"ma=
rgin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:=
1ex"><div dir=3D"ltr"><div>Hello</div><div><br></div><div>Are there differe=
nces in terms of performance between having a large collection (150k docs) =
with or without a folder structure?</div><div><br></div><div>I want to trea=
t them as a single collection, but I don&#39;t know if it helps to have sub=
-collections to organise them, or if that is irrelevant to eXist.</div><div=
><br></div><div>I appreciate any help you can provide.</div><div>Alberto</d=
iv><br><span class=3D"gmail_signature_prefix">-- </span><br><div dir=3D"ltr=
" class=3D"gmail_signature"><div dir=3D"ltr">Alberto Sim=C3=B5es<br></div><=
/div></div>
_______________________________________________<br>
Exist-open mailing list<br>
<a href=3D"mailto:[email protected]" target=3D"_blank">Exist=
[email protected]</a><br>
<a href=3D"https://lists.sourceforge.net/lists/listinfo/exist-open" rel=3D"=
noreferrer" target=3D"_blank">https://lists.sourceforge.net/lists/listinfo/=
exist-open</a><br>
</blockquote></div><div><br clear=3D"all"></div><br><span class=3D"gmail_si=
gnature_prefix">-- </span><br><div dir=3D"ltr" class=3D"gmail_signature">Mi=
chael Westbay<br>Writer/System Administrator<br><a href=3D"http://www.japan=
esebaseball.com/" target=3D"_blank">http://www.japanesebaseball.com/</a></d=
iv>
</blockquote></div><div><br clear=3D"all"></div><br><span class=3D"gmail_si=
gnature_prefix">-- </span><br><div dir=3D"ltr" class=3D"gmail_signature"><d=
iv dir=3D"ltr">Alberto Sim=C3=B5es<br></div></div>

--000000000000716bd606357b360a--


--===============6381826650894544748==
Content-Type: text/plain; charset="us-ascii"
MIME-Version: 1.0
Content-Transfer-Encoding: 7bit
Content-Disposition: inline


--===============6381826650894544748==
Content-Type: text/plain; charset="us-ascii"
MIME-Version: 1.0
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

_______________________________________________
Exist-open mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/exist-open

--===============6381826650894544748==--