CDB | size limitations | concurrency

Matthew Berk <[email protected]> Tue, 18 Oct 2005 22:29:55 -0400
Newsgroups gmane.comp.djb.cdb
Message-ID <[email protected]> 
This is a multi-part message in MIME format.

------------save-the-trees-c0d230681b6ce0d44edbc9dddac73f94
Content-Type: text/plain;
	charset="us-ascii"
Content-Transfer-Encoding: quoted-printable

For the past year or so, Open List has been VERY happily making great  u=
se of CDB as our default persistence method. On the back end, we store  =
serialized data structures from Perl through CDB=5FFile, using Storable.=
  We're fast scaling in terms of the data we process (from millions, to =
 tens of millions of records, in hundreds of collections). Can anyone  h=
elp answer the following=3F
 =20
  1. Are there any limitations on CDB file size beyond those of the file=
 system=3F
   =20
    2. Are there any limitations on CDB data size (for value, not key)=
=3F
   =20
    3. Can we read from a CDB file while it's being created, by simply t=
ie-ing to the temporary file=3F
   =20
    Thanks in advance,
 =20
  Matthew
 =20
  Matthew Berk
  CTO
  Open List, Inc.
  http://www.openlist.com/
 =20
 =20
------------save-the-trees-c0d230681b6ce0d44edbc9dddac73f94
Content-Type: text/html;
	charset="us-ascii"
Content-Transfer-Encoding: quoted-printable

<!DOCTYPE html PUBLIC '-//W3C//DTD HTML 4.01 Transitional//EN'>
<html>
<head>
 <meta http-equiv=3D'Content-Type' content=3D'text/html;charset=3Dus-asc=
ii'>
 <style>BODY{font:10pt Tahoma, Verdana, sans-serif;}</style>
</head>
<body>
For the past year or so, Open List has been VERY happily making great
use of CDB as our default persistence method. On the back end, we store
serialized data structures from Perl through CDB=5FFile, using Storable.
We're fast scaling in terms of the data we process (from millions, to
tens of millions of records, in hundreds of collections). Can anyone
help answer the following=3F<br>
<br>
1. Are there any limitations on CDB file size beyond those of the file s=
ystem=3F<br>

<br>

2. Are there any limitations on CDB data size (for value, not key)=3F<br=
>

<br>

3. Can we read from a CDB file while it's being created, by simply tie-i=
ng to the temporary file=3F<br>

<br>

Thanks in advance,<br>
<br>
Matthew<br>
<br>
Matthew Berk<br>
CTO<br>
Open List, Inc.<br>
http://www.openlist.com/<br>
<br>
</body></html>
------------save-the-trees-c0d230681b6ce0d44edbc9dddac73f94--