Re: Fast massive ldif load

Quanah Gibson-Mount <[email protected]>
Newsgroups gmane.network.openldap.general
Message-ID <[email protected]>

--On October 7, 2009 11:09:18 PM +0200 Emmanuel Lecharny 
<[email protected]> wrote:

> Quanah Gibson-Mount wrote:
>>
>>
>> --On October 7, 2009 3:32:51 PM -0400 Aaron Richton
>> <[email protected]> wrote:
>>
>>> On Wed, 7 Oct 2009, iz1ksw iz1ksw wrote:
>>>
>>>> What is the fastest way (in terms of openldap settings) to perform a
>>>> massive load (~200MB ldif file) of data into openldap directory?
>>>
>>> Try "slapadd -q" (read slapadd(8) man page to get started).
>>
>> slapadd -q is important, but so is having a large enough BDB cache in
>> the DB_CONFIG file, plus setting the right number of tool threads.  I
>> took a load down from 17 hours to less than 2 hours adjusting all of
>> those correctly and adding -q.
>
> The LDIF file is only 200Mb large. It should be a matter of minutes to
> load it on a decent machine, even when using the standard parameters :)


There is not a 1 to 1 correlation between LDIF file size and resulting 
database size.  My LDIF file was 300MB and the resulting database was 12.5 
GB.

--Quanah


--

Quanah Gibson-Mount
Principal Software Engineer
Zimbra, Inc
--------------------
Zimbra ::  the leader in open source messaging and collaboration
lmpx.com only provides a reader for public news (NNTP) servers. It is not affiliated with the servers or forums shown here and is not responsible for the content of articles, which is written by their respective authors.