Re: Git import of cvs2git dumpfile

Fabian Schäfer <[email protected]> Wed, 14 Aug 2013 18:45:40 +0200
Newsgroups gmane.comp.version-control.subversion.cvs2svn.user
Message-ID <CAGrb+mSvXAufXunKRFOtBpJxeo1T+MWAHBqXb-sg+VTGdKxf2g@mail.gmail.com>
2013/8/12 Michael Haggerty <[email protected]>

> On 08/12/2013 03:28 PM, Fabian Schäfer wrote:
> >>What command did you use to load the files?  Did it crash when loading
> >>the blob file or the dump file or did you load them both at the same
> >>time?  If you were loading them at the same time, you might try loading
> >>them separately:
> >>
> >>    git fast-import --export-marks=FILENAME <git-blob.dat
> >>    git fast-import --import-marks=FILENAME <git-dump.dat
> >>
> >>and see which of the processes dies.
> >
> > I tried both. And the blob-file import does work very well. It
> > interrupts when I try to import the dump file.
> >
> >>Did you monitor the size of the "git fast-import" process before it
> >>died?  Was it slowly eating up the available 72 Gb?
> >
> > Yes, I have monitored the consumption. the process uses less than 10% of
> > memory. So a swapfile is never used.
>
> If the process runs out of memory after using only 7 GB on a machine
> with 72 GB of RAM + swap, then it sounds very much like something else
> is limiting the process's memory consumption.  Perhaps ulimits or quotas
> or ...  Can you get *any* process to allocate more memory when run the
> same way that you ran git-fast-import?
>
> Are other processes running on the computer at the same time?  Maybe
> something else is eating up 65 Gb.
>
> I very much hope that the computer is running in 64-bit mode, and that
> git-fast-import was compiled for 64-bits.  Otherwise you could run out
> of virtual address space after only 4 GB.
>
> It is hard to imagine how this could be a git-fast-import bug, let alone
> a cvs2git bug.
>
> If you give me a computer with 32 GB of RAM I'd be happy to do some
> testing :-)
>
> Michael
>
> --
> Michael Haggerty
> [email protected]
> http://softwareswirl.blogspot.com/
>

>I very much hope that the computer is running in 64-bit mode, and that
>git-fast-import was compiled for 64-bits.  Otherwise you could run out
>of virtual address space after only 4 GB.

This was the key hint for me in order to make it work. I have switched to a
RHEL6.3 (64Bit) and now the git fast-import works very well :)
Thank you very much!!!

Best Regards,
Fabian

------------------------------------------------------
http://cvs2svn.tigris.org/ds/viewMessage.do?dsForumId=1670&dsMessageId=3062625

To unsubscribe from this discussion, e-mail: [[email protected]].