Re: Problem with sort ... textutils-2.0.21 on TRU64 v5.1a
[email protected] (Bob Proulx) Thu, 12 Sep 2002 22:08:04 -0600
| Newsgroups | gmane.comp.gnu.textutils.bugs |
|---|---|
| Message-ID | <[email protected]> |
> > 4. Amount of RAM ... = 5gb.
>
> Which should certainly be enough to sort an 800 MB file in memory
> directly without using any temporary files. So it is obtaining an
> incorrect value for the amount of memory there.
>
> Would it be possible for you to debug what lib/physmem.c is returning
> for memory on your system for the two library routines physmem_total()
> and physmem_available()?
Newer versions of GNU sort have an option to specify the amount of
memory to use for sorting. If you could try that on True64 then I am
sure that with 5GB of memory that you would sort without using any
temporary files. I had forgotten about that previously. And I am
sure if you time it there will be a large performance improvement.
-S, --buffer-size=SIZE use SIZE for main memory buffer
Therefore something like this?
sort --buffer-size=1G bigfile > bigsortedfile
Bob