RE: Problem with sort ... textutils-2.0.21 on TRU64 v5.1a
Parkin Frank - fparki <[email protected]> Fri, 13 Sep 2002 08:46:38 +0100
| Newsgroups | gmane.comp.gnu.textutils.bugs |
|---|---|
| Message-ID | <F5C14CB08F4FD411811D00508B13420804309791@SRVSUND14> |
Hi Bob, Apologies for my delayed response. I tried this parameter shortly after our last conversation. Unfortunately, the only difference it made was that the process fell-over after 5 minutes rather than 30 seconds. Temporary files were still being created. Would it be possible for you to debug what lib/physmem.c is returning for memory on your system for the two library routines physmem_total() and physmem_available()? Sorry, I would not know how ... I am a lowly system admin and part-time Perl hacker. Thanks Frank -----Original Message----- From: [email protected] [mailto:[email protected]] Sent: 13 September 2002 05:08 To: Parkin Frank - fparki; [email protected] Subject: Re: Problem with sort ... textutils-2.0.21 on TRU64 v5.1a > > 4. Amount of RAM ... = 5gb. > > Which should certainly be enough to sort an 800 MB file in memory > directly without using any temporary files. So it is obtaining an > incorrect value for the amount of memory there. > > Would it be possible for you to debug what lib/physmem.c is returning > for memory on your system for the two library routines physmem_total() > and physmem_available()? Newer versions of GNU sort have an option to specify the amount of memory to use for sorting. If you could try that on True64 then I am sure that with 5GB of memory that you would sort without using any temporary files. I had forgotten about that previously. And I am sure if you time it there will be a large performance improvement. -S, --buffer-size=SIZE use SIZE for main memory buffer Therefore something like this? sort --buffer-size=1G bigfile > bigsortedfile Bob ********************************************************************* The information contained in this communication is confidential, is intended only for the use of the recipient named above, and may be legally privileged. If the reader of this message is not the intended recipient, you are hereby notified that any dissemination, distribution, or copying of this communication is strictly prohibited. If you have received this communication in error, please re-send this communication to the sender and delete the original message or any copy of it from your computer system. Thank You.