Re: Best queue system for myrinet?

Enrique Lomba wrote:
> 
> 
> Bill Broadley wrote:
> 
>> I'm reinstalling a 32 node (64 cpu) myrinet cluster.
>>
>> I'm looking for a batch queue system, but want to avoid the problem
>> I've had in the past (although this info maybe somewhat dated).
>>
>> Basically I want to schedule my cluster as 64 cpu's, but if I
>> tell the queue system I have more then 32 cpu it needs to know
>> that the first job on a given node gets Myrinet channel 2, and the 
>> second job on the same node gets Myrinet channel 4.
>>
>> What is working well for people?
>>
> 
> Hello,
> we have a 32 node dual cluster with Myrinet and we are using rather 
> successfully OpenPBS 2.3 (with the patches that can be found in 
> http://bellatrix.pcl.ox.ac.uk/~ben/pbs/) and mpiexec to run parallel jobs.

Actually, we have a similar config here (with the Maui scheduler for
node selection) on five 32+ dual node clusters and in my experience
OpenPBS needs quite a bit of hand holding.  Having to restart PBS
services often for various (usually unclear) reasons is in fact quite
a pain.  I must immediately add that we don't have ALL the patches of
the above site, but as far as I know we do use the relevant ones.

Maybe other people can comment on SGE (Sun Grid Engine, formerly Codine).
It seems to offer a similar interface, is now open software, and
possibly a bit more stable?

Regards,
Kees Verstoep