Re: gm_board_info only shows the node itself

Patrick Geoffray <[email protected]> Tue, 13 Jan 2004 18:31:37 -0500
Newsgroups gmane.network.myrinet.general
Organization Myricom, Inc.
Message-ID <[email protected]>
Hi Atsuko,

Atsuko Miyashita wrote:
> Yes, I aware this... and actually, if I do
> mpirun -np 1 ./cpi
> 
> then it works without problem.
> It means, when I am not using Myrinet, it works...

You are always opening a GM port, even with only one process.
The difference is that MPICH-GM does not try to allocate
DMAable memory if all of the processes are on the same machine
(and the shared memory support is not disabled).

As the GM driver fails to lock pages on your machine, it fails to
allocate DMA-able memory (which needs to be locked), that's why
you see these errors:

> >[root@hgt001 basic]# mpirun -np 4 ./cpi
> >Process 2 of 4 on hgt001.linux.coc
> >[3]: alloc failed, not enough memory (Fatal Error)
> >Context: <(gmpi_init) gmpi_dma_alloc: dma send buffers>
> >[1]: alloc failed, not enough memory (Fatal Error)
> >Context: <(gmpi_init) gmpi_dma_alloc: dma send buffers>

gmpi_dma_alloc fails because the gm_dma_alloc call fails, but it fails
because the driver cannot lock pages, not because lack of memory.

> I think I should try latest version, GM 2.0.8 tomorrow...

You can do that, but if the kernel mismatch is still there, I don't
think it
will make a difference.

Patrick
-- 

Patrick Geoffray
Myricom, Inc.
http://www.myri.com