Re: [myrinet] Re: RE: mpich PBS etc. and gm_ports not closing
Bob Felderman <[email protected]>
| Newsgroups | gmane.network.myrinet.general |
|---|---|
| Message-ID | <[email protected]> |
=> From: Peter Boyle <[email protected]> => => I'm not using PBS, however I am seeing problems with mpi processes left => running after a non-clean exit by one of the nodes. I have never seen a => port open without an associated process in existence. Typically they are => using a high percentage of cpu, which suggests they are sitting in a spin => loop. => => I use an awk script to parse gm_board_info after => job has finished, however I am having intermittent problems with => gm_board_info hanging, in which case I have to go round killing processes => (both gm_board_info and mpi processes). => => From: "Greg Lindahl" <[email protected]> => I believe that this problem (gm_board_info hanging) is only present in early => versions of gm-1.2.X -- can you tell us what version you're running? I just was on a machine at UNM running gm-1.2.3 where the mpi processes were hung. I tried gm_board_info and that hung. Trying to kill the processes using kill -9 did not kill them at all. We know there are some broken locking issues in gm-1.2.x and we're expecting to have them addressed in gm-1.4. Bob