Re: Testing with openMosix 2.6.17
Deadpan110 <[email protected]> Mon, 30 Oct 2006 12:36:34 +0000
| Newsgroups | gmane.linux.cluster.openmosix.general |
|---|---|
| Message-ID | <[email protected]> |
Oops, missed this off the mailing list... My kernel is compiled on Gentoo and has the following in its config: <edited> # CONFIG_X86_32=y CONFIG_X86=y # Processor type and features # CONFIG_SMP=y CONFIG_X86_PC=y CONFIG_M686=y CONFIG_X86_GENERIC=y # (all the stuff that gets enabled from selecting pentiumpro in make menuconfig) CONFIG_X86_PPRO_FENCE=y CONFIG_X86_USE_PPRO_CHECKSUM=y #etc CONFIG_NR_CPUS=2 I use pentiumpro because that is the lowest CPU type in my network (2 x dual proliant servers), the kernel runs fine on my dual P3 netfinity servers and also my 2 desktops, single CPU plain Pentium 4's (none of that fancy dual core or hyperthreading - heh) If you would like me to try and build you a kernel and its modules, then I could give it a go :) Email me your config and if its sucessful, I will tar.bz2 it all up and drop it somewhere for you to download. (either the resulting lot or just vmlinux/bzImage and modules - whichever you prefer) - oh, and which 2.6.17 would you like me to try... Im still unsure of the date and version of the 1st one I made from snark(git) (of which your daemon worked) and the 2nd one is the one where my manual migration failed but is more recent. Martin On 30/10/06, Carl Radford (DC0854-IT) <[email protected]> wrote: > I forgot to say, and keep up the good work, you are doing better than me. > I have made no progress with 2.6.17 at all on my extremely fussy system, > it won't even stand up long enough to even attempt a migration. Maybe I > should get you to compile a kernel for me :>). > > I am curious what arch you are using, is it x86_64, the same as Florian, > or i386, the same as me. > > > -----Original Message----- > From: Deadpan110 [mailto:[email protected]] > Sent: 30 October 2006 10:35 > To: Carl Radford (DC0854-IT) > Cc: openmosix-general-5NWGOfrQmneRv+LV9MX5uipxlwaOVQ5f@public.gmane.org > Subject: Re: [openMosix-general] Testing with openMosix 2.6.17 > > > Yes sure, > > The only reason I didn't try manual migration to begin with was > because the previous 2.6.17 sources I used from snark (git) worked and > I then automatically assumed that manual migration would also work on > 2.6.17-om26-20061019 so indeed it is hardly supprising that that your > userspace daemon wouldn't work. > (both kernels were compiled with the same configuration - just incase > anyone wonders if I left anything out) > > If anyone would like me to test out another more recent kernel, I will > firstly make sure manual migration works without assumption and then > definately test out any versions of your userspace daemon you wish to > pass my way. > > Regarding the kernel development side, If there is any debugging > information I could grab when things go pear shaped, also let me know > and I can paste it somewhere. > > Martin > > On 30/10/06, Carl Radford (DC0854-IT) <[email protected]> wrote: > > Hi Martin, > > > > I think you may be misconstruing what the userspace daemon does > > (or doesn't). It basically has nothing to do with migration other > > that to choose which process to migrate, and which node to migrate > > it to. All migration itself (the clever stuff) is handled by the > > kernel. It is pointless running the daemon until you have manual > > migration working as all it will achieve is to confusticate what > > is really going on (if the kernel gets it wrong, the daemon > > "really" gets it wrong, making a worse mess, e.g.. trying to migrate > > a single process to all of the cluster nodes at the same time). > > > > I have written in a dirty fix for the problems with the 2.6.17 > > kernel reporting a process as being "home" when it is actually > > migrating. If you would like it, let me know when manual migration > > is working and I'll stop hacking the source and let you have the > > latest....... > > > > -----Original Message----- > > From: Deadpan110 [mailto:[email protected]] > > Sent: 28 October 2006 22:34 > > To: Florian Delizy; Dirk Eddelbuettel; Carl Radford (DC0854-IT) > > Cc: openmosix-general-5NWGOfrQmneRv+LV9MX5uipxlwaOVQ5f@public.gmane.org > > Subject: Re: [openMosix-general] Testing with openMosix 2.6.17 > > > > > > Ohh yeah... sorry about posting the patch within the mailing lists... > > I should have really known better... I guess my enthusiasm got the > > better of me... > > > > Anyways... > > > > I have been using 2.6.17-om26-20061019 for over a week now and upon > > re-examining the patch I created (without knowing much in the way of > > its workings) > > I noticed that there is a lot of stuff included in there that isnt oM > > related... was the kernel patched with updates or other bits n pieces > > that caused the patch to get a lil bloaty? > > > > I have noticed that using Carl Radford's migration daemon does not > > work on this version of oM but worked on the 2.6.17 sources from snark > > (git) and I think I remembered them from 2.6.15 (way back in the > > mailing list). > > > > I have now tried manual migration using the usual > > awk 'BEGIN {for(i=0;i<10000;i++)for(j=0;j<10000;j++);}' & > > then after looking in ps aux > > echo [nodeIP] >> /proc/[NUM]/om/where > > and it seems to hang with kcomd at 100% cpu on both nodes. > > > > The kernels are the same across nodes and compiled with > > CONFIG_OPENMOSIX=y > > CONFIG_OPENMOSIX_VERBOSE=y > > CONFIG_OPENMOSIX_MIGRATION_VERBOSE=y > > CONFIG_OPENMOSIX_DEBUG=y > > CONFIG_OPENMOSIX_MIGRATION_DEBUG=y > > # CONFIG_OPENMOSIX_DEBUG_FS is not set > > CONFIG_OPENMOSIX_CTRL_FS=y > > > > After having to reboot to regain access to my nodes, I am ready once > > again to break them :) > > > > Kernel is currently compiled for pentium pro SMP - if anyone requires > > me to break it some more, or recompile another... or even require me > > to obtain some more useful debugging info (with some basic > > instructions) etc... Im still available!! > > > > Martin > > > > On 24/10/06, Florian Delizy <[email protected]> wrote: > > > > > > > I have sucessfully compiled linux-2.6.17-om26-20061019 from > > > > http://openmosix.unfreeze.net/releases and it seems to be running > > > > stable although I have not yet tested manual migration. > > > Well, at this point I guess only the manual migration should work > > > BTW, I reorganized this place and I'll upload some tools as well (I > > > should make another release in the week fixing many issues...) > > > > > > > An initial test of Carl Radford's usertools do not appear to work with > > > > this version, I havent had time to do much else as Im still messing > > > > with setting up all my nodes - maybe recompiling the tools will give > > > > better results. > > > Well, for what version are those tools made ?? 2.4 and 2.6 are not > > > compatible from the user tool point of view, I would need to have a look > > > at the code to say exactly what to change, but you can have a look at > > > > > > http://openmosix.snarc.org > > > > > > for some description of the oM2.6 functioning > > > > It appears that doing: > > > > awk 'BEGIN {for(i=0;i<10000;i++)for(j=0;j<10000;j++);}' & > > > > several times, wants to migrate... but doesn't... > > > How is the migration order passed ? (this process should migrate)... > > > > I wll try it again later and get a dump of the output. > > > > > > > I have also knocked together a patch of the above oM kernel for use > > > > with the plain linux-2.6.17 sources. > > > Thanks, although I could have made one :) (I'll do for next release, I > > > swear), can you sent it back to me, I'll put it online. > > > > > > > > > > NOTE TO USERS, as you are proberly aware... oM 2.6 is still in > > > > development, oM 2.4.26 is still very much stable and very complete - > > > > with userspace tools... > > > > > > > Use the included patch for 2.6.17 AT YOUR OWN RISK! > > > Don't worry, we'll be stable (beta?) soon (I hope at least :) ) > > > > I should perhaps join the oM development lists and post there. > > > Well, some traffic on the general list is good as well, I'll remember to > > > post here anytime to announce another alpha test release :) (yes it is > > > alpha for now :) ) > > > > > > > > > Florian Delizy > > > > > > > > > ------------------------------------------------------------------------- > > > Using Tomcat but need to do more? Need to support web services, security? > > > Get stuff done quickly with pre-integrated technology to make your job easier > > > Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo > > > http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642 > > > _______________________________________________ > > > openMosix-general mailing list > > > openMosix-general-5NWGOfrQmneRv+LV9MX5uipxlwaOVQ5f@public.gmane.org > > > https://lists.sourceforge.net/lists/listinfo/openmosix-general > > > > > > ------------------------------------------------------------------------- Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642