Re: scheduler for SF

"Xavier Grehant" <[email protected]> Thu, 18 Jan 2007 20:41:21 +0100
Newsgroups gmane.comp.java.smartfrog.user
Message-ID <[email protected]>
Same idea, with the information sent from the SFPoolMember (schedulee)
to the SFPoolManager (scheduler) as arguments of getNextHost(...).

I feel close but I still trying to make the schedulee work. Changing
sfProcessHost value just before deployment of the schedulee's children
does not change where they're deployed, one has to do it before, but
still after the schedulee's deployment. I'm not really sure where to
override Compound.

Xavier

---------- Forwarded message ----------
From: Xavier Grehant <[email protected]>
Date: Jan 18, 2007 12:27 PM
Subject: Scheduler
To: smartfrog-developer <smartfrog-developer-5NWGOfrQmneRv+LV9MX5uipxlwaOVQ5f@public.gmane.org>


Hi all -
Andreas asked the question about a scheduler that would take a number
of hosts as attributes and set the sfProcessHost attributes of
relevant components.
I'm implementing something that would take this form :

myScheduler extends Scheduler {
   hosts ["host1.cern.ch", "123.45.678.90", "host2.cern.ch"];
}

anything extends Schedulee {
   scheduler LAZY ATTRIB myScheduler;
   - extends Anything {
       // the sfProcessHost attribute is set by class
       // Schedulee (implements Compound) calling a public
       // method getNextHost() of class Scheduler.
   }
}

Best,
Xavier


On 1/18/07, Phillip Thurmond <[email protected]> wrote:
> Andreas--
>
> I need the exact same thing.  I started on some code for this a few
> weeks ago, but nothing that works yet.  The idea of my implementation
> would be to have two types of SF components:  SFPoolManager and
> SFPoolMember.  The members would report to the pool manager
> information about that host such as hostname, available ip addresses,
> architecture, OS, etc...  Now, as far as the actual scheduling
> algorithm, the simplest solution would be to embed some meta data in
> your sf scripts like number and type (OS, arch, etc..) of hosts
> needed.  Now, the scheduler doesn't have to be very smart.  It just
> checks to see if the correct types of hosts are currently available in
> the pool.  If so, it passes references for those hosts to the script.
> If not, it just waits until more resources are available.
>
> Anyways, that was very stream-of-consciousness.  This example is
> complicated by the fact that our pool is heterogeneous and our scripts
> use many hosts at once.  If you had simpler requirements, you might
> not need any meta data in the scripts.  Currently, I have other
> priorities so I don't know when I'll get back to this, so it's
> currently just an idea.  Thoughts?
>
> --Phillip
>
>
> On 1/18/07, Andreas Unterkircher <[email protected]> wrote:
> > Hello,
> >
> > we're looking for a scheduler to deploy components on different hosts.
> > For a start our requirements are very simple: we have a pool of machines
> > where we can deploy components, the scheduler should decide on which
> > machine to deploy new components based on very simple criteria (how many
> > components are already running on a certain machine ? no cpu, memory
> > usage etc. has to be taken into account). Is there already something in
> > SF that we could use for a start to experiment with ?
> >
> > Thanks,
> > Andreas
> >
> >
> > -------------------------------------------------------------------------
> > Take Surveys. Earn Cash. Influence the Future of IT
> > Join SourceForge.net's Techsay panel and you'll get the chance to share your
> > opinions on IT & business topics through brief surveys - and earn cash
> > http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV
> > _______________________________________________
> > Smartfrog-support mailing list
> > Smartfrog-support-5NWGOfrQmneRv+LV9MX5uipxlwaOVQ5f@public.gmane.org
> > https://lists.sourceforge.net/lists/listinfo/smartfrog-support
> >
>
> -------------------------------------------------------------------------
> Take Surveys. Earn Cash. Influence the Future of IT
> Join SourceForge.net's Techsay panel and you'll get the chance to share your
> opinions on IT & business topics through brief surveys - and earn cash
> http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV
> _______________________________________________
> Smartfrog-support mailing list
> Smartfrog-support-5NWGOfrQmneRv+LV9MX5uipxlwaOVQ5f@public.gmane.org
> https://lists.sourceforge.net/lists/listinfo/smartfrog-support
>

-------------------------------------------------------------------------
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT & business topics through brief surveys - and earn cash
http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV