Re: Fw: [linuxNUS] Internship offer
Brice Rebsamen <[email protected]>
| Newsgroups | gmane.user-groups.linux.singapore |
|---|---|
| Message-ID | <[email protected]> |
Hi Harish Thanks for the suggestion, but I fail to see how is R related to my problem. Can you explain? All my code is written under Matlab, I do not consider converting to any other language. I am looking for a way to distribute the computation, taking advantage of the cluster of Matlab machines available at my work place. Regards Brice On Thu, Apr 15, 2010 at 1:10 PM, Harish Pillay <[email protected]> wrote: > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 > > Brice - > -----BEGIN PGP SIGNATURE----- > Version: GnuPG v1.4.10 (GNU/Linux) > Comment: Use GnuPG with Firefox : http://getfiregpg.org (Version: 0.7.10) > > iEYEARECAAYFAkvGn9wACgkQD4An23RoCeNv+wCdE0JWoOQ2KgfSG+8cq91eJv2w > Vu8An1/rE2pgT6CY0Xm+9wyc0GXaKgF6 > =lTnV > -----END PGP SIGNATURE----- > > >> Thanks for your interest. I think my situation is much simpler though: >> - splitting the task into parallel processes is straightforward (one >> process for each combination of the dataset and parameters) >> - data and code transfer between nodes is also straightforward since >> the file system is shared (NFS) >> - aggregating the result is also easy: a simple way is to save the >> result in a file, properly labeled, and aggregate these files at the >> end of the computation. >> >> The constraint is that the computation has to be done under Matlab (is >> this possible with Hadoop? my guess is no). >> >> So the only 'difficulty' is to open matlab sessions on remote hosts, >> send them some instructions, detect when the job is complete, reassign >> a new job and so on. This seems very basic to me, I think I could do >> it in a week or so. I have some other things to do though, hence the >> job offer. > > Have you looked at the R Project (http://www.r-project.org/). Perhaps > that is what you need? > > Harish > _______________________________________________ LUGS Mailing list - [email protected] List FAQ: http://wiki.lugs.org.sg/LugsMailingListFaq Info page: http://www.lugs.org.sg/mailman/listinfo/slugnet To unsubscribe send an empty email to: [email protected]