Re: FSF Europe starts distributed search engine, seeks peers & developers

I know nothing of the technology. Have fired it up on my laptop to see
how things work. Perhaps the p2p protocol could be reimplemented in
something like node.js/Twisted/Erlang?

FWIW, if this were to start from scratch I think a distributed crawler
using Hadoop/HDFS would make lots of sense.

On 29 November 2011 11:38, Robin Paulson <[email protected]> wrote:
> On Tue, 29 Nov 2011 09:49:51 +1300, Tim McNamara wrote:
>>
>> http://yacy.net/
>
> i don't want to sound like i'm down on this as it is a wonderful project and
> google should be getting far more free software/data competition than it is,
> but yacy is 5 years old now.
>
> does this article say more about computer world than yacy?
>
> anyway on the subject of the software, i ran a node for a while.
> bonuses: it turned up good results, i'd use it permanently in a heartbeat.
> problem: it's fat, it needs serious RAM and storage, and a lot of bandwidth.
> a search query downloaded the order of 10s of MB from other peers, and my
> weedy 384MB RAN/5GB hard drive VPS was not up to it, it started impacting
> other services on the server.
>
> has anyone else here tried it, on something more powerful?
>
> glad to see they're encouraging developers and getting FSF funding, i'd like
> to see this project take off and become more mainstream
>
> --
> robin
>
> http://fu.ac.nz - Auckland's Free University
>
> _______________________________________________
> NZLUG mailing list [email protected]
> http://www.linux.net.nz/cgi-bin/mailman/listinfo/nzlug
>

_______________________________________________
NZLUG mailing list [email protected]
http://www.linux.net.nz/cgi-bin/mailman/listinfo/nzlug