RE: [discuss] the live statistics about the current online host number

"Greg Bildson" <[email protected]> Fri, 8 Apr 2005 17:23:34 -0400
Newsgroups gmane.network.gnutella.limewire.general
Message-ID <[email protected]>
This is a multi-part message in MIME format.

--===============1193468366==
Content-Type: multipart/alternative;
	boundary="----=_NextPart_000_04D1_01C53C5F.B1115530"

This is a multi-part message in MIME format.

------=_NextPart_000_04D1_01C53C5F.B1115530
Content-Type: text/plain;
	charset="GB2312"
Content-Transfer-Encoding: quoted-printable
X-MIME-Autoconverted: from 8bit to quoted-printable by www.limewire.org id j38LGTdF028251

Or competition on the linux box that it is running on with another proces=
s
that can interfere with the UDP crawl.

Thanks
-greg
  -----Original Message-----
  From: [email protected]
[mailto:[email protected]]On Behalf Of Greg Bildson
  Sent: Friday, April 08, 2005 12:42 PM
  To: [email protected]
  Subject: RE: [discuss] the live statistics about the current online hos=
t
number


  Or randomness.

  Thanks
  -greg
    -----Original Message-----
    From: [email protected]
[mailto:[email protected]]On Behalf Of Greg Bildson
    Sent: Friday, April 08, 2005 12:37 PM
    To: Justin Schmidt
    Cc: discuss
    Subject: RE: [discuss] the live statistics about the current online h=
ost
number


    The incremental time in milliseconds to crawl the next 50,000 hosts.
Nobody said the increments were smooth.  Differential times could be an
indication of clumpiness in the network or inefficiencies in the crawl.

    Thanks
    -greg
      -----Original Message-----
      From: Justin Schmidt [mailto:[email protected]]
      Sent: Friday, April 08, 2005 12:26 PM
      To: Greg Bildson
      Cc: =A8=B0=A8=B9=A1=C1??t; discuss
      Subject: Re: [discuss] the live statistics about the current online
host number


      What does the time column mean?  The non-monotonical increasing nat=
ure
of it doesn't make a whole lot of sense.  Note the bold elements below.


      Greg Bildson wrote:
Zuoning,

Hi.  We do a combined crawl of the network using both TCP and UDP to
communicate with ultrapeers.  The cycle is once every hour and the active
crawl takes about 50 minutes.  The number does appear to undercount other
vendors such as BearShare given that they only support the TCP crawl.

Here is an example of the crawling time for the majority of nodes.  The
total unique nodes is on the left and the incremental time in millisecond=
s
is on the right:

Count: 1        Time: 3047
Count: 50000    Time: 14239
Count: 100000   Time: 11818
Count: 150000   Time: 16553
Count: 200000   Time: 25506
Count: 250000   Time: 28869
Count: 300000   Time: 34274
Count: 350000   Time: 51653
Count: 400000   Time: 99632
Count: 450000   Time: 63595
Count: 500000   Time: 81248
Count: 550000   Time: 93576
Count: 600000   Time: 100121
Count: 650000   Time: 106283
Count: 700000   Time: 106316
Count: 750000   Time: 120726
Count: 800000   Time: 132113
Count: 850000   Time: 139076
Count: 900000   Time: 191107
Count: 950000   Time: 244538
Count: 1000000  Time: 173649
Count: 1050000  Time: 186755
Count: 1100000  Time: 180398
Count: 1150000  Time: 195833
Count: 1200000  Time: 211029
Count: 1250000  Time: 361543
Count: 1300000  Time: 320897

Thanks
-greg

  -----Original Message-----
From: [email protected]
[mailto:[email protected]]On Behalf Of =D2=FC=D7=F4=C4=FE
Sent: Friday, April 08, 2005 12:44 AM
To: discuss
Subject: [discuss] the live statistics about the current online
host number


Hi All:
	I am interested in the live statistics about the current
online host number on the homepage of Limewire, the number is
enormous. I wonder how do the  statistics come from. I gusess
limewire must have some monitor mechanism, then how long is the
duration of a monitior process, an hour? half an hour?


Best Regards!!

zuoning yin
2005-04-08

Cluster and Grid Computing Lab
School of Computer Science
Huazhong University of Science and Technology
Wuhan, 430074, China
Tel: +86-27-87557047
Fax: +86-27-87557354
Email: [email protected]
Homepage:http://grid.hust.edu.cn



_______________________________________________
discuss mailing list
[email protected]
http://www.limewire.org/mailman/listinfo/discuss


_______________________________________________
discuss mailing list
[email protected]
http://www.limewire.org/mailman/listinfo/discuss


------=_NextPart_000_04D1_01C53C5F.B1115530
Content-Type: text/html;
	charset="GB2312"
Content-Transfer-Encoding: quoted-printable

<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN">
<HTML><HEAD>
<META http-equiv=3DContent-Type content=3Dtext/html;charset=3DGB2312>
<META content=3D"MSHTML 6.00.2800.1491" name=3DGENERATOR></HEAD>
<BODY text=3D#000000 bgColor=3D#ffffff>
<DIV><FONT face=3DArial color=3D#0000ff size=3D2><SPAN =
class=3D094474616-08042005>Or=20
competition on the linux box that it is running on with another process =
that can=20
interfere with the UDP crawl.</SPAN></FONT></DIV>
<DIV><FONT face=3DArial color=3D#0000ff size=3D2><SPAN=20
class=3D094474616-08042005></SPAN></FONT><FONT face=3DArial =
color=3D#0000ff=20
size=3D2><SPAN class=3D094474616-08042005></SPAN></FONT>&nbsp;</DIV>
<DIV><FONT face=3DArial color=3D#0000ff size=3D2><SPAN=20
class=3D094474616-08042005>Thanks</SPAN></FONT></DIV>
<DIV><FONT face=3DArial color=3D#0000ff size=3D2><SPAN=20
class=3D094474616-08042005>-greg</SPAN></FONT></DIV>
<BLOCKQUOTE dir=3Dltr=20
style=3D"PADDING-LEFT: 5px; MARGIN-LEFT: 5px; BORDER-LEFT: #0000ff 2px =
solid; MARGIN-RIGHT: 0px">
  <DIV class=3DOutlookMessageHeader dir=3Dltr align=3Dleft><FONT =
face=3DTahoma=20
  size=3D2>-----Original Message-----<BR><B>From:</B>=20
  [email protected]=20
  [mailto:[email protected]]<B>On Behalf Of </B>Greg=20
  Bildson<BR><B>Sent:</B> Friday, April 08, 2005 12:42 PM<BR><B>To:</B>=20
  [email protected]<BR><B>Subject:</B> RE: [discuss] the live=20
  statistics about the current online host number<BR><BR></FONT></DIV>
  <DIV><FONT face=3DArial color=3D#0000ff size=3D2><SPAN =
class=3D657554016-08042005>Or=20
  randomness.</SPAN></FONT></DIV>
  <DIV><FONT face=3DArial color=3D#0000ff size=3D2><SPAN=20
  class=3D657554016-08042005></SPAN></FONT>&nbsp;</DIV>
  <DIV><FONT face=3DArial color=3D#0000ff size=3D2><SPAN=20
  class=3D657554016-08042005>Thanks</SPAN></FONT></DIV>
  <DIV><FONT face=3DArial color=3D#0000ff size=3D2><SPAN=20
  class=3D657554016-08042005>-greg</SPAN></FONT></DIV>
  <BLOCKQUOTE dir=3Dltr=20
  style=3D"PADDING-LEFT: 5px; MARGIN-LEFT: 5px; BORDER-LEFT: #0000ff 2px =
solid; MARGIN-RIGHT: 0px">
    <DIV class=3DOutlookMessageHeader dir=3Dltr align=3Dleft><FONT =
face=3DTahoma=20
    size=3D2>-----Original Message-----<BR><B>From:</B>=20
    [email protected]=20
    [mailto:[email protected]]<B>On Behalf Of </B>Greg=20
    Bildson<BR><B>Sent:</B> Friday, April 08, 2005 12:37 =
PM<BR><B>To:</B> Justin=20
    Schmidt<BR><B>Cc:</B> discuss<BR><B>Subject:</B> RE: [discuss] the =
live=20
    statistics about the current online host number<BR><BR></FONT></DIV>
    <DIV><FONT face=3DArial color=3D#0000ff size=3D2><SPAN=20
    class=3D628283216-08042005>The incremental time in milliseconds to =
crawl the=20
    next 50,000 hosts.&nbsp; Nobody said the increments were =
smooth.&nbsp;=20
    Differential times could be an indication of clumpiness in the =
network or=20
    inefficiencies in the crawl.&nbsp; </SPAN></FONT></DIV>
    <DIV><FONT face=3DArial color=3D#0000ff size=3D2><SPAN=20
    class=3D628283216-08042005></SPAN></FONT>&nbsp;</DIV>
    <DIV><FONT face=3DArial color=3D#0000ff size=3D2><SPAN=20
    class=3D628283216-08042005>Thanks</SPAN></FONT></DIV>
    <DIV><FONT face=3DArial color=3D#0000ff size=3D2><SPAN=20
    class=3D628283216-08042005>-greg</SPAN></FONT></DIV>
    <BLOCKQUOTE dir=3Dltr=20
    style=3D"PADDING-LEFT: 5px; MARGIN-LEFT: 5px; BORDER-LEFT: #0000ff =
2px solid; MARGIN-RIGHT: 0px">
      <DIV class=3DOutlookMessageHeader dir=3Dltr align=3Dleft><FONT =
face=3DTahoma=20
      size=3D2>-----Original Message-----<BR><B>From:</B> Justin Schmidt =

      [mailto:[email protected]]<BR><B>Sent:</B> Friday, April 08, =
2005=20
      12:26 PM<BR><B>To:</B> Greg Bildson<BR><B>Cc:</B> =
=A8=B0=A8=B9=A1=C1??t;=20
      discuss<BR><B>Subject:</B> Re: [discuss] the live statistics about =
the=20
      current online host number<BR><BR></FONT></DIV>What does the time =
column=20
      mean?&nbsp; The non-monotonical increasing nature of it doesn't =
make a=20
      whole lot of sense.&nbsp; Note the bold elements =
below.<BR><BR><BR>Greg=20
      Bildson wrote:=20
      <BLOCKQUOTE =
[email protected]=20
      type=3D"cite"><PRE wrap=3D"">Zuoning,

Hi.  We do a combined crawl of the network using both TCP and UDP to
communicate with ultrapeers.  The cycle is once every hour and the =
active
crawl takes about 50 minutes.  The number does appear to undercount =
other
vendors such as BearShare given that they only support the TCP crawl.

Here is an example of the crawling time for the majority of nodes.  The
total unique nodes is on the left and the incremental time in =
milliseconds
is on the right:

Count: 1        Time: 3047
Count: 50000    Time: 14239
Count: 100000   Time: 11818
Count: 150000   Time: 16553
Count: 200000   Time: 25506
Count: 250000   Time: 28869
Count: 300000   Time: 34274
Count: 350000   Time: 51653
Count: 400000   Time: <B>99632</B>
Count: 450000   Time: 63595
Count: 500000   Time: 81248
Count: 550000   Time: 93576
Count: 600000   Time: 100121
Count: 650000   Time: 106283
Count: 700000   Time: 106316
Count: 750000   Time: 120726
Count: 800000   Time: 132113
Count: 850000   Time: 139076
Count: 900000   Time: <B>191107</B>
Count: 950000   Time: <B>244538</B>
Count: 1000000  Time: 173649
Count: 1050000  Time: 186755
Count: 1100000  Time: 180398
Count: 1150000  Time: 195833
Count: 1200000  Time: 211029
Count: 1250000  Time: <B>361543</B>
Count: 1300000  Time: 320897

Thanks
-greg

  </PRE>
        <BLOCKQUOTE type=3D"cite"><PRE wrap=3D"">-----Original =
Message-----
From: <A class=3Dmoz-txt-link-abbreviated =
href=3D"mailto:[email protected]">discuss-bounces@lists.=
limewire.org</A>
[<A class=3Dmoz-txt-link-freetext =
href=3D"mailto:[email protected]">mailto:discuss-bounces=
@lists.limewire.org</A>]On Behalf Of =D2=FC=D7=F4=C4=FE
Sent: Friday, April 08, 2005 12:44 AM
To: discuss
Subject: [discuss] the live statistics about the current online
host number


Hi All:
	I am interested in the live statistics about the current
online host number on the homepage of Limewire, the number is
enormous. I wonder how do the  statistics come from. I gusess
limewire must have some monitor mechanism, then how long is the
duration of a monitior process, an hour? half an hour?


Best Regards!!

zuoning yin
2005-04-08

Cluster and Grid Computing Lab
School of Computer Science
Huazhong University of Science and Technology
Wuhan, 430074, China
Tel: +86-27-87557047
Fax: +86-27-87557354
Email: <A class=3Dmoz-txt-link-abbreviated =
href=3D"mailto:[email protected]">[email protected]</A>
Homepage:<A class=3Dmoz-txt-link-freetext =
href=3D"http://grid.hust.edu.cn">http://grid.hust.edu.cn</A>



_______________________________________________
discuss mailing list
<A class=3Dmoz-txt-link-abbreviated =
href=3D"mailto:[email protected]">[email protected]</A>=

<A class=3Dmoz-txt-link-freetext =
href=3D"http://www.limewire.org/mailman/listinfo/discuss">http://www.lime=
wire.org/mailman/listinfo/discuss</A>
    </PRE></BLOCKQUOTE><PRE wrap=3D""><!---->

_______________________________________________
discuss mailing list
<A class=3Dmoz-txt-link-abbreviated =
href=3D"mailto:[email protected]">[email protected]</A>=

<A class=3Dmoz-txt-link-freetext =
href=3D"http://www.limewire.org/mailman/listinfo/discuss">http://www.lime=
wire.org/mailman/listinfo/discuss</A>
  =
</PRE></BLOCKQUOTE></BLOCKQUOTE></BLOCKQUOTE></BLOCKQUOTE></BODY></HTML>

------=_NextPart_000_04D1_01C53C5F.B1115530--



--===============1193468366==
Content-Type: text/plain; charset="us-ascii"
MIME-Version: 1.0
Content-Disposition: inline
Content-Transfer-Encoding: 7bit

_______________________________________________
discuss mailing list
[email protected]
http://www.limewire.org/mailman/listinfo/discuss

--===============1193468366==--