Re: torrent sharing
Stu Midgley <[email protected]> Thu, 14 Sep 2017 23:34:07 +0800
| Newsgroups | gmane.network.lftp.user |
|---|---|
| Message-ID | <CAEM1RsX1qneDHAG3NLfJd1+LE5NT32D1602HpiUM0F5uDwUg5w@mail.gmail.com> |
--===============6002524815057955737==
Content-Type: multipart/alternative; boundary="94eb2c05c09c0cc04d055928038f"
--94eb2c05c09c0cc04d055928038f
Content-Type: text/plain; charset="UTF-8"
I'm still struggling to get this working... I think lftp is computing the
same node id for all the nodes?
---- starting search for 7AF61DD571566B9076B64DC85E98483A13731943
---- too few good nodes found in the routing table 1/8
---- search for 7AF61DD571566B9076B64DC85E98483A13731943 continues on
363FFE697351FF4AEC29CDBAABF2FBE3467CC267 ([172.16.250.40]:6881) depth=0
---> sending DHT find_node to [172.16.250.40]:6881 {"a":{"want":["n4",
"n6"], "target":"<binary:7AF61DD571566B9076B64DC85E98483A13731943>",
"id":"<binary:7AF61DD571566B9076B64DC85E98483A13731943>"}, "q":"find_node",
"y":"q", "t":"<binary:7F005F51>"}
<--- received DHT response from [172.16.250.40]:6881 {"r":{"nodes6":"",
"nodes":"<binary:7AF61DD571566B9076B64DC85E98483A13731943AC10FA281AE57AF61DD571566B9076B64DC85E98483A13731943AC10FAB61AE37AF61DD571566B9076B64DC85E98483A13731943AC10FA281AE5>",
"id":"<binary:363FFE697351FF4AEC29CDBAABF2FBE3467CC267>"},
"ip":"<binary:AC10FA281AE5>", "y":"r", "t":"<binary:7F005F51>"}
---- got reply for find_node with target
7AF61DD571566B9076B64DC85E98483A13731943 from node
363FFE697351FF4AEC29CDBAABF2FBE3467CC267
---- search for 7AF61DD571566B9076B64DC85E98483A13731943 goes to depth=1
with best_node_id=363FFE697351FF4AEC29CDBAABF2FBE3467CC267
---- adding 3 nodes
---- node [172.16.250.40]:6885 has our own id
7AF61DD571566B9076B64DC85E98483A13731943
---- node [172.16.250.182]:6883 has our own id
7AF61DD571566B9076B64DC85E98483A13731943
---- node [172.16.250.40]:6885 has our own id
7AF61DD571566B9076B64DC85E98483A13731943
---- adding 0 nodes6
On Thu, Sep 14, 2017 at 10:13 PM, Stu Midgley <[email protected]> wrote:
> What I'm trying to do is use bittorrent for the booting of our cluster (to
> get the 2GB image out to the compute nodes). The idea being that the nodes
> can feed each other parts of the image rather than all of them trying to
> download it from a single (or small number) of servers.
>
> Thanks.
>
> On Thu, Sep 14, 2017 at 10:11 PM, Stu Midgley <[email protected]> wrote:
>
>> That would be great, thanks.
>>
>> On Thu, Sep 14, 2017 at 10:05 PM, Alexander V. Lukyanov <[email protected]>
>> wrote:
>>
>>> On Thu, Sep 14, 2017 at 09:56:19PM +0800, Stu Midgley wrote:
>>> > and of course... their was a similar test in dht-bootstrap .
>>> >
>>> > I have removed both tests and they at least talk to each other.
>>>
>>> I think I'll make a new setting allowing DHT and bittorrent to private
>>> networks (off by default).
>>>
>>> --
>>> Alexander.
>>>
>>> > On Thu, Sep 14, 2017 at 9:48 PM, Stu Midgley <[email protected]> wrote:
>>> >
>>> > > Right... and line 743,1131 in DHT.cc and 575,586 in Torrent.cc
>>> > >
>>> > > I modified the is_private function in network.cc to
>>> > >
>>> > > bool sockaddr_u::is_private() const
>>> > >
>>> > > {
>>> > >
>>> > > if(sa.sa_family==AF_INET)
>>> > >
>>> > > {
>>> > >
>>> > > unsigned char *a=(unsigned char *)&in.sin_addr;
>>> > >
>>> > > return (0==1);
>>> > >
>>> > > }
>>> > >
>>> > > #if INET6
>>> > >
>>> > > if(family()==AF_INET6) {
>>> > >
>>> > > return IN6_IS_ADDR_SITELOCAL(&in6.sin6_addr)
>>> > >
>>> > > || IN6_IS_ADDR_LINKLOCAL(&in6.sin6_addr);
>>> > >
>>> > > }
>>> > >
>>> > > #endif
>>> > >
>>> > > return false;
>>> > >
>>> > > }
>>> > >
>>> > >
>>> > >
>>> > > and it still didn't work.
>>> > >
>>> > >
>>> > > On Thu, Sep 14, 2017 at 9:25 PM, Alexander V. Lukyanov <[email protected]
>>> >
>>> > > wrote:
>>> > >
>>> > >> On Thu, Sep 14, 2017 at 09:12:40PM +0800, Stu Midgley wrote:
>>> > >> > Thanks for the quick response.
>>> > >> >
>>> > >> > I started the bootstrap-dht and the lftp client and server on the
>>> single
>>> > >> > machine (172.16.250.40) which is a machine without external
>>> access to
>>> > >> the
>>> > >> > internet (hence why I want to run my own dht bootstrap service.
>>> > >> ...
>>> > >> > I don't see lftp contacting the bootstrap service.
>>> > >>
>>> > >> It appears that lftp refuses to talk DHT to private IP addresses
>>> (see
>>> > >> DHT.cc:296). I don't know if that's correct, but I was thinking
>>> about
>>> > >> security of private networks when I coded this.
>>> > >>
>>> > >> --
>>> > >> Alexander.
>>> > >>
>>> > >
>>> > >
>>> > >
>>> > > --
>>> > > Dr Stuart Midgley
>>> > > [email protected]
>>> > >
>>> >
>>> >
>>> >
>>> > --
>>> > Dr Stuart Midgley
>>> > [email protected]
>>>
>>> > _______________________________________________
>>> > lftp mailing list
>>> > [email protected]
>>> > http://univ.uniyar.ac.ru/mailman/listinfo/lftp
>>>
>>
>>
>>
>> --
>> Dr Stuart Midgley
>> [email protected]
>>
>
>
>
> --
> Dr Stuart Midgley
> [email protected]
>
--
Dr Stuart Midgley
[email protected]
--94eb2c05c09c0cc04d055928038f
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable
<div dir=3D"ltr"><div class=3D"gmail_default" style=3D"font-family:monospac=
e,monospace">I'm still struggling to get this working...=C2=A0 I think =
lftp is computing the same node id for all the nodes?</div><div class=3D"gm=
ail_default" style=3D"font-family:monospace,monospace"><br></div><div class=
=3D"gmail_default" style=3D"font-family:monospace,monospace"><p style=3D"ma=
rgin:0px;font-size:11px;line-height:normal;font-family:Menlo;color:rgb(0,0,=
0)"><span style=3D"font-variant-ligatures:no-common-ligatures">---- startin=
g search for 7AF61DD571566B9076B64DC85E98483A13731943</span></p>
<p style=3D"margin:0px;font-size:11px;line-height:normal;font-family:Menlo;=
color:rgb(0,0,0)"><span style=3D"font-variant-ligatures:no-common-ligatures=
">---- too few good nodes found in the routing table 1/8</span></p>
<p style=3D"margin:0px;font-size:11px;line-height:normal;font-family:Menlo;=
color:rgb(0,0,0)"><span style=3D"font-variant-ligatures:no-common-ligatures=
">---- search for 7AF61DD571566B9076B64DC85E98483A13731943 continues on 363=
FFE697351FF4AEC29CDBAABF2FBE3467CC267 ([172.16.250.40]:6881) depth=3D0</spa=
n></p>
<p style=3D"margin:0px;font-size:11px;line-height:normal;font-family:Menlo;=
color:rgb(0,0,0)"><span style=3D"font-variant-ligatures:no-common-ligatures=
">---> sending DHT find_node to [172.16.250.40]:6881 {"a":{&qu=
ot;want":["n4", "n6"], "target":"&l=
t;binary:7AF61DD571566B9076B64DC85E98483A13731943>", "id"=
:"<binary:7AF61DD571566B9076B64DC85E98483A13731943>"}, &quo=
t;q":"find_node", "y":"q", "t"=
:"<binary:7F005F51>"}</span></p>
<p style=3D"margin:0px;font-size:11px;line-height:normal;font-family:Menlo;=
color:rgb(0,0,0)"><span style=3D"font-variant-ligatures:no-common-ligatures=
"><--- received DHT response from [172.16.250.40]:6881 {"r":{&=
quot;nodes6":"", "nodes":"<binary:7AF61DD5=
71566B9076B64DC85E98483A13731943AC10FA281AE57AF61DD571566B9076B64DC85E98483=
A13731943AC10FAB61AE37AF61DD571566B9076B64DC85E98483A13731943AC10FA281AE5&g=
t;", "id":"<binary:363FFE697351FF4AEC29CDBAABF2FBE34=
67CC267>"}, "ip":"<binary:AC10FA281AE5>",=
"y":"r", "t":"<binary:7F005F51>&q=
uot;}</span></p>
<p style=3D"margin:0px;font-size:11px;line-height:normal;font-family:Menlo;=
color:rgb(0,0,0)"><span style=3D"font-variant-ligatures:no-common-ligatures=
">---- got reply for find_node with target 7AF61DD571566B9076B64DC85E98483A=
13731943 from node 363FFE697351FF4AEC29CDBAABF2FBE3467CC267</span></p>
<p style=3D"margin:0px;font-size:11px;line-height:normal;font-family:Menlo;=
color:rgb(0,0,0)"><span style=3D"font-variant-ligatures:no-common-ligatures=
">---- search for 7AF61DD571566B9076B64DC85E98483A13731943 goes to depth=3D=
1 with best_node_id=3D363FFE697351FF4AEC29CDBAABF2FBE3467CC267</span></p>
<p style=3D"margin:0px;font-size:11px;line-height:normal;font-family:Menlo;=
color:rgb(0,0,0)"><span style=3D"font-variant-ligatures:no-common-ligatures=
">---- adding 3 nodes</span></p>
<p style=3D"margin:0px;font-size:11px;line-height:normal;font-family:Menlo;=
color:rgb(0,0,0)"><span style=3D"font-variant-ligatures:no-common-ligatures=
">---- node [172.16.250.40]:6885 has our own id 7AF61DD571566B9076B64DC85E9=
8483A13731943</span></p>
<p style=3D"margin:0px;font-size:11px;line-height:normal;font-family:Menlo;=
color:rgb(0,0,0)"><span style=3D"font-variant-ligatures:no-common-ligatures=
">---- node [172.16.250.182]:6883 has our own id 7AF61DD571566B9076B64DC85E=
98483A13731943</span></p>
<p style=3D"margin:0px;font-size:11px;line-height:normal;font-family:Menlo;=
color:rgb(0,0,0)"><span style=3D"font-variant-ligatures:no-common-ligatures=
">---- node [172.16.250.40]:6885 has our own id 7AF61DD571566B9076B64DC85E9=
8483A13731943</span></p>
<p style=3D"margin:0px;font-size:11px;line-height:normal;font-family:Menlo;=
color:rgb(0,0,0)"><span style=3D"font-variant-ligatures:no-common-ligatures=
">---- adding 0 nodes6</span></p><div><span style=3D"font-variant-ligatures=
:no-common-ligatures"><br></span></div><div><span style=3D"font-variant-lig=
atures:no-common-ligatures"><br></span></div><div><br></div></div></div><di=
v class=3D"gmail_extra"><br><div class=3D"gmail_quote">On Thu, Sep 14, 2017=
at 10:13 PM, Stu Midgley <span dir=3D"ltr"><<a href=3D"mailto:sdm900@gm=
ail.com" target=3D"_blank">[email protected]</a>></span> wrote:<br><block=
quote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1px #ccc=
solid;padding-left:1ex"><div dir=3D"ltr"><div class=3D"gmail_default" styl=
e=3D"font-family:monospace,monospace">What I'm trying to do is use bitt=
orrent for the booting of our cluster (to get the 2GB image out to the comp=
ute nodes).=C2=A0 The idea being that the nodes can feed each other parts o=
f the image rather than all of them trying to download it from a single (or=
small number) of servers.</div><div class=3D"gmail_default" style=3D"font-=
family:monospace,monospace"><br></div><div class=3D"gmail_default" style=3D=
"font-family:monospace,monospace">Thanks.</div></div><div class=3D"HOEnZb">=
<div class=3D"h5"><div class=3D"gmail_extra"><br><div class=3D"gmail_quote"=
>On Thu, Sep 14, 2017 at 10:11 PM, Stu Midgley <span dir=3D"ltr"><<a hre=
f=3D"mailto:[email protected]" target=3D"_blank">[email protected]</a>></s=
pan> wrote:<br><blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex=
;border-left:1px #ccc solid;padding-left:1ex"><div dir=3D"ltr"><div class=
=3D"gmail_default" style=3D"font-family:monospace,monospace">That would be =
great, thanks.</div></div><div class=3D"m_6858328802857731722HOEnZb"><div c=
lass=3D"m_6858328802857731722h5"><div class=3D"gmail_extra"><br><div class=
=3D"gmail_quote">On Thu, Sep 14, 2017 at 10:05 PM, Alexander V. Lukyanov <s=
pan dir=3D"ltr"><<a href=3D"mailto:[email protected]" target=3D"_blank">lav@n=
etis.ru</a>></span> wrote:<br><blockquote class=3D"gmail_quote" style=3D=
"margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><span>On Th=
u, Sep 14, 2017 at 09:56:19PM +0800, Stu Midgley wrote:<br>
> and of course... their was a similar test in dht-bootstrap .<br>
><br>
> I have removed both tests and they at least talk to each other.<br>
<br>
</span>I think I'll make a new setting allowing DHT and bittorrent to p=
rivate<br>
networks (off by default).<br>
<br>
--<br>
=C2=A0 =C2=A0Alexander.<br>
<div><div class=3D"m_6858328802857731722m_1817870852929177599h5"><br>
> On Thu, Sep 14, 2017 at 9:48 PM, Stu Midgley <<a href=3D"mailto:sdm=
[email protected]" target=3D"_blank">[email protected]</a>> wrote:<br>
><br>
> > Right... and line 743,1131 in DHT.cc and 575,586 in Torrent.cc<br=
>
> ><br>
> > I modified the is_private function in network.cc to<br>
> ><br>
> > bool sockaddr_u::is_private() const<br>
> ><br>
> > {<br>
> ><br>
> >=C2=A0 =C2=A0 if(sa.sa_family=3D=3DAF_INET)<br>
> ><br>
> >=C2=A0 =C2=A0 {<br>
> ><br>
> >=C2=A0 =C2=A0 =C2=A0 =C2=A0unsigned char *a=3D(unsigned char *)&am=
p;in.sin_addr;<br>
> ><br>
> >=C2=A0 =C2=A0 =C2=A0 =C2=A0return (0=3D=3D1);<br>
> ><br>
> >=C2=A0 =C2=A0 }<br>
> ><br>
> > #if INET6<br>
> ><br>
> >=C2=A0 =C2=A0 if(family()=3D=3DAF_INET6) {<br>
> ><br>
> >=C2=A0 =C2=A0 =C2=A0 =C2=A0return IN6_IS_ADDR_SITELOCAL(&in6.s=
in<wbr>6_addr)<br>
> ><br>
> >=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0|| IN6_IS_ADDR_LINKLOCAL(=
&in6.sin<wbr>6_addr);<br>
> ><br>
> >=C2=A0 =C2=A0 }<br>
> ><br>
> > #endif<br>
> ><br>
> >=C2=A0 =C2=A0 return false;<br>
> ><br>
> > }<br>
> ><br>
> ><br>
> ><br>
> > and it still didn't work.<br>
> ><br>
> ><br>
> > On Thu, Sep 14, 2017 at 9:25 PM, Alexander V. Lukyanov <<a hre=
f=3D"mailto:[email protected]" target=3D"_blank">[email protected]</a>><br>
> > wrote:<br>
> ><br>
> >> On Thu, Sep 14, 2017 at 09:12:40PM +0800, Stu Midgley wrote:<=
br>
> >> > Thanks for the quick response.<br>
> >> ><br>
> >> > I started the bootstrap-dht and the lftp client and serv=
er on the single<br>
> >> > machine (172.16.250.40) which is a machine without exter=
nal access to<br>
> >> the<br>
> >> > internet (hence why I want to run my own dht bootstrap s=
ervice.<br>
> >> ...<br>
> >> > I don't see lftp contacting the bootstrap service.<b=
r>
> >><br>
> >> It appears that lftp refuses to talk DHT to private IP addres=
ses (see<br>
> >> DHT.cc:296). I don't know if that's correct, but I wa=
s thinking about<br>
> >> security of private networks when I coded this.<br>
> >><br>
> >> --<br>
> >>=C2=A0 =C2=A0 Alexander.<br>
> >><br>
> ><br>
> ><br>
> ><br>
> > --<br>
> > Dr Stuart Midgley<br>
> > <a href=3D"mailto:[email protected]" target=3D"_blank">sdm900@gmai=
l.com</a><br>
> ><br>
><br>
><br>
><br>
> --<br>
> Dr Stuart Midgley<br>
> <a href=3D"mailto:[email protected]" target=3D"_blank">[email protected]=
</a><br>
<br>
</div></div>> ______________________________<wbr>_________________<br>
> lftp mailing list<br>
> <a href=3D"mailto:[email protected]" target=3D"_blank">[email protected].=
ru</a><br>
> <a href=3D"http://univ.uniyar.ac.ru/mailman/listinfo/lftp" rel=3D"nore=
ferrer" target=3D"_blank">http://univ.uniyar.ac.ru/mailm<wbr>an/listinfo/lf=
tp</a><br>
</blockquote></div><br><br clear=3D"all"><div><br></div>-- <br><div class=
=3D"m_6858328802857731722m_1817870852929177599gmail_signature" data-smartma=
il=3D"gmail_signature"><div dir=3D"ltr"><div><font face=3D"monospace, monos=
pace">Dr Stuart Midgley<br><a href=3D"mailto:[email protected]" target=3D"_b=
lank">[email protected]</a></font></div></div></div>
</div>
</div></div></blockquote></div><br><br clear=3D"all"><div><br></div>-- <br>=
<div class=3D"m_6858328802857731722gmail_signature" data-smartmail=3D"gmail=
_signature"><div dir=3D"ltr"><div><font face=3D"monospace, monospace">Dr St=
uart Midgley<br><a href=3D"mailto:[email protected]" target=3D"_blank">sdm90=
[email protected]</a></font></div></div></div>
</div>
</div></div></blockquote></div><br><br clear=3D"all"><div><br></div>-- <br>=
<div class=3D"gmail_signature" data-smartmail=3D"gmail_signature"><div dir=
=3D"ltr"><div><font face=3D"monospace, monospace">Dr Stuart Midgley<br><a h=
ref=3D"mailto:[email protected]" target=3D"_blank">[email protected]</a></fon=
t></div></div></div>
</div>
--94eb2c05c09c0cc04d055928038f--
--===============6002524815057955737==
Content-Type: text/plain; charset="us-ascii"
MIME-Version: 1.0
Content-Transfer-Encoding: 7bit
Content-Disposition: inline
_______________________________________________
lftp mailing list
[email protected]
http://univ.uniyar.ac.ru/mailman/listinfo/lftp
--===============6002524815057955737==--