Re: [FreeGeoCZ] velké bodové datasety na webu (TWK B, PBF)

Ha Noj <[email protected]> Fri, 7 Jul 2017 21:48:04 +0200
Newsgroups	gmane.comp.gis.grass.cz
Message-ID	<CANKDr1LHG6ENsrWERWrJrPuYzj6je+3xJjiwyfYPrDg6=N_PhA@mail.gmail.com>
--===============1904395801==
Content-Type: multipart/alternative; boundary="001a114222c40656280553bf83aa"

--001a114222c40656280553bf83aa
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

D=C3=ADky za rady,

1) GPKG jsem zkusil n=C4=9Bjak=C3=A1 =C3=BAspora ve velikosti souboru proti=
 TopoJSON je,
ale zase =C4=8Dasov=C3=A1 ztr=C3=A1ta p=C5=99i dek=C3=B3dov=C3=A1n=C3=AD. A=
 OpenLayers to nacpe zase do pam=C4=9Bti
roze=C5=BEran=C3=A9ho GeoJSON  [1]

2) Zkusil jsem tippecanoe  + tileserver.php [2, 3] co=C5=BE skon=C4=8Dilo "=
Error:
Unimplemented type: 3", v=C3=BDklad je pom=C4=9Brn=C4=9B =C5=A1irok=C3=BD.

3) P=C5=99=C3=ADmo =C4=8D=C3=ADst maptiles um=C3=AD leaflet, ale jen pokud =
jde o rastrov=C3=A1(?) data.
[4]

4) samotn=C3=A9 bin=C3=A1rn=C3=AD PBF se mi poda=C5=99ilo vytvo=C5=99it, al=
e jen pro p=C5=99ilo=C5=BEen=C3=BD
p=C5=99=C3=ADklad, moje data p=C5=99eveden=C3=A1 do pbf u=C5=BE na=C4=8D=C3=
=ADst ne=C5=A1la s chybou "Error:
Expected varint not more than 10 bytes  pbf-dev.js:268:15". [5][6]

5) tedy jsem skon=C4=8Dil zp=C3=A1tky u TopoJSON a Openlayers, kde to s pom=
oc=C3=AD
ol.Cluster jak=C5=BE tak=C5=BE chod=C3=AD:

http://nakole.templ.net/prestupkyMPB-dopravni.htm
<http://nakole.templ.net/prestupky2016MPB.htm>


zdrav=C3=AD Dan B=C3=A1rta


[1] http://ngageoint.github.io/geopackage-js/
[2] https://github.com/mapbox/tippecanoe
[3] https://github.com/klokantech/tileserver-php
[4] https://gitlab.com/IvanSanchez/Leaflet.TileLayer.MBTiles/tree/master
[5] https://github.com/mapbox/pygeobuf
[6] https://bl.ocks.org/mofoyoda/da963a75a3bb8c9437a6

Dne 3. =C4=8Dervence 2017 10:29 Jachym Cepicky <[email protected]>
napsal(a):

> Nadla=C5=BEdicovat
>
> https://github.com/mapbox/tippecanoe
>
>
> po 3. 7. 2017 v 10:03 odes=C3=ADlatel Vojta Dubrovsky <[email protected]>
> napsal:
>
>> Ahoj,
>>
>> =C5=99e=C5=A1il jsem n=C4=9Bco podobn=C3=A9ho. Nyn=C3=AD zobrazuji =E2=
=80=9Cpouze=E2=80=9D 10k bod=C5=AF, ale d=C3=A1 se to
>> pou=C5=BE=C3=ADt jako usecase.
>>
>> http://vdubr.github.io/water_moldavia/
>>
>> Pou=C5=BEil jsem TopoJSON s p=C5=99esnost=C3=AD na metry. V gzipu to d=
=C4=9Bl=C3=A1 80KB.
>> Atribotov=C3=A1 data jsem vy=C4=8Dlenil od geometrie a stahuj=C3=AD se z=
e slo=C5=BEky podle ID
>> a=C5=BE p=C5=99i prokliku. M=C3=A1m tam p=C5=99ipraveny i offline filtro=
v=C3=A1n=C3=AD.
>>
>> Koukni do dev konzole na =C4=8Dasy, ale mysl=C3=ADm =C5=BEe i 100k bod=
=C5=AF by bylo st=C3=A1le
>> pro u=C5=BEivatele snesiteln=C3=BDch.
>>
>> Kdo si vy=C5=BE=C3=ADv=C3=A1 v Moldav=C5=A1tin=C4=9B, tak si m=C5=AF=C5=
=BEe po=C4=8D=C3=ADst.
>>
>> ------
>>
>> Vojt=C4=9Bch Dubrovsk=C3=BD
>>
>> m:  +420 608 075 163 <608%20075%20163>
>> e:   [email protected]
>> t: @vdubr
>> ln: https://cz.linkedin.com/in/vojtechdubrovsky
>>
>> On 30 Jun 2017, at 17:00, Ha Noj <[email protected]> wrote:
>>
>> Ahoj,
>>
>> cht=C4=9Bl bych publikovat na webu v n=C4=9B=C4=8Dem jako Openlayers bez=
 u=C5=BEit=C3=AD serveru
>> dataset o 100.000 bodech, optim=C3=A1ln=C4=9B i s n=C4=9Bjak=C3=BDmi atr=
ibuty, ale lze to
>> ud=C4=9Blat i bez atribut=C5=AF.
>> M=C3=A1te n=C4=9Bjakou praktickou zku=C5=A1enost?
>>
>> 1) GeoJSON 32 MB/zip 3 MB/RAM 390 MB (zip za p=C5=99edpokladu, =C5=BEe w=
eb server
>> se s klientem dohodnou na sta=C5=BEen=C3=AD v Gzip - zd=C3=A1 se mi, =C5=
=BEe tomu tak nen=C3=AD
>> v=C5=BEdy), pokud odstran=C3=ADm v=C5=A1echny atributy tak 11 MB/zip 0,7=
 MB/ RAM 350 MB.
>> *** klasika, ale velk=C3=BD a pomal=C3=BD...
>>
>> 2) TopoJSON 26 MB/zip 3 MB
>> *** pro body to nem=C3=A1 moc v=C3=BDznam
>>
>> 3) TWKB [1]
>> *** zaj=C3=ADmav=C3=BD! RAM 9 MB na 100.000 bod=C5=AF, ale nepochopil ja=
k se vytv=C3=A1=C5=99=C3=AD
>> soubory twkb? Z=C3=ADskat samotnou geometrii je v psql jednoduch=C3=A9, =
jak ale
>> vytvo=C5=99it korektn=C3=AD bin=C3=A1rn=C3=AD soubor?
>> psql -c "SELECT ST_AsTWKB('POINT(16 49)'::geometry);"
>>
>> 4) Geobuf PBF [2]
>> *** op=C4=9Bt zaj=C3=ADmav=C3=BD, ale =C5=BE=C3=A1dn=C3=BDm z n=C3=A1str=
oj=C5=AF se mi nepoda=C5=99ilo vytvo=C5=99it
>> pot=C5=99ebn=C3=BD PBF soubor, v=C5=BEdy to kon=C4=8D=C3=AD p=C3=A1dem p=
=C5=99ev=C3=A1d=C4=9Bc=C3=ADho n=C3=A1stroje [3].
>>
>> 5) N=C4=9Bco jin=C3=A9ho jinak? =C3=9Apln=C4=9B jinak?
>>
>> zdrav=C3=AD
>>  Dan B=C3=A1rta
>>
>> [1] https://dev.camptocamp.com/files/ol3/webgl/examples/webgl-points.htm=
l
>> [2] https://github.com/mapbox/geobuf#install
>> [3] https://stackoverflow.com/questions/35393903/geojson-
>> encoding-for-using-in-leaflet-js
>>
>> _______________________________________________
>> FreeGeoCZ mailing list
>> [email protected]
>> http://mailman.fsv.cvut.cz/mailman/listinfo/freegeocz
>>
>>
>> _______________________________________________
>> FreeGeoCZ mailing list
>> [email protected]
>> http://mailman.fsv.cvut.cz/mailman/listinfo/freegeocz
>>
>
> _______________________________________________
> FreeGeoCZ mailing list
> [email protected]
> http://mailman.fsv.cvut.cz/mailman/listinfo/freegeocz
>
>

--001a114222c40656280553bf83aa
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr"><div><div>D=C3=ADky za rady,<br><br></div>1) GPKG jsem zku=
sil n=C4=9Bjak=C3=A1 =C3=BAspora ve velikosti souboru proti TopoJSON je, al=
e zase =C4=8Dasov=C3=A1 ztr=C3=A1ta p=C5=99i dek=C3=B3dov=C3=A1n=C3=AD. A O=
penLayers to nacpe zase do pam=C4=9Bti roze=C5=BEran=C3=A9ho GeoJSON=C2=A0 =
[1]<br><br>2) Zkusil jsem tippecanoe=C2=A0 + tileserver.php [2, 3] co=C5=BE=
 skon=C4=8Dilo &quot;Error: Unimplemented type: 3&quot;, v=C3=BDklad je pom=
=C4=9Brn=C4=9B =C5=A1irok=C3=BD. <br><br>3) P=C5=99=C3=ADmo =C4=8D=C3=ADst =
maptiles um=C3=AD leaflet, ale jen pokud jde o rastrov=C3=A1(?) data. [4]<b=
r><br></div><div>4) samotn=C3=A9 bin=C3=A1rn=C3=AD PBF se mi poda=C5=99ilo =
vytvo=C5=99it, ale jen pro p=C5=99ilo=C5=BEen=C3=BD p=C5=99=C3=ADklad, moje=
 data p=C5=99eveden=C3=A1 do pbf u=C5=BE na=C4=8D=C3=ADst ne=C5=A1la s chyb=
ou &quot;Error: Expected varint not more than 10 bytes=C2=A0 pbf-dev.js:268=
:15&quot;. [5][6]<br></div><div><br></div>5) tedy jsem skon=C4=8Dil zp=C3=
=A1tky u TopoJSON a Openlayers, kde to s pomoc=C3=AD ol.Cluster jak=C5=BE t=
ak=C5=BE chod=C3=AD:<br><div><br><a href=3D"http://nakole.templ.net/prestup=
ky2016MPB.htm" target=3D"_blank">http://nakole.templ.net/<wbr>prestupkyMPB-=
dopravni.htm</a><br><br><br></div><div>zdrav=C3=AD Dan B=C3=A1rta<br></div>=
<div><br><br>[1] <a href=3D"http://ngageoint.github.io/geopackage-js/" targ=
et=3D"_blank">http://ngageoint.github.io/geo<wbr>package-js/</a><br>[2] <a =
href=3D"https://github.com/mapbox/" target=3D"_blank">https://github.com/ma=
pbox/</a>tipp<wbr>ecanoe<br>[3] <a href=3D"https://github.com/klokantech/ti=
leserver-php" target=3D"_blank">https://github.com/klokantech/<wbr>tileserv=
er-php</a><br>[4] <a href=3D"https://gitlab.com/IvanSanchez/Leaflet.TileLay=
er.MBTiles/tree/master" target=3D"_blank">https://gitlab.com/IvanSanchez<wb=
r>/Leaflet.TileLayer.MBTiles/<wbr>tree/master</a><br>[5] <a href=3D"https:/=
/github.com/mapbox/pygeobuf" target=3D"_blank">https://github.com/mapbox/py=
ge<wbr>obuf</a><br>[6] <a href=3D"https://bl.ocks.org/mofoyoda/da963a75a3bb=
8c9437a6" target=3D"_blank">https://bl.ocks.org/mofoyoda/<wbr>da963a75a3bb8=
c9437a6</a><br></div></div><div class=3D"gmail_extra"><br><div class=3D"gma=
il_quote">Dne 3. =C4=8Dervence 2017 10:29 Jachym Cepicky <span dir=3D"ltr">=
&lt;<a href=3D"mailto:[email protected]" target=3D"_blank">jachym.ce=
[email protected]</a>&gt;</span> napsal(a):<br><blockquote class=3D"gmail_quo=
te" style=3D"margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"=
><div dir=3D"ltr">Nadla=C5=BEdicovat<div><br></div><div><a href=3D"https://=
github.com/mapbox/tippecanoe" target=3D"_blank">https://github.com/mapbox/<=
wbr>tippecanoe</a><br></div><div><br></div></div><br><div class=3D"gmail_qu=
ote"><div dir=3D"ltr">po 3. 7. 2017 v 10:03 odes=C3=ADlatel Vojta Dubrovsky=
 &lt;<a href=3D"mailto:[email protected]" target=3D"_blank">[email protected]=
</a>&gt; napsal:<br></div><div><div class=3D"h5"><blockquote class=3D"gmail=
_quote" style=3D"margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:=
1ex"><div style=3D"word-wrap:break-word">Ahoj,<div><br></div><div>=C5=99e=
=C5=A1il jsem n=C4=9Bco podobn=C3=A9ho. Nyn=C3=AD zobrazuji =E2=80=9Cpouze=
=E2=80=9D 10k bod=C5=AF, ale d=C3=A1 se to pou=C5=BE=C3=ADt jako usecase.</=
div><div><br></div><div><a href=3D"http://vdubr.github.io/water_moldavia/" =
target=3D"_blank">http://vdubr.github.io/water_<wbr>moldavia/</a></div><div=
><br></div><div>Pou=C5=BEil jsem TopoJSON s p=C5=99esnost=C3=AD na metry. V=
 gzipu to d=C4=9Bl=C3=A1 80KB. Atribotov=C3=A1 data jsem vy=C4=8Dlenil od g=
eometrie a stahuj=C3=AD se ze slo=C5=BEky podle ID a=C5=BE p=C5=99i proklik=
u. M=C3=A1m tam p=C5=99ipraveny i offline filtrov=C3=A1n=C3=AD.=C2=A0</div>=
<div><br></div><div>Koukni do dev konzole na =C4=8Dasy, ale mysl=C3=ADm =C5=
=BEe i 100k bod=C5=AF by bylo st=C3=A1le pro u=C5=BEivatele snesiteln=C3=BD=
ch.</div><div><br></div><div>Kdo si vy=C5=BE=C3=ADv=C3=A1 v Moldav=C5=A1tin=
=C4=9B, tak si m=C5=AF=C5=BEe po=C4=8D=C3=ADst.</div><div><br><div>
<div style=3D"word-wrap:break-word"><div style=3D"color:rgb(0,0,0);font-fam=
ily:Helvetica;font-size:12px;font-style:normal;font-variant-caps:normal;fon=
t-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text=
-transform:none;white-space:normal;word-spacing:0px">------=C2=A0<br><br>Vo=
jt=C4=9Bch Dubrovsk=C3=BD<br><br>m:=C2=A0<span class=3D"m_-7586453549681580=
528m_3396100065647067193Apple-tab-span" style=3D"white-space:pre-wrap">		</=
span><a href=3D"tel:608%20075%20163" value=3D"+420608075163" target=3D"_bla=
nk">+420 608 075 163</a><br>e: =C2=A0<span class=3D"m_-7586453549681580528m=
_3396100065647067193Apple-tab-span" style=3D"white-space:pre-wrap">		</span=
><a href=3D"mailto:[email protected]" target=3D"_blank">[email protected]</a>=
<br>t:<span class=3D"m_-7586453549681580528m_3396100065647067193Apple-tab-s=
pan" style=3D"white-space:pre-wrap">		</span>@vdubr</div><div style=3D"colo=
r:rgb(0,0,0);font-family:Helvetica;font-size:12px;font-style:normal;font-va=
riant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start=
;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">l=
n:<span class=3D"m_-7586453549681580528m_3396100065647067193Apple-tab-span"=
 style=3D"white-space:pre-wrap">		</span><a href=3D"https://cz.linkedin.com=
/in/vojtechdubrovsky" target=3D"_blank">https://cz.linkedin.com/in/<wbr>voj=
techdubrovsky</a></div></div>
</div></div></div><div style=3D"word-wrap:break-word"><div>

<br><div><blockquote type=3D"cite"><div>On 30 Jun 2017, at 17:00, Ha Noj &l=
t;<a href=3D"mailto:[email protected]" target=3D"_blank">[email protected]</a=
>&gt; wrote:</div><br class=3D"m_-7586453549681580528m_3396100065647067193A=
pple-interchange-newline"><div><div dir=3D"ltr"><div><div><div><div><div>Ah=
oj,<br></div><br>cht=C4=9Bl bych publikovat na webu v n=C4=9B=C4=8Dem jako =
Openlayers bez u=C5=BEit=C3=AD serveru dataset o 100.000 bodech, optim=C3=
=A1ln=C4=9B i s n=C4=9Bjak=C3=BDmi atributy, ale lze to ud=C4=9Blat i bez a=
tribut=C5=AF.<br></div><div>M=C3=A1te n=C4=9Bjakou praktickou zku=C5=A1enos=
t?<br></div><div><br></div>1) GeoJSON 32 MB/zip 3 MB/RAM 390 MB (zip za p=
=C5=99edpokladu, =C5=BEe web server se s klientem dohodnou na sta=C5=BEen=
=C3=AD v Gzip - zd=C3=A1 se mi, =C5=BEe tomu tak nen=C3=AD v=C5=BEdy), poku=
d odstran=C3=ADm v=C5=A1echny atributy tak 11 MB/zip 0,7 MB/ RAM 350 MB.<br=
></div><div>*** klasika, ale velk=C3=BD a pomal=C3=BD...<br></div><div><br>=
</div>2) TopoJSON 26 MB/zip 3 MB<br></div><div>*** pro body to nem=C3=A1 mo=
c v=C3=BDznam<br></div><div><br></div>3) TWKB [1]<br></div><div>*** zaj=C3=
=ADmav=C3=BD! RAM 9 MB na 100.000 bod=C5=AF, ale nepochopil jak se vytv=C3=
=A1=C5=99=C3=AD soubory twkb? Z=C3=ADskat samotnou geometrii je v psql jedn=
oduch=C3=A9, jak ale vytvo=C5=99it korektn=C3=AD bin=C3=A1rn=C3=AD soubor?<=
br></div><div>psql -c &quot;SELECT ST_AsTWKB(&#39;POINT(16 49)&#39;::geomet=
ry);&quot; <span class=3D"m_-7586453549681580528m_3396100065647067193m_2432=
755989386533772gmail-"><br><br></span></div>4) Geobuf PBF [2]<br><div>*** o=
p=C4=9Bt zaj=C3=ADmav=C3=BD, ale =C5=BE=C3=A1dn=C3=BDm z n=C3=A1stroj=C5=AF=
 se mi nepoda=C5=99ilo vytvo=C5=99it pot=C5=99ebn=C3=BD PBF soubor, v=C5=BE=
dy to kon=C4=8D=C3=AD p=C3=A1dem p=C5=99ev=C3=A1d=C4=9Bc=C3=ADho n=C3=A1str=
oje [3].<br><br></div><div>5) N=C4=9Bco jin=C3=A9ho jinak? =C3=9Apln=C4=9B =
jinak?<br></div><div><br>zdrav=C3=AD<br>=C2=A0Dan B=C3=A1rta<br><br>[1] <a =
href=3D"https://dev.camptocamp.com/files/ol3/webgl/examples/webgl-points.ht=
ml" target=3D"_blank">https://dev.camptocamp.com/<wbr>files/ol3/webgl/examp=
les/<wbr>webgl-points.html</a><br>[2] <a href=3D"https://github.com/mapbox/=
geobuf#install" target=3D"_blank">https://github.com/mapbox/<wbr>geobuf#ins=
tall</a><br>[3] <a href=3D"https://stackoverflow.com/questions/35393903/geo=
json-encoding-for-using-in-leaflet-js" target=3D"_blank">https://stackoverf=
low.com/<wbr>questions/35393903/geojson-<wbr>encoding-for-using-in-leaflet-=
<wbr>js</a><br><br></div></div>
______________________________<wbr>_________________<br>FreeGeoCZ mailing l=
ist<br><a href=3D"mailto:[email protected]" target=3D"_blank">FreeGeoCZ=
@fsv.cvut.cz</a><br><a href=3D"http://mailman.fsv.cvut.cz/mailman/listinfo/=
freegeocz" target=3D"_blank">http://mailman.fsv.cvut.cz/<wbr>mailman/listin=
fo/freegeocz</a><br></div></blockquote></div><br></div></div>______________=
________________<wbr>_________________<br>
FreeGeoCZ mailing list<br>
<a href=3D"mailto:[email protected]" target=3D"_blank">[email protected]=
ut.cz</a><br>
<a href=3D"http://mailman.fsv.cvut.cz/mailman/listinfo/freegeocz" rel=3D"no=
referrer" target=3D"_blank">http://mailman.fsv.cvut.cz/<wbr>mailman/listinf=
o/freegeocz</a><br>
</blockquote></div></div></div>
<br>______________________________<wbr>_________________<br>
FreeGeoCZ mailing list<br>
<a href=3D"mailto:[email protected]">[email protected]</a><br>
<a href=3D"http://mailman.fsv.cvut.cz/mailman/listinfo/freegeocz" rel=3D"no=
referrer" target=3D"_blank">http://mailman.fsv.cvut.cz/<wbr>mailman/listinf=
o/freegeocz</a><br>
<br></blockquote></div><br></div>

--001a114222c40656280553bf83aa--

--===============1904395801==
Content-Type: text/plain; charset="iso-8859-2"
MIME-Version: 1.0
Content-Transfer-Encoding: quoted-printable
Content-Disposition: inline

_______________________________________________
FreeGeoCZ mailing list
[email protected]
http://mailman.fsv.cvut.cz/mailman/listinfo/freegeocz

--===============1904395801==--