MapCache clusters
Sebastiano Laini <[email protected]> Mon, 18 Nov 2019 15:47:10 +0000
| Newsgroups | gmane.comp.gis.mapserver.user |
|---|---|
| Message-ID | <832135f0016547ca8542dd294f82b574@BCExchange.BuchananComputing.co.uk> |
--===============3433880940228732176==
Content-Language: en-US
Content-Type: multipart/alternative;
boundary="_000_832135f0016547ca8542dd294f82b574BCExchangeBuchananCompu_"
--_000_832135f0016547ca8542dd294f82b574BCExchangeBuchananCompu_
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
Hi All,
I was wondering if is possible to dockerise my server and then use multiple=
cluster to seed the cache? I know I can use multiple processes with the -n=
and -p flag though I'm wondering there is a limit on how much you can real=
ly increase those number.
E.g. I dockerise the server and I spawn a 8core VM with 16GB ram, I can use=
sure -p 8 or maybe 10 but still I think that will require like 60 days to =
seed the whole UK with our data, can I spawn another machine and speed up t=
he process? For example another 8core VM.
We have 4 caches with different style that are updated twice a year so if i=
t takes me 60 days for each by the time I finish it's already time to start=
again.
I was wondering maybe I can run multiple VM and seed one or maybe 2 levels =
on each VM or if I spawn a new VM the original process will take advantage =
of the new VM?
In a VM I'm going to have MapServer and MapCache and I will use a subdomain=
under a load balancer just to seed while the domain will be use just for t=
he seeded cache and in the same way will be under a load balancer.
Regards,
Sebastiano Laini
Web Developer
Buchanan Computing
--_000_832135f0016547ca8542dd294f82b574BCExchangeBuchananCompu_
Content-Type: text/html; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
<html xmlns:v=3D"urn:schemas-microsoft-com:vml" xmlns:o=3D"urn:schemas-micr=
osoft-com:office:office" xmlns:w=3D"urn:schemas-microsoft-com:office:word" =
xmlns:m=3D"http://schemas.microsoft.com/office/2004/12/omml" xmlns=3D"http:=
//www.w3.org/TR/REC-html40">
<head>
<meta http-equiv=3D"Content-Type" content=3D"text/html; charset=3Dus-ascii"=
>
<meta name=3D"Generator" content=3D"Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri",sans-serif;
mso-fareast-language:EN-US;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:#0563C1;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:#954F72;
text-decoration:underline;}
span.EmailStyle17
{mso-style-type:personal-compose;
font-family:"Calibri",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri",sans-serif;
mso-fareast-language:EN-US;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:72.0pt 72.0pt 72.0pt 72.0pt;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext=3D"edit" spidmax=3D"1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext=3D"edit">
<o:idmap v:ext=3D"edit" data=3D"1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang=3D"EN-GB" link=3D"#0563C1" vlink=3D"#954F72">
<div class=3D"WordSection1">
<p class=3D"MsoNormal">Hi All,<o:p></o:p></p>
<p class=3D"MsoNormal"><o:p> </o:p></p>
<p class=3D"MsoNormal">I was wondering if is possible to dockerise my serve=
r and then use multiple cluster to seed the cache? I know I can use multipl=
e processes with the –n and –p flag though I’m wondering =
there is a limit on how much you can really increase
those number.<o:p></o:p></p>
<p class=3D"MsoNormal"><o:p> </o:p></p>
<p class=3D"MsoNormal">E.g. I dockerise the server and I spawn a 8core VM w=
ith 16GB ram, I can use sure –p 8 or maybe 10 but still I think that =
will require like 60 days to seed the whole UK with our data, can I spawn a=
nother machine and speed up the process?
For example another 8core VM.<o:p></o:p></p>
<p class=3D"MsoNormal"><o:p> </o:p></p>
<p class=3D"MsoNormal">We have 4 caches with different style that are updat=
ed twice a year so if it takes me 60 days for each by the time I finish it&=
#8217;s already time to start again.<o:p></o:p></p>
<p class=3D"MsoNormal"><o:p> </o:p></p>
<p class=3D"MsoNormal">I was wondering maybe I can run multiple VM and seed=
one or maybe 2 levels on each VM or if I spawn a new VM the original proce=
ss will take advantage of the new VM?<o:p></o:p></p>
<p class=3D"MsoNormal">In a VM I’m going to have MapServer and MapCac=
he and I will use a subdomain under a load balancer just to seed while the =
domain will be use just for the seeded cache and in the same way will be un=
der a load balancer.<o:p></o:p></p>
<p class=3D"MsoNormal"><o:p> </o:p></p>
<p class=3D"MsoNormal">Regards,<o:p></o:p></p>
<p class=3D"MsoNormal"><o:p> </o:p></p>
<p class=3D"MsoNormal"><span style=3D"color:#1F497D;mso-fareast-language:EN=
-GB">Sebastiano Laini<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"color:#1F497D;mso-fareast-language:EN=
-GB">Web Developer<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"color:#1F497D;mso-fareast-language:EN=
-GB">Buchanan Computing<o:p></o:p></span></p>
</div>
</body>
</html>
--_000_832135f0016547ca8542dd294f82b574BCExchangeBuchananCompu_--
--===============3433880940228732176==
Content-Type: text/plain; charset="utf-8"
MIME-Version: 1.0
Content-Transfer-Encoding: base64
Content-Disposition: inline
X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX18KbWFwc2VydmVy
LXVzZXJzIG1haWxpbmcgbGlzdAptYXBzZXJ2ZXItdXNlcnNAbGlzdHMub3NnZW8ub3JnCmh0dHBz
Oi8vbGlzdHMub3NnZW8ub3JnL21haWxtYW4vbGlzdGluZm8vbWFwc2VydmVyLXVzZXJz
--===============3433880940228732176==--