Re: Slow performance using multi_curl_* with HTTPs requests

Thomas Stähle via curl-and-php <[email protected]> Thu, 24 Jun 2021 14:47:14 +0200
Newsgroups gmane.comp.web.curl.php
Message-ID <CAPE=xU8ZX87viV-KJkV9AFgUH0Rjbt_-EA5iSgK_6WaPsm6LXQ@mail.gmail.com>
--===============1906643449==
Content-Type: multipart/alternative; boundary="000000000000c7718605c5826c4c"

--000000000000c7718605c5826c4c
Content-Type: text/plain; charset="UTF-8"

Hi Daniel,

This "new" libcurl of yours was relased in December 2016. We have done more
> than 3,200 documented bug-fixes in the curl project since then.
> While I can't name exactly what fixes that might have an impact on your
> performance issue, I don't think you'll find any people interested in
> truly
> investigating this unless you see a problem with a much more recent
> version.
>

fair enough. I can understand you.

Here is one more set of tests. Similar node but now in the same DC as the
sleep script. So without the additional network time the numbers in total
are smaller than before but the issue is still present. I compiled libcurl
for buster and compiled PHPs curl extension.

# cat /etc/debian_version
10.9
# php --version
PHP 7.4.20 ...
# php -i | grep cURL
cURL support => enabled
cURL Information => 7.77.0-DEV

I am using the implementations I posted in the response to Jess.

# php curl_plain.php http
  Total: 100.1340649128 seconds
# php curl_plain.php https
  Total: 101.8970041275 seconds

# php curl_multi.php http
  Total: 100.19338607788 seconds
# php curl_multi.php https
  Total: 106.07211399078 seconds

I would not expect any runtime longer than 102 seconds.

Cheers
Thomas

--000000000000c7718605c5826c4c
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr"><div class=3D"gmail_quote"><div>Hi Daniel,</div><div><br><=
/div><blockquote class=3D"gmail_quote" style=3D"margin:0px 0px 0px 0.8ex;bo=
rder-left:1px solid rgb(204,204,204);padding-left:1ex">
This &quot;new&quot; libcurl of yours was relased in December 2016. We have=
 done more <br>
than 3,200 documented bug-fixes in the curl project since then.<br>
While I can&#39;t name exactly what fixes that might have an impact on your=
 <br>
performance issue, I don&#39;t think you&#39;ll find any people interested =
in truly <br>
investigating this unless you see a problem with a much more recent version=
.<br></blockquote><div><br></div><div>fair enough. I can understand you.</d=
iv><div><br></div><div>Here is one more set of tests. Similar node but now =
in the same DC as the sleep script. So without the additional network time =
the numbers in total are smaller than before but the issue is still present=
. I compiled libcurl for buster and compiled PHPs curl extension.</div><div=
><br></div><div># cat /etc/debian_version<br>10.9<br></div><div># php --ver=
sion</div>PHP 7.4.20 ...</div><div class=3D"gmail_quote"># php -i | grep cU=
RL<br>cURL support =3D&gt; enabled<br>cURL Information =3D&gt; 7.77.0-DEV<b=
r><div><br></div><div>I am using the implementations I posted in the respon=
se to Jess.</div><div><br></div><div># php curl_plain.php http<br>=C2=A0 To=
tal: 100.1340649128 seconds<br></div><div># php curl_plain.php https<br>=C2=
=A0 Total: 101.8970041275 seconds<br></div><div><br></div><div># php curl_m=
ulti.php http<br>=C2=A0 Total: 100.19338607788 seconds<br></div><div># php =
curl_multi.php https<br>=C2=A0 Total: 106.07211399078 seconds<br></div><div=
><br></div><div>I would not expect any runtime longer than 102 seconds.</di=
v><div><br></div><div>Cheers</div><div>Thomas</div></div></div>

--000000000000c7718605c5826c4c--

--===============1906643449==
Content-Type: text/plain; charset="utf-8"
MIME-Version: 1.0
Content-Transfer-Encoding: base64
Content-Disposition: inline

X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX18KaHR0cHM6Ly9j
b29sLmhheHguc2UvY2dpLWJpbi9tYWlsbWFuL2xpc3RpbmZvL2N1cmwtYW5kLXBocAo=

--===============1906643449==--