Re: Performance issue -- serving from cache
Jonathan Lee <[email protected]> Sat, 14 Feb 2026 15:31:08 -0800
| Newsgroups | gmane.comp.web.squid.general |
|---|---|
| Message-ID | <[email protected]> |
--===============7183876413031772496== Content-Type: multipart/alternative; boundary=Apple-Mail-447D0CBE-FA88-4EE2-BA1B-458362883AC1 Content-Transfer-Encoding: 7bit --Apple-Mail-447D0CBE-FA88-4EE2-BA1B-458362883AC1 Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: quoted-printable <html class=3D"apple-mail-supports-explicit-dark-mode"><head><meta http-equi= v=3D"content-type" content=3D"text/html; charset=3Dutf-8"></head><body dir=3D= "auto">Rock can run multiple squid processes to knowledge and workers on the= same cache <br id=3D"lineBreakAtBeginningOfSignature"><div dir=3D"ltr"= >Sent from my iPhone</div><div dir=3D"ltr"><br><blockquote type=3D"cite">On = Feb 14, 2026, at 14:55, Brad House <[email protected]> wrote:<br><br= ></blockquote></div><blockquote type=3D"cite"><div dir=3D"ltr">=EF=BB=BF =20 <meta http-equiv=3D"Content-Type" content=3D"text/html; charset=3DUTF-8"= > =20 =20 <p>AUFS cache is currently being used. I'm pretty sure I tried roc= k after and noticed worse performance but I don't recall trying to tune it.</p> <div class=3D"moz-cite-prefix">On 2/14/26 5:40 PM, Jonathan Lee wrote:<b= r> </div> <blockquote type=3D"cite" cite=3D"mid:D8714BEE-9639-4734-A0C7-76A5FF767F0= [email protected]"> <meta http-equiv=3D"content-type" content=3D"text/html; charset=3DUTF-= 8"> Is it rock cache and how many workers are you using ?<br id=3D"lineBre= akAtBeginningOfSignature"> <div dir=3D"ltr">Sent from my iPhone</div> <div dir=3D"ltr"><br> <blockquote type=3D"cite">On Feb 14, 2026, at 11:45, Brad House <a class=3D"moz-txt-link-rfc2396E" href=3D"mailto:brad@brad-house.= com"><[email protected]></a> wrote:<br> <br> </blockquote> </div> <blockquote type=3D"cite"> <div dir=3D"ltr">=EF=BB=BF <meta http-equiv=3D"content-type" content=3D"text/html; charset=3D= UTF-8"> <p>I've got a squid deployment where serving from cache can be slower than an uncached download. I'm seeing speeds of around 50MB/s when serving from cache, which is much slower than anticipated. Infact, when hitting fast upstream servers, serving of a non-cached asset is faster (even though its still hitting squid to fetch it). </p> <p>I'm thinking there's got to be something wrong with my squid configuration, I'm currently running on Rocky Linux 10 with Squid 6.10-6.</p> <p>The VM I'm using currently has 4 cores, 16G RAM and 100G of usable space. I used fio to measure disk performance and I= got </p> <ul data-list-tree=3D"true" data-indent=3D"1" data-border=3D"0" st= yle=3D"margin: 4px 0 4px 24px; padding: 0; list-style-position: outside"> <li style=3D"margin: 2px 0; padding: 0; color: #1d1c1d">Random Write: 3629MiB/s (1MB block), 33.2k (4k block) IOPS</li> <li style=3D"margin: 2px 0; padding: 0; color: #1d1c1d">Random Read: 8391MiB/s (1MB block), 43.5k (4k block) IOPS</li> </ul> <p>Adding more cpu cores or ram doesn't appear to impact performance.</p> <p>The underlying infrastructure is made up of hypervisors with dual 100G uplinks, both the client and squid run on the same hypervisor cloud. Network performance is not the issue.</p> <p>As a test, I spun up Apache Traffic Server and get over 800MB/s when serving from cache.</p> <p>We have a large on site build system that spins up runners for GitHub actions, and they're constantly fetching large assets from the internet for each build, hence our desire for a caching proxy. We'd rather not switch to Apache Traffic Server as that doesn't have SSL bump capability (we haven't yet enabled that capability in squid, however). Hopefully there's a simple configuration I'm missing.</p> <p>Just for testing I was pulling large image via http that is below my max object size: <a class=3D"moz-txt-link-freetext" href=3D"http://mirrors.edge.k= ernel.org/ubuntu-releases/20.04.6/ubuntu-20.04.6-live-server-amd64.iso" moz-= do-not-send=3D"true">http://mirrors.edge.kernel.org/ubuntu-releases/20.04.6/= ubuntu-20.04.6-live-server-amd64.iso</a></p> <p>Configuration below:</p> <p>acl public src 0.0.0.0/0<br> acl SSL_ports port 443<br> acl Safe_ports port 80<br> acl Safe_ports port 443<br> http_access deny !Safe_ports<br> http_access deny CONNECT !SSL_ports<br> http_access allow localhost manager<br> http_access deny manager<br> http_access allow public<br> http_access deny to_localhost<br> http_access deny to_linklocal<br> http_access deny all<br> http_port 8080<br> maximum_object_size 2 GB<br> cache_dir aufs /var/spool/squid 325632 16 256<br> cache_mem 1000 MB<br> maximum_object_size_in_memory 102400 KB<br> coredump_dir /var/spool/squid<br> refresh_pattern -i (/cgi-bin/|\?) 0 0% = 0<br> refresh_pattern deb$ 129600 100% 129600<br> refresh_pattern udeb$ 129600 100% 129600<br> refresh_pattern tar.gz$ 129600 100% 129600<br> refresh_pattern tar.xz$ 129600 100% 129600<br> refresh_pattern tar.bz2$ 129600 100% 129600<br> refresh_pattern \/(Packages|Sources)(|\.bz2|\.gz|\.xz)$ 0 0% 0 refresh-ims<br> refresh_pattern \/Release(|\.gpg)$ 0 0% 0 refresh-ims<br> refresh_pattern \/InRelease$ 0 0% 0 refresh-ims<br> refresh_pattern \/(Translation-.*)(|\.bz2|\.gz|\.xz)$ 0 0% 0 refresh-ims<br> refresh_pattern changelogs.ubuntu.com\/.* 0 1% 1</p>= <p><br> </p> <p>Thanks!</p> <p>-Brad</p> <span>_______________________________________________</span><br> <span>squid-users mailing list</span><br> <span><a class=3D"moz-txt-link-abbreviated" href=3D"mailto:squid-u= [email protected]">[email protected]</a></span><br>= <span><a class=3D"moz-txt-link-freetext" href=3D"https://lists.squ= id-cache.org/listinfo/squid-users">https://lists.squid-cache.org/listinfo/sq= uid-users</a></span><br> </div> </blockquote> </blockquote> =20 </div></blockquote></body></html>= --Apple-Mail-447D0CBE-FA88-4EE2-BA1B-458362883AC1-- --===============7183876413031772496== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ squid-users mailing list [email protected] https://lists.squid-cache.org/listinfo/squid-users --===============7183876413031772496==--