Squid 4.13: too much memory used for ACL url_regex when big list file used

Meridoff <[email protected]> Mon, 16 Aug 2021 20:45:15 +0300
Newsgroups gmane.comp.web.squid.devel
Message-ID <CAFfuDwzfy=9g6EH706iyfGTJ51d6V7qc+aUtPNXfwPXiMERPHg@mail.gmail.com>
Hello, I have simplest squid config with such acl:

acl a1 url_regex "/tmp/urls.txt"

In /tmp/urls.txt there are about 220 000 URL regexps, most of them in such
form (example):
^(https?|ftp)://([a-z0-9.-]+\.)?nicebox\.pro(/.*)?$
OR
^(https?|ftp)://order-yudobashi-com\.363q1\.bar/

There are a lot of memory used by squid for such configuration: about 2GB.
Without this command: about 30MB used.

So aprxm. 10KB for 1 regexp. Is it normal? I think it is too big..

I think that such big consumption is because of regexps , for simple
strings (for example, domains or IPs) consumption will be less.

How I can decrease memory consumption for such big regexp lists in ACLs ?
May be some fix in squid or some fix in regexp lists ?

Thanks.

_______________________________________________
squid-dev mailing list
[email protected]
http://lists.squid-cache.org/listinfo/squid-dev