url filter and Internet down each Wednesday Morning

Chris Wensink <cwensink-vkMKHgLPN8f9Ak/[email protected]>
Newsgroups gmane.comp.security.ipcop.user
Message-ID <[email protected]>
Hello Everyone,

I'm having an issue with url filter on ipcop being down each wednesday 
morning.  We are running ipcop 2.1.9 with the Proxy service on and 
transparent on the green interface only.

We have a very high end ipcop server
Quad Core Xeon Processor
4GB Ram
500 GB Hard Drive
Quad Gigabit Intel Nic cards

The memory Cache size is 1536 MB,  Hard Disk Cache is 100000
Min Object size is 0 KB  Max Object size (KB): 4096
Number of Level-1 subdirectories (16)
Memory replacement policy LRU
Cache replacement Policy LRU

There are no time restrictions or download throttling parameters in 
place, and no authentication
Redirectors are enabled and I have tried adjusting this from 5-25.

I suspect this has something to do with Windows Updates pulling through 
because Microsoft releases windows updates on Tuesdays, and all machines 
default to download and applying windows updates at 3AM Wednesday morning.

There are no entries in the URL Filter Log on the web interface of ipcop 
for February 8, 9, or 10, and the Proxy

in /var/log/messages I can see that SquidGuard seems to go down right 
around Midnight and there are a numer of Cannot allocate memory messages 
throughout the log (attached).

I have seen some posts about possibly increasing the swap space to be 
larger than 64 MB as that could be the cause, but I didn't personally 
think that was a factor given how much ram we have in the system.

In cache.log starting around midnight, on 2/10/2016 I see repeating 
messages of this:

2016/02/10 00:00:03| Current Directory is /
2016/02/10 00:00:03 kid1| storeDirWriteCleanLogs: Starting...
2016/02/10 00:00:03 kid1|     65536 entries written so far.
2016/02/10 00:00:03 kid1|    131072 entries written so far.
2016/02/10 00:00:03 kid1|    196608 entries written so far.
2016/02/10 00:00:03 kid1|    262144 entries written so far.
2016/02/10 00:00:03 kid1|    327680 entries written so far.
2016/02/10 00:00:03 kid1|    393216 entries written so far.
2016/02/10 00:00:03 kid1|   Finished.  Wrote 428923 entries.
2016/02/10 00:00:03 kid1|   Took 0.14 seconds (3146026.79 entries/sec).
2016/02/10 00:00:03 kid1| logfileRotate: stdio:/var/log/squid/access.log
2016/02/10 00:00:03 kid1| Rotate log file stdio:/var/log/squid/access.log
2016/02/10 00:00:03 kid1| logfileRotate: stdio:/var/log/squid/user_agent.log
2016/02/10 00:00:03 kid1| Rotate log file 
stdio:/var/log/squid/user_agent.log
2016/02/10 00:00:03 kid1| helperOpenServers: Starting 1/25 
'redirectwrapper' processes
2016/02/10 00:00:03 kid1| ipcCreate: fork: (12) Cannot allocate memory
2016/02/10 00:00:03 kid1| WARNING: Cannot run 
'/usr/local/bin/redirectwrapper' process.
2016/02/10 00:00:28 kid1| Starting new redirector helpers...
2016/02/10 00:00:28 kid1| helperOpenServers: Starting 1/25 
'redirectwrapper' processes
2016/02/10 00:00:28 kid1| ipcCreate: fork: (12) Cannot allocate memory
2016/02/10 00:00:28 kid1| WARNING: Cannot run 
'/usr/local/bin/redirectwrapper' process.
2016/02/10 00:00:42 kid1| Starting new redirector helpers...
2016/02/10 00:00:42 kid1| helperOpenServers: Starting 1/25 
'redirectwrapper' processes
2016/02/10 00:00:42 kid1| ipcCreate: fork: (12) Cannot allocate memory
--------------------------------------------------------------
During off hours should I increase the swap file size?  Any other 
thoughts on settings I should change or tweak to prevent this from 
happening all the time?

The log files do get quite big:
-rw-r--r--  1 squid squid  214K Feb  9 00:00 user_agent.log-20160208.gz
-rw-r--r--  1 squid squid  5.0M Feb  9 00:00 access.log-20160208.gz
-rw-r--r--  1 squid squid   17K Feb  9 16:59 cache.log-20160209
-rw-r--r--  1 squid squid   13M Feb 10 00:00 user_agent.log-20160209
-rw-r--r--  1 squid squid   38M Feb 10 00:00 access.log-20160209
drwxr-xr-x 15 root  root    20K Feb 10 09:07 ..
-rw-r--r--  1 root  root   3.0K Feb 10 09:25 info
drwxr-xr-x  2 squid squid   64K Feb 10 09:27 .
-rw-r--r--  1 squid squid  3.5M Feb 10 09:28 cache.log
-rw-r--r--  1 squid squid  1.7M Feb 10 09:29 user_agent.log
-rw-r--r--  1 squid squid  4.9M Feb 10 09:29 access.log

I appreciate the help.

Thanks.

Chris

------------------------------------------------------------------------------
Site24x7 APM Insight: Get Deep Visibility into Application Performance
APM + Mobile APM + RUM: Monitor 3 App instances at just $35/Month
Monitor end-to-end web transactions and take corrective actions now
Troubleshoot faster and improve end-user experience. Signup Now!
http://pubads.g.doubleclick.net/gampad/clk?id=272487151&iu=/4140

_______________________________________________
IPCop-user mailing list
[email protected]
Manage your subscription or unsubscribe
https://lists.sourceforge.net/lists/listinfo/ipcop-user
lmpx.com only provides a reader for public news (NNTP) servers. It is not affiliated with the servers or forums shown here and is not responsible for the content of articles, which is written by their respective authors.