short on chunk memory..

Brian Cook <[email protected]>
Newsgroups gmane.comp.web.polipo.user
Message-ID <CAOyb_Eyxx8vJskCkap-C8vHj_4W=77fQ=gPJ+QuK1=0f88aKCg@mail.gmail.com>
I have just recently found polipo and have found it quite impressive.

I am trying to tune it to be a 'cache_peer' for our squid setup.

polipo being the final hop that leaves the network Internet bound..

I find that I routinely am 'short on chunk memory' regardless of what
I tune or do not tune.

I have made an elaborate monit/daemontools setup for polipo. I have
even gone so far as to make two proxies for squid to cache_peer to.

I have not seen any posts for the December 2012 year so I am not sure
if I am talking to a dead horse..

below is the basic config for both proxies:

pidFile = /var/run/polipo/polipo.pid
proxyAddress = "0.0.0.0"    # IPv4 only
allowedClients = 127.0.8.0/24, 127.0.0.1, 10.20.0.10
proxyName = "polipo.pcsd"
diskCacheRoot = ""
dnsQueryIPv6 = no
censoredHeaders = from, accept-language, x-pad, link
censorReferer = maybe
logFile=/var/log/polipo
maxAge = 5m
maxExpiresAge = 5m
maxNoModifiedAge = 5m
maxConnectionAge = 5m
clientTimeout = 92s
serverIdleTimeout = 30s

and the daemontools run file for each of the processes looks like this:
exec /usr/bin/polipo -c /etc/polipo/config
logFile=/var/log/polipo-8124 pidFile=./polipo.pid
proxyAddress=127.0.8.124 proxyPort=8124

(the other being 8125)

and the squid lines sending traffic to the polipo proxies:

cache_peer 127.0.8.124 parent 8124 0 no-query no-digest
no-netdb-exchange round-robin
cache_peer 127.0.8.125 parent 8125 0 no-query no-digest
no-netdb-exchange round-robin
# never_direct allow all

When working properly never_direct forces squid to get results from
the cache_peers..

I have monit checking the 8124/8125 is accessable, and if not, svc -t
/service/polipo[8124 8125]; which restarts it, but it still hangs..

this machine is a vm and I only have 4G allocated to the vm, but have
more if it would help.

this is another config that I was working on.. but again it still ends
up 'short on chunk memory'

pidFile = /var/run/polipo/polipo.pid
allowedClients = 127.0.0.1, 10.20.0.10
proxyName = "polipo.pcsd"
chunkHighMark = 536870912
diskCacheRoot = ""
disableServersList = false
dnsQueryIPv6 = no
dnsUseGethostbyname = yes
censoredHeaders = from, accept-language, x-pad, link
censorReferer = maybe
pmmFirstSize = 262144
pmmSize = 32768
chunkCriticalMark = 262144
chunkLowMark = 0
maxAge = 5m
maxExpiresAge = 5m
maxNoModifiedAge = 5m
objectHashTableSize = 0
publicObjectLowMark = 65535
objectHighMark = 131072
dontCacheRedirects = true
dontCacheCookies = true
maxConnectionAge = 5m
logFile=/var/log/polipo
serverMaxSlots = 8
serverSlots = 8
serverSlots1 = 8

I am unclear where I need to go to see how things are doing or how I
can further help myself without the aid of others..

Thanks for taking the time to read this.

------------------------------------------------------------------------------
LogMeIn Rescue: Anywhere, Anytime Remote support for IT. Free Trial
Remotely access PCs and mobile devices and provide instant support
Improve your efficiency, and focus on delivering more value-add services
Discover what IT Professionals Know. Rescue delivers
http://p.sf.net/sfu/logmein_12329d2d
lmpx.com only provides a reader for public news (NNTP) servers. It is not affiliated with the servers or forums shown here and is not responsible for the content of articles, which is written by their respective authors.