App performance degradation at scale

Hi,

I am using cherrypy to serve a few million requests per day. The app 
basically gets some data from memcache and a column store db for every 
request. What i am noticing though, is that the performance keeps degrading 
as the server gets more and more requests. It starts off with roughly 50 ms 
per response, but after a few thousands of requests, the performance 
becomes as slow as 30 seconds. 

i am using cherrypy 5.0.0 on a virtualized kernel - Linux 
2.6.32-573.12.1.el6.x86_64.

Also, when the app performance is degraded, if i perform the same operation 
from command line, the performance is normal/consistent (roughly 50-100 
ms), which indicates that the external resources being used are performing 
ok at that time, and the network is also not an issue.

Any clues?

Regards,

Vishal.

-- 
You received this message because you are subscribed to the Google Groups "cherrypy-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to cherrypy-users+unsubscribe-/JYPxA39Uh5TLH3MbocFF+G/[email protected]
To post to this group, send email to cherrypy-users-/JYPxA39Uh5TLH3MbocFF+G/[email protected]
Visit this group at https://groups.google.com/group/cherrypy-users.
For more options, visit https://groups.google.com/d/optout.