Re: Web cache solutions in 2010
Thomas Burger <[email protected]> Tue, 16 Mar 2010 17:25:22 -0700
| Newsgroups | gmane.comp.programming.load-balancing.general |
|---|---|
| Message-ID | <[email protected]> |
--===============0780209084== Content-Type: multipart/alternative; boundary=Apple-Mail-109-568030267 --Apple-Mail-109-568030267 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=us-ascii Hi Rubens,=20 On the open-source side: 1. Have you checked out Varnish? http://varnish-cache.org/ Depending on the use case It offers significant performance advantages = over old Squid:=20 http://www.oscon.com/oscon2009/public/schedule/detail/10433 It is designed as more of a web accelerator / reverse proxy rather than = a forward proxy. =46rom your list of "totally useless features" I think = you may also be interested in Forward Proxy functionality for = controlling users accessing the internet? Varnish would not be a good = fit in that case. 2. Another interesting one is the Apache Traffic server, formerly Yahoo = Traffic Server, formerly Inktomi Traffic Server. It is currently in = production at Yahoo and was recently donated to the Apache Foundation: http://en.wikipedia.org/wiki/Traffic_Server/ http://incubator.apache.org/trafficserver/ 3. Since it claims reverse proxy caching functionality as well, you = might also want to checkout Nginx. Its fairly new, but it seems to be = increasing in popularity: = http://royal.pingdom.com/2010/02/23/nginx-the-little-russian-web-server-ta= king-on-the-giants/ http://nginx.org/ -thomas On Mar 15, 2010, at 8:27 PM, Ed Toro wrote: > It seems most load balancers use RAM based cache now for speed. The = good=20 > ones also let you use policies to override pragma and cache dynamic=20 > content. This can be useful for high volume sites and "dynamic" = content=20 > that is not stale until a few seconds pass. >=20 > On 3/15/10 9:14 PM , Tony Bourke wrote: >> That's in interesting question. My initial thoughts are that web = caches have fallen out of fashion, at least in the data center. End = user caching (office connectivity), and WAN optimization still seems to = be in play, but other than that. >>=20 >> There are some caching solutions that have been integrated into load = balancers, such as Cisco's ACE and F5's LTM, and on the value market = KEMP's offerings. But as far as standalone devices go, I haven't seen = one of them deployed in quite a while. >>=20 >> Tony >>=20 >>=20 >> On Mar 15, 2010, at 12:16 PM, Rubens Kuhl wrote: >>=20 >>=20 >>> After so many mergers, acquisitions, product line sells and >>> discontinuing I've lost track of what would be good cache solutions >>> these days. >>> Requirements: >>> 1) Transparent caching, every request should be made on behalf(IP >>> address) of the original request >>> 2) Some kind of easy fail-over; doesn't need to be electrical but it >>> wouldn't hurt >>> Added benefits: >>> 3) WAN optimization targeted at web applications would be nice to = have >>> 4) TCP satellite acceleration of non-cacheable apps would be nice to = have >>> 5) Software-only version (due to high custom taxes, hardware will >>> always cost more) >>> Totally useless features: >>> - Policy control (which seems to be the focus these days) >>> - Websense or alike integration >>> - Pointy-Haired-Boss reports (destination websites and so forth) >>>=20 >>>=20 >>> Bluecoat is one vendor I already identified after some googling, but >>> comments on its technology are welcom. >>> Open-source recommendations are welcome as well, provided they = target >>> operation quality dependability. >>>=20 >>>=20 >>> Tks, >>> Rubens >>> _______________________________________________ >>> lb-l mailing list >>> [email protected] >>> http://vegan.net/mailman/listinfo/lb-l >>> Searchable Archive: http://vegan.net/lb/archive >>> http://lbdigest.com Load Balancing Digest >>> http://lbwiki.com Load Balancing Wiki >>>=20 >> _______________________________________________ >> lb-l mailing list >> [email protected] >> http://vegan.net/mailman/listinfo/lb-l >> Searchable Archive: http://vegan.net/lb/archive >> http://lbdigest.com Load Balancing Digest >> http://lbwiki.com Load Balancing Wiki >>=20 >=20 > _______________________________________________ > lb-l mailing list > [email protected] > http://vegan.net/mailman/listinfo/lb-l > Searchable Archive: http://vegan.net/lb/archive > http://lbdigest.com Load Balancing Digest > http://lbwiki.com Load Balancing Wiki --Apple-Mail-109-568030267 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=us-ascii <html><head></head><body style=3D"word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; ">Hi = Rubens, <br><br>On the open-source side:<br><br>1. Have you checked = out Varnish?<br><a = href=3D"http://varnish-cache.org/">http://varnish-cache.org/</a><br><br>De= pending on the use case It offers significant performance advantages = over old Squid: <br><a = href=3D"http://www.oscon.com/oscon2009/public/schedule/detail/10433">http:= //www.oscon.com/oscon2009/public/schedule/detail/10433</a><br><br>It is = designed as more of a web accelerator / reverse proxy rather than a = forward proxy. =46rom your list of "totally useless features" I think = you may also be interested in Forward Proxy functionality for = controlling users accessing the internet? Varnish would not be a good = fit in that case.<br><br><br>2. Another interesting one is the Apache = Traffic server, formerly Yahoo Traffic Server, formerly Inktomi Traffic = Server. It is currently in production at Yahoo and was recently donated = to the Apache Foundation:<br><a = href=3D"http://en.wikipedia.org/wiki/Traffic_Server/">http://en.wikipedia.= org/wiki/Traffic_Server/</a><br><a = href=3D"http://incubator.apache.org/trafficserver/">http://incubator.apach= e.org/trafficserver/</a><br><br>3. Since it claims reverse proxy caching = functionality as well, you might also want to checkout Nginx. Its fairly = new, but it seems to be increasing in popularity:<br><a = href=3D"http://royal.pingdom.com/2010/02/23/nginx-the-little-russian-web-s= erver-taking-on-the-giants/">http://royal.pingdom.com/2010/02/23/nginx-the= -little-russian-web-server-taking-on-the-giants/</a><br><a = href=3D"http://nginx.org/">http://nginx.org/</a><br><br>-thomas<div><br><d= iv><div>On Mar 15, 2010, at 8:27 PM, Ed Toro wrote:</div><br = class=3D"Apple-interchange-newline"><blockquote type=3D"cite"><div>It = seems most load balancers use RAM based cache now for speed. The good = <br>ones also let you use policies to override pragma and cache dynamic = <br>content. This can be useful for high volume sites and "dynamic" = content <br>that is not stale until a few seconds pass.<br><br>On = 3/15/10 9:14 PM , Tony Bourke wrote:<br><blockquote type=3D"cite">That's = in interesting question. My initial thoughts are that web caches = have fallen out of fashion, at least in the data center. End = user caching (office connectivity), and WAN optimization still seems to = be in play, but other than that.<br></blockquote><blockquote = type=3D"cite"><br></blockquote><blockquote type=3D"cite">There are some = caching solutions that have been integrated into load balancers, such as = Cisco's ACE and F5's LTM, and on the value market KEMP's offerings. = But as far as standalone devices go, I haven't seen one of them = deployed in quite a while.<br></blockquote><blockquote = type=3D"cite"><br></blockquote><blockquote = type=3D"cite">Tony<br></blockquote><blockquote = type=3D"cite"><br></blockquote><blockquote = type=3D"cite"><br></blockquote><blockquote type=3D"cite">On Mar 15, = 2010, at 12:16 PM, Rubens Kuhl wrote:<br></blockquote><blockquote = type=3D"cite"><br></blockquote><blockquote = type=3D"cite"><br></blockquote><blockquote type=3D"cite"><blockquote = type=3D"cite">After so many mergers, acquisitions, product line sells = and<br></blockquote></blockquote><blockquote type=3D"cite"><blockquote = type=3D"cite">discontinuing I've lost track of what would be good cache = solutions<br></blockquote></blockquote><blockquote = type=3D"cite"><blockquote type=3D"cite">these = days.<br></blockquote></blockquote><blockquote type=3D"cite"><blockquote = type=3D"cite">Requirements:<br></blockquote></blockquote><blockquote = type=3D"cite"><blockquote type=3D"cite">1) Transparent caching, every = request should be made on = behalf(IP<br></blockquote></blockquote><blockquote = type=3D"cite"><blockquote type=3D"cite">address) of the original = request<br></blockquote></blockquote><blockquote type=3D"cite"><blockquote= type=3D"cite">2) Some kind of easy fail-over; doesn't need to be = electrical but it<br></blockquote></blockquote><blockquote = type=3D"cite"><blockquote type=3D"cite">wouldn't = hurt<br></blockquote></blockquote><blockquote type=3D"cite"><blockquote = type=3D"cite">Added benefits:<br></blockquote></blockquote><blockquote = type=3D"cite"><blockquote type=3D"cite">3) WAN optimization targeted at = web applications would be nice to = have<br></blockquote></blockquote><blockquote type=3D"cite"><blockquote = type=3D"cite">4) TCP satellite acceleration of non-cacheable apps would = be nice to have<br></blockquote></blockquote><blockquote = type=3D"cite"><blockquote type=3D"cite">5) Software-only version (due to = high custom taxes, hardware = will<br></blockquote></blockquote><blockquote type=3D"cite"><blockquote = type=3D"cite">always cost more)<br></blockquote></blockquote><blockquote = type=3D"cite"><blockquote type=3D"cite">Totally useless = features:<br></blockquote></blockquote><blockquote = type=3D"cite"><blockquote type=3D"cite">- Policy control (which seems to = be the focus these days)<br></blockquote></blockquote><blockquote = type=3D"cite"><blockquote type=3D"cite">- Websense or alike = integration<br></blockquote></blockquote><blockquote = type=3D"cite"><blockquote type=3D"cite">- Pointy-Haired-Boss reports = (destination websites and so = forth)<br></blockquote></blockquote><blockquote type=3D"cite"><blockquote = type=3D"cite"><br></blockquote></blockquote><blockquote = type=3D"cite"><blockquote = type=3D"cite"><br></blockquote></blockquote><blockquote = type=3D"cite"><blockquote type=3D"cite">Bluecoat is one vendor I already = identified after some googling, = but<br></blockquote></blockquote><blockquote type=3D"cite"><blockquote = type=3D"cite">comments on its technology are = welcom.<br></blockquote></blockquote><blockquote type=3D"cite"><blockquote= type=3D"cite">Open-source recommendations are welcome as well, provided = they target<br></blockquote></blockquote><blockquote = type=3D"cite"><blockquote type=3D"cite">operation quality = dependability.<br></blockquote></blockquote><blockquote = type=3D"cite"><blockquote = type=3D"cite"><br></blockquote></blockquote><blockquote = type=3D"cite"><blockquote = type=3D"cite"><br></blockquote></blockquote><blockquote = type=3D"cite"><blockquote = type=3D"cite">Tks,<br></blockquote></blockquote><blockquote = type=3D"cite"><blockquote = type=3D"cite">Rubens<br></blockquote></blockquote><blockquote = type=3D"cite"><blockquote = type=3D"cite">_______________________________________________<br></blockqu= ote></blockquote><blockquote type=3D"cite"><blockquote type=3D"cite">lb-l = mailing list<br></blockquote></blockquote><blockquote = type=3D"cite"><blockquote type=3D"cite"><a = href=3D"mailto:[email protected]">[email protected]</a><br></blockquote></blockq= uote><blockquote type=3D"cite"><blockquote type=3D"cite"><a = href=3D"http://vegan.net/mailman/listinfo/lb-l">http://vegan.net/mailman/l= istinfo/lb-l</a><br></blockquote></blockquote><blockquote = type=3D"cite"><blockquote type=3D"cite">Searchable Archive: <a = href=3D"http://vegan.net/lb/archive">http://vegan.net/lb/archive</a><br></= blockquote></blockquote><blockquote type=3D"cite"><blockquote = type=3D"cite"><a href=3D"http://lbdigest.com">http://lbdigest.com</a> = Load Balancing Digest<br></blockquote></blockquote><blockquote = type=3D"cite"><blockquote type=3D"cite"><a = href=3D"http://lbwiki.com">http://lbwiki.com</a> Load Balancing = Wiki<br></blockquote></blockquote><blockquote type=3D"cite"><blockquote = type=3D"cite"><br></blockquote></blockquote><blockquote = type=3D"cite">_______________________________________________<br></blockqu= ote><blockquote type=3D"cite">lb-l mailing = list<br></blockquote><blockquote type=3D"cite"><a = href=3D"mailto:[email protected]">[email protected]</a><br></blockquote><blockqu= ote type=3D"cite"><a = href=3D"http://vegan.net/mailman/listinfo/lb-l">http://vegan.net/mailman/l= istinfo/lb-l</a><br></blockquote><blockquote type=3D"cite">Searchable = Archive: <a = href=3D"http://vegan.net/lb/archive">http://vegan.net/lb/archive</a><br></= blockquote><blockquote type=3D"cite"><a = href=3D"http://lbdigest.com">http://lbdigest.com</a> Load Balancing = Digest<br></blockquote><blockquote type=3D"cite"><a = href=3D"http://lbwiki.com">http://lbwiki.com</a> Load Balancing = Wiki<br></blockquote><blockquote = type=3D"cite"><br></blockquote><br>_______________________________________= ________<br>lb-l mailing list<br><a = href=3D"mailto:[email protected]">[email protected]</a><br>http://vegan.net/mail= man/listinfo/lb-l<br>Searchable Archive: = http://vegan.net/lb/archive<br>http://lbdigest.com Load Balancing = Digest<br>http://lbwiki.com Load Balancing = Wiki<br></div></blockquote></div><br></div></body></html>= --Apple-Mail-109-568030267-- --===============0780209084== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ lb-l mailing list [email protected] http://vegan.net/mailman/listinfo/lb-l Searchable Archive: http://vegan.net/lb/archive http://lbdigest.com Load Balancing Digest http://lbwiki.com Load Balancing Wiki --===============0780209084==--