Re: filestat - a different perspective

I'm not sure caching solves this issue in its current state.  tools.Walk
gets called with a variety of different arguments and thus does different
things.  I did some analysis on this a while back and decided that the
successful hit rate on the cache didn't make it worth the effort nor did
we get much of a performance boost out of it.

Memoizing caching function is interesting though.  Having said that, one
of the big complaints (though this hasn't been voiced in the last few
months) is that bits of the code are too complex to fathom.  At one point
I was doing some research into removing all the lambdas, maps, filters,
and other functional things that were "obscure" and "obfuscated".  I can't
imagine this kind of code would make the weak-stomachs feel good.  I don't
even know if those people are still with us.  (shrug)


Anyhow, I think I want to investigate re-writing tools.Walk or portions of
it so that it's working less.  At this stage, I'll keep it backwards
compatible.  But in the future, I'm thinking it might be a better idea to
split out some of its functionality into different functions.  That's my
plan.

It'd be cool if someone wanted to investigate this kind of caching as
well.  It's not clear what the best setup here should be and it may be a
combination of refactoring and memoizationalyzing.

/will


On Mon, 23 Aug 2004, David Ascher wrote:
> >
> > I am interested in solving performance issues.  I'll toss it on my todo
> > list of things to do some analysis on and report back my results and
> > thoughts.
>
> For non-persistent processes (i.e. the typical CGI setup), things like
> memoization can cover up a lot of architectural inefficiencies.  See
> e.g.
>
> http://aspn.activestate.com/ASPN/Cookbook/Python/Recipe/52201
>
> --david
>

-- 
whatever it is, you can find it at http://www.bluesock.org/~willg/
except Will--you can only see him in real life.


-------------------------------------------------------
SF.Net email is sponsored by Shop4tech.com-Lowest price on Blank Media
100pk Sonic DVD-R 4x for only $29 -100pk Sonic DVD+R for only $33
Save 50% off Retail on Ink & Toner - Free Shipping and Free Gift.
http://www.shop4tech.com/z/Inkjet_Cartridges/9_108_r285