[benchmarks] Project plan

[email protected] (Paul Biggar) Thu, 21 May 2009 16:42:04 +0100
Newsgroups php.gsoc
Message-ID <[email protected]>
Hi Alexander,

I see that you added a project plan on
http://wiki.php.net/gsoc/2009/benchmarks. I have some questions and
comments:

> Late may and early June: Research and start coding on the CLI-version of the benchmark suite. This involves porting necessarily benchmarks and place them in the benchmark suite.

1. There are a number of benchmarks ported already. Which do you intend to port?
2. What are you planning to do for the 'suite' part of the benchmarks?
That is, we'll need a driver to test run-time/memory usage/cachegrind
stats/etc.


> Mid june - late june: The CLI version of the benchmark suite should have a clear shape.

I think this date is quite pessimistic. Since there isnt a huge deal
to be done for the CLI benchmarks, you should move this up.


> Early July (Mid term): The CLI-application should be totally complete and work should be focused on the web applications such as phpBB, worpress, joomla and/or SugarCRM.
> Early august: Applications should start to pile up. Hopefully there should be plenty of them here, but it will depend on the difficulty to modify them and the size of them.

By contrast, this is quite optimistic, to my mind. What exactly is
planned here? Are you anticipating help from outside sources?
Otherwise, I'm not sure that converting even 1 application in 3 weeks
in doable (bear in mind that web apps need test loads).


> August 10th - August 17th: Documentation and bug checking.

Please document as you go. It will help us know what's going on.


Other than that, a decent plan, but it could do with more detail. When
did you intend to start?

Thanks,
Paul


-- 
Paul Biggar
[email protected]