RE: [benchmarks] Project plan

Hi Paul

Thanks for your comments. I'll try to answer the questions here:

The deltablue and raytrace benchmarks are finished. The Richards test is =
almost finished, since it has some bugs left that needs to be fixed. I'm =
thinking of using both phpWhirl and j4p5 as a part of the test since =
both of these use tests eval and some other functionality. I would also =
like to include some smaller and simpler tests that I believe are good =
for some purposes. In example, a test for recursive functions (could be =
Fibonacci or Ackermann), XML parsing and array performance (maybe by =
using the gauss-jordan-agorithm). Any ideas here that should be =
added/taken away is nice to hear:)

To the 2nd question. I have minimal experiences from this so I would =
really like some guidance here. What tools can be used and what should =
not be used?=20


As for the date, the first one might be pessimistic. I'll change that.

To the web application deadline, I find it hard to put that on a =
schedule. As you say, there's lots of work to be done and it might be =
more realistic to try to get one application fully finished. I don't =
have any help more than the PHP community. Is there any "old" =
application or something that I might take a look at for directions of =
how it should be done? Has any work been done in this part?

As for the last documentation week, I just saw that google suggested a =
"pencils down" date at August 10th, to improve documentation and write =
tests. This will probably be a week of web application development as =
well.

I starting lightly today with some code writing and will keep going on =
and off as my studies will finish (I have two more exams, the last one =
in June 1th). I hope I will be able to get a nice start with some =
efficient work and not only problems.

-----Original Message-----
From: Paul Biggar [mailto:[email protected]]=20
Sent: den 21 maj 2009 17:42
To: Alexander Hjalmarsson
Cc: Nuno Lopes; [email protected]
Subject: [benchmarks] Project plan

Hi Alexander,

I see that you added a project plan on
http://wiki.php.net/gsoc/2009/benchmarks. I have some questions and
comments:

> Late may and early June: Research and start coding on the CLI-version =
of the benchmark suite. This involves porting necessarily benchmarks and =
place them in the benchmark suite.

1. There are a number of benchmarks ported already. Which do you intend =
to port?
2. What are you planning to do for the 'suite' part of the benchmarks?
That is, we'll need a driver to test run-time/memory usage/cachegrind
stats/etc.


> Mid june - late june: The CLI version of the benchmark suite should =
have a clear shape.

I think this date is quite pessimistic. Since there isnt a huge deal
to be done for the CLI benchmarks, you should move this up.


> Early July (Mid term): The CLI-application should be totally complete =
and work should be focused on the web applications such as phpBB, =
worpress, joomla and/or SugarCRM.
> Early august: Applications should start to pile up. Hopefully there =
should be plenty of them here, but it will depend on the difficulty to =
modify them and the size of them.

By contrast, this is quite optimistic, to my mind. What exactly is
planned here? Are you anticipating help from outside sources?
Otherwise, I'm not sure that converting even 1 application in 3 weeks
in doable (bear in mind that web apps need test loads).


> August 10th - August 17th: Documentation and bug checking.

Please document as you go. It will help us know what's going on.


Other than that, a decent plan, but it could do with more detail. When
did you intend to start?

Thanks,
Paul


--=20
Paul Biggar
[email protected]