Re: New tinderbox tests for sunbird/lightning

Talos provides non-tinderbox infrastructure for running those same tests 
(Ts, Tp, Txul, etc).  Talos' follows these basic steps when running any 
given test:

- it creates a clean profile
- runs the browser once to a) ensure that the browser works at all and 
b) to get rid of the first-run overhead
- loads the browser with a given url
- waits for the browser to dump data that is formatted correctly to be 
interpreted as a test result
- waits for the browser to close then cleans up (removes test profile, etc)

It looks to me like a lot of these steps would be the same for calendar. 
  I'm not familiar with the calendar code so I don't know what sort of 
work would be involved in getting Talos to work with it instead of 
browser code, along with redesigning the tests which are all browser 
specific.

There is a doc for setting up your own Talos 
(http://wiki.mozilla.org/StandaloneTalos).  A lot of the information 
wouldn't be applicable, since you don't seem to want to be running the 
actual browser tests - but it will give you a start at understanding the 
Talos code base.

Hope that helps,

alice.

Michiel van Leeuwen wrote:
> For the calendar project, there are tinderboxes creating builds. Firefox 
> have Ts, Txul and tests like that. But nothing exists for calendar code. 
> I'd like to add those somehow. The question is: what would be the best 
> way to do that? I don't really know any tinderbox code, but from a first 
> look, the test-suite didn't look extedable. The tests are pretty much 
> hard coded. Is there some way around that? Is it possible to add new tests?
> 
> I'm currently thinking of a testrun that would look like:
> sunbird -createprofile perftest
> sunbird -P perftest -measurestartup <current time>
> sunbird -P perftest -subscribe <url to some ics file>
> sunbird -P perftest -measurestartup <current time>
> and maybe a few more. The pattern is that I try to make it all 
> scriptable from the commandline. But how do I get tinderbox to run that?
> 
> Can Talos help in any way?
> 
> 
> Michiel