Re: Running StandaloneTalos test
alice nodelman <[email protected]> Thu, 07 Feb 2008 11:41:24 -0800
| Newsgroups | gmane.comp.mozilla.performance |
|---|---|
| Message-ID | <[email protected]> |
I'm afraid that the stalling behavior is currently expected - there needs to be additional work done on the proxy server to see why this happens, but for now I would just remove those 'bad' pages from the manifest file. Creating a re-playable web page test set is actually a pretty difficult problem. Pages in the wild behave strangely, don't load, are full of errors, etc, etc. Basically, the current best strategy is to start with a really large manifest and then prune it down as pages fail/don't load/raise errors/popups. Eventually you'll settle on a list of pages that you can repeatably and consistently load and then you'll use that as your local test farm. alice. [email protected] wrote: > On Feb 6, 3:55 pm, alice nodelman <[email protected]> wrote: >> You aren't going to get any result from the proxy_setup.config - it >> expressly throws away results since it is just trying to build up the >> local cache of web pages that can be served later. After a successful >> run with proxy_setup.config you need to run with proxy_run.config. You >> can see this in the final steps on the StandaloneTalos wiki page; it has >> you switch the proxy over to only serve pages from the local cache and >> use the secondary config file. >> >> I can also see how talos is getting confused, it's expectation is that >> the firefox path is that to the directory that contains both the >> executable and the libraries (ie, I grab a copy of firefox fromhttp://stage.mozilla.org/pub/mozilla.org/firefox/nightly/which I then >> untar to a local directory, then I end up with a firefox directory with >> both firefox-bin and all the other firefox related files in it). Having >> your executable somewhere else from the library files meant that it was >> unable to install the chrome/components directories. >> >> alice. >> > > I got the initial test framework set up and got the results following > a run with the server using local cache. However, the test seems to > stall now and then serving up the pages from the local cache. > Sometimes a simple refresh gets it going and at other times I have to > stop it and refresh it while the test is running. Is this expected > behavior? > > As you suggest, I will grab a local copy of firefox for testing and > try this once I stabilize the framework. > > thanks again, > - mouli