Mozmill calendar tests failure with Lightning

Decathlon <[email protected]> Sat, 8 Feb 2014 06:45:20 -0800 (PST)
Newsgroups gmane.comp.mozilla.devel.calendar
Message-ID <[email protected]>
Hi to all,
I'm trying to run the set of Mozmill tests for Lightning.
On my system (Win7) Mozmill is running from the command line tool and I provide the following command:

$ mozmill -b "C:\Program Files (x86)\Thunderbird29.0a1\thunderbird\thunderbird.exe" -p "C:\Users\me\AppData\Roaming\Thunderbird\Profiles\mozmillTest" -m C:/Users/me/comm-central/calendar/test/unit/xpcshell.ini


Lightning is already installed in the profile which I'm using (I also tried by installing Lightning with he "-a" command line option) and the paths for the binary and the profile are usual locations on Windows for executables and profiles. The code for the calendar tests is inside the comm-central repository (cloned with mercurial) at the path specified in the command.

The tests run globally, Thunderbird starts, Lightning's interface gets animated, but _all_ the tests fail because of errors such as:

TEST-START | test_extract.js | test_overrides
ERROR | Test Failure | {
   "exception": {
   "message": "do_check_eq is not defined",
   "lineNumber": 160,
   "name": "ReferenceError",
   "fileName": "resource://mozmill/modules/frame.js -> file:///C:/Users/me/comm-central/calendar/test/unit/test_extract.js"
   }
}

other error messages are kind of:

  "cal is not defined"
  "getStorageCal is not defined"
  "do_test_pending is not defined"
  ...

I think I've missed something in the use of mozmill. Is it sufficient installing the command line tool and using the command as described above?