Re: [Fuego] location for non-upsteam tests (prep for pre-built docker image)

"Bird, Tim" <[email protected]> Thu, 6 Aug 2020 19:01:24 +0000
Newsgroups dev.linux.lists.fuego
Message-ID <CY4PR13MB1175C3F54ABC388BEAF11120FD480@CY4PR13MB1175.namprd13.prod.outlook.com>

> -----Original Message-----
> From:  Laszlo Sitzer
> 
> Hello!
> 
> I was curious if you think it would be a nice feature to allow users of Fuego to use a separate location for their custom tests and plans.

I think that the overall concept is great.  I've been working on the ability for users to publish their own tests
and obtain and run tests, from a location besides the git repository, for some time now.  If I understand
what you have in mind, this is not exactly the same thing, but it is related.

> 
> I am asking because I am working on a couple of tests that will not be published to upstream and I'd like to have the possibility to bind-
> mount all my custom things into the container and Fuego picking these up.

This sounds fine.  I think extending ftc to pick up tests from an additional directory would
be pretty straightforward. It does affect a few different code paths, but the code
itself appears to be not difficult (see get_tests(), get_test_home_dir())

> 
> Background: Aside from having a location that is distinct from official Fuego tests I would like to have such feature as I am really eager on
> making it possible to have a pre-built Fuego docker image. Then the user would decide if she/he wants to add additional tests using a bind
> mount.
The existing upstream tests (from the fuego-core repository) are already outside the container,
since fuego-core is volume-mounted.  So I'm not sure I understand this.  

Note that Fuego can already run a test from /fuego-rw/tests.  This is outside of /fuego-core/tests
So installing and running a non-upstream test is already supported.  (But honestly, this has not
been extensively tested and I wouldn't be surprised if we needed to shake a few bugs out
to get this working better.)

Try this:
  $ ftc package-test Benchmark.Dhrystone
  $ ftc install-test /fuego-rw/Benchmark.Dhrystone-1.1-1.ftp
  $ ls /fuego-rw/tests

A test definition in /fuego-rw/tests takes precedence over a test definition
in /fuego-core/tests.

You can put your own tests in /fuego-rw/tests now.  Would this do what you need? 
 -- Tim