Re: GSoC: Weighting Schemes

On Sun, May 08, 2016 at 04:36:16PM +0530, Vivek Pal wrote:

> >>you need to independently calculate, or independently
> >>verify, the correct outputs for some test sets (you should be able to
> >>use the existing test databases).
> 
> So, careful manual testing of implemented code and automated testing
> through xapian-core/tests/api_weight.cc
> using the existing test databases is what I'd need to perform for complete
> testing of implemented weighting functions.

Almost -- the manual step should just be in calculating the correct
outputs. All the actual testing, verifying that the weights come out
correctly, should be automated.

> I've started exploring and trying to get this evaluation module
> running on my system.  Facing some issues initially so trying to
> sort out those issues with the help from Gaurav on IRC.

Great -- I note that Olly has dropped something in IRC about this, so
hopefully you're able to keep moving forward.

> >>We may want to take the opportunity to discuss whether parts or all of
> >>this evaluation framework can be moved into the main Xapian repo, and
> >>if there are changes that will make it easier to use for evaluation in
> >>future.
> 
> Yes, it'd be a huge plus for us as it would help to compare
> Xapian's performance based on the different weighting functions.
> I'll add this under "Additional tasks" in my project wiki and would like to
> work with Gaurav after completing my GSoC project.

Perfect.

J

-- 
  James Aylett, occasional trouble-maker
  xapian.org