Re: GSoC: Weighting Schemes

Hi Vivek,

 I saw your comments on IRC,  as noted by olly :
*<olly> vivekp: (if you check the logs) - you want: ./trec_index config*
*<olly> you want to run the compiled binary (no ".cc") not the source
file...*

But i guess you are not able to compile the setup. I can write steps and
send across how to compile and sample files from config.

Most of the files in config are from a test collection taken from FIRE, we
would need to ask permission to gain access to those files by FIRE team(
http://fire.irsi.res.in/fire/static/data). It needs to be signed to gain
access by organization to permit us to use data.

@olly and @James
Earlier being part of fire team, i was able to use this data. Not sure i
have the data now, Should we fill these form and ask permission to use this
data from FIRE team?

Thanks,
Gaurav


On Mon, May 9, 2016 at 4:03 PM, James Aylett <[email protected]>
wrote:

> On Sun, May 08, 2016 at 04:36:16PM +0530, Vivek Pal wrote:
>
> > >>you need to independently calculate, or independently
> > >>verify, the correct outputs for some test sets (you should be able to
> > >>use the existing test databases).
> >
> > So, careful manual testing of implemented code and automated testing
> > through xapian-core/tests/api_weight.cc
> > using the existing test databases is what I'd need to perform for
> complete
> > testing of implemented weighting functions.
>
> Almost -- the manual step should just be in calculating the correct
> outputs. All the actual testing, verifying that the weights come out
> correctly, should be automated.
>
> > I've started exploring and trying to get this evaluation module
> > running on my system.  Facing some issues initially so trying to
> > sort out those issues with the help from Gaurav on IRC.
>
> Great -- I note that Olly has dropped something in IRC about this, so
> hopefully you're able to keep moving forward.
>
> > >>We may want to take the opportunity to discuss whether parts or all of
> > >>this evaluation framework can be moved into the main Xapian repo, and
> > >>if there are changes that will make it easier to use for evaluation in
> > >>future.
> >
> > Yes, it'd be a huge plus for us as it would help to compare
> > Xapian's performance based on the different weighting functions.
> > I'll add this under "Additional tasks" in my project wiki and would like
> to
> > work with Gaurav after completing my GSoC project.
>
> Perfect.
>
> J
>
> --
>   James Aylett, occasional trouble-maker
>   xapian.org
>
>


-- 
Regards,
Gaurav Arora