Re: GSoC 2017: Letor Click Data Mining

On 23 Mar 2017, at 06:18, Vivek Pal <[email protected]> wrote:

[existing omega logging]
> So, as I understand it, we'll need some more info
> to be logged than this to be able to train click models for relevance judgements.

Definitely.

>> and you'll need a way to use letor from omega, or you'll have trained a
>> model for no good reason :)
> 
> Sorry, I may have misunderstood you here but why would we need a way to use
> letor from omega? For training Letor module, wouldn't we just need two files
> i.e. Query and Qrel as mentioned in the xapian-letor docs? Letor API can then
> generate the final training file using those two files.

Yes, but you need to then _use_ letor in displaying omega results. Otherwise you've just trained the model.

> Is there a better way to mine the relevance judgements than click models?

There may be, but that's really a different project. If you find anything that sounds promising, maybe add it for possible follow-up; I suspect there's more than enough for a summer project already.

J

-- 
 James Aylett
 devfort.com — spacelog.org — tartarus.org/james/