Weighting Schemes: Implementing Piv+ Normalization

Vivek Pal <[email protected]>
Newsgroups gmane.comp.search.xapian.devel
Message-ID <CAGxcUfxoqUO22f3FUv=4D7o1e1g9jAuPsJpXevOozBLnNKmw7Q@mail.gmail.com>
Hi,

I have added support for Piv normalization in Tf-Idf weighting scheme as a
intermediate step to implementing the support for Piv+ normalization. All
tests pass.

But I'm running into some issues with Piv+ normalization. In the Piv+
formula  , there are two parameters (s and delta) that control the weight
assigned. I think the way I'm serialising and unserialising these
parameters has some issues which is causing a few errors,
http://pastebin.com/yCyuvF1X.  Any suggestion is appreciated!

Also, I was wondering if we want to have pivoted normalization weighting as
a separate weighting scheme in Xapian as it will make a way to add support
of different variations of pivoted normalization in the future?

Piv+ weighting formula:
https://trac.xapian.org/attachment/wiki/GSoC2016/Weighting/ProjectPlan/Piv%2B.png
)
Commit of Piv changes:
https://github.com/ivmarkp/xapian/commit/a02942fe3c3cf6cfbdd3c14685c2ff5f8a6b8b7c
Commit Piv+ changes:
https://github.com/ivmarkp/xapian/commit/e31a46e5a5ee1bdd3931de25e25722e46df056fe

Thanks,
Vivek
lmpx.com only provides a reader for public news (NNTP) servers. It is not affiliated with the servers or forums shown here and is not responsible for the content of articles, which is written by their respective authors.