Text-Extraction Libraries for Omindex

Bruno Baruffaldi <[email protected]> Fri, 14 Jun 2019 08:52:51 -0300
Newsgroups gmane.comp.search.xapian.devel
Message-ID <CAND-c9M9+1dnGUAYEkfCMfEOwKDQfkniSM+8Yjmf0f4dTgcMyw@mail.gmail.com>
--000000000000e83673058b4749ff
Content-Type: text/plain; charset="UTF-8"

This is a list with some libraries that I have been looking at.

The idea is to discuss the advantages and disadvantages of adding some of
these libraries to Xapian.

If anyone knows another library that could be add to the list it would be
great!

Libfreexl:
* For Excel (.xls)
* Last release: 2018-02
* Info: gaia-gis.it/fossil/freexl/index
* License: MPL tri-license

==============================

Libzip:
* For zip archives(C library)
* Last release 2018-04
* Info: libzip.org
* License: 3-clause BSD

Libzipios++:
* For zip archives
* Last release 2019-04
* Info: zipios.sourceforge.net
* License: GNU Lesser General Public License (LGPL)

I have been thinking about unzip. It is widely use in omindex an it might
be an option to replace unzip with one of this libraries. I know that it is
not the best solution, but it could be something to consider for some
formats.

==============================

Djvulibre:
* For DjVu files
* Last release: 2015-02
* Info: djvu.sourceforge.net
* License: GNU General Public License version 2

==============================

Libe-book:
* For ebooks formats
* Last release 2018-01
* It shows little activity
* Status: Beta
* Info: sourceforge.net/projects/libebook/
* License: GNU Lesser GPL 2.1+ and MPL 2.0+

I have been reading the code of this library, but it seems a bit complex.
It could be a good option, but it will take a while to figure it out how it
works.

==============================

Libetonyek-dev:
* For Apple iWork documents
* Status: Beta
* Info: wiki.documentfoundation.org/DLP/Libraries/libetonyek
* License: MPL 2.0+

==============================

Libabw:
* For AbiWord documents
* Last release 2017-12
* Info: wiki.documentfoundation.org/DLP/Libraries/libabw
* License: MPL 2.0

==============================

Other Options:
* libreoffice-dev(SDK)
* libmarkdown2-dev

--000000000000e83673058b4749ff
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr"><div class=3D"gmail_default" style=3D"font-family:tahoma,s=
ans-serif"><div class=3D"gmail_default" style=3D"font-family:tahoma,sans-se=
rif">This is a list with some libraries that I have been looking at.</div><=
div class=3D"gmail_default" style=3D"font-family:tahoma,sans-serif"><br></d=
iv><div class=3D"gmail_default" style=3D"font-family:tahoma,sans-serif">The=
 idea is to discuss the advantages and disadvantages of adding some of thes=
e libraries to Xapian.<br></div><div class=3D"gmail_default" style=3D"font-=
family:tahoma,sans-serif"><br></div><div class=3D"gmail_default" style=3D"f=
ont-family:tahoma,sans-serif">If anyone knows another library that could be=
 add to the list it would be great!</div><div class=3D"gmail_default" style=
=3D"font-family:tahoma,sans-serif"><br></div><div><div style=3D"font-family=
:tahoma,sans-serif" class=3D"gmail_default">Libfreexl:<br>* For Excel (.xls=
)<br>* Last release: 2018-02<br>* Info: <a href=3D"http://gaia-gis.it/fossi=
l/freexl/index" target=3D"_blank">gaia-gis.it/fossil/freexl/index</a><br>* =
License: MPL tri-license<br><br>=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D<br><br>Libzip:<br>* For zi=
p archives(C library)<br>* Last release 2018-04<br>* Info: <a href=3D"http:=
//libzip.org" target=3D"_blank">libzip.org</a><br>* License: 3-clause BSD<b=
r><br>Libzipios++:<br>* For zip archives<br>* Last release 2019-04<br>* Inf=
o: <a href=3D"http://zipios.sourceforge.net" target=3D"_blank">zipios.sourc=
eforge.net</a><br>* License: GNU Lesser General Public License (LGPL)<br></=
div><div style=3D"font-family:tahoma,sans-serif" class=3D"gmail_default"><d=
iv><div style=3D"font-family:tahoma,sans-serif" class=3D"gmail_default"><br=
></div><div style=3D"font-family:tahoma,sans-serif" class=3D"gmail_default"=
>I
 have been thinking about unzip. It is widely use in omindex an it might
 be an option to replace unzip with one of this libraries. I know that=20
it is not the best solution, but it could be something to consider for=20
some formats.<br></div></div></div><div style=3D"font-family:tahoma,sans-se=
rif" class=3D"gmail_default"><br>=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D<br><br>Djvulibre: <br>* Fo=
r DjVu files<br>* Last release: 2015-02<br>* Info: <a href=3D"http://djvu.s=
ourceforge.net" target=3D"_blank">djvu.sourceforge.net</a><br>* License: GN=
U General Public License version 2<br></div><div style=3D"font-family:tahom=
a,sans-serif" class=3D"gmail_default"><br>=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D</div><div style=
=3D"font-family:tahoma,sans-serif" class=3D"gmail_default"><br>Libe-book:<b=
r>* For ebooks formats<br>* Last release 2018-01<br>* It shows little activ=
ity<br>* Status: Beta<br>* Info: <a href=3D"http://sourceforge.net/projects=
/libebook/" target=3D"_blank">sourceforge.net/projects/libebook/</a><br>* L=
icense: GNU Lesser GPL 2.1+ and MPL 2.0+<br></div><div style=3D"font-family=
:tahoma,sans-serif" class=3D"gmail_default"><br></div><div style=3D"font-fa=
mily:tahoma,sans-serif" class=3D"gmail_default">I have been reading the cod=
e of this library, but it seems a bit complex. <br></div><div style=3D"font=
-family:tahoma,sans-serif" class=3D"gmail_default">It could be a good optio=
n, but it will take a while to figure it out how it works.<br></div><div st=
yle=3D"font-family:tahoma,sans-serif" class=3D"gmail_default"><br>=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D</div><div style=3D"font-family:tahoma,sans-serif" class=3D"gmail_def=
ault"><br>Libetonyek-dev:<br>* For Apple iWork documents<br>* Status: Beta<=
br>* Info: <a href=3D"http://wiki.documentfoundation.org/DLP/Libraries/libe=
tonyek" target=3D"_blank">wiki.documentfoundation.org/DLP/Libraries/libeton=
yek</a><br>* License: MPL 2.0+<br><br>=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D</div><div style=3D"f=
ont-family:tahoma,sans-serif" class=3D"gmail_default"><br>Libabw:<br>* For =
AbiWord documents<br>* Last release 2017-12<br>* Info: <a href=3D"http://wi=
ki.documentfoundation.org/DLP/Libraries/libabw" target=3D"_blank">wiki.docu=
mentfoundation.org/DLP/Libraries/libabw</a><br>* License: MPL 2.0<br><br>=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D</div><div style=3D"font-family:tahoma,sans-serif" class=3D"=
gmail_default"><br>Other Options:<br>* libreoffice-dev(SDK)<br>* libmarkdow=
n2-dev</div></div></div></div>

--000000000000e83673058b4749ff--