[GSoC] Questions about project Text-Extraction Libraries

Bruno Baruffaldi <[email protected]> Thu, 21 Mar 2019 09:31:26 -0300
Newsgroups gmane.comp.search.xapian.devel
Message-ID <CAND-c9Mg19nvcQOx0B9KO6S=Q2=4WAHQnJ4K3agiAbCfu7=O9g@mail.gmail.com>
--00000000000062878d058499eb7d
Content-Type: text/plain; charset="UTF-8"

Hello!

I have a few question related to the project Text-Extraction Libraries.

Firstly, I think that trying to isolate library bugs in subprocesses could
get to work, but I am not sure about how to handle deadlocks or infinite
loops. I feel that using a timer is the only way to deal with it but I
would like to know what you think about it.

Secondly, I have been reading the source code of ominex, but I cannot
figure out if it is possible to group all file formats under the same
interface. When indexing files, are all file formats treated in a similar
way, or are there special formats that require a different work (beyond the
use of external filters)?

To sum up, I want to know if ominex use multithreading for indexing files
or if you consider that it could be implemented to speed it up.

Cheers,
   Bruno Baruffaldi

--00000000000062878d058499eb7d
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr"><div class=3D"gmail_default" style=3D"font-family:tahoma,s=
ans-serif"><div style=3D"font-family:tahoma,sans-serif" class=3D"gmail_defa=
ult"><p dir=3D"ltr" style=3D"line-height:1.38;margin-top:0pt;margin-bottom:=
0pt" id=3D"gmail-m_-349343913123026912gmail-docs-internal-guid-d40163f2-7ff=
f-826b-e479-1a604174fe5e"><span style=3D"font-size:11pt;font-family:Arial;c=
olor:rgb(0,0,0);background-color:transparent;font-weight:400;font-style:nor=
mal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-=
space:pre-wrap">Hello!</span></p><p dir=3D"ltr" style=3D"line-height:1.38;m=
argin-top:0pt;margin-bottom:0pt"><span style=3D"font-size:11pt;font-family:=
Arial;color:rgb(0,0,0);background-color:transparent;font-weight:400;font-st=
yle:normal;font-variant:normal;text-decoration:none;vertical-align:baseline=
;white-space:pre-wrap">I have a few question related to the project Text-Ex=
traction Libraries.</span></p><br><p dir=3D"ltr" style=3D"line-height:1.38;=
margin-top:0pt;margin-bottom:0pt"><span style=3D"font-size:11pt;font-family=
:Arial;color:rgb(0,0,0);background-color:transparent;font-weight:400;font-s=
tyle:normal;font-variant:normal;text-decoration:none;vertical-align:baselin=
e;white-space:pre-wrap">Firstly, I think that trying to isolate library bug=
s in subprocesses could get to work, but I am not sure about how to handle =
deadlocks or infinite loops. I feel that using a timer is the only way to d=
eal with it but I would like to know what you think about it.</span></p><br=
><p dir=3D"ltr" style=3D"line-height:1.38;margin-top:0pt;margin-bottom:0pt"=
><span style=3D"font-size:11pt;font-family:Arial;color:rgb(0,0,0);backgroun=
d-color:transparent;font-weight:400;font-style:normal;font-variant:normal;t=
ext-decoration:none;vertical-align:baseline;white-space:pre-wrap">Secondly,=
 I have been reading the source code of ominex, but I cannot figure out if =
it is possible to group all file formats under the same interface. When ind=
exing files, are all file formats treated in a similar way, or are there sp=
ecial formats that require a different work <span class=3D"gmail-tlid-trans=
lation gmail-translation" lang=3D"en"><span title=3D"" class=3D"gmail-">(be=
yond the use of external filters)</span></span>?</span></p><br><p dir=3D"lt=
r" style=3D"line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style=
=3D"font-size:11pt;font-family:Arial;color:rgb(0,0,0);background-color:tran=
sparent;font-weight:400;font-style:normal;font-variant:normal;text-decorati=
on:none;vertical-align:baseline;white-space:pre-wrap">To sum up, I want to =
know if ominex use multithreading for indexing files or if you consider tha=
t it could be implemented to speed it up.</span></p></div><div style=3D"fon=
t-family:tahoma,sans-serif" class=3D"gmail_default"><br></div><div style=3D=
"font-family:tahoma,sans-serif" class=3D"gmail_default">Cheers,<br></div><d=
iv dir=3D"ltr">=C2=A0=C2=A0 Bruno Baruffaldi</div></div><br></div>

--00000000000062878d058499eb7d--