[GSoC] Questions about project Text-Extraction Libraries
Bruno Baruffaldi <[email protected]> Thu, 21 Mar 2019 09:31:26 -0300
| Newsgroups | gmane.comp.search.xapian.devel |
|---|---|
| Message-ID | <CAND-c9Mg19nvcQOx0B9KO6S=Q2=4WAHQnJ4K3agiAbCfu7=O9g@mail.gmail.com> |
--00000000000062878d058499eb7d Content-Type: text/plain; charset="UTF-8" Hello! I have a few question related to the project Text-Extraction Libraries. Firstly, I think that trying to isolate library bugs in subprocesses could get to work, but I am not sure about how to handle deadlocks or infinite loops. I feel that using a timer is the only way to deal with it but I would like to know what you think about it. Secondly, I have been reading the source code of ominex, but I cannot figure out if it is possible to group all file formats under the same interface. When indexing files, are all file formats treated in a similar way, or are there special formats that require a different work (beyond the use of external filters)? To sum up, I want to know if ominex use multithreading for indexing files or if you consider that it could be implemented to speed it up. Cheers, Bruno Baruffaldi --00000000000062878d058499eb7d Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable <div dir=3D"ltr"><div class=3D"gmail_default" style=3D"font-family:tahoma,s= ans-serif"><div style=3D"font-family:tahoma,sans-serif" class=3D"gmail_defa= ult"><p dir=3D"ltr" style=3D"line-height:1.38;margin-top:0pt;margin-bottom:= 0pt" id=3D"gmail-m_-349343913123026912gmail-docs-internal-guid-d40163f2-7ff= f-826b-e479-1a604174fe5e"><span style=3D"font-size:11pt;font-family:Arial;c= olor:rgb(0,0,0);background-color:transparent;font-weight:400;font-style:nor= mal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-= space:pre-wrap">Hello!</span></p><p dir=3D"ltr" style=3D"line-height:1.38;m= argin-top:0pt;margin-bottom:0pt"><span style=3D"font-size:11pt;font-family:= Arial;color:rgb(0,0,0);background-color:transparent;font-weight:400;font-st= yle:normal;font-variant:normal;text-decoration:none;vertical-align:baseline= ;white-space:pre-wrap">I have a few question related to the project Text-Ex= traction Libraries.</span></p><br><p dir=3D"ltr" style=3D"line-height:1.38;= margin-top:0pt;margin-bottom:0pt"><span style=3D"font-size:11pt;font-family= :Arial;color:rgb(0,0,0);background-color:transparent;font-weight:400;font-s= tyle:normal;font-variant:normal;text-decoration:none;vertical-align:baselin= e;white-space:pre-wrap">Firstly, I think that trying to isolate library bug= s in subprocesses could get to work, but I am not sure about how to handle = deadlocks or infinite loops. I feel that using a timer is the only way to d= eal with it but I would like to know what you think about it.</span></p><br= ><p dir=3D"ltr" style=3D"line-height:1.38;margin-top:0pt;margin-bottom:0pt"= ><span style=3D"font-size:11pt;font-family:Arial;color:rgb(0,0,0);backgroun= d-color:transparent;font-weight:400;font-style:normal;font-variant:normal;t= ext-decoration:none;vertical-align:baseline;white-space:pre-wrap">Secondly,= I have been reading the source code of ominex, but I cannot figure out if = it is possible to group all file formats under the same interface. When ind= exing files, are all file formats treated in a similar way, or are there sp= ecial formats that require a different work <span class=3D"gmail-tlid-trans= lation gmail-translation" lang=3D"en"><span title=3D"" class=3D"gmail-">(be= yond the use of external filters)</span></span>?</span></p><br><p dir=3D"lt= r" style=3D"line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style= =3D"font-size:11pt;font-family:Arial;color:rgb(0,0,0);background-color:tran= sparent;font-weight:400;font-style:normal;font-variant:normal;text-decorati= on:none;vertical-align:baseline;white-space:pre-wrap">To sum up, I want to = know if ominex use multithreading for indexing files or if you consider tha= t it could be implemented to speed it up.</span></p></div><div style=3D"fon= t-family:tahoma,sans-serif" class=3D"gmail_default"><br></div><div style=3D= "font-family:tahoma,sans-serif" class=3D"gmail_default">Cheers,<br></div><d= iv dir=3D"ltr">=C2=A0=C2=A0 Bruno Baruffaldi</div></div><br></div> --00000000000062878d058499eb7d--