Re: Search not indexing Table content

Hi Xavi,

I did try just now, no luck. Although some other searches started to provide slightly more results still no luck with table content.

Thanks though

Pawel

From: Xavier de Pedro <[email protected]>
Sent: 22 December 2018 02:02
To: Tiki users mailing list <[email protected]>; Pawel Katarzynski <[email protected]>
Subject: Re: [Tikiwiki-users] Search not indexing Table content


Hi Pawel

Can you try searching with asterisk after the search string?

searching foobar will not find a match in foobarlong

searching foobar* will (shouldm, afaik)  find a match in foobarlong

Maybe this is also applicable to strings with hyphens.

Just a guess

HTH

Xavi


On 19/12/18 15:04, Pawel Katarzynski wrote:
Hi Marc,

I did changed back to mySQL full-text search engine, on options (General Setting tab) I have Unified search index ticked on, Excluded plugins and excluded categories – empty list, and exclude all plugins unticked.

I did rebuild index from command line again and still no luck with search
Below are logs and version I am using in case maybe there is something I missed or is incompatible . Thanks

# sudo -u apache php console.php index:rebuild --force --log
[2018-12-19 13:56] Started rebuilding index... logging to file: /tmp/Search_Indexer_mysql_tiki_wiki_console.log
Unified search engine: MySQL, version 10.0.37-MariaDB
PHP Notice:  A non well formed numeric value encountered in /var/www/html/tiki/lib/wiki-plugins/wikiplugin_split.php on line 171
PHP Notice:  A non well formed numeric value encountered in /var/www/html/tiki/lib/wiki-plugins/wikiplugin_split.php on line 171
….. That PHP Notice started to appear after disabling that exclude all plugins. (and its repeated like 50 times here)
PHP Notice:  A non well formed numeric value encountered in /var/www/html/tiki/lib/wiki-plugins/wikiplugin_split.php on line 171
Indexed
  wiki page: 48
  file: 0
  file gallery: 3
  comment: 0
  user: 10
  group: 14
  calendaritem: 0
  calendar: 0
  category: 0
  total fields in the search index: 43
Rebuilding index done
Execution time: 3 secs
Current Memory usage: 40.3 MiB
Memory peak usage before indexing: 14.6 MiB
Memory peak usage after indexing: 40.4 MiB
Number of queries: 1159


Log file (I’ve removed names and most of pages and users form it to make it easier to see and left all warnings and errors)

cat /tmp/Search_Indexer_mysql_tiki_wiki_console.log
2018-12-19T13:56:24+00:00 INFO (6): Starting rebuild {"memoryUsage":"16.9 MiB"}
2018-12-19T13:56:24+00:00 INFO (6): addDocument wiki page XXX {"memoryUsage":"16.9 MiB"}
…
2018-12-19T13:56:24+00:00 ERR (3): NOTICE: A non well formed numeric value encountered {"code":8,"file":"/var/www/html/tiki/lib/wiki-plugins/wikiplugin_split.php","line":171}
2018-12-19T13:56:24+00:00 ERR (3): NOTICE: A non well formed numeric value encountered {"code":8,"file":"/var/www/html/tiki/lib/wiki-plugins/wikiplugin_split.php","line":171}
2018-12-19T13:56:24+00:00 ERR (3): WARNING: A non-numeric value encountered {"code":2,"file":"/var/www/html/tiki/lib/wiki-plugins/wikiplugin_img.php","line":1570}
2018-12-19T13:56:24+00:00 ERR (3): NOTICE: A non well formed numeric value encountered {"code":8,"file":"/var/www/html/tiki/lib/wiki-plugins/wikiplugin_split.php","line":171}
2018-12-19T13:56:25+00:00 INFO (6): addDocument wiki page XXX {"memoryUsage":"21.1 MiB"}
….
2018-12-19T13:56:25+00:00 ERR (3): WARNING: A non-numeric value encountered {"code":2,"file":"/var/www/html/tiki/lib/wiki-plugins/wikiplugin_img.php","line":1570}
2018-12-19T13:56:25+00:00 ERR (3): NOTICE: A non well formed numeric value encountered {"code":8,"file":"/var/www/html/tiki/lib/wiki-plugins/wikiplugin_split.php","line":171}
2018-12-19T13:56:25+00:00 INFO (6): addDocument wiki page XXX {"memoryUsage":"21.2 MiB"}
2018-12-19T13:56:25+00:00 ERR (3): WARNING: A non-numeric value encountered {"code":2,"file":"/var/www/html/tiki/lib/wiki-plugins/wikiplugin_img.php","line":1570}
2018-12-19T13:56:25+00:00 ERR (3): NOTICE: A non well formed numeric value encountered {"code":8,"file":"/var/www/html/tiki/lib/wiki-plugins/wikiplugin_split.php","line":171}
2018-12-19T13:56:25+00:00 INFO (6): addDocument wiki page XXX {"memoryUsage":"21.4 MiB"}
…
2018-12-19T13:56:25+00:00 ERR (3): WARNING: A non-numeric value encountered {"code":2,"file":"/var/www/html/tiki/lib/wiki-plugins/wikiplugin_img.php","line":1570}
2018-12-19T13:56:25+00:00 ERR (3): NOTICE: A non well formed numeric value encountered {"code":8,"file":"/var/www/html/tiki/lib/wiki-plugins/wikiplugin_split.php","line":171}
2018-12-19T13:56:25+00:00 INFO (6): addDocument wiki page XXX {"memoryUsage":"22.0 MiB"}
…
2018-12-19T13:56:25+00:00 INFO (6): addDocument file gallery 1 {"memoryUsage":"22.0 MiB"}
2018-12-19T13:56:25+00:00 INFO (6): addDocument file gallery 2 {"memoryUsage":"21.9 MiB"}
2018-12-19T13:56:25+00:00 INFO (6): addDocument file gallery 3 {"memoryUsage":"21.9 MiB"}
2018-12-19T13:56:25+00:00 INFO (6): addDocument user YYYY {"memoryUsage":"21.9 MiB"}
…
2018-12-19T13:56:25+00:00 INFO (6): addDocument group ZZZ {"memoryUsage":"22.0 MiB"}
…
2018-12-19T13:56:25+00:00 INFO (6): Starting optimization {"memoryUsage":"22.1 MiB"}
2018-12-19T13:56:25+00:00 INFO (6): Finished optimization {"memoryUsage":"22.1 MiB"}
2018-12-19T13:56:25+00:00 INFO (6): Finished rebuild {"memoryUsage":"22.1 MiB"}

No other errors appears.

Versions used:

# httpd -V
Server version: Apache/2.4.6 (CentOS)
Server built:   Nov  5 2018 01:47:09
Server's Module Magic Number: 20120211:24
Server loaded: APR 1.4.8, APR-UTIL 1.5.2
Compiled using: APR 1.4.8, APR-UTIL 1.5.2
Architecture:   64-bit
Server MPM:     prefork
  threaded:     no
    forked:     yes (variable process count)
Server compiled with....
-D APR_HAS_SENDFILE
-D APR_HAS_MMAP
-D APR_HAVE_IPV6 (IPv4-mapped addresses enabled)
-D APR_USE_SYSVSEM_SERIALIZE
-D APR_USE_PTHREAD_SERIALIZE
-D SINGLE_LISTEN_UNSERIALIZED_ACCEPT
-D APR_HAS_OTHER_CHILD
-D AP_HAVE_RELIABLE_PIPED_LOGS
-D DYNAMIC_MODULE_LIMIT=256
-D HTTPD_ROOT="/etc/httpd"
-D SUEXEC_BIN="/usr/sbin/suexec"
-D DEFAULT_PIDLOG="/run/httpd/httpd.pid"
-D DEFAULT_SCOREBOARD="logs/apache_runtime_status"
-D DEFAULT_ERRORLOG="logs/error_log"
-D AP_TYPES_CONFIG_FILE="conf/mime.types"
-D SERVER_CONFIG_FILE="conf/httpd.conf"

# php --version
PHP 7.2.13 (cli) (built: Dec 8 2018 12:11:34) ( NTS )
Copyright (c) 1997-2018 The PHP Group
Zend Engine v3.2.0, Copyright (c) 1998-2018 Zend Technologies
    with Zend OPcache v7.2.13, Copyright (c) 1999-2018, by Zend Technologies

# mysql --version
mysql  Ver 15.1 Distrib 10.0.37-MariaDB, for Linux (x86_64) using readline 5.1

# cat /etc/redhat-release
CentOS Linux release 7.6.1810 (Core)

# uname -a
Linux hostname 3.10.0-957.1.3.el7.x86_64 #1 SMP Thu Nov 29 14:49:43 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux




Pawel

From: Marc Laporte <[email protected]><mailto:[email protected]>
Sent: 19 December 2018 13:26
To: Tiki users mailing list <[email protected]><mailto:[email protected]>
Subject: Re: [Tikiwiki-users] Search not indexing Table content

hmmmmm

Weird. There is another preference to exclude certain categories from the index, but I doubt you have activated it. And it would hide the whole page, not just the table.


One more idea:

Lucene is deprecated. Try MySQL FTS.

You can then use PhpMyAdmin or https://www.adminer.org<https://emea01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.adminer.org&data=02%7C01%7Cp.katarzynski%40kew.org%7C4f49ffe2801a46f45cd108d665b5939a%7C44892b45194046119753a4b3be4ea7fe%7C0%7C0%7C636808227897726947&sdata=CgpafaeN44I6yvmByoqSxlIsl0WeB88cKePFsDvoeOk%3D&reserved=0> to check the generated data.

Try to find the page, and what is stored in the index.

Marc





On Wednesday, December 19, 2018, Pawel Katarzynski <[email protected]<mailto:[email protected]>> wrote:
Hi Marc,

It did not made any change. I did "untick" by the "Exclude all plugins" in options. Did index rebuild using: # sudo -u apache php console.php index:rebuild --force --log. With Lucene as search engine, still no results found for any keyword that is in table.

Pawel

-----Original Message-----
From: Cloutier, Philippe (DGARI-Consultant) <[email protected]<mailto:[email protected]>>
Sent: 18 December 2018 21:40
To: Tiki users mailing list <[email protected]<mailto:[email protected]>>
Subject: Re: [Tikiwiki-users] Search not indexing Table content

>De : Marc Laporte [mailto:[email protected]<mailto:[email protected]>] Envoyé : 18 décembre
>2018 14:56
>
>This is because all plugin content is excluded by default.
>
>Instead, unified_exclude_all_plugins should be off
>
>
>It was added in r47124 and made it the default in r48096
>
>Here is: https://emea01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fsourceforge.net%2Fp%2Ftikiwiki%2Fcode%2F47124It&amp;data=02%7C01%7Cp.katarzynski%40kew.org%7Cf0393a3f6721444265a908d665315e76%7C44892b45194046119753a4b3be4ea7fe%7C0%7C0%7C636807660059308450&amp;sdata=OIopTlHxTEsA60V2kxFAMxbRZ2n3W1lDQ9M3jKfzcFA%3D&amp;reserved=0<https://emea01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fsourceforge.net%2Fp%2Ftikiwiki%2Fcode%2F47124It&data=02%7C01%7Cp.katarzynski%40kew.org%7C4f49ffe2801a46f45cd108d665b5939a%7C44892b45194046119753a4b3be4ea7fe%7C0%7C0%7C636808227897726947&sdata=NEfbjrEwy3nmaBbMpjLeeY0uj3utKJMnoQJF91Aphak%3D&reserved=0> was a good idea to add such a feature. A bad idea to activate by default in https://emea01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fsourceforge.net%2Fp%2Ftikiwiki%2Fcode%2F48096.So&amp;data=02%7C01%7Cp.katarzynski%40kew.org%7Cf0393a3f6721444265a908d665315e76%7C44892b45194046119753a4b3be4ea7fe%7C0%7C0%7C636807660059308450&amp;sdata=NNj7zwqHT9Tdszo8zcchvzuMH%2BiQ40jUyrc%2BUboa4xk%3D&amp;reserved=0<https://emea01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fsourceforge.net%2Fp%2Ftikiwiki%2Fcode%2F48096.So&data=02%7C01%7Cp.katarzynski%40kew.org%7C4f49ffe2801a46f45cd108d665b5939a%7C44892b45194046119753a4b3be4ea7fe%7C0%7C0%7C636808227897726947&sdata=z3NbgPor7J5u21HS%2Fgw3mGjJrzO9Bpnane%2BmI9oGK0U%3D&reserved=0> kicking the can down the road instead of addressing the issues. Would have been better to exclude plugins with known issues from the index. The result of this is that all future work on existing and new plugins was mostly done without taking into account the index.


I added that proposal to https://emea01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdev.tiki.org%2FDefault-Preferences-to-be-changed&amp;data=02%7C01%7Cp.katarzynski%40kew.org%7Cf0393a3f6721444265a908d665315e76%7C44892b45194046119753a4b3be4ea7fe%7C0%7C0%7C636807660059308450&amp;sdata=pYcQRTwMLvqtpDVSTMDCVx4am0wu92vHuIPGHS1VRxg%3D&amp;reserved=0<https://emea01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdev.tiki.org%2FDefault-Preferences-to-be-changed&data=02%7C01%7Cp.katarzynski%40kew.org%7C4f49ffe2801a46f45cd108d665b5939a%7C44892b45194046119753a4b3be4ea7fe%7C0%7C0%7C636808227897726947&sdata=biVYeVsjzGIRA8VsqYWcQnC%2FEKTbmXQe2LDT2tb%2Bhsw%3D&reserved=0> in version 19.

P.S. Your mail has strange formatting Marc (never noticed that before).

>Marc
>
>
>
>On Tuesday, December 18, 2018, Pawel Katarzynski
><[email protected]<mailto:[email protected]>>
>wrote:
>
>> Hi List,
>>
>>
>>
>> I am using tiki 18.2 and Search engine set to: MySQL Full-text search
>> (although I did tried with Lucene engine as well to same effect).
>>
>> Whenever I try to search for keyword that is inside table rather than
>> just a plain text I get no result.
>>
>>
>>
>> Example:
>>
>> [image: cid:[email protected]]
>>
>>
>>
>> If I search for “KEW-PTP-001” I get no results. I’ve rebuild index
>> few times since so its not indexing it at all.
>>
>> [image: cid:[email protected]]
>>
>>
>>
>> While checking logs form rebuild index – no matter if I use MySQL or
>> Lucene it always show an error in the end (although though Tiki
>> interface it always shows “done”)
>>
>>
>>
>> # php console.php index:rebuild --log
>>
>> [2018-12-18 17:06] Started rebuilding index... logging to file:
>> /tmp/Search_Indexer_mysql_tiki_wiki_console.log
>>
>> Unified search engine: MySQL, version 5.5.60-MariaDB
>>
>> Indexed
>>
>>   wiki page: 48
>>
>>   file: 2
>>
>>   file gallery: 3
>>
>>   comment: 0
>>
>>   user: 10
>>
>>   group: 14
>>
>>   calendaritem: 0
>>
>>   calendar: 0
>>
>>   category: 0
>>
>>   total fields in the search index: 49
>>
>> Rebuilding index done
>>
>> Execution time: 3 secs
>>
>> Current Memory usage: 34.8 MiB
>>
>> Memory peak usage before indexing: 14.6 MiB
>>
>> Memory peak usage after indexing: 34.9 MiB
>>
>> Number of queries: 1164
>>
>> [root@kptnetops01 tiki]# cat /tmp/Search_Indexer_lucene_console.log
>>
>> 2018-12-18T17:05:05+00:00 INFO (6): Starting rebuild
>> {"memoryUsage":"17.5 MiB"}
>>
>> …..
>>
>> 2018-12-18T17:05:07+00:00 INFO (6): Starting optimization
>> {"memoryUsage":"20.7 MiB"}
>>
>> 2018-12-18T17:05:07+00:00 INFO (6): Finished optimization
>> {"memoryUsage":"20.5 MiB"}
>>
>> 2018-12-18T17:05:07+00:00 INFO (6): Finished rebuild
>> {"memoryUsage":"20.5 MiB"}
>>
>> 2018-12-18T17:05:07+00:00 ERR (3): NOTICE: Undefined property:
>> Search_Lucene_Index::$lucene {"code":8,"file":"/var/www/htm
>> l/tiki/lib/core/Search/Lucene/Index.php","line":36}
>>
>>
>>
>> Any tips how to solve this issue will be appreciated. Most of my Wiki
>> pages are table content and hence make search unusable ☹
>>
>>
>>
>>
>>
>> Thanks
>>
>> *Pawel*

_______________________________________________
TikiWiki-users mailing list
[email protected]<mailto:[email protected]>
https://emea01.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.sourceforge.net%2Flists%2Flistinfo%2Ftikiwiki-users&amp;data=02%7C01%7Cp.katarzynski%40kew.org%7Cf0393a3f6721444265a908d665315e76%7C44892b45194046119753a4b3be4ea7fe%7C0%7C0%7C636807660059308450&amp;sdata=tFU7xMmgBSJYgw5ovu6cHpi8C5FlZ3Iku5ALLfL2qBM%3D&amp;reserved=0<https://emea01.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.sourceforge.net%2Flists%2Flistinfo%2Ftikiwiki-users&data=02%7C01%7Cp.katarzynski%40kew.org%7C4f49ffe2801a46f45cd108d665b5939a%7C44892b45194046119753a4b3be4ea7fe%7C0%7C0%7C636808227897883156&sdata=0pWx9jX9OpdHE1noekg2nNiObP67Pwt0u375EjfhCXA%3D&reserved=0>

_______________________________________________
TikiWiki-users mailing list
[email protected]<mailto:[email protected]>
https://lists.sourceforge.net/lists/listinfo/tikiwiki-users<https://emea01.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.sourceforge.net%2Flists%2Flistinfo%2Ftikiwiki-users&data=02%7C01%7Cp.katarzynski%40kew.org%7C4f49ffe2801a46f45cd108d665b5939a%7C44892b45194046119753a4b3be4ea7fe%7C0%7C0%7C636808227897883156&sdata=0pWx9jX9OpdHE1noekg2nNiObP67Pwt0u375EjfhCXA%3D&reserved=0>


--
Marc Laporte

http://WikiSuite.org<https://emea01.safelinks.protection.outlook.com/?url=http%3A%2F%2FWikiSuite.org&data=02%7C01%7Cp.katarzynski%40kew.org%7C4f49ffe2801a46f45cd108d665b5939a%7C44892b45194046119753a4b3be4ea7fe%7C0%7C0%7C636808227897883156&sdata=5kIIVGhcSWAsGoHVOYESv2ypm0rabfFBjFCNw%2F4xbuw%3D&reserved=0>
http://PluginProblems.com<https://emea01.safelinks.protection.outlook.com/?url=http%3A%2F%2FPluginProblems.com&data=02%7C01%7Cp.katarzynski%40kew.org%7C4f49ffe2801a46f45cd108d665b5939a%7C44892b45194046119753a4b3be4ea7fe%7C0%7C0%7C636808227897883156&sdata=zN97mNllTELx3TXCAVfzAes35UkkXkosx5zCwAS3Feg%3D&reserved=0>
http://Avan.Tech<https://emea01.safelinks.protection.outlook.com/?url=http%3A%2F%2FAvan.Tech&data=02%7C01%7Cp.katarzynski%40kew.org%7C4f49ffe2801a46f45cd108d665b5939a%7C44892b45194046119753a4b3be4ea7fe%7C0%7C0%7C636808227897883156&sdata=riEaXzOiF52YsAcml3eoOaczoeh3Y5rrVWTaskLtOBk%3D&reserved=0>




_______________________________________________

TikiWiki-users mailing list

[email protected]<mailto:[email protected]>

https://lists.sourceforge.net/lists/listinfo/tikiwiki-users<https://lists.sourceforge.net/lists/listinfo/tikiwiki-users>

Disclaimer

The information contained in this communication from the sender is confidential. It is intended solely for use by the recipient and others authorized to receive it. If you are not the recipient, you are hereby notified that any disclosure, copying, distribution or taking action in relation of the contents of this information is strictly prohibited and may be unlawful.

This email has been scanned for viruses and malware, and may have been automatically archived by Mimecast Ltd, an innovator in Software as a Service (SaaS) for business. Providing a safer and more useful place for your human generated data. Specializing in; Security, archiving and compliance. To find out more visit the Mimecast website.

_______________________________________________
TikiWiki-users mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/tikiwiki-users