Re: Search not indexing Table content

Pawel Katarzynski <[email protected]>
Newsgroups gmane.comp.cms.tiki.user
Message-ID <MMXP123MB12779D56908BAA5E62A17AFFF8BE0@MMXP123MB1277.GBRP123.PROD.OUTLOOK.COM> 
Hi Marc,

I did changed back to mySQL full-text search engine, on options (General Setting tab) I have Unified search index ticked on, Excluded plugins and excluded categories – empty list, and exclude all plugins unticked.

I did rebuild index from command line again and still no luck with search
Below are logs and version I am using in case maybe there is something I missed or is incompatible . Thanks

# sudo -u apache php console.php index:rebuild --force --log
[2018-12-19 13:56] Started rebuilding index... logging to file: /tmp/Search_Indexer_mysql_tiki_wiki_console.log
Unified search engine: MySQL, version 10.0.37-MariaDB
PHP Notice:  A non well formed numeric value encountered in /var/www/html/tiki/lib/wiki-plugins/wikiplugin_split.php on line 171
PHP Notice:  A non well formed numeric value encountered in /var/www/html/tiki/lib/wiki-plugins/wikiplugin_split.php on line 171
….. That PHP Notice started to appear after disabling that exclude all plugins. (and its repeated like 50 times here)
PHP Notice:  A non well formed numeric value encountered in /var/www/html/tiki/lib/wiki-plugins/wikiplugin_split.php on line 171
Indexed
  wiki page: 48
  file: 0
  file gallery: 3
  comment: 0
  user: 10
  group: 14
  calendaritem: 0
  calendar: 0
  category: 0
  total fields in the search index: 43
Rebuilding index done
Execution time: 3 secs
Current Memory usage: 40.3 MiB
Memory peak usage before indexing: 14.6 MiB
Memory peak usage after indexing: 40.4 MiB
Number of queries: 1159


Log file (I’ve removed names and most of pages and users form it to make it easier to see and left all warnings and errors)

cat /tmp/Search_Indexer_mysql_tiki_wiki_console.log
2018-12-19T13:56:24+00:00 INFO (6): Starting rebuild {"memoryUsage":"16.9 MiB"}
2018-12-19T13:56:24+00:00 INFO (6): addDocument wiki page XXX {"memoryUsage":"16.9 MiB"}
…
2018-12-19T13:56:24+00:00 ERR (3): NOTICE: A non well formed numeric value encountered {"code":8,"file":"/var/www/html/tiki/lib/wiki-plugins/wikiplugin_split.php","line":171}
2018-12-19T13:56:24+00:00 ERR (3): NOTICE: A non well formed numeric value encountered {"code":8,"file":"/var/www/html/tiki/lib/wiki-plugins/wikiplugin_split.php","line":171}
2018-12-19T13:56:24+00:00 ERR (3): WARNING: A non-numeric value encountered {"code":2,"file":"/var/www/html/tiki/lib/wiki-plugins/wikiplugin_img.php","line":1570}
2018-12-19T13:56:24+00:00 ERR (3): NOTICE: A non well formed numeric value encountered {"code":8,"file":"/var/www/html/tiki/lib/wiki-plugins/wikiplugin_split.php","line":171}
2018-12-19T13:56:25+00:00 INFO (6): addDocument wiki page XXX {"memoryUsage":"21.1 MiB"}
….
2018-12-19T13:56:25+00:00 ERR (3): WARNING: A non-numeric value encountered {"code":2,"file":"/var/www/html/tiki/lib/wiki-plugins/wikiplugin_img.php","line":1570}
2018-12-19T13:56:25+00:00 ERR (3): NOTICE: A non well formed numeric value encountered {"code":8,"file":"/var/www/html/tiki/lib/wiki-plugins/wikiplugin_split.php","line":171}
2018-12-19T13:56:25+00:00 INFO (6): addDocument wiki page XXX {"memoryUsage":"21.2 MiB"}
2018-12-19T13:56:25+00:00 ERR (3): WARNING: A non-numeric value encountered {"code":2,"file":"/var/www/html/tiki/lib/wiki-plugins/wikiplugin_img.php","line":1570}
2018-12-19T13:56:25+00:00 ERR (3): NOTICE: A non well formed numeric value encountered {"code":8,"file":"/var/www/html/tiki/lib/wiki-plugins/wikiplugin_split.php","line":171}
2018-12-19T13:56:25+00:00 INFO (6): addDocument wiki page XXX {"memoryUsage":"21.4 MiB"}
…
2018-12-19T13:56:25+00:00 ERR (3): WARNING: A non-numeric value encountered {"code":2,"file":"/var/www/html/tiki/lib/wiki-plugins/wikiplugin_img.php","line":1570}
2018-12-19T13:56:25+00:00 ERR (3): NOTICE: A non well formed numeric value encountered {"code":8,"file":"/var/www/html/tiki/lib/wiki-plugins/wikiplugin_split.php","line":171}
2018-12-19T13:56:25+00:00 INFO (6): addDocument wiki page XXX {"memoryUsage":"22.0 MiB"}
…
2018-12-19T13:56:25+00:00 INFO (6): addDocument file gallery 1 {"memoryUsage":"22.0 MiB"}
2018-12-19T13:56:25+00:00 INFO (6): addDocument file gallery 2 {"memoryUsage":"21.9 MiB"}
2018-12-19T13:56:25+00:00 INFO (6): addDocument file gallery 3 {"memoryUsage":"21.9 MiB"}
2018-12-19T13:56:25+00:00 INFO (6): addDocument user YYYY  {"memoryUsage":"21.9 MiB"}
…
2018-12-19T13:56:25+00:00 INFO (6): addDocument group ZZZ {"memoryUsage":"22.0 MiB"}
…
2018-12-19T13:56:25+00:00 INFO (6): Starting optimization {"memoryUsage":"22.1 MiB"}
2018-12-19T13:56:25+00:00 INFO (6): Finished optimization {"memoryUsage":"22.1 MiB"}
2018-12-19T13:56:25+00:00 INFO (6): Finished rebuild {"memoryUsage":"22.1 MiB"}

No other errors appears.

Versions used:

# httpd -V
Server version: Apache/2.4.6 (CentOS)
Server built:   Nov  5 2018 01:47:09
Server's Module Magic Number: 20120211:24
Server loaded:  APR 1.4.8, APR-UTIL 1.5.2
Compiled using: APR 1.4.8, APR-UTIL 1.5.2
Architecture:   64-bit
Server MPM:     prefork
  threaded:     no
    forked:     yes (variable process count)
Server compiled with....
-D APR_HAS_SENDFILE
-D APR_HAS_MMAP
-D APR_HAVE_IPV6 (IPv4-mapped addresses enabled)
-D APR_USE_SYSVSEM_SERIALIZE
-D APR_USE_PTHREAD_SERIALIZE
-D SINGLE_LISTEN_UNSERIALIZED_ACCEPT
-D APR_HAS_OTHER_CHILD
-D AP_HAVE_RELIABLE_PIPED_LOGS
-D DYNAMIC_MODULE_LIMIT=256
-D HTTPD_ROOT="/etc/httpd"
-D SUEXEC_BIN="/usr/sbin/suexec"
-D DEFAULT_PIDLOG="/run/httpd/httpd.pid"
-D DEFAULT_SCOREBOARD="logs/apache_runtime_status"
-D DEFAULT_ERRORLOG="logs/error_log"
-D AP_TYPES_CONFIG_FILE="conf/mime.types"
-D SERVER_CONFIG_FILE="conf/httpd.conf"

# php --version
PHP 7.2.13 (cli) (built: Dec  8 2018 12:11:34) ( NTS )
Copyright (c) 1997-2018 The PHP Group
Zend Engine v3.2.0, Copyright (c) 1998-2018 Zend Technologies
    with Zend OPcache v7.2.13, Copyright (c) 1999-2018, by Zend Technologies

# mysql --version
mysql  Ver 15.1 Distrib 10.0.37-MariaDB, for Linux (x86_64) using readline 5.1

# cat /etc/redhat-release
CentOS Linux release 7.6.1810 (Core)

# uname -a
Linux hostname 3.10.0-957.1.3.el7.x86_64 #1 SMP Thu Nov 29 14:49:43 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux




Pawel

From: Marc Laporte <[email protected]>
Sent: 19 December 2018 13:26
To: Tiki users mailing list <[email protected]>
Subject: Re: [Tikiwiki-users] Search not indexing Table content

hmmmmm

Weird. There is another preference to exclude certain categories from the index, but I doubt you have activated it. And it would hide the whole page, not just the table.


One more idea:

Lucene is deprecated. Try MySQL FTS.

You can then use PhpMyAdmin or https://www.adminer.org<https://emea01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.adminer.org&data=02%7C01%7Cp.katarzynski%40kew.org%7C4f49ffe2801a46f45cd108d665b5939a%7C44892b45194046119753a4b3be4ea7fe%7C0%7C0%7C636808227897726947&sdata=CgpafaeN44I6yvmByoqSxlIsl0WeB88cKePFsDvoeOk%3D&reserved=0> to check the generated data.

Try to find the page, and what is stored in the index.

Marc





On Wednesday, December 19, 2018, Pawel Katarzynski <[email protected]<mailto:[email protected]>> wrote:
Hi Marc,

It did not made any change. I did "untick" by the "Exclude all plugins" in options. Did index rebuild using: # sudo -u apache php console.php index:rebuild --force --log. With Lucene as search engine, still no results found for any keyword that is in table.

Pawel

-----Original Message-----
From: Cloutier, Philippe (DGARI-Consultant) <[email protected]<mailto:[email protected]>>
Sent: 18 December 2018 21:40
To: Tiki users mailing list <[email protected]<mailto:[email protected]>>
Subject: Re: [Tikiwiki-users] Search not indexing Table content

>De : Marc Laporte [mailto:[email protected]<mailto:[email protected]>] Envoyé : 18 décembre
>2018 14:56
>
>This is because all plugin content is excluded by default.
>
>Instead, unified_exclude_all_plugins should be off
>
>
>It was added in r47124 and made it the default in r48096
>
>Here is: https://emea01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fsourceforge.net%2Fp%2Ftikiwiki%2Fcode%2F47124It&amp;data=02%7C01%7Cp.katarzynski%40kew.org%7Cf0393a3f6721444265a908d665315e76%7C44892b45194046119753a4b3be4ea7fe%7C0%7C0%7C636807660059308450&amp;sdata=OIopTlHxTEsA60V2kxFAMxbRZ2n3W1lDQ9M3jKfzcFA%3D&amp;reserved=0<https://emea01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fsourceforge.net%2Fp%2Ftikiwiki%2Fcode%2F47124It&data=02%7C01%7Cp.katarzynski%40kew.org%7C4f49ffe2801a46f45cd108d665b5939a%7C44892b45194046119753a4b3be4ea7fe%7C0%7C0%7C636808227897726947&sdata=NEfbjrEwy3nmaBbMpjLeeY0uj3utKJMnoQJF91Aphak%3D&reserved=0> was a good idea to add such a feature. A bad idea to activate by default in https://emea01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fsourceforge.net%2Fp%2Ftikiwiki%2Fcode%2F48096.So&amp;data=02%7C01%7Cp.katarzynski%40kew.org%7Cf0393a3f6721444265a908d665315e76%7C44892b45194046119753a4b3be4ea7fe%7C0%7C0%7C636807660059308450&amp;sdata=NNj7zwqHT9Tdszo8zcchvzuMH%2BiQ40jUyrc%2BUboa4xk%3D&amp;reserved=0<https://emea01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fsourceforge.net%2Fp%2Ftikiwiki%2Fcode%2F48096.So&data=02%7C01%7Cp.katarzynski%40kew.org%7C4f49ffe2801a46f45cd108d665b5939a%7C44892b45194046119753a4b3be4ea7fe%7C0%7C0%7C636808227897726947&sdata=z3NbgPor7J5u21HS%2Fgw3mGjJrzO9Bpnane%2BmI9oGK0U%3D&reserved=0> kicking the can down the road instead of addressing the issues. Would have been better to exclude plugins with known issues from the index. The result of this is that all future work on existing and new plugins was mostly done without taking into account the index.


I added that proposal to https://emea01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdev.tiki.org%2FDefault-Preferences-to-be-changed&amp;data=02%7C01%7Cp.katarzynski%40kew.org%7Cf0393a3f6721444265a908d665315e76%7C44892b45194046119753a4b3be4ea7fe%7C0%7C0%7C636807660059308450&amp;sdata=pYcQRTwMLvqtpDVSTMDCVx4am0wu92vHuIPGHS1VRxg%3D&amp;reserved=0<https://emea01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdev.tiki.org%2FDefault-Preferences-to-be-changed&data=02%7C01%7Cp.katarzynski%40kew.org%7C4f49ffe2801a46f45cd108d665b5939a%7C44892b45194046119753a4b3be4ea7fe%7C0%7C0%7C636808227897726947&sdata=biVYeVsjzGIRA8VsqYWcQnC%2FEKTbmXQe2LDT2tb%2Bhsw%3D&reserved=0> in version 19.

P.S. Your mail has strange formatting Marc (never noticed that before).

>Marc
>
>
>
>On Tuesday, December 18, 2018, Pawel Katarzynski
><[email protected]<mailto:[email protected]>>
>wrote:
>
>> Hi List,
>>
>>
>>
>> I am using tiki 18.2 and Search engine set to: MySQL Full-text search
>> (although I did tried with Lucene engine as well to same effect).
>>
>> Whenever I try to search for keyword that is inside table rather than
>> just a plain text I get no result.
>>
>>
>>
>> Example:
>>
>> [image: cid:[email protected]]
>>
>>
>>
>> If I search for “KEW-PTP-001” I get no results. I’ve rebuild index
>> few times since so its not indexing it at all.
>>
>> [image: cid:[email protected]]
>>
>>
>>
>> While checking logs form rebuild index – no matter if I use MySQL or
>> Lucene it always show an error in the end (although though Tiki
>> interface it always shows “done”)
>>
>>
>>
>> # php console.php index:rebuild --log
>>
>> [2018-12-18 17:06] Started rebuilding index... logging to file:
>> /tmp/Search_Indexer_mysql_tiki_wiki_console.log
>>
>> Unified search engine: MySQL, version 5.5.60-MariaDB
>>
>> Indexed
>>
>>   wiki page: 48
>>
>>   file: 2
>>
>>   file gallery: 3
>>
>>   comment: 0
>>
>>   user: 10
>>
>>   group: 14
>>
>>   calendaritem: 0
>>
>>   calendar: 0
>>
>>   category: 0
>>
>>   total fields in the search index: 49
>>
>> Rebuilding index done
>>
>> Execution time: 3 secs
>>
>> Current Memory usage: 34.8 MiB
>>
>> Memory peak usage before indexing: 14.6 MiB
>>
>> Memory peak usage after indexing: 34.9 MiB
>>
>> Number of queries: 1164
>>
>> [root@kptnetops01 tiki]# cat /tmp/Search_Indexer_lucene_console.log
>>
>> 2018-12-18T17:05:05+00:00 INFO (6): Starting rebuild
>> {"memoryUsage":"17.5 MiB"}
>>
>> …..
>>
>> 2018-12-18T17:05:07+00:00 INFO (6): Starting optimization
>> {"memoryUsage":"20.7 MiB"}
>>
>> 2018-12-18T17:05:07+00:00 INFO (6): Finished optimization
>> {"memoryUsage":"20.5 MiB"}
>>
>> 2018-12-18T17:05:07+00:00 INFO (6): Finished rebuild
>> {"memoryUsage":"20.5 MiB"}
>>
>> 2018-12-18T17:05:07+00:00 ERR (3): NOTICE: Undefined property:
>> Search_Lucene_Index::$lucene {"code":8,"file":"/var/www/htm
>> l/tiki/lib/core/Search/Lucene/Index.php","line":36}
>>
>>
>>
>> Any tips how to solve this issue will be appreciated. Most of my Wiki
>> pages are table content and hence make search unusable ☹
>>
>>
>>
>>
>>
>> Thanks
>>
>> *Pawel*

_______________________________________________
TikiWiki-users mailing list
[email protected]<mailto:[email protected]>
https://emea01.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.sourceforge.net%2Flists%2Flistinfo%2Ftikiwiki-users&amp;data=02%7C01%7Cp.katarzynski%40kew.org%7Cf0393a3f6721444265a908d665315e76%7C44892b45194046119753a4b3be4ea7fe%7C0%7C0%7C636807660059308450&amp;sdata=tFU7xMmgBSJYgw5ovu6cHpi8C5FlZ3Iku5ALLfL2qBM%3D&amp;reserved=0<https://emea01.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.sourceforge.net%2Flists%2Flistinfo%2Ftikiwiki-users&data=02%7C01%7Cp.katarzynski%40kew.org%7C4f49ffe2801a46f45cd108d665b5939a%7C44892b45194046119753a4b3be4ea7fe%7C0%7C0%7C636808227897883156&sdata=0pWx9jX9OpdHE1noekg2nNiObP67Pwt0u375EjfhCXA%3D&reserved=0>

_______________________________________________
TikiWiki-users mailing list
[email protected]<mailto:[email protected]>
https://lists.sourceforge.net/lists/listinfo/tikiwiki-users<https://emea01.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.sourceforge.net%2Flists%2Flistinfo%2Ftikiwiki-users&data=02%7C01%7Cp.katarzynski%40kew.org%7C4f49ffe2801a46f45cd108d665b5939a%7C44892b45194046119753a4b3be4ea7fe%7C0%7C0%7C636808227897883156&sdata=0pWx9jX9OpdHE1noekg2nNiObP67Pwt0u375EjfhCXA%3D&reserved=0>


--
Marc Laporte

http://WikiSuite.org<https://emea01.safelinks.protection.outlook.com/?url=http%3A%2F%2FWikiSuite.org&data=02%7C01%7Cp.katarzynski%40kew.org%7C4f49ffe2801a46f45cd108d665b5939a%7C44892b45194046119753a4b3be4ea7fe%7C0%7C0%7C636808227897883156&sdata=5kIIVGhcSWAsGoHVOYESv2ypm0rabfFBjFCNw%2F4xbuw%3D&reserved=0>
http://PluginProblems.com<https://emea01.safelinks.protection.outlook.com/?url=http%3A%2F%2FPluginProblems.com&data=02%7C01%7Cp.katarzynski%40kew.org%7C4f49ffe2801a46f45cd108d665b5939a%7C44892b45194046119753a4b3be4ea7fe%7C0%7C0%7C636808227897883156&sdata=zN97mNllTELx3TXCAVfzAes35UkkXkosx5zCwAS3Feg%3D&reserved=0>
http://Avan.Tech<https://emea01.safelinks.protection.outlook.com/?url=http%3A%2F%2FAvan.Tech&data=02%7C01%7Cp.katarzynski%40kew.org%7C4f49ffe2801a46f45cd108d665b5939a%7C44892b45194046119753a4b3be4ea7fe%7C0%7C0%7C636808227897883156&sdata=riEaXzOiF52YsAcml3eoOaczoeh3Y5rrVWTaskLtOBk%3D&reserved=0>

_______________________________________________
TikiWiki-users mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/tikiwiki-users
lmpx.com only provides a reader for public news (NNTP) servers. It is not affiliated with the servers or forums shown here and is not responsible for the content of articles, which is written by their respective authors.