Re: struggling with running GIFT...

"Niles Johnson" <[email protected]> Tue, 22 Jul 2008 20:54:43 -0500
Newsgroups gmane.comp.gnu.gift.general
Message-ID <[email protected]>
Hi Neville,

Sorry for the delayed response . . . here I've attached three files of
output from my GIFT installation so that we can try to tell the
difference between those errors that matter and those that don't.  I
made some annotations so that hopefully they're easier to read (for
example, I deleted parts where it lists all 20 or so of my image
collections).  Parts I've changed are marked with comments in *stars*.

'gift-index.txt'  contains the tail end of the output from indexing a
collection.  In particular, you will notice that the "ERROR in
generating inverted file" happens for me too.

'gift-server-start.txt'  contains the output dumped immediately after
starting the server.  Most of this seems very similar to the output
you have, although there are some slight differences in the
plugin-checking section (the part following "Configuring the
CAccessorFactoryContainer:").  I would guess these are due to
platform/configuration differences, but I don't really know much about
that.

'gift-query.txt'  shows the output when I ran a few queries through:
getting a random set of images and refining the results a few times.
This is the part that looks most different, but could be due to
differences in our GIFT clients.  At this stage I started getting
tired, so I didn't really look too thoroughly there.

Let me know if this helps, or at least helps to generate new
questions.  By the way, the client I use is a modified version of the
one at 'gift.monosock.org'  The online demo seems to be down now, but
it looks like the source is still available.  I had to learn a little
php to get it working, and I think I had to install PEAR too, but I
did find it relatively easy to understand.

best,
Niles

p.s.  Maybe if some of the experts are listening they could look
through these files and help further pare them down to something
useful for troubleshooting?

_______________________________________________
help-GIFT mailing list
[email protected]
http://lists.gnu.org/mailman/listinfo/help-gift
gift-server-start.txt (text/plain, 13.6 KB)
GIFT:Starting Server
Random number generator has been seeded with 12530
gift: CAlgorithmCollection: The following is the config file 
located at "/*config*/*path*/gift-config.mrml" as read by this program: 
<?xml version="1.0" standalone="no"?>
<!DOCTYPE mrml SYSTEM "file:/Applications/GIFT/share/mrml.dtd">
<!-- 
*
*comments about MRML v.s. psgml, other rants*
*
-->
<mrml>
  <cui-configuration>
    <algorithm-list>
    <!--COMMENT 
         *about the 'new' definition of the default algorithm*
      -->
*algorithms follow*
      <algorithm algorithm-id="a-perl" algorithm-type="a-perl" algorithm-name="Perl link" collection-id="c-01" cui-base-type="perl" cui-perl-script-file="/Users/peachick/gift-embed-perl-modules.pl" cui-perl-package="CGIFTLink" cui-perl-query-function="processGIFTQueryCall" cui-perl-random-function="processGIFTRandomQueryCall" cui-weighting-function="ClassicalIDF">
        <query-paradigm-list>
           <query-paradigm type="inverted-file"/>
           <query-paradigm type="perl-demo"/>
        </query-paradigm-list>
        <property-sheet property-sheet-id="cui-p-1" property-sheet-type="subset" send-type="none" minsubsetsize="0" maxsubsetsize="1">
          <property-sheet property-sheet-id="cui-p0" caption="Modify default configuration" property-sheet-type="set-element" send-type="none"/>
        </property-sheet>
      </algorithm>
      <algorithm algorithm-id="a-cidf" algorithm-type="a-cidf" algorithm-name="Classical IDF" collection-id="c-01" cui-block-color-histogram="no" cui-block-color-blocks="no" cui-block-texture-histogram="no" cui-block-texture-blocks="no" cui-pr-percentage-of-features="70" cui-base-type="inverted_file" cui-weighting-function="ClassicalIDF">
        <query-paradigm-list>
           <query-paradigm/><!-- match anything -->
        </query-paradigm-list>
        <property-sheet property-sheet-id="cui-p-1" property-sheet-type="subset" send-type="none" minsubsetsize="0" maxsubsetsize="1">
          <property-sheet property-sheet-id="cui-p0" caption="Modify default configuration" property-sheet-type="set-element" send-type="none">
  	  <property-sheet property-sheet-id="cui-p15" caption="Prune at % of features" property-sheet-type="numeric" send-type="attribute" send-name="cui-pr-percentage-of-features" from="20" to="100" step="5" send-value="70"/>
  	  <property-sheet property-sheet-id="cui-p1" property-sheet-type="subset" send-type="none" minsubsetsize="1" maxsubsetsize="4">
   	    <property-sheet property-sheet-id="cui-p12" send-boolean-inverted="yes" caption="Colour blocks" property-sheet-type="set-element" send-type="attribute" send-name="cui-block-color-blocks" send-value="yes"/>
  	    <property-sheet property-sheet-id="cui-p14" send-boolean-inverted="yes" caption="Gabor blocks" property-sheet-type="set-element" send-type="attribute" send-name="cui-block-texture-blocks" send-value="yes"/>
  	    <property-sheet property-sheet-id="cui-p13" send-boolean-inverted="yes" caption="Gabor histogram" property-sheet-type="set-element" send-type="attribute" send-name="cui-block-texture-histogram" send-value="yes"/>
  	    <property-sheet property-sheet-id="cui-p11" send-boolean-inverted="yes" caption="Colour histogram" property-sheet-type="set-element" send-type="attribute" send-name="cui-block-color-histogram" send-value="yes"/>
            </property-sheet>
          </property-sheet>
        </property-sheet>
     </algorithm><!-- a-cidf -->
      <algorithm algorithm-id="adefault" algorithm-type="adefault" algorithm-name="Separate Normalisation" collection-id="c-01" cui-block-color-histogram="no" cui-block-color-blocks="no" cui-block-texture-histogram="no" cui-block-texture-blocks="no" cui-pr-percentage-of-features="70" cui-base-type="multiple" cui-weighting-function="ClassicalIDF">
      <algorithm algorithm-id="sub1" algorithm-type="sub1" algorithm-name="sub1" cui-block-color-blocks="yes" cui-block-texture-histogram="yes" cui-block-texture-blocks="yes" cui-pr-percentage-of-features="100" cui-base-type="inverted_file"/>
      <algorithm algorithm-id="sub2" algorithm-type="sub2" algorithm-name="sub2" cui-block-color-histogram="yes" cui-block-texture-histogram="yes" cui-block-texture-blocks="yes" cui-base-type="inverted_file"/>
      <algorithm algorithm-id="sub3" algorithm-type="sub3" algorithm-name="sub3" cui-block-color-histogram="yes" cui-block-color-blocks="yes" cui-block-texture-blocks="yes" cui-pr-percentage-of-features="100" cui-base-type="inverted_file"/>
      <algorithm algorithm-id="sub4" algorithm-type="sub4" algorithm-name="sub4" cui-block-color-histogram="yes" cui-block-color-blocks="yes" cui-block-texture-histogram="yes" cui-base-type="inverted_file"/>
        <query-paradigm-list>
           <query-paradigm/><!-- match anything -->
        </query-paradigm-list>
        <property-sheet property-sheet-id="cui-p-1" property-sheet-type="subset" send-type="none" minsubsetsize="0" maxsubsetsize="1">
          <property-sheet property-sheet-id="cui-p0" caption="Modify default configuration" property-sheet-type="set-element" send-type="none">
  	  <property-sheet property-sheet-id="cui-p15" caption="Prune at % of features" property-sheet-type="numeric" send-type="attribute" send-name="cui-pr-percentage-of-features" from="20" to="100" step="5" send-value="70"/>
  	  <property-sheet property-sheet-id="cui-p1" property-sheet-type="subset" send-type="none" minsubsetsize="1" maxsubsetsize="4">
   	    <property-sheet property-sheet-id="cui-p12" send-boolean-inverted="yes" caption="Colour blocks" property-sheet-type="set-element" send-type="attribute" send-name="cui-block-color-blocks" send-value="yes"/>
  	    <property-sheet property-sheet-id="cui-p14" send-boolean-inverted="yes" caption="Gabor blocks" property-sheet-type="set-element" send-type="attribute" send-name="cui-block-texture-blocks" send-value="yes"/>
  	    <property-sheet property-sheet-id="cui-p13" send-boolean-inverted="yes" caption="Gabor histogram" property-sheet-type="set-element" send-type="attribute" send-name="cui-block-texture-histogram" send-value="yes"/>
  	    <property-sheet property-sheet-id="cui-p11" send-boolean-inverted="yes" caption="Colour histogram" property-sheet-type="set-element" send-type="attribute" send-name="cui-block-color-histogram" send-value="yes"/>
            </property-sheet>
          </property-sheet>
        </property-sheet>
     </algorithm><!-- a-cidf  -->
    </algorithm-list>
    <cui-algorithm-id-list-list>	
      <cui-algorithm-id-list cui-algorithm-id-list-id="ail-inverted-file">
	<cui-algorithm-id cui-algorithm-id="a-cidf"/>
      </cui-algorithm-id-list>
    </cui-algorithm-id-list-list>	
    <collection-list listid="1">

<!-- xxyx gift-add-collection xyxx DEPENDS ON THIS LINE -->

    <collection collection-id="c-*numbers*-*separated*-*by*-*dashes*" collection-name="*Image Collection*" cui-algorithm-id-list-id="ail-inverted-file" cui-number-of-images="*NN*" cui-base-dir="/*your*/*base*/*dir*/gift-indexing-data/Full-Image-Collection/" cui-inverted-file-location="InvertedFile.db" cui-offset-file-location="InvertedFileOffset.db" cui-feature-description-location="InvertedFileFeatureDescription.db" cui-feature-file-location="url2fts.xml">
					 <query-paradigm-list>
					 <query-paradigm type="inverted-file"/>
					 <query-paradigm type="perl-demo"/>
					 </query-paradigm-list>
					 </collection>
*
*information about other collections follows*
*
</collection-list>
  </cui-configuration>
</mrml>
*
*comments about/for emacs*
*
This config file content will now be parsed by an XML parser 
If error messages occur, these are related to the content shown above.
++/+//++//++//+++/++/+/+/+////+/+/+/+/++//+++/++/+/+/+////gift: CAlgorithmCollection: The config file has 
been parsed successfully by CAlgorithmCollection
maybe other parts of the program will also parse
the same config file. 
-----
Configuring CAccessorAdminCollection
../*some*/*path*/lib....--
Configuring the CAccessorFactoryContainer:
I am going to scan the following directorys for plugins 
/*some*/*path*/lib
Not testing file:. (File name does not match plugin name) 
Not testing file:.. (File name does not match plugin name)
* 
*possibly more files also not tested, for the same reason* (File name does not match plugin name) 
*
libGIFTAcDistanceMatrix.0.0.0.dylib contains a sane GIFT Accessor plugin: distance_matrix
Lib:libGIFTAcDistanceMatrix, to be linked from libGIFTAcDistanceMatrix.0.dylib already registered! 
Lib:libGIFTAcDistanceMatrix, to be linked from libGIFTAcDistanceMatrix.a already registered! 
Lib:libGIFTAcDistanceMatrix, to be linked from libGIFTAcDistanceMatrix.dylib already registered! 
Lib:libGIFTAcDistanceMatrix, to be linked from libGIFTAcDistanceMatrix.la already registered! 
libGIFTAcHierarchy.0.0.0.dylib contains a sane GIFT Accessor plugin: hierarchy
Lib:libGIFTAcHierarchy, to be linked from libGIFTAcHierarchy.0.dylib already registered! 
Lib:libGIFTAcHierarchy, to be linked from libGIFTAcHierarchy.a already registered! 
Lib:libGIFTAcHierarchy, to be linked from libGIFTAcHierarchy.dylib already registered! 
Lib:libGIFTAcHierarchy, to be linked from libGIFTAcHierarchy.la already registered! 
libGIFTAcInvertedFile.0.0.0.so contains a sane GIFT Accessor plugin: inverted_file
Lib:libGIFTAcInvertedFile, to be linked from libGIFTAcInvertedFile.0.so already registered! 
Lib:libGIFTAcInvertedFile, to be linked from libGIFTAcInvertedFile.a already registered! 
Lib:libGIFTAcInvertedFile, to be linked from libGIFTAcInvertedFile.la already registered! 
Lib:libGIFTAcInvertedFile, to be linked from libGIFTAcInvertedFile.so already registered! 
Could not link to symbol libGIFTAcPerl_getClassName:dlsym(0x8fe34878, libGIFTAcPerl_getClassName): symbol not found
libGIFTAcPerl.0.0.0.dylib tested. Test FAILED. 
Could not link to symbol libGIFTAcPerl_getClassName:dlsym(0x8fe34878, libGIFTAcPerl_getClassName): symbol not found
libGIFTAcPerl.0.dylib tested. Test FAILED. 
Could not open library: 
dlopen(/*some*/*path*/lib/libGIFTAcPerl.a, 1): no suitable image found.  Did find:
	/*some*/*path*/lib/libGIFTAcPerl.a: unknown file type, first eight bytes: 0x21 0x3C 0x61 0x72 0x63 0x68 0x3E 0x0A
libGIFTAcPerl.a tested. Test FAILED. 
Could not link to symbol libGIFTAcPerl_getClassName:dlsym(0x8fe34878, libGIFTAcPerl_getClassName): symbol not found
libGIFTAcPerl.dylib tested. Test FAILED. 
Could not open library: 
dlopen(/*some*/*path*/lib/libGIFTAcPerl.la, 1): no suitable image found.  Did find:
	/*some*/*path*/lib/libGIFTAcPerl.la: unknown file type, first eight bytes: 0x23 0x20 0x6C 0x69 0x62 0x47 0x49 0x46
libGIFTAcPerl.la tested. Test FAILED. 
libGIFTAcURL2FTS.0.0.0.dylib contains a sane GIFT Accessor plugin: url2fts
Lib:libGIFTAcURL2FTS, to be linked from libGIFTAcURL2FTS.0.dylib already registered! 
Lib:libGIFTAcURL2FTS, to be linked from libGIFTAcURL2FTS.a already registered! 
Lib:libGIFTAcURL2FTS, to be linked from libGIFTAcURL2FTS.dylib already registered! 
Lib:libGIFTAcURL2FTS, to be linked from libGIFTAcURL2FTS.la already registered! 
FINISHED configuring the CAccessorFactoryContainer.
.--gift::CAccessorAdminCollection : I read the config file 
/Library/GIFT/gift-config.mrml
Now we will parse the contents of this file using an XML parser 
CAccessorAdminCollection: Adding collection *Image Collection*
under the ID c-*numbers*-*separated*-*by*-*dashes*
*
*other collections added*
*
The config file has been parsed 
successfully maybe other parts
of the program will also parse
the same config file. 
FINISHED configuring CAccessorAdminCollection.
FileSize:-1 characters
CI18nTranslator.cc:75: File unreadable.
Internationalization will be disabled in this run of the GIFT
--
Configuring CDynamicQueryFactory 
Looking for libGIFTQu*.so in directory 
/Applications/GIFT/lib
Not testing file:. (File name does not match plugin name) 
Not testing file:.. (File name does not match plugin name) 
* 
*possibly more files also not tested, for the same reason* (File name does not match plugin name) 
*
libGIFTQuHierarchy.0.0.0.dylib contains a sane GIFT Query plugin: hierarchy
Lib:libGIFTQuHierarchy, to be linked from libGIFTQuHierarchy.0.dylib already registered! 
Lib:libGIFTQuHierarchy, to be linked from libGIFTQuHierarchy.a already registered! 
Lib:libGIFTQuHierarchy, to be linked from libGIFTQuHierarchy.dylib already registered! 
Lib:libGIFTQuHierarchy, to be linked from libGIFTQuHierarchy.la already registered! 
libGIFTQuInvertedFile.0.0.0.dylib contains a sane GIFT Query plugin: inverted_file
Lib:libGIFTQuInvertedFile, to be linked from libGIFTQuInvertedFile.0.dylib already registered! 
Lib:libGIFTQuInvertedFile, to be linked from libGIFTQuInvertedFile.a already registered! 
Lib:libGIFTQuInvertedFile, to be linked from libGIFTQuInvertedFile.dylib already registered! 
Lib:libGIFTQuInvertedFile, to be linked from libGIFTQuInvertedFile.la already registered! 
dlsym(0x8fe347ac, libGIFTQuPerl_getClassName): symbol not found
dlsym(0x8fe347ac, libGIFTQuPerl_getClassName): symbol not found
..Could not open library: 
dlopen(/*some*/path*/lib/libGIFTQuPerl.a, 1): no suitable image found.  Did find:
	/*some*/path*/lib/libGIFTQuPerl.a: unknown file type, first eight bytes: 0x21 0x3C 0x61 0x72 0x63 0x68 0x3E 0x0A
dlsym(0x8fe347ac, libGIFTQuPerl_getClassName): symbol not found
..Could not open library: 
dlopen(/*some*/path*/lib/libGIFTQuPerl.la, 1): no suitable image found.  Did find:
	/*some*/path*/lib/libGIFTQuPerl.la: unknown file type, first eight bytes: 0x23 0x20 0x6C 0x69 0x62 0x47 0x49 0x46
FINISHED Configuring CDynamicQueryFactory 
----------------------------------------
The current configuration directory is: /*config*/*path*
----------------------------------------
Opening port 12789
----------------------------------------
TCP socket successfully initialized:7
TCP socket successfully initialized:8
Waiting for connection...
gift-query.txt (text/plain, 27.1 KB)
Waiting for connection...

...select
trying to accept 7 1
Accept and serve: 7
connected: 7->3
Accepted Connection!
Accepted from adress [Peer INET Address: 127.0.0.1]
calling processMessage (no thread)
CCommunicationHandler.cc:637:readAndParse before parse
<?xml version="1.0" standalone="no" ?><!DOCTYPE mrml SYSTEM "http://www.mrml.net/specification/v1_0/MRML_v10.dtd"><mrml>STARTING:mrml
 1:--------------------TEXT_ _
 1:--------------------TEXT_ _
 1:--------------------TEXT_ _
 1:--------------------TEXT_ _
<get-collections/>STARTING:get-collections
ENDING:get-collections
</mrml>ENDING:mrml
CCommunicationHandler.cc:728:readAndParse before visit
++//CCommunicationHandler.cc:731:readAndParse before check
CHECKING: __ROOT__
++//CHECKING SUCCEEDED
VISITING: __ROOT__
CHECKING: mrml
++//CHECKING SUCCEEDED
VISITING: mrml
CHECKING: get-collections
+/CHECKING SUCCEEDED
VISITING: get-collections
getcollections
x<collection-list>
<collection collection-id="c-*numbers*-*separated*-*by*-*dashes*" collection-name="*Image Collection*" cui-algorithm-id-list-id="ail-inverted-file" />
*
*more collections in list*
*
</collection-list>

checking before making children 
making children 
checking before making children 
making children 
*
*many times*
*
checking before making children 
making children 
Unknown session 
endMultiRequest: WRITING: <mrml  just-for-test="and-of-course-for-fun" session-id="" >
    <cui-time-stamp  calendar-time="Tue Jul 22 18:26:43 2008
" />
    <collection-list  >
        <collection  collection-id="c-*numbers*-*separated*-*by*-*dashes*" collection-name="*Image Collection*" cui-algorithm-id-list-id="ail-inverted-file" cui-base-dir="/*your*/*base*/*dir*/gift-indexing-data/*Full-Image-Collection*/" cui-feature-description-location="InvertedFileFeatureDescription.db" cui-feature-file-location="url2fts.xml" cui-inverted-file-location="InvertedFile.db" cui-number-of-images="??" cui-offset-file-location="InvertedFileOffset.db" >
            <query-paradigm-list  >
                <query-paradigm  type="inverted-file" />
                <query-paradigm  type="perl-demo" />
            </query-paradigm-list>
        </collection>
*
*other collections listed
*

    </collection-list>
    <cui-time-stamp  calendar-time="Tue Jul 22 18:26:43 2008
" />
</mrml>

waitingendwaiting0
*
*repeat this a few times*
*
Message successfully sent!
CCommunicationHandler.cc:734:readAndParse after visit
flushing everything!
shutting down the socket!
waitreadstream (I)
reading eof
FINISHED reading eof
waitreadstream (II)
Deleting thread parameters
DONE
returned processMessage (no thread)
endfor 
Waiting for connection...



...select
trying to accept 7 1
Accept and serve: 7
connected: 7->3
Accepted Connection!
Accepted from adress [Peer INET Address: 127.0.0.1]
calling processMessage (no thread)
CCommunicationHandler.cc:637:readAndParse before parse
<?xml version="1.0" standalone="no" ?><!DOCTYPE mrml SYSTEM "http://www.mrml.net/specification/v1_0/MRML_v10.dtd"><mrml>STARTING:mrml
 1:--------------------TEXT_ _
 1:--------------------TEXT_ _
 1:--------------------TEXT_ _
 1:--------------------TEXT_ _
<get-algorithms collection-id=""/>STARTING:get-algorithms
ENDING:get-algorithms
</mrml>ENDING:mrml
CCommunicationHandler.cc:728:readAndParse before visit
++//CCommunicationHandler.cc:731:readAndParse before check
CHECKING: __ROOT__
++//CHECKING SUCCEEDED
VISITING: __ROOT__
CHECKING: mrml
++//CHECKING SUCCEEDED
VISITING: mrml
CHECKING: get-algorithms
+/CHECKING SUCCEEDED
VISITING: get-algorithms
checking before making children 
making children 
checking before making children 
making children 
*
*many times*
*
checking before making children 
making children 
Unknown session 
endMultiRequest: WRITING: <mrml  just-for-test="and-of-course-for-fun" session-id="" >
    <cui-time-stamp  calendar-time="Tue Jul 22 18:26:43 2008
" />
    <algorithm-list  >
        <algorithm  algorithm-id="a-cidf" algorithm-name="Classical IDF" algorithm-type="a-cidf" collection-id="c-*numbers*-*separated*-*by*-*dashes*" cui-base-type="inverted_file" cui-block-color-blocks="no" cui-block-color-histogram="no" cui-block-texture-blocks="no" cui-block-texture-histogram="no" cui-pr-percentage-of-features="70" cui-weighting-function="ClassicalIDF" >
            <query-paradigm-list  >
                <query-paradigm  />
            </query-paradigm-list>
            <property-sheet  maxsubsetsize="1" minsubsetsize="0" property-sheet-id="cui-p-1" property-sheet-type="subset" send-type="none" >
                <property-sheet  caption="Modify default configuration" property-sheet-id="cui-p0" property-sheet-type="set-element" send-type="none" >
                    <property-sheet  caption="Prune at % of features" from="20" property-sheet-id="cui-p15" property-sheet-type="numeric" send-name="cui-pr-percentage-of-features" send-type="attribute" send-value="70" step="5" to="100" />
                    <property-sheet  maxsubsetsize="4" minsubsetsize="1" property-sheet-id="cui-p1" property-sheet-type="subset" send-type="none" >
                        <property-sheet  caption="Colour blocks" property-sheet-id="cui-p12" property-sheet-type="set-element" send-boolean-inverted="yes" send-name="cui-block-color-blocks" send-type="attribute" send-value="yes" />
                        <property-sheet  caption="Gabor blocks" property-sheet-id="cui-p14" property-sheet-type="set-element" send-boolean-inverted="yes" send-name="cui-block-texture-blocks" send-type="attribute" send-value="yes" />
                        <property-sheet  caption="Gabor histogram" property-sheet-id="cui-p13" property-sheet-type="set-element" send-boolean-inverted="yes" send-name="cui-block-texture-histogram" send-type="attribute" send-value="yes" />
                        <property-sheet  caption="Colour histogram" property-sheet-id="cui-p11" property-sheet-type="set-element" send-boolean-inverted="yes" send-name="cui-block-color-histogram" send-type="attribute" send-value="yes" />
                    </property-sheet>
                </property-sheet>
            </property-sheet>
        </algorithm>
        <algorithm  algorithm-id="a-perl" algorithm-name="Perl link" algorithm-type="a-perl" collection-id="c-*numbers*-*separated*-*by*-*dashes*" cui-base-type="perl" cui-perl-package="CGIFTLink" cui-perl-query-function="processGIFTQueryCall" cui-perl-random-function="processGIFTRandomQueryCall" cui-perl-script-file="/Users/peachick/gift-embed-perl-modules.pl" cui-weighting-function="ClassicalIDF" >
            <query-paradigm-list  >
                <query-paradigm  type="inverted-file" />
                <query-paradigm  type="perl-demo" />
            </query-paradigm-list>
            <property-sheet  maxsubsetsize="1" minsubsetsize="0" property-sheet-id="cui-p-1" property-sheet-type="subset" send-type="none" >
                <property-sheet  caption="Modify default configuration" property-sheet-id="cui-p0" property-sheet-type="set-element" send-type="none" />
            </property-sheet>
        </algorithm>
        <algorithm  algorithm-id="adefault" algorithm-name="Separate Normalisation" algorithm-type="adefault" collection-id="c-*numbers*-*separated*-*by*-*dashes*" cui-base-type="multiple" cui-block-color-blocks="no" cui-block-color-histogram="no" cui-block-texture-blocks="no" cui-block-texture-histogram="no" cui-pr-percentage-of-features="70" cui-weighting-function="ClassicalIDF" >
            <algorithm  algorithm-id="sub1" algorithm-name="sub1" algorithm-type="sub1" cui-base-type="inverted_file" cui-block-color-blocks="yes" cui-block-texture-blocks="yes" cui-block-texture-histogram="yes" cui-pr-percentage-of-features="100" />
            <algorithm  algorithm-id="sub2" algorithm-name="sub2" algorithm-type="sub2" cui-base-type="inverted_file" cui-block-color-histogram="yes" cui-block-texture-blocks="yes" cui-block-texture-histogram="yes" />
            <algorithm  algorithm-id="sub3" algorithm-name="sub3" algorithm-type="sub3" cui-base-type="inverted_file" cui-block-color-blocks="yes" cui-block-color-histogram="yes" cui-block-texture-blocks="yes" cui-pr-percentage-of-features="100" />
            <algorithm  algorithm-id="sub4" algorithm-name="sub4" algorithm-type="sub4" cui-base-type="inverted_file" cui-block-color-blocks="yes" cui-block-color-histogram="yes" cui-block-texture-histogram="yes" />
            <query-paradigm-list  >
                <query-paradigm  />
            </query-paradigm-list>
            <property-sheet  maxsubsetsize="1" minsubsetsize="0" property-sheet-id="cui-p-1" property-sheet-type="subset" send-type="none" >
                <property-sheet  caption="Modify default configuration" property-sheet-id="cui-p0" property-sheet-type="set-element" send-type="none" >
                    <property-sheet  caption="Prune at % of features" from="20" property-sheet-id="cui-p15" property-sheet-type="numeric" send-name="cui-pr-percentage-of-features" send-type="attribute" send-value="70" step="5" to="100" />
                    <property-sheet  maxsubsetsize="4" minsubsetsize="1" property-sheet-id="cui-p1" property-sheet-type="subset" send-type="none" >
                        <property-sheet  caption="Colour blocks" property-sheet-id="cui-p12" property-sheet-type="set-element" send-boolean-inverted="yes" send-name="cui-block-color-blocks" send-type="attribute" send-value="yes" />
                        <property-sheet  caption="Gabor blocks" property-sheet-id="cui-p14" property-sheet-type="set-element" send-boolean-inverted="yes" send-name="cui-block-texture-blocks" send-type="attribute" send-value="yes" />
                        <property-sheet  caption="Gabor histogram" property-sheet-id="cui-p13" property-sheet-type="set-element" send-boolean-inverted="yes" send-name="cui-block-texture-histogram" send-type="attribute" send-value="yes" />
                        <property-sheet  caption="Colour histogram" property-sheet-id="cui-p11" property-sheet-type="set-element" send-boolean-inverted="yes" send-name="cui-block-color-histogram" send-type="attribute" send-value="yes" />
                    </property-sheet>
                </property-sheet>
            </property-sheet>
        </algorithm>
    </algorithm-list>
    <cui-time-stamp  calendar-time="Tue Jul 22 18:26:43 2008
" />
</mrml>

waitingendwaiting0
waitingendwaiting0
waitingendwaiting0
Message successfully sent!
CCommunicationHandler.cc:734:readAndParse after visit
flushing everything!
shutting down the socket!
waitreadstream (I)
reading eof
FINISHED reading eof
waitreadstream (II)
Deleting thread parameters
DONE
returned processMessage (no thread)
endfor 
Waiting for connection...


...select
trying to accept 7 1
Accept and serve: 7
connected: 7->3
Accepted Connection!
Accepted from adress [Peer INET Address: 127.0.0.1]
calling processMessage (no thread)
CCommunicationHandler.cc:637:readAndParse before parse
<?xml version="1.0" standalone="no" ?><!DOCTYPE mrml SYSTEM "http://www.mrml.net/specification/v1_0/MRML_v10.dtd"><mrml session-id="dummy_session_identifier">STARTING:mrml

1:--------------------TEXT_
_
 1:--------------------TEXT_ _
 1:--------------------TEXT_ _
 1:--------------------TEXT_ _
 1:--------------------TEXT_ _
 1:--------------------TEXT_ _
 1:--------------------TEXT_ _
 1:--------------------TEXT_ _
 1:--------------------TEXT_ _
 1:--------------------TEXT_ _
 1:--------------------TEXT_ _
 1:--------------------TEXT_ _
 1:--------------------TEXT_ _
 1:--------------------TEXT_ _
 1:--------------------TEXT_ _
 1:--------------------TEXT_ _
 1:--------------------TEXT_ _
<open-session user-name="anonymous"
                    session-name="monosock_default_session" />STARTING:open-session
ENDING:open-session

1:--------------------TEXT_
_
 1:--------------------TEXT_ _
 1:--------------------TEXT_ _
 1:--------------------TEXT_ _
 1:--------------------TEXT_ _
 1:--------------------TEXT_ _
 1:--------------------TEXT_ _
 1:--------------------TEXT_ _
 1:--------------------TEXT_ _
 1:--------------------TEXT_ _
 1:--------------------TEXT_ _
 1:--------------------TEXT_ _
 1:--------------------TEXT_ _
</mrml>ENDING:mrml
CCommunicationHandler.cc:728:readAndParse before visit
++/+//CCommunicationHandler.cc:731:readAndParse before check
CHECKING: __ROOT__
++/+//CHECKING SUCCEEDED
VISITING: __ROOT__
CHECKING: mrml
++/+//CHECKING SUCCEEDED
VISITING: mrml
CHECKING: open-session
+/+/CHECKING SUCCEEDED
VISITING: open-session
HIER OPEN SESSION
ENTERING OPENSESSION
making a new session II
We have 3 algorithms in the algorithm collection.
CAlgorithmCollection.cc:284:default algorithm found
CAlgorithmCollection.cc:299:going to check default algorithm
+/+/+/+/++//+++/++/+/+/+////CAlgorithmCollection.cc:303:checked, now copying 
checking before making children 
making children 
*
*a few times*
*
checking before making children 
making children 
CAlgorithmCollection.cc:305:copied, now checking again 
+/+/+/+/++//+++/++/+/+/+////[set
adefault
set]
[build
0xc0ea60
1NUMBER OF CHILDREN that are ALGORITHMS 4
23.0xc0ebf0
1234.0xc0ed30
1234.0xc0ee50
1234.0xc0ef90
12344-Algorithm CONFIGURED-: configuration
<algorithm  algorithm-id="adefault" algorithm-name="Separate Normalisation" algorithm-type="adefault" collection-id="c-*numbers*-*separated*-*by*-*dashes*" cui-base-type="multiple" cui-block-color-blocks="no" cui-block-color-histogram="no" cui-block-texture-blocks="no" cui-block-texture-histogram="no" cui-pr-percentage-of-features="70" cui-weighting-function="ClassicalIDF" >
    <algorithm  algorithm-id="sub1" algorithm-name="sub1" algorithm-type="sub1" collection-id="c-*numbers*-*separated*-*by*-*dashes*" cui-base-type="inverted_file" cui-block-color-blocks="yes" cui-block-color-histogram="no" cui-block-texture-blocks="yes" cui-block-texture-histogram="yes" cui-pr-percentage-of-features="100" cui-weighting-function="ClassicalIDF" />
    <algorithm  algorithm-id="sub2" algorithm-name="sub2" algorithm-type="sub2" collection-id="c-*numbers*-*separated*-*by*-*dashes*" cui-base-type="inverted_file" cui-block-color-blocks="no" cui-block-color-histogram="yes" cui-block-texture-blocks="yes" cui-block-texture-histogram="yes" cui-pr-percentage-of-features="70" cui-weighting-function="ClassicalIDF" />
    <algorithm  algorithm-id="sub3" algorithm-name="sub3" algorithm-type="sub3" collection-id="c-*numbers*-*separated*-*by*-*dashes*" cui-base-type="inverted_file" cui-block-color-blocks="yes" cui-block-color-histogram="yes" cui-block-texture-blocks="yes" cui-block-texture-histogram="no" cui-pr-percentage-of-features="100" cui-weighting-function="ClassicalIDF" />
    <algorithm  algorithm-id="sub4" algorithm-name="sub4" algorithm-type="sub4" collection-id="c-*numbers*-*separated*-*by*-*dashes*" cui-base-type="inverted_file" cui-block-color-blocks="yes" cui-block-color-histogram="yes" cui-block-texture-blocks="no" cui-block-texture-histogram="yes" cui-pr-percentage-of-features="70" cui-weighting-function="ClassicalIDF" />
    <query-paradigm-list  >
        <query-paradigm  />
    </query-paradigm-list>
    <property-sheet  maxsubsetsize="1" minsubsetsize="0" property-sheet-id="cui-p-1" property-sheet-type="subset" send-type="none" >
        <property-sheet  caption="Modify default configuration" property-sheet-id="cui-p0" property-sheet-type="set-element" send-type="none" >
            <property-sheet  caption="Prune at % of features" from="20" property-sheet-id="cui-p15" property-sheet-type="numeric" send-name="cui-pr-percentage-of-features" send-type="attribute" send-value="70" step="5" to="100" />
            <property-sheet  maxsubsetsize="4" minsubsetsize="1" property-sheet-id="cui-p1" property-sheet-type="subset" send-type="none" >
                <property-sheet  caption="Colour blocks" property-sheet-id="cui-p12" property-sheet-type="set-element" send-boolean-inverted="yes" send-name="cui-block-color-blocks" send-type="attribute" send-value="yes" />
                <property-sheet  caption="Gabor blocks" property-sheet-id="cui-p14" property-sheet-type="set-element" send-boolean-inverted="yes" send-name="cui-block-texture-blocks" send-type="attribute" send-value="yes" />
                <property-sheet  caption="Gabor histogram" property-sheet-id="cui-p13" property-sheet-type="set-element" send-boolean-inverted="yes" send-name="cui-block-texture-histogram" send-type="attribute" send-value="yes" />
                <property-sheet  caption="Colour histogram" property-sheet-id="cui-p11" property-sheet-type="set-element" send-boolean-inverted="yes" send-name="cui-block-color-histogram" send-type="attribute" send-value="yes" />
            </property-sheet>
        </property-sheet>
    </property-sheet>
</algorithm>
-Algorithm CONFIGURED-
[mQ:multiple
mQ]
Build subalgorithm0xc0ebf0 {algorithm}:inverted_file
really doing it
[mQ:inverted_file
mQ]
hier 
sub1
checking before making children 
making children 
Deleting mContentdoneCDynamicQueryFactory

GQOUERY0
CQInvertedFile.cc:255:Diagnostic output 0xc0fd90

CAccessorFactoryContainer::openAccessor:inverted_file
 NEWLY GENERATED.

CALLED: libGIFTAcInvertedFile_makeAccessor

Opening /*your*/*base*/*dir*/gift-indexing-data/*Full-Image-Collection*/url2fts.xml ...success.
constructing parser
Reading 
541118 characters
Read url2fts.xml
Successfully processed
URLFile /*your*/*base*/*dir*/gift-indexing-data/Full-Image-Collection/url2fts.xml processed.
Opening _/*your*/*base*/*dir*/gift-indexing-data/Full-Image-Collection/InvertedFile.db_ ...success. 
Opening _/*your*/*base*/*dir*/gift-indexing-data/Full-Image-Collection/InvertedFileOffset.db_ ...success. 
Opening _/*your*/*base*/*dir*/gift-indexing-data/Full-Image-Collection/InvertedFileFeatureDescription.db_ ...success. 

Current success status1
URLFile /*your*/*base*/*dir*/gift-indexing-data/Full-Image-Collection/url2fts.xml processed. Current success status1
OffsetFile /*your*/*base*/*dir*/gift-indexing-data/Full-Image-Collection/InvertedFileOffset.db processed. Current success status: 1
FeatureDescriptionFile /*your*/*base*/*dir*/gift-indexing-data/Full-Image-Collection/InvertedFileFeatureDescription.db processed: 87446 elements in hash.
Initialisation successful? Returning 1
CInvertedFile succuessfully initialised. Parameters:/*your*/*base*/*dir*/gift-indexing-data/Full-Image-Collection/InvertedFile.db
/*your*/*base*/*dir*/gift-indexing-data/Full-Image-Collection/InvertedFileOffset.db
/*your*/*base*/*dir*/gift-indexing-data/Full-Image-Collection/url2fts.xml
/*your*/*base*/*dir*/gift-indexing-data/Full-Image-Collection/InvertedFileFeatureDescription.db


CAccessorAdmin::openAccessor:inverted_file
 NEWLY GENERATED.
1st Checking accessor
????????????????????????????????????????
                    <algorithm  algorithm-id="sub1" algorithm-name="sub1" algorithm-type="sub1" collection-id="c-*numbers*-*separated*-*by*-*dashes*" cui-base-type="inverted_file" cui-block-color-blocks="yes" cui-block-color-histogram="no" cui-block-texture-blocks="yes" cui-block-texture-histogram="yes" cui-pr-percentage-of-features="100" cui-weighting-function="ClassicalIDF" />
????????????????????????????????????????
CQNNoNormalization.cc:108:Diagnostic output in clone
CQNNoNormalization.cc:108:Diagnostic output in clone
CQInvertedFile.cc:425:Diagnostic output                     <algorithm  algorithm-id="sub1" algorithm-name="sub1" algorithm-type="sub1" collection-id="c-*numbers*-*separated*-*by*-*dashes*" cui-base-type="inverted_file" cui-block-color-blocks="yes" cui-block-color-histogram="no" cui-block-texture-blocks="yes" cui-block-texture-histogram="yes" cui-pr-percentage-of-features="100" cui-weighting-function="ClassicalIDF" />

%%%%%%%%%%%%%%%%%%%%no

????????????????????blocking feature group: 3

????????????????????blocking feature group: 0

????????????????????blocking feature group: 2

????????????????????USE FEATURE PRUNING: 100
Init finished 
++Accessor: 0x1020c00
Checking Accessor II
CQInvertedFile THIS:0xc0ff30
MAKING 0xc0fd70.0xc0ff30
CHECKING SUCCEEDED
this CHECKING SUCCEEDED
 CQueryTreeNode::addChild(inChild,1) 0xc0fd70CHECKING SUCCEEDED
AFTER CQueryTreeNode::addChild(inChild,1) 0xc0fd70CHECKING SUCCEEDED
Build subalgorithm0xc0ed30 {algorithm}:inverted_file
really doing it
[mQ:inverted_file
mQ]
hier 
sub2
checking before making children 
making children 
Deleting mContentdoneCDynamicQueryFactory

GQOUERY1
CQInvertedFile.cc:255:Diagnostic output 0x2b43300

CAccessorAdmin::openAccessor:inverted_file
 REUSED. (2 times in use)
1st Checking accessor
????????????????????????????????????????
                    <algorithm  algorithm-id="sub2" algorithm-name="sub2" algorithm-type="sub2" collection-id="c-*numbers*-*separated*-*by*-*dashes*" cui-base-type="inverted_file" cui-block-color-blocks="no" cui-block-color-histogram="yes" cui-block-texture-blocks="yes" cui-block-texture-histogram="yes" cui-pr-percentage-of-features="70" cui-weighting-function="ClassicalIDF" />
????????????????????????????????????????
CQNNoNormalization.cc:108:Diagnostic output in clone
CQNNoNormalization.cc:108:Diagnostic output in clone
CQInvertedFile.cc:425:Diagnostic output                     <algorithm  algorithm-id="sub2" algorithm-name="sub2" algorithm-type="sub2" collection-id="c-*numbers*-*separated*-*by*-*dashes*" cui-base-type="inverted_file" cui-block-color-blocks="no" cui-block-color-histogram="yes" cui-block-texture-blocks="yes" cui-block-texture-histogram="yes" cui-pr-percentage-of-features="70" cui-weighting-function="ClassicalIDF" />

%%%%%%%%%%%%%%%%%%%%yes

????????????????????blocking feature group: 1

????????????????????blocking feature group: 3

????????????????????blocking feature group: 2

????????????????????USE FEATURE PRUNING: 70
Init finished 
++Accessor: 0x1020c00
Checking Accessor II
CQInvertedFile THIS:0x2b43560
MAKING 0xc0fcf0.0x2b43560
CHECKING SUCCEEDED
this CHECKING SUCCEEDED
 CQueryTreeNode::addChild(inChild,1) 0xc0fcf0CHECKING SUCCEEDED
AFTER CQueryTreeNode::addChild(inChild,1) 0xc0fcf0CHECKING SUCCEEDED
Build subalgorithm0xc0ee50 {algorithm}:inverted_file
really doing it
[mQ:inverted_file
mQ]
hier 
sub3
checking before making children 
making children 
Deleting mContentdoneCDynamicQueryFactory

GQOUERY2
CQInvertedFile.cc:255:Diagnostic output 0x2b43ab0

CAccessorAdmin::openAccessor:inverted_file
 REUSED. (4 times in use)
1st Checking accessor
????????????????????????????????????????
                    <algorithm  algorithm-id="sub3" algorithm-name="sub3" algorithm-type="sub3" collection-id="c-*numbers*-*separated*-*by*-*dashes*" cui-base-type="inverted_file" cui-block-color-blocks="yes" cui-block-color-histogram="yes" cui-block-texture-blocks="yes" cui-block-texture-histogram="no" cui-pr-percentage-of-features="100" cui-weighting-function="ClassicalIDF" />
????????????????????????????????????????
CQNNoNormalization.cc:108:Diagnostic output in clone
CQNNoNormalization.cc:108:Diagnostic output in clone
CQInvertedFile.cc:425:Diagnostic output                     <algorithm  algorithm-id="sub3" algorithm-name="sub3" algorithm-type="sub3" collection-id="c-*numbers*-*separated*-*by*-*dashes*" cui-base-type="inverted_file" cui-block-color-blocks="yes" cui-block-color-histogram="yes" cui-block-texture-blocks="yes" cui-block-texture-histogram="no" cui-pr-percentage-of-features="100" cui-weighting-function="ClassicalIDF" />

%%%%%%%%%%%%%%%%%%%%yes

????????????????????blocking feature group: 1

????????????????????blocking feature group: 0

????????????????????blocking feature group: 2

????????????????????USE FEATURE PRUNING: 100
Init finished 
++Accessor: 0x1020c00
Checking Accessor II
CQInvertedFile THIS:0x2b43e60
MAKING 0x2b43a90.0x2b43e60
CHECKING SUCCEEDED
this CHECKING SUCCEEDED
 CQueryTreeNode::addChild(inChild,1) 0x2b43a90CHECKING SUCCEEDED
AFTER CQueryTreeNode::addChild(inChild,1) 0x2b43a90CHECKING SUCCEEDED
Build subalgorithm0xc0ef90 {algorithm}:inverted_file
really doing it
[mQ:inverted_file
mQ]
hier 
sub4
checking before making children 
making children 
Deleting mContentdoneCDynamicQueryFactory

GQOUERY3
CQInvertedFile.cc:255:Diagnostic output 0x2b44360

CAccessorAdmin::openAccessor:inverted_file
 REUSED. (6 times in use)
1st Checking accessor
????????????????????????????????????????
                    <algorithm  algorithm-id="sub4" algorithm-name="sub4" algorithm-type="sub4" collection-id="c-*numbers*-*separated*-*by*-*dashes*" cui-base-type="inverted_file" cui-block-color-blocks="yes" cui-block-color-histogram="yes" cui-block-texture-blocks="no" cui-block-texture-histogram="yes" cui-pr-percentage-of-features="70" cui-weighting-function="ClassicalIDF" />
????????????????????????????????????????
CQNNoNormalization.cc:108:Diagnostic output in clone
CQNNoNormalization.cc:108:Diagnostic output in clone
CQInvertedFile.cc:425:Diagnostic output                     <algorithm  algorithm-id="sub4" algorithm-name="sub4" algorithm-type="sub4" collection-id="c-*numbers*-*separated*-*by*-*dashes*" cui-base-type="inverted_file" cui-block-color-blocks="yes" cui-block-color-histogram="yes" cui-block-texture-blocks="no" cui-block-texture-histogram="yes" cui-pr-percentage-of-features="70" cui-weighting-function="ClassicalIDF" />

%%%%%%%%%%%%%%%%%%%%yes

????????????????????blocking feature group: 1

????????????????????blocking feature group: 3

????????????????????blocking feature group: 0

????????????????????USE FEATURE PRUNING: 70
Init finished 
++Accessor: 0x1020c00
Checking Accessor II
CQInvertedFile THIS:0x2b44710
MAKING 0x2b44340.0x2b44710
CHECKING SUCCEEDED
this CHECKING SUCCEEDED
 CQueryTreeNode::addChild(inChild,1) 0x2b44340CHECKING SUCCEEDED
AFTER CQueryTreeNode::addChild(inChild,1) 0x2b44340CHECKING SUCCEEDED
Build subalgorithm0xc0f0b0 {query-paradigm-list}:
Build subalgorithm0xc0f130 {property-sheet}:
hier 
adefault
checking before making children 
making children
*
*repeat*
*
checking before making children 
making children 
Deleting mContentdone
GQOUERY4

CAccessorFactoryContainer::openAccessor:url2fts
 NEWLY GENERATED.

Opening /*your*/*base*/*dir*/gift-indexing-data/Full-Image-Collection/url2fts.xml ...success.
constructing parser
Reading 
541118 characters
Read url2fts.xml
Successfully processed
URLFile /*your*/*base*/*dir*/gift-indexing-data/Full-Image-Collection/url2fts.xml processed.

CAccessorAdmin::openAccessor:url2fts
 NEWLY GENERATED.
MAKING 0xc0fd40.0x2b45ec0
CHECKING SUCCEEDED
ADDING 0xc0fd40.0x2b45ec0 <- 0xc0fd70.0xc0ff30, 1
i->first:          CHECKING SUCCEEDED
i->first->Content: CHECKING SUCCEEDED
ADDING 0xc0fd40.0x2b45ec0 <- 0xc0fcf0.0x2b43560, 1
i->first:          CHECKING SUCCEEDED
i->first->Content: CHECKING SUCCEEDED
ADDING 0xc0fd40.0x2b45ec0 <- 0x2b43a90.0x2b43e60, 1
i->first:          CHECKING SUCCEEDED
i->first->Content: CHECKING SUCCEEDED
ADDING 0xc0fd40.0x2b45ec0 <- 0x2b44340.0x2b44710, 1
i->first:          CHECKING SUCCEEDED
i->first->Content: CHECKING SUCCEEDED
build]
dummy_session_identifier-> new Session ID: 1
current state in multi reponse :1
CHECKING: 
+/+/CHECKING SUCCEEDED
VISITING: 
endMultiRequest: WRITING: <mrml  just-for-test="and-of-course-for-fun" session-id="1" >
    <cui-time-stamp  calendar-time="Tue Jul 22 18:26:43 2008
" />
    <acknowledge-session-op  session-id="1" session-name="monosock_default_session" user-name="anonymous" />
    <cui-time-stamp  calendar-time="Tue Jul 22 18:27:00 2008
" />
</mrml>

waitingendwaiting0
waitingendwaiting0
Message successfully sent!
CCommunicationHandler.cc:734:readAndParse after visit
flushing everything!
shutting down the socket!
waitreadstream (I)
reading eof
FINISHED reading eof
waitreadstream (II)
Deleting thread parameters
DONE
returned processMessage (no thread)
endfor 
Waiting for connection...
gift-index.txt (text/plain, 742 B)
*
*ends*
*with*
*
Writing Chunk for Feature ID 15594. The Offset is 0x6fa78=457336
writing chunk of size 1
*
*
[inFeatureID:4/87445;inPosition:132/457360==457360]136
Writing Chunk for Feature ID 15595. The Offset is 0x6fa90=457360
writing chunk of size 4
NEW WRITING ADI ****************************************
NEW ADI WRITTEN ****************************************

BEFORE checking inverted file consistencyAFTER checking inverted file consistency
The check was successful
ERROR in generating inverted fileCAcIFFileSystem::~CAcIFFileSystem() called 
CAccessor.cccalling destructor
CAccessor.cccalling destructor

PROGRESS: 99%


Copying /*your*/*base*/*dir*/gift-config.mrml to /*your*/*base*/*dir*/gift-config.mrml-old


PROGRESS: 100%