Re: struggling with running GIFT...

Henning Müller <[email protected]> Wed, 23 Jul 2008 11:48:47 +0200
Newsgroups gmane.comp.gnu.gift.general
Message-ID <[email protected]>
Dear Niles,

indeed, gift has a long list of outputs and much of it was made for 
debugging purposes as this was mainly a research tool. Much of it could 
be removed without too much trouble ...

There used to be an error right at the end of indexing the inverted file 
and still things worked fine, so in your case this seems to be OK.

Which version of gift are you using? The latest version form the cvs?

Could you send the gift-config.mrml if possible? This might contain an 
error if the algorithms are not shown properly.

The perl link algorithm should be removed manually form gift_config as 
it was done for a particular test and if it is not installed it crashed 
the gift server when selecting it in the interface.

A general recommandation is also to always name the directory for 
indexing the collections and modifying the cofigurations files. You have 
options for this in gitf-add-collection.pl and also in the gift server. 
Like this you are sure that the correct configuration file is taken.

I attach you an example gift config file that you could use as a basis 
for your one. You will need to modify the collections of course. Maybe 
try it out with copying a single collection inside.

The php client from the Viper web pages is not the newest one, so it 
might be worth trying out the monosock one that is actually based on the 
one you downloaded.

Cheers, Henning

Niles Johnson a écrit :
> Hi Neville,
> 
> Sorry for the delayed response . . . here I've attached three files of
> output from my GIFT installation so that we can try to tell the
> difference between those errors that matter and those that don't.  I
> made some annotations so that hopefully they're easier to read (for
> example, I deleted parts where it lists all 20 or so of my image
> collections).  Parts I've changed are marked with comments in *stars*.
> 
> 'gift-index.txt'  contains the tail end of the output from indexing a
> collection.  In particular, you will notice that the "ERROR in
> generating inverted file" happens for me too.
> 
> 'gift-server-start.txt'  contains the output dumped immediately after
> starting the server.  Most of this seems very similar to the output
> you have, although there are some slight differences in the
> plugin-checking section (the part following "Configuring the
> CAccessorFactoryContainer:").  I would guess these are due to
> platform/configuration differences, but I don't really know much about
> that.
> 
> 'gift-query.txt'  shows the output when I ran a few queries through:
> getting a random set of images and refining the results a few times.
> This is the part that looks most different, but could be due to
> differences in our GIFT clients.  At this stage I started getting
> tired, so I didn't really look too thoroughly there.
> 
> Let me know if this helps, or at least helps to generate new
> questions.  By the way, the client I use is a modified version of the
> one at 'gift.monosock.org'  The online demo seems to be down now, but
> it looks like the source is still available.  I had to learn a little
> php to get it working, and I think I had to install PEAR too, but I
> did find it relatively easy to understand.
> 
> best,
> Niles
> 
> p.s.  Maybe if some of the experts are listening they could look
> through these files and help further pare them down to something
> useful for troubleshooting?
> 
> 
> ------------------------------------------------------------------------
> 
> _______________________________________________
> help-GIFT mailing list
> [email protected]
> http://lists.gnu.org/mailman/listinfo/help-gift

_______________________________________________
help-GIFT mailing list
[email protected]
http://lists.gnu.org/mailman/listinfo/help-gift
gift-config.mrml (text/xml, 5.3 KB)
<?xml version="1.0" standalone="no"?>
<!DOCTYPE mrml SYSTEM "file:/usr/local/share/mrml.dtd">
<!-- This file has become quite a free interpretation of MRML 
     the above !DOCTYPE is rather for the use of psgml than
     a promise that the following is pure MRML. In fact the
     parser does not validate.

This is a configuration file for the server. It contains
information about collections, algorithms and
property sheets.


THIS FILE NEEDS CLEANING. ABOUT HALF OF THE LINES HERE ARE
LEGACY CODE. HOWEVER, IT IS NOT YET TESTED HOW THINGS BEHAVE
WHEN YOU REMOVE THE LEGACY CODE. SO, FOR A WHILE YOU HAVE
TO LIVE WITH QUITE A NUMBER OF OBSOLETE TAGS.

-->
<mrml>
  <cui-configuration>
    <algorithm-list>
    <!--COMMENT The new definiton of the default algorithm
                The default algorithm performs in fact a meta
                query of several inverted file queries.
                Each sub-query of the meta query is
                specialised on one of the feature groups 

                Color histogram
                Color block
                Gabor histogram
                Gabor block

                Each one of them is pruned in adifferent way.
                (this is the goal of the operation)
      -->
      <algorithm algorithm-id="adefault" algorithm-type="adefault" algorithm-name="Separate Normalisation" collection-id="c-2-55-13-23-3-108-3-113-0" cui-block-color-histogram="no" cui-block-color-blocks="no" cui-block-texture-histogram="no" cui-block-texture-blocks="no" cui-pr-percentage-of-features="70" cui-base-type="multiple" cui-weighting-function="ClassicalIDF">
      <algorithm algorithm-id="sub1" algorithm-type="sub1" algorithm-name="sub1" cui-block-color-blocks="yes" cui-block-texture-histogram="yes" cui-block-texture-blocks="yes" cui-pr-percentage-of-features="100" cui-base-type="inverted_file"/>
      <algorithm algorithm-id="sub2" algorithm-type="sub2" algorithm-name="sub2" cui-block-color-histogram="yes" cui-block-texture-histogram="yes" cui-block-texture-blocks="yes" cui-base-type="inverted_file"/>
      <algorithm algorithm-id="sub3" algorithm-type="sub3" algorithm-name="sub3" cui-block-color-histogram="yes" cui-block-color-blocks="yes" cui-block-texture-blocks="yes" cui-pr-percentage-of-features="100" cui-base-type="inverted_file"/>
      <algorithm algorithm-id="sub4" algorithm-type="sub4" algorithm-name="sub4" cui-block-color-histogram="yes" cui-block-color-blocks="yes" cui-block-texture-histogram="yes" cui-base-type="inverted_file"/>
        <query-paradigm-list>
           <query-paradigm/><!-- match anything -->
        </query-paradigm-list>
        <property-sheet property-sheet-id="cui-p-1" property-sheet-type="subset" send-type="none" minsubsetsize="0" maxsubsetsize="1">
          <property-sheet property-sheet-id="cui-p0" caption="Modify default configuration" property-sheet-type="set-element" send-type="none">
  	  <property-sheet property-sheet-id="cui-p15" caption="Prune at % of features" property-sheet-type="numeric" send-type="attribute" send-name="cui-pr-percentage-of-features" from="20" to="100" step="5" send-value="70"/>
  	  <property-sheet property-sheet-id="cui-p1" property-sheet-type="subset" send-type="none" minsubsetsize="1" maxsubsetsize="4">
   	    <property-sheet property-sheet-id="cui-p12" send-boolean-inverted="yes" caption="Colour blocks" property-sheet-type="set-element" send-type="attribute" send-name="cui-block-color-blocks" send-value="yes"/>
  	    <property-sheet property-sheet-id="cui-p14" send-boolean-inverted="yes" caption="Gabor blocks" property-sheet-type="set-element" send-type="attribute" send-name="cui-block-texture-blocks" send-value="yes"/>
  	    <property-sheet property-sheet-id="cui-p13" send-boolean-inverted="yes" caption="Gabor histogram" property-sheet-type="set-element" send-type="attribute" send-name="cui-block-texture-histogram" send-value="yes"/>
  	    <property-sheet property-sheet-id="cui-p11" send-boolean-inverted="yes" caption="Colour histogram" property-sheet-type="set-element" send-type="attribute" send-name="cui-block-color-histogram" send-value="yes"/>
            </property-sheet>
          </property-sheet>
        </property-sheet>
     </algorithm><!-- a-cidf  -->
    </algorithm-list>
    <cui-algorithm-id-list-list>	
      <cui-algorithm-id-list cui-algorithm-id-list-id="ail-inverted-file">
	<cui-algorithm-id cui-algorithm-id="a-cidf"/>
      </cui-algorithm-id-list>
    </cui-algorithm-id-list-list>	
    <collection-list listid="1">

<!-- xxyx gift-add-collection xyxx DEPENDS ON THIS LINE -->

    <collection collection-id="c-2-55-13-23-3-108-3-113-0" collection-name="RSNA" cui-algorithm-id-list-id="ail-inverted-file" cui-number-of-images="8000" cui-base-dir="/databases/casimageRSNA/" cui-inverted-file-location="InvertedFile.db" cui-offset-file-location="InvertedFileOffset.db" cui-feature-description-location="InvertedFileFeatureDescription.db" cui-feature-file-location="url2fts.xml">
					 <query-paradigm-list>
					 <query-paradigm type="inverted-file"/>
					 <query-paradigm type="perl-demo"/>
					 </query-paradigm-list>
					 </collection>
</collection-list>
  </cui-configuration>
</mrml>
<!-- this is for xemacs to make it start up in the right mode.
     it does the right thing, but complains
-->
<!-- ;;; Local Variables: *** -->
<!-- ;;; mode: sgml       *** -->