Archetypes references - memory explosion

Hi,

Did anybody every give an answer to this, or at least some theories on  
where to start looking?

From: Stephen Kenworthy <[email protected]>
Newsgroups: gmane.comp.web.zope.plone.archetypes.general
Subject: Updating the uid catalog
Date: Tue, 05 Apr 2005 17:37:47 +0800

I'm having trouble updating the archetypes uid catalog (Advanced tab).
  I have 4500 references in the catalog and when I click "Update
catalog" the process eats up a lot of memory (450Mb), causing the
machine to do a lot of disk caching and hence slow drastically. I
haven't been able to get the update process to complete as a result.

Should the catalog update be taking up this much memory? This became a
  problem after I upgraded from Arcehtypes 1.3.0-final to 1.3.2-final.
I've reduced the subtransaction size from 10,000 down to 1,000 and 100
  (!) to try to solve it - see my post on the plone-users list http://
thread.gmane.org/gmane.comp.web.zope.plone.user/32315 but this hasn't
fixed it.

I did eventually fix the problem by deleting all my content, cleaning/
reindexing the catalog, re-adding 4500 items (it was scripted) and
then indexing worked fine with a minimal memory overhead (the process
grew to 70Mb). The difference here being that the content was CREATED
using archetypes 1.3.2-final whereas before it had gone through the
upgrade from 1.3.0-final.

I'm using LinguaPlone which I know used references for its translations
  - which we are making extensive use of.

I guess this is a problem because of the fact that we'll need to be
able to upgrade archetypes in the future with a lot of content that
is not scripted.

My specs:
Archetypes 1.3.2-final
LinguaPlone 0.7.1
Verbose security 0.6
Call Profiler (not hooked up)
Plone 2.0.5
Zope 2.7.4
and other products

Red Hat Enterprise 3
Pentuim 1Ghz 512 Mb RAM

Would really appreciate some comments: could I be doing something
wrong in my import script? Or has the way that archetypes implements
the UID catalog changed that the migration process can't handle?

Many thanks

-- 
Stephen Kenworthy
www.globalhand.org

-- 
_____________________________________________________________________

      Alexander Limi · Chief Architect · Plone Solutions · Norway

  Consulting · Training · Development · http://www.plonesolutions.com
_____________________________________________________________________

       Plone Co-Founder · http://plone.org · Connecting Content
   Plone Foundation · http://plone.org/foundation · Protecting Plone



-------------------------------------------------------
This SF.Net email is sponsored by the JBoss Inc.  Get Certified Today
Register for a JBoss Training Course.  Free Certification Exam
for All Training Attendees Through End of 2005. For more info visit:
http://ads.osdn.com/?ad_id=7628&alloc_id=16845&op=click