Re: Quintagroup.transmogrifier file export

Oi, Volodymyr,

I am gonna work a bit more on the fix I made for the binary.py file,
because my workaround was too restrictive (it would work only for the
standard File and Image types, which is what I need to export right now).

In my pipeline I have already commented out the comments and portlets
importers. But what puzzles me is that it seems that genericsetup is simply
ignoring the transmogrifier import step when I input the tar.gz file I got
from the export in the original Plone setup. Something in the file is
confusing the GenericSetup engine to ignore the transmogrifier step.

I'd like to analyze the file to see what could it be, but I have no idea on
what is the expected file format. Do you know if there is any reference on
the file format GenericSetup expects?

Another thing I'd like to try is to upload the file to the server
filesystem (instead of using the browser to do that). I am a bit worried
about uploading some 300MB file for the import (because the server is a bit
low on memory). Can it be done with GenericSetup (I mean, using a tar.gz
file in the server filesystem)?

Thank you for your help so far.

Alberto

On Sat, Sep 20, 2014 at 5:22 PM, Volodymyr Cherepanyak <[email protected]>
wrote:

> Hi Alberto,
>
> you can provide your fix with a pull request or in a branch. We used
> quintagroup.transmogrifier for exporting content from older (pre Plone4
> versions) so it is possible that some Archetypes related code is not up to
> date with Plone4 version of Archetypes.
>
> To find out which of the the blueprints fail just comment out them one by
> one in your control panel before importing content. I suspect that
> "commentsimporter" blueprint can fail.
>
> Volodymyr.
>
> On Fri, Sep 19, 2014 at 9:30 AM, Alberto Lopes <[email protected]> wrote:
>
>> Hi, Volodymyr,
>>
>> I don't have a traceback right now, because I kinda of worked around the
>> issue a few days ago and moved on (I can replicate the error if you'd like
>> though).
>>
>> My workaround was to modify the code at the
>> quintagroup.transmogrifier.binary.py module. I did that after debugging
>> a while and discovering that the 'file' field in the 'File' objects was not
>> being treated as binary when the file inside was an ODT (and the blueprint
>> was skipping all File objects with non-binary 'file' fields). What I did
>> was to change the "is the field a binary field?" check on the code to a "is
>> the object of portal_type File and the field name 'file' or the portal_type
>> equal to 'Image' and the field name equal to 'image'?"
>>
>> I am facing a different issue right now. Same setup (from 4.0.7 to
>> 4.3.1). The transmogrifier config (
>> http://localhost:8081/Plone/@@pipeline-config) for the export site was
>> the same as the default one, except that I changed the sitewalker for a
>> catalogsource, and supressed the portlet and comments exporters. I ran the
>> transmogrifier export step at portal_setup and got
>> a setup_tool-20140919052526.tar.gz file. The file seems alright, it has a
>> structure directory, with the subdirectories reflecting the structure of
>> the items I wanted to export, and the .marshall,xml and other files at the
>> directory for the content items themselves. In short, the export file seems
>> to be ok.
>>
>> However, when I go to the new site, and try to import the selected
>> tarball selecting the tar.gz file, it won't import. The console (I am
>> running instance fg) says : "GenericSetup.rolemap Role / permission map
>> imported." and "GenericSetup.archetypetool Archetype tool imported.", and
>> nothing else (not even those messages saying how many items went through
>> the pipeline.
>>
>> At the web browser, the file is uploaded (I get a percentage indication
>> from Chrome, and it does take a few seconds to upload - it is a 239MB
>> file), but after it stops loading, I get back the same import page, with a
>> message log at the bottom that says nothing for the transmogrifier step,
>> and "Nothing to import" to some other steps (like action-icons, toolset,
>> and component-registry).
>>
>> What can be wrong for the file to be completely ignored?
>>
>> Thanks.
>>
>> On Thu, Sep 18, 2014 at 9:32 AM, Volodymyr Cherepanyak <[email protected]
>> > wrote:
>>
>>> Hi Alberto,
>>>
>>> any traceback generated?
>>>
>>> Volodymyr.
>>>
>>> On Tue, Sep 9, 2014 at 9:07 PM, Alberto Lopes <[email protected]>
>>> wrote:
>>>
>>>> Dear all,
>>>>
>>>> I am trying to migrate some content with quintagroup.transmogrifier
>>>> from Plone 4.0.7 to Plone 4.3.1.
>>>>
>>>> I've created a test site to play and learn with
>>>> quintagroup.transmogrifier before going real. So I created a bunch of
>>>> content items and exported them. Then I deleted all of them and imported
>>>> them from the tgz file.
>>>>
>>>> One problem though: the File object (which contained a ODT file),
>>>> didn't export successfully. I tried again with another File object, with a
>>>> TGZ file within , and it worked.
>>>>
>>>> It seems that when I have an ODT file the blueprint treats it
>>>> differently.
>>>>
>>>> Anyone has had this issue?
>>>>
>>>> Alberto
>>>>
>>>>
>>>> ------------------------------------------------------------------------------
>>>> Want excitement?
>>>> Manually upgrade your production database.
>>>> When you want reliability, choose Perforce.
>>>> Perforce version control. Predictably reliable.
>>>>
>>>> http://pubads.g.doubleclick.net/gampad/clk?id=157508191&iu=/4140/ostg.clktrk
>>>> _______________________________________________
>>>> Plone-Users mailing list
>>>> [email protected]
>>>> https://lists.sourceforge.net/lists/listinfo/plone-users
>>>>
>>>>
>>>
>>>
>>> --
>>> Volodymyr Cherepanyak
>>> e-mail: [email protected]
>>> skype : callto://chervol?chat
>>>
>>
>>
>
>
> --
> Volodymyr Cherepanyak
> e-mail: [email protected]
> skype : callto://chervol?chat
>

------------------------------------------------------------------------------
Meet PCI DSS 3.0 Compliance Requirements with EventLog Analyzer
Achieve PCI DSS 3.0 Compliant Status with Out-of-the-box PCI DSS Reports
Are you Audit-Ready for PCI DSS 3.0 Compliance? Download White paper
Comply to PCI DSS 3.0 Requirement 10 and 11.5 with EventLog Analyzer
http://pubads.g.doubleclick.net/gampad/clk?id=154622311&iu=/4140/ostg.clktrk

_______________________________________________
Plone-Users mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/plone-users