Re: Re: Python-3-Migration of existing Data.fs
Jim Fulton <[email protected]> Tue, 20 Mar 2018 07:51:50 -0600
| Newsgroups | gmane.comp.web.zope.zodb |
|---|---|
| Message-ID | <CAPDm-Fhy8RxX25pO=GyUTtvf4kkn0dmKc3BMk6yhxe9hFz9k4g@mail.gmail.com> |
On Tue, Mar 20, 2018 at 6:22 AM, Arthur LEDARD <[email protected]> wrote: > Hi, > > I’m trying to migrate my Data.fs. > I use your code, but I’m stuck with a non expected problem. > > Using python2, my oid are pickled in a format "U\x08\x00\x00\x00\x00\x00\ > x00\x03\xeaq\x03" > The format seems correct, but is not understood with python3 : > UnicodeDecodeError. > Ouch. > > I was expecting to have problems with data, not oid. > I assume you're storing oids in your data somewhere. Can you confirm? I happen to like this pattern (as opposed to generating ids at the application level), but I can see how this might be a headache in the transition to Python 3. Did you face this problem? > Did you succeed in your migrations? > I suspect they were focussed on providing a tool for future migrations, but am curious about any experience they might have. Jim > > Regards, > > Arthur > Le lundi 23 mai 2016 16:48:18 UTC+1, mh a écrit : >> >> Hi, >> >> at "Berlin Strategic sprint 2016“ [1] Florian Pilz and me developed a >> tool to analyze a ZODB Filestorage for Python 2 string objects. When they >> are in an encoding besides ASCII this would prevent using this Filestorage >> with Python 3 because of decoding errors arising on loading the pickles. >> The tool is even able to convert those strings either to unicode by >> decoding them using a configurable encoding or convert them to >> `zodbpickle.binary` so Python 3 will read them as `bytes`. >> See [3] for the documentation of the tool and [2] for the repository on >> GitHub. >> >> * Is there already another tool for this analysis/migration? >> * Is there already any practical knowledge migrating Filestorage contents >> to Python 3? >> * Do you think such a tool is the right approach to achieve such a >> migration? >> * Is there anyone who wants to try out the tool on a Filestorage of a >> personal project and share the experiences? (I analyzed two projects where >> I have access to a Filestorage but I am sure this does not catch all the >> edge cases.) >> >> >> >> [1] http://gil.badall.net/2016/05/20/berlin-2016-sprint-update/ >> [2] https://github.com/gocept/zodb.py3migrate >> [3] https://pythonhosted.org/zodb.py3migrate/ >> >> -- >> Michael Howitz · [email protected] · software developer >> gocept gmbh & co. kg · Forsterstraße 29 · 06112 Halle (Saale) · Germany >> <https://maps.google.com/?q=Forsterstra%C3%9Fe+29+%C2%B7+06112+Halle+(Saale)+%C2%B7+Germany&entry=gmail&source=g> >> http://gocept.com · Tel +49 345 1229889-8 <+49%20345%2012298898> >> Python, Pyramid, Plone, Zope · consulting, development, hosting, >> operations >> >> -- > You received this message because you are subscribed to the Google Groups > "zodb" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [email protected]. > For more options, visit https://groups.google.com/d/optout. > -- Jim Fulton http://jimfulton.info -- You received this message because you are subscribed to the Google Groups "zodb" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. For more options, visit https://groups.google.com/d/optout.