Re: Strange behaviour with getLangFmtDate encoding

"Sebastian Tänzer [email protected] [zms-developers]" <[email protected]> Thu, 5 Feb 2015 14:35:15 +0100
Newsgroups gmane.comp.cms.zms.devel
Message-ID <[email protected]>
--APb5Jy1V1q00arde4oG4z9oWAlLFVoHhBtlVpn-
Content-Type: text/plain; charset=us-ascii
Content-Transfer-Encoding: quoted-printable

Hello Niels,

thanks for your input - really appreciate your help.

Both python versions were build from vanilla sources but maybe changed on t=
he Debian system (which was upgraded from Debian 6 before).
My next step will be to do what you suggested and dig further into this. I =
too think this is related to incompatible libraries.

The full error beeing produced is:

2015-02-05T14:43:57 ERROR ZMS [ZMSEvent@/e416/e1808/e2090][getObjProperty]:=
 key=3Dstandard_html
Traceback (most recent call last):
  File "/www/zope/sites/k4/Products/zms/_objattrs.py", line 666, in getObjP=
roperty
    value =3D self.nvl(self.evalMetaobjAttr(key),'')
  File "/www/zope/sites/k4/Products/zms/_objattrs.py", line 718, in evalMet=
aobjAttr
    return self.getMetaobjManager().evalMetaobjAttr(id,attr_id,zmscontext=
=3Dself,options=3Dkwargs)
  File "/www/zope/sites/k4/Products/zms/ZMSMetaobjManager.py", line 631, in=
 evalMetaobjAttr
    value =3D call(metaObjAttr['zpt'])
  File "/www/zope/sites/k4/Products/zms/ZMSMetaobjManager.py", line 614, in=
 call
    return fn(zmscontext=3Dzmscontext)
  File "/www/python/virtual/py27zope/lib/python2.7/site-packages/Zope2-2.13=
.12-py2.7.egg/Shared/DC/Scripts/Bindings.py", line 322, in __call__
    return self._bindAndExec(args, kw, None)
  File "/www/python/virtual/py27zope/lib/python2.7/site-packages/Zope2-2.13=
.12-py2.7.egg/Shared/DC/Scripts/Bindings.py", line 359, in _bindAndExec
    return self._exec(bound_data, args, kw)
  File "/www/python/virtual/py27zope/lib/python2.7/site-packages/Zope2-2.13=
.12-py2.7.egg/Products/PageTemplates/ZopePageTemplate.py", line 334, in _ex=
ec
    result =3D self.pt_render(extra_context=3Dbound_names)
  File "/www/python/virtual/py27zope/lib/python2.7/site-packages/Zope2-2.13=
.12-py2.7.egg/Products/PageTemplates/ZopePageTemplate.py", line 431, in pt_=
render
    result =3D PageTemplate.pt_render(self, source, extra_context)
  File "/www/python/virtual/py27zope/lib/python2.7/site-packages/Zope2-2.13=
.12-py2.7.egg/Products/PageTemplates/PageTemplate.py", line 79, in pt_rende=
r
    showtal=3Dshowtal)
  File "/www/python/virtual/py27zope/lib/python2.7/site-packages/zope.paget=
emplate-3.5.2-py2.7.egg/zope/pagetemplate/pagetemplate.py", line 114, in pt=
_render
    return output.getvalue()
  File "/www/python/normal/python2.7/lib/python2.7/StringIO.py", line 271, =
in getvalue
    self.buf +=3D ''.join(self.buflist)
UnicodeDecodeError: 'utf8' codec can't decode byte 0xe4 in position 1: inva=
lid continuation byte

Anything that helps to trace this back in there?

Best
Sebastian

> Am 05.02.2015 um 14:24 schrieb Niels Dettenbach [email protected] [zms-deve=
lopers] <[email protected]>:
>=20
> Am Donnerstag, 5. Februar 2015, 13:42:28 schrieben Sie:
>=20
>> On our live systems (Debian 7, Zope 2.13.12, python 2.7.2, linux2) the s=
ame=20
> code results in a unicode decode error:
>=20
> Do you have any further log output from ZOPE event.log or similiar?
>=20
>=20
>        UnicodeDecodeError: 'utf8' codec can't decode byte 0xe4 in positio=
n 1:=20
> invalid continuation byte
>=20
>> Could this be related to different python or zope versions somehow?
>=20
> With just a short in the dark, i would point on the python binary / build=
 and=20
> possibly used regarding libs.
>=20
> Could you try to make your own python build from sources from vanilla?
>=20
> If that does'nt change anything - could you / we compare the config / bui=
ld=20
> output from BOTH pythons (from Maports and from linux) to see any differe=
nces=20
> here?
>=20
> sorry, yes, this may take some further time and may be the wrong directio=
n -=20
> but would be what i would try as next here.
>=20
>=20
> good luck and
> cheerioh,
>=20
>=20
> Niels.=20
>=20
> --=20
> ---
> Niels Dettenbach
> Syndicat IT & Internet
> http://www.syndicat.com
> PGP: https://syndicat.com/pub_key.asc
> ---
>=20
>=20
>=20
>=20



--APb5Jy1V1q00arde4oG4z9oWAlLFVoHhBtlVpn-
Content-Type: text/html; charset=US-ASCII
Content-Transfer-Encoding: 7bit




<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01//EN" "http://www.w3.org/TR/html4/strict.dtd">
<html>
<head>
</head>






 
<body style="background-color: #fff;">
<span style="display:none">&nbsp;</span>

<!--~-|**|PrettyHtmlStartT|**|-~-->
<div id="ygrp-mlmsg" style="position:relative;">
  <div id="ygrp-msg" style="z-index: 1;">
<!--~-|**|PrettyHtmlEndT|**|-~-->

    <div id="ygrp-text" >
      
      
      <p>Hello Niels,<br>
<br>
thanks for your input - really appreciate your help.<br>
<br>
Both python versions were build from vanilla sources but maybe changed on the Debian system (which was upgraded from Debian 6 before).<br>
My next step will be to do what you suggested and dig further into this. I too think this is related to incompatible libraries.<br>
<br>
The full error beeing produced is:<br>
<br>
2015-02-05T14:43:57 ERROR ZMS [ZMSEvent@/e416/e1808/e2090][getObjProperty]: key=standard_html<br>
Traceback (most recent call last):<br>
  File &quot;/www/zope/sites/k4/Products/zms/_objattrs.py&quot;, line 666, in getObjProperty<br>
    value = self.nvl(self.evalMetaobjAttr(key),&#39;&#39;)<br>
  File &quot;/www/zope/sites/k4/Products/zms/_objattrs.py&quot;, line 718, in evalMetaobjAttr<br>
    return self.getMetaobjManager().evalMetaobjAttr(id,attr_id,zmscontext=self,options=kwargs)<br>
  File &quot;/www/zope/sites/k4/Products/zms/ZMSMetaobjManager.py&quot;, line 631, in evalMetaobjAttr<br>
    value = call(metaObjAttr[&#39;zpt&#39;])<br>
  File &quot;/www/zope/sites/k4/Products/zms/ZMSMetaobjManager.py&quot;, line 614, in call<br>
    return fn(zmscontext=zmscontext)<br>
  File &quot;/www/python/virtual/py27zope/lib/python2.7/site-packages/Zope2-2.13.12-py2.7.egg/Shared/DC/Scripts/Bindings.py&quot;, line 322, in __call__<br>
    return self._bindAndExec(args, kw, None)<br>
  File &quot;/www/python/virtual/py27zope/lib/python2.7/site-packages/Zope2-2.13.12-py2.7.egg/Shared/DC/Scripts/Bindings.py&quot;, line 359, in _bindAndExec<br>
    return self._exec(bound_data, args, kw)<br>
  File &quot;/www/python/virtual/py27zope/lib/python2.7/site-packages/Zope2-2.13.12-py2.7.egg/Products/PageTemplates/ZopePageTemplate.py&quot;, line 334, in _exec<br>
    result = self.pt_render(extra_context=bound_names)<br>
  File &quot;/www/python/virtual/py27zope/lib/python2.7/site-packages/Zope2-2.13.12-py2.7.egg/Products/PageTemplates/ZopePageTemplate.py&quot;, line 431, in pt_render<br>
    result = PageTemplate.pt_render(self, source, extra_context)<br>
  File &quot;/www/python/virtual/py27zope/lib/python2.7/site-packages/Zope2-2.13.12-py2.7.egg/Products/PageTemplates/PageTemplate.py&quot;, line 79, in pt_render<br>
    showtal=showtal)<br>
  File &quot;/www/python/virtual/py27zope/lib/python2.7/site-packages/zope.pagetemplate-3.5.2-py2.7.egg/zope/pagetemplate/pagetemplate.py&quot;, line 114, in pt_render<br>
    return output.getvalue()<br>
  File &quot;/www/python/normal/python2.7/lib/python2.7/StringIO.py&quot;, line 271, in getvalue<br>
    self.buf += &#39;&#39;.join(self.buflist)<br>
UnicodeDecodeError: &#39;utf8&#39; codec can&#39;t decode byte 0xe4 in position 1: invalid continuation byte<br>
<br>
Anything that helps to trace this back in there?<br>
<br>
Best<br>
Sebastian<br>
<br>
&gt; Am 05.02.2015 um 14:24 schrieb Niels Dettenbach [email protected] [zms-developers] &lt;[email protected]&gt;:<br>
&gt; <br>
&gt; Am Donnerstag, 5. Februar 2015, 13:42:28 schrieben Sie:<br>
&gt; <br>
&gt;&gt; On our live systems (Debian 7, Zope 2.13.12, python 2.7.2, linux2) the same <br>
&gt; code results in a unicode decode error:<br>
&gt; <br>
&gt; Do you have any further log output from ZOPE event.log or similiar?<br>
&gt; <br>
&gt; <br>
&gt;        UnicodeDecodeError: &#39;utf8&#39; codec can&#39;t decode byte 0xe4 in position 1: <br>
&gt; invalid continuation byte<br>
&gt; <br>
&gt;&gt; Could this be related to different python or zope versions somehow?<br>
&gt; <br>
&gt; With just a short in the dark, i would point on the python binary / build and <br>
&gt; possibly used regarding libs.<br>
&gt; <br>
&gt; Could you try to make your own python build from sources from vanilla?<br>
&gt; <br>
&gt; If that does&#39;nt change anything - could you / we compare the config / build <br>
&gt; output from BOTH pythons (from Maports and from linux) to see any differences <br>
&gt; here?<br>
&gt; <br>
&gt; sorry, yes, this may take some further time and may be the wrong direction - <br>
&gt; but would be what i would try as next here.<br>
&gt; <br>
&gt; <br>
&gt; good luck and<br>
&gt; cheerioh,<br>
&gt; <br>
&gt; <br>
&gt; Niels. <br>
&gt; <br>
&gt; -- <br>
&gt; ---<br>
&gt; Niels Dettenbach<br>
&gt; Syndicat IT & Internet<br>
&gt; http://www.syndicat.com<br>
&gt; PGP: https://syndicat.com/pub_key.asc<br>
&gt; ---<br>
&gt; <br>
&gt; <br>
&gt; <br>
&gt; <br>
<br>
</p>

    </div>
     

    <!--~-|**|PrettyHtmlStart|**|-~-->
    <div style="color: #fff; height: 0;">__._,_.___</div>

          
  
 

    
    <div style="clear:both"> </div>

    <div id="fromDMARC" style="margin-top: 10px;">
        <hr style="height:2px ; border-width:0; color:#E3E3E3; background-color:#E3E3E3;">
        Posted by: =?utf-8?Q?Sebastian_T=C3=A4nzer?= &lt;[email protected]&gt;        <hr style="height:2px ; border-width:0; color:#E3E3E3; background-color:#E3E3E3;">
     </div>
    <div style="clear:both"> </div>

    <table cellspacing=4px style="margin-top: 10px; margin-bottom: 10px; color: #2D50FD;">
      <tbody>
        <tr>
          <td style="font-size: 12px; font-family: arial; font-weight: bold; padding: 7px 5px 5px;"  >
                          <a style="text-decoration: none; color: #2D50FD" href="https://groups.yahoo.com/neo/groups/zms-developers/conversations/messages/3871;_ylc=X3oDMTJwanU1MTh1BF9TAzk3MzU5NzE0BGdycElkAzg0NzA4MjEEZ3Jwc3BJZAMxNzA3MjgxOTQyBG1zZ0lkAzM4NzEEc2VjA2Z0cgRzbGsDcnBseQRzdGltZQMxNDIzMTQzMzIw?act=reply&messageNum=3871">Reply via web post</a>
                      </td>
          <td>&bull;</td>
          <td style="font-size: 12px; font-family: arial; padding: 7px 5px 5px;" >
            <a href="mailto:[email protected]?subject=Re%3A%20%5Bzms-developers%5D%20Strange%20behaviour%20with%20getLangFmtDate%20encoding" style="text-decoration: none; color: #2D50FD;">
               Reply to sender            </a>
          </td>
          <td>&bull;</td>
          <td style="font-size: 12px; font-family: arial; padding: 7px 5px 5px;">
            <a href="mailto:[email protected]?subject=Re%3A%20%5Bzms-developers%5D%20Strange%20behaviour%20with%20getLangFmtDate%20encoding" style="text-decoration: none; color: #2D50FD">
              Reply to group            </a>
          </td>
          <td>&bull;</td>
          <td style="font-size: 12px; font-family: arial; padding: 7px 5px 5px;" >
            <a href="https://groups.yahoo.com/neo/groups/zms-developers/conversations/newtopic;_ylc=X3oDMTJlY3ZhMnBlBF9TAzk3MzU5NzE0BGdycElkAzg0NzA4MjEEZ3Jwc3BJZAMxNzA3MjgxOTQyBHNlYwNmdHIEc2xrA250cGMEc3RpbWUDMTQyMzE0MzMyMA--" style="text-decoration: none; color: #2D50FD">Start a New Topic</a>
          </td>
          <td>&bull;</td>
          <td style="font-size: 12px; font-family: arial; padding: 7px 5px 5px;color: #2D50FD;" >
                            <a href="https://groups.yahoo.com/neo/groups/zms-developers/conversations/topics/3869;_ylc=X3oDMTM0YjQyYWVsBF9TAzk3MzU5NzE0BGdycElkAzg0NzA4MjEEZ3Jwc3BJZAMxNzA3MjgxOTQyBG1zZ0lkAzM4NzEEc2VjA2Z0cgRzbGsDdnRwYwRzdGltZQMxNDIzMTQzMzIwBHRwY0lkAzM4Njk-" style="text-decoration: none; color: #2D50FD;">Messages in this topic</a>
                (3)
                      </td>
        </tr>
      </tbody>
    </table>

        

<!------- Start Nav Bar ------>




 

<!-- |**|begin egp html banner|**| -->
<div id="ygrp-vital" style="background-color: #f2f2f2; font-family: Verdana; font-size: 10px; margin-bottom: 10px; padding: 10px;">

    <span id="vithd" style="font-weight: bold; color: #333; text-transform: uppercase; "><a href="https://groups.yahoo.com/neo/groups/zms-developers/info;_ylc=X3oDMTJlZTNuMTdtBF9TAzk3MzU5NzE0BGdycElkAzg0NzA4MjEEZ3Jwc3BJZAMxNzA3MjgxOTQyBHNlYwN2dGwEc2xrA3ZnaHAEc3RpbWUDMTQyMzE0MzMyMA--" style="text-decoration: none;">Visit Your Group</a></span>

     <ul style="list-style-type: none; margin: 0; padding: 0; display: inline;">
                                                    </ul>
  </div>


<div id="ft" style="font-family: Arial; font-size: 11px; margin-top: 5px; padding: 0 2px 0 0; clear: both;">
  <a href="https://groups.yahoo.com/neo;_ylc=X3oDMTJkajhrczFuBF9TAzk3MzU5NzE0BGdycElkAzg0NzA4MjEEZ3Jwc3BJZAMxNzA3MjgxOTQyBHNlYwNmdHIEc2xrA2dmcARzdGltZQMxNDIzMTQzMzIw" style="float: left;"><img src="http://l.yimg.com/ru/static/images/yg/img/email/new_logo/logo-groups-137x15.png" height="15" width="137" alt="Yahoo! Groups" style="border: 0;"/></a>
  <div style="color: #747575; float: right;"> &bull; <a href="https://info.yahoo.com/privacy/us/yahoo/groups/details.html" style="text-decoration: none;">Privacy</a> &bull; <a href="mailto:[email protected]?subject=Unsubscribe" style="text-decoration: none;">Unsubscribe</a> &bull; <a href="https://info.yahoo.com/legal/us/yahoo/utos/terms/" style="text-decoration: none;">Terms of Use</a> </div>
</div>
<br>

<!-- |**|end egp html banner|**| -->

  </div> <!-- ygrp-msg -->

 
  <!-- Sponsor -->
  <!-- |**|begin egp html banner|**| -->
  <div id="ygrp-sponsor" style="width:160px; float:right; clear:none; margin:0 0 25px 0; background: #fff;">

<!-- Start Recommendations -->
<div id="ygrp-reco">
     </div>
<!-- End Recommendations -->



  </div>   <!-- |**|end egp html banner|**| -->

  <div style="clear:both; color: #FFF; font-size:1px;">.</div>
</div>

  <img src="http://geo.yahoo.com/serv?s=97359714/grpId=8470821/grpspId=1707281942/msgId=3871/stime=1423143320" width="1" height="1"> <br>

<img src="http://y.analytics.yahoo.com/fpc.pl?ywarid=515FB27823A7407E&a=10001310322279&js=no&resp=img" width="1" height="1"> 

<div style="color: #fff; height: 0;">__,_._,___</div>
<!--~-|**|PrettyHtmlEnd|**|-~-->

</body>

<!--~-|**|PrettyHtmlStart|**|-~-->
<head>
  <style type="text/css">
  <!--
  #ygrp-mkp {
  border: 1px solid #d8d8d8;
  font-family: Arial;
  margin: 10px 0;
  padding: 0 10px;
}

#ygrp-mkp hr {
  border: 1px solid #d8d8d8;
}

#ygrp-mkp #hd {
  color: #628c2a;
  font-size: 85%;
  font-weight: 700;
  line-height: 122%;
  margin: 10px 0;
}

#ygrp-mkp #ads {
  margin-bottom: 10px;
}

#ygrp-mkp .ad {
  padding: 0 0;
}

#ygrp-mkp .ad p {
  margin: 0;
}

#ygrp-mkp .ad a {
  color: #0000ff;
  text-decoration: none;
}
  #ygrp-sponsor #ygrp-lc {
  font-family: Arial;
}

#ygrp-sponsor #ygrp-lc #hd {
  margin: 10px 0px;
  font-weight: 700;
  font-size: 78%;
  line-height: 122%;
}

#ygrp-sponsor #ygrp-lc .ad {
  margin-bottom: 10px;
  padding: 0 0;
}

  #actions {
    font-family: Verdana;
    font-size: 11px;
    padding: 10px 0;
  }

  #activity {
    background-color: #e0ecee;
    float: left;
    font-family: Verdana;
    font-size: 10px;
    padding: 10px;
  }

  #activity span {
    font-weight: 700;
  }

  #activity span:first-child {
    text-transform: uppercase;
  }

  #activity span a {
    color: #5085b6;
    text-decoration: none;
  }

  #activity span span {
    color: #ff7900;
  }

  #activity span .underline {
    text-decoration: underline;
  }

  .attach {
    clear: both;
    display: table;
    font-family: Arial;
    font-size: 12px;
    padding: 10px 0;
    width: 400px;
  }

  .attach div a {
    text-decoration: none;
  }

  .attach img {
    border: none;
    padding-right: 5px;
  }

  .attach label {
    display: block;
    margin-bottom: 5px;
  }

  .attach label a {
    text-decoration: none;
  }
  
  blockquote {
    margin: 0 0 0 4px;
  }

  .bold {
    font-family: Arial;
    font-size: 13px;
    font-weight: 700;
  }

  .bold a {
    text-decoration: none;
  }

  dd.last p a {
    font-family: Verdana;
    font-weight: 700;
  }

  dd.last p span {
    margin-right: 10px;
    font-family: Verdana;
    font-weight: 700;
  }

  dd.last p span.yshortcuts {
    margin-right: 0;
  }

  div.attach-table div div a {
    text-decoration: none;
  }

  div.attach-table {
    width: 400px;
  }

  div.file-title a, div.file-title a:active, div.file-title a:hover, div.file-title a:visited {
    text-decoration: none;
  }

  div.photo-title a, div.photo-title a:active, div.photo-title a:hover, div.photo-title a:visited {
    text-decoration: none;
  }

  div#ygrp-mlmsg #ygrp-msg p a span.yshortcuts {
    font-family: Verdana;
    font-size: 10px;
    font-weight: normal;
  }

  .green {
    color: #628c2a;
  }

  .MsoNormal {
    margin: 0 0 0 0;
  }

  o {
    font-size: 0;
  }

  #photos div {
    float: left;
    width: 72px;
  }

  #photos div div {
    border: 1px solid #666666;
    height: 62px;
    overflow: hidden;
    width: 62px;
  }

  #photos div label {
    color: #666666;
    font-size: 10px;
    overflow: hidden;
    text-align: center;
    white-space: nowrap;
    width: 64px;
  }

  #reco-category {
    font-size: 77%;
  }

  #reco-desc {
    font-size: 77%;
  }

  .replbq {
    margin: 4px;
  }

  #ygrp-actbar div a:first-child {
   /* border-right: 0px solid #000;*/
    margin-right: 2px;
    padding-right: 5px;
  }

  #ygrp-mlmsg {
    font-size: 13px;
    font-family: Arial, helvetica,clean, sans-serif;
    *font-size: small;
    *font: x-small;
  }

  #ygrp-mlmsg table {
    font-size: inherit;
    font: 100%;
  }

  #ygrp-mlmsg select, input, textarea {
    font: 99% Arial, Helvetica, clean, sans-serif;
  }

  #ygrp-mlmsg pre, code {
    font:115% monospace;
    *font-size:100%;
  }

  #ygrp-mlmsg * {
    line-height: 1.22em;
  }

  #ygrp-mlmsg #logo {
    padding-bottom: 10px;
  }


  #ygrp-msg p a {
    font-family: Verdana;
  }

  #ygrp-msg p#attach-count span {
    color: #1E66AE;
    font-weight: 700;
  }

  #ygrp-reco #reco-head {
    color: #ff7900;
    font-weight: 700;
  }

  #ygrp-reco {
    margin-bottom: 20px;
    padding: 0px;
  }

  #ygrp-sponsor #ov li a {
    font-size: 130%;
    text-decoration: none;
  }

  #ygrp-sponsor #ov li {
    font-size: 77%;
    list-style-type: square;
    padding: 6px 0;
  } 

  #ygrp-sponsor #ov ul {
    margin: 0;
    padding: 0 0 0 8px;
  }

  #ygrp-text {
    font-family: Georgia;
  }

  #ygrp-text p {
    margin: 0 0 1em 0;
  }

  #ygrp-text tt {
    font-size: 120%;
  }

  #ygrp-vital ul li:last-child {
    border-right: none !important; 
  } 
  -->
  </style>
</head>

<!--~-|**|PrettyHtmlEnd|**|-~-->
</html>
<!-- end group email -->


--APb5Jy1V1q00arde4oG4z9oWAlLFVoHhBtlVpn---