Re: Tidy [Inferred Table] Bug

Ger Hobbelt <[email protected]> Wed, 20 Jan 2010 18:40:59 +0100
Newsgroups gmane.comp.web.html-tidy.devel
Message-ID <[email protected]>
--===============3405426185589220447==
Content-Type: multipart/alternative; boundary=00151747beaaedc06c047d9c166f

--00151747beaaedc06c047d9c166f
Content-Type: text/plain; charset=ISO-8859-1

Okay,

<insert priorities blah-di-blah here or else insert your favorite excuse for
delays />

Anyhow, there's an experimental distro available at www.hebbut.net -- nope,
I don't have CVS  write access, etc.etc., so not from SF until I find the
time to transform this to a decent diff/patch submission set and such
submission is accepted and incorporated in mainline.
For now, you can at least have a look-see and experiment with it; see if you
like what it does.

That goes for the <tr></tr> without the <table> bug/feature request, and
goes likewise for a couple of other things that are in there which I needed
myself in one form or another; some of those items have request numbers in
SF tracking system, but that was just me, back in nov/2009 making sure I had
a number to attach all this stuff to. That was/is handy when you add test
cases, like I did, in test/input: the numbers of the testcase files nicely
correspond with your bug/feature req number in the SF tracker then :-))

For now, a quick list of what it's got:

1- <tr> / <td> handling with missing <table>.

2- MathML / SVG / <canvas> support: these HTML5 tags are recognized and
processed in a reasonable fashion (SVG and MathML 'chunks' are treated as
'pure XML sections' as those are always XML-style formatted

3- re-introduction / augmentation/ hacking of the codepage / encoding
support that was lurking in there since antiquity (needed that for some
really troublesome Asian pages that had to be pulled through tidy without
damaging the content despite it not being UTF-8). This is the most brittle
and dangerous piece of work in there, so YMMV.

4- some API additions that helped getting the html2db DocBook converter
going without the original gory source hacking.


Like I said:
status: EXPERIMENTAL

Items 1 & 2 come with testcases; see directory test/input for those.
The comments in those HTML files show a bit about what is expected/done and
why. Be aware that htmltidy is not a browser, so it's not trying to mimic
one here; rather, it is done so that a erroneous 'content editing process'
gets to see the errors in the least destructive way. That is: htmltidy is
expected to sit in the content editing path, with a feedback loop so the
content editor (a human) can alter the produce whenever needed, while
guaranteeing a HTML/XML compliant content feed into the database.
Intent of having htmltidy in the editorial chain: no garbage-in for the CMS
database --> much less chance of barbage-out. Saves quite a bit on later
(repetitive, costly) fixups: write once by one, read many times by others,
so it saves server load and cuts down on HTML formatting 'issues' as
conbined content shows up at client machines when the db content is
guaranteed to be compliant, everywhere, any time. That goes for content,
templates, etc.etc. but I digress.
That is how my preferred process flow happens; have a look and see whether
the htmltidy behaviour as it is, is suitable for /your/ needs too.



Now where can you get it?

http://hebbut.net/

go to 'Public Offerings' and scroll down the list to find htmltidy in there;
click and you go to another page; downloads are at the bottom, most recent
on top of list (.tar.bz2 and .7z is offered; WinRAR on Windows can extract
it, and so can the usual tools on Linux/UNIX ) The page mentions MSVC2005,
but the project files which are really up to date are the MSVC2008 ones
right now.

No rpms; Just The Source.

./configure
make
make check
(yes, a few accessibility tests will fail!)

make install
...or whatever you need.

For 'release builds' with maximum optimizations, there's

./configure --enable-debug=no

(the configure script is augmented; this does NOT apply to the SF available
tidy distro/downloads)

You may want to configure/build this baby with
./configure --enable-access  --enable-asian --enable-utf16
if you are in need of any of that. Check
./configure --help
output if you feel unsure about this; then I'd say go with plain vanilla
./configure
and go from there.


Enjoy if you like bleeding edge development source distro's / binaries. ;-)
(BTW: Windows executables are available there too)


I'm not sure when I'll be able (= find time) to extract everything into neat
diffs, so no predictions whatsoever when and how this will enter mainline.
Besides diff/patches, there's review in that path. Some of this has been
lurking in there for over a year and still I've found enough excuses to
attend other things first.




On Fri, Jan 8, 2010 at 11:41 PM, Ben McCann <[email protected]> wrote:

> Sounds good to me.  I'm grateful you're helping me out here.  (Taking time
> off the holidays is a good enough excuse for me.  I used it several times
> :o)  Thanks Ger!
>
>
-- 
Met vriendelijke groeten / Best regards,

Ger Hobbelt

--------------------------------------------------
web:    http://www.hobbelt.com/
       http://www.hebbut.net/
mail:   [email protected]
mobile: +31-6-11 120 978
--------------------------------------------------

--00151747beaaedc06c047d9c166f
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

Okay,<br><br>&lt;insert priorities blah-di-blah here or else insert your fa=
vorite excuse for delays /&gt;<br><br>Anyhow, there&#39;s an experimental d=
istro available at <a href=3D"http://www.hebbut.net" target=3D"_blank">www.=
hebbut.net</a> -- nope, I don&#39;t have CVS=A0 write access, etc.etc., so =
not from SF until I find the time to transform this to a decent diff/patch =
submission set and such submission is accepted and incorporated in mainline=
.<br>

For now, you can at least have a look-see and experiment with it; see if yo=
u like what it does.<br><br>That goes for the &lt;tr&gt;&lt;/tr&gt; without=
 the &lt;table&gt; bug/feature request, and goes likewise for a couple of o=
ther things that are in there which I needed myself in one form or another;=
 some of those items have request numbers in SF tracking system, but that w=
as just me, back in nov/2009 making sure I had a number to attach all this =
stuff to. That was/is handy when you add test cases, like I did, in test/in=
put: the numbers of the testcase files nicely correspond with your bug/feat=
ure req number in the SF tracker then :-))<br>
<br>For now, a quick list of what it&#39;s got:<br><br>1- &lt;tr&gt; / &lt;=
td&gt; handling with missing &lt;table&gt;. <br><br>2- MathML / SVG / &lt;c=
anvas&gt; support: these HTML5 tags are recognized and processed in a reaso=
nable fashion (SVG and MathML &#39;chunks&#39; are treated as &#39;pure XML=
 sections&#39; as those are always XML-style formatted<br>
<br>3- re-introduction / augmentation/ hacking of the codepage / encoding s=
upport that was lurking in there since antiquity (needed that for some real=
ly troublesome Asian pages that had to be pulled through tidy without damag=
ing the content despite it not being UTF-8). This is the most brittle and d=
angerous piece of work in there, so YMMV.<br>
<br>4- some API additions that helped getting the html2db DocBook converter=
 going without the original gory source hacking.<br><br><br>Like I said: <b=
r>status: EXPERIMENTAL<br><br>Items 1 &amp; 2 come with testcases; see dire=
ctory test/input for those.<br>
The comments in those HTML files show a bit about what is expected/done and=
 why. Be aware that htmltidy is not a browser, so it&#39;s not trying to mi=
mic one here; rather, it is done so that a erroneous &#39;content editing p=
rocess&#39; gets to see the errors in the least destructive way. That is: h=
tmltidy is expected to sit in the content editing path, with a feedback loo=
p so the content editor (a human) can alter the produce whenever needed, wh=
ile guaranteeing a HTML/XML compliant content feed into the database.<br>
Intent of having htmltidy in the editorial chain: no garbage-in for the CMS=
 database --&gt; much less chance of barbage-out. Saves quite a bit on late=
r (repetitive, costly) fixups: write once by one, read many times by others=
, so it saves server load and cuts down on HTML formatting &#39;issues&#39;=
 as conbined content shows up at client machines when the db content is gua=
ranteed to be compliant, everywhere, any time. That goes for content, templ=
ates, etc.etc. but I digress.<br>
That is how my preferred process flow happens; have a look and see whether =
the htmltidy behaviour as it is, is suitable for /your/ needs too.<br><br><=
br><br>Now where can you get it?<br><br><a href=3D"http://hebbut.net/">http=
://hebbut.net/</a> <br>
<br>go to &#39;Public Offerings&#39; and scroll down the list to find htmlt=
idy in there; click and you go to another page; downloads are at the bottom=
, most recent on top of list (.tar.bz2 and .7z is offered; WinRAR on Window=
s can extract it, and so can the usual tools on Linux/UNIX ) The page menti=
ons MSVC2005, but the project files which are really up to date are the MSV=
C2008 ones right now.<br>
<br>No rpms; Just The Source.<br><br>./configure <br>make<br>make check<br>=
(yes, a few accessibility tests will fail!)<br><br>make install<br>...or wh=
atever you need.<br><br>For &#39;release builds&#39; with maximum optimizat=
ions, there&#39;s<br>
<br>./configure --enable-debug=3Dno<br><br>(the configure script is augment=
ed; this does NOT apply to the SF available tidy distro/downloads)<br><br>Y=
ou may want to configure/build this baby with<br>./configure --enable-acces=
s=A0 --enable-asian --enable-utf16<br>
if you are in need of any of that. Check <br>./configure --help<br>output i=
f you feel unsure about this; then I&#39;d say go with plain vanilla <br>./=
configure<br>and go from there.<br><br><br>Enjoy if you like bleeding edge =
development source distro&#39;s / binaries. ;-)<br>
(BTW: Windows executables are available there too)<br><br><br>I&#39;m not s=
ure when I&#39;ll be able (=3D find time) to extract everything into neat d=
iffs, so no predictions whatsoever when and how this will enter mainline. B=
esides diff/patches, there&#39;s review in that path. Some of this has been=
 lurking in there for over a year and still I&#39;ve found enough excuses t=
o attend other things first.<br>
<br><br><br><br><div class=3D"gmail_quote">On Fri, Jan 8, 2010 at 11:41 PM,=
 Ben McCann <span dir=3D"ltr">&lt;<a href=3D"mailto:[email protected]" targ=
et=3D"_blank">[email protected]</a>&gt;</span> wrote:<br><blockquote class=
=3D"gmail_quote" style=3D"border-left: 1px solid rgb(204, 204, 204); margin=
: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;">

Sounds good to me. =A0I&#39;m grateful you&#39;re helping me out here. =A0(=
Taking time off the holidays is a good enough excuse for me. =A0I used it s=
everal times :o) =A0Thanks Ger!<div><div></div><div><div><br></div></div></=
div>
</blockquote></div><br>-- <br>Met vriendelijke groeten / Best regards,<br><=
br>Ger Hobbelt<br><br>--------------------------------------------------<br=
>web: =A0 =A0<a href=3D"http://www.hobbelt.com/" target=3D"_blank">http://w=
ww.hobbelt.com/</a><br>

 =A0 =A0 =A0 =A0<a href=3D"http://www.hebbut.net/" target=3D"_blank">http:/=
/www.hebbut.net/</a><br>mail: =A0 <a href=3D"mailto:[email protected]" target=
=3D"_blank">[email protected]</a><br>mobile: +31-6-11 120 978<br>------------=
--------------------------------------<br>
<br>


--00151747beaaedc06c047d9c166f--


--===============3405426185589220447==
Content-Type: text/plain; charset="us-ascii"
MIME-Version: 1.0
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

------------------------------------------------------------------------------
Throughout its 18-year history, RSA Conference consistently attracts the
world's best and brightest in the field, creating opportunities for Conference
attendees to learn about information security's most important issues through
interactions with peers, luminaries and emerging and established companies.
http://p.sf.net/sfu/rsaconf-dev2dev
--===============3405426185589220447==
Content-Type: text/plain; charset="us-ascii"
MIME-Version: 1.0
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

_______________________________________________
Tidy-develop mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/tidy-develop

--===============3405426185589220447==--