Parse webpage HTML

Julius Hamilton via xml <[email protected]> Fri, 17 Sep 2021 12:15:01 +0200
Newsgroups gmane.comp.gnome.lib.xml.general
Message-ID <CAEsMKX1m9ssxbuJHU+TSMzztPZb+UBEpER9EZJBq4LPvMnfWyQ@mail.gmail.com>
--===============3963934654938231549==
Content-Type: multipart/alternative; boundary="000000000000f9169505cc2e34aa"

--000000000000f9169505cc2e34aa
Content-Type: text/plain; charset="UTF-8"

Hey,

I would like to write a script which extracts article text content from
webpage HTML. The webpages have similar structure because they are all
documentation pages from the same website, Microsoft Visual Basic for
Applications homepage.

I believe I should first inspect the HTML tree, i.e. the raw HTML returned
by wget, to figure out which nodes tend to have the text content I am
seeking. Should I do that in Firefox or Chrome, or is there a good
standalone tool for that?

Then, could I use this xml parsing library, or is there some other standard
one, for retrieving the text content at the nodes I have identified?

Thanks very much,
Julius

--000000000000f9169505cc2e34aa
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr"><div>Hey,</div><div><br></div><div>I would like to write a=
 script which extracts article text content from webpage HTML. The webpages=
 have similar structure because they are all documentation pages from the s=
ame website, Microsoft Visual Basic for Applications homepage.</div><div><b=
r></div><div>I believe I should first inspect the HTML tree, i.e. the raw H=
TML returned by wget, to figure out which nodes tend to have the text conte=
nt I am seeking. Should I do that in Firefox or Chrome, or is there a good =
standalone tool for that?</div><div><br></div><div>Then, could I use this x=
ml parsing library, or is there some other standard one, for retrieving the=
 text content at the nodes I have identified?</div><div><br></div><div>Than=
ks very much,<br></div><div>Julius<br></div></div>

--000000000000f9169505cc2e34aa--

--===============3963934654938231549==
Content-Type: text/plain; charset="us-ascii"
MIME-Version: 1.0
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

_______________________________________________
xml mailing list, project page  http://xmlsoft.org/
[email protected]
https://mail.gnome.org/mailman/listinfo/xml

--===============3963934654938231549==--