Re: Browser redirect
[email protected] Mon, 25 Feb 2008 06:00:04 -0800 (PST)
| Newsgroups | gmane.comp.mozilla.devel.java |
|---|---|
| Organization | http://groups.google.com |
| Message-ID | <28620362-0021-4a4c-996a-4ca3d0d9d40d__15732.9046786346$1203948080$gmane$org@s37g2000prg.googlegroups.com> |
If you just want a crawler you can either try using the HTTPClient in the Sun JDK(net classes) or try innovationch.com for a java package to do the same but better (connections persist). You may also need a HTML parser that makes sense, for that you can try any number of packages freely available. I do not think you "have" to render a page for what you're trying to achieve. Web crawlers do not "render" pages. You can use Mozilla embedding for that, but don't render if you don't have too. To crawl page to page just submit the action and whatever parms are needed. So to "submit" you do not need to "render". Any HTML that is retrieved from a web page will be just that, the non-rendered HTML code. To render, that is get the page image after browser load you'll need a mozilla SDK tool. But to crawl the web "rendering" is not necc.