Re: scripting an interactive web page

"Voytek Eymont" <[email protected]> Sat, 10 Apr 2010 15:45:32 +1000 (EST)
Newsgroups gmane.org.user-groups.slug.chat
Message-ID <[email protected]>
On Thu, March 4, 2010 1:59 pm, Steffen Schulz wrote:
> On 100304 at 09:45, Ken Foskey wrote:
>> On Tue, 2010-03-02 at 22:48 +1100, Voytek Eymont wrote:

> Alternative to curl is to use good old wget, which might look like:
> wget --post-data 'username=me&password=foo' --save-cookies session.tmp

Steffen and everyone replied, many thanks

decided to go with wget as it was something I've used in the past

after a few false starts (and some help) I managed to pass all required
'input' values correctly, and, I'm in

...
wget -O abc.html .....
...

links -dump abc.html > abc.txt
awk '$1 !~ /(^$)/' abc.txt  > abc
...

how to ditch all text past a keyword?
or, alternatively, ditch all lines with 'file:///'

after data I want ends, I have like 25 lines of links like so:

------------------------
data
data
data
References
   Visible links
   1. file:///main.htm?_module=active_list
   2. file:///.....
....
------------------------


-- 
Voytek

-- 
SLUG - Sydney Linux User Group Mailing List - http://slug.org.au/
Subscription info and FAQs: http://slug.org.au/faq/mailinglists.html