Re: reject/accept on entire query string

Mauro Tortonesi <[email protected]> Mon, 12 Jun 2006 18:27:39 +0200
Newsgroups gmane.comp.web.wget.patches
Organization Università di Ferrara
Message-ID <[email protected]>
John Clarke wrote:
> (Please send cc me with any replies)
> 
> With a previous version, someone was kind enough to build a special WIN32
> version of wget for me that made wget assess the *entire* query string, not
> just the "page name" when evaluating accept/reject options.
> 
> Typically URLs on my site look something like this:
> 
> www.mywiki.org/wc.dll?namespace~mytopic~secondary_namespace
> 
> Currently WGET will only evaluate up to "wc.dll" and thus ignore the
> important query string with the distinguishing URL data.
> 
> Is there a design reason why WGET does not assess the entire string? Is
> there any work around other than to make a special build (I wouldn't know
> how)? Could this be part of a future build?
> 
> (Please send cc me with any replies)

hi john,

you're raising an interesting point here. in fact, the current semantics 
of -A/-R are very limited and we have recently received many requests to 
implement an improved mechanism for URL filtering.

for this reason i have decided that, immediately after the release of 
wget 1.11 (which i scheduled for the end of june), i will start 
implementing a new URL filtering mechanism with regex support. for more 
information, please see:

http://www.mail-archive.com/wget%40sunsite.dk/msg08816.html


-- 
Aequam memento rebus in arduis servare mentem...

Mauro Tortonesi                          http://www.tortonesi.com

University of Ferrara - Dept. of Eng.    http://www.ing.unife.it
GNU Wget - HTTP/FTP file retrieval tool  http://www.gnu.org/software/wget
Deep Space 6 - IPv6 for Linux            http://www.deepspace6.net
Ferrara Linux User Group                 http://www.ferrara.linux.it