Re: NTLM authentication
Peter Karman <[email protected]>
| Newsgroups | gmane.comp.web.swish-e |
|---|---|
| Message-ID | <[email protected]> |
thanks for the detailed posting. Glad you found something that works. FWIW, the Perl-centric nature of some Swish-e components is due to who took the time to write them. Since the main swish-e program is in C, and the API well-documented, we encourage other scripting language advocates to contribute code in their favorite languages. cheers, pek Gertjan Hofman scribbled on 8/6/06 8:42 PM: > Dear Swish user, > > I posted a message a while ago trying to see how to > get NTLM authentication to work in conjunction with > swish-e. It was pointed out to me that there is a Perl > module for this. It probably works, but unless some > one tells me step-by-step how to use it, it's a time > consuming route for someone who doesnt speak Perl - i > tried Perl a few years ago and decided there are many > better scripting languages around and stopped learning > and using it. Not trying to start a flaming war here, > but just an observation that if Swish becomes very > Perl focused in it's set-up, it might lose some users. > > > Anyway, for anyone else who is Perl-ignorant and wants > to do this, I got around the NTLM authentication > required to get to our intranet by using the ntlmap > proxy server. I downloaded the package from > sourceforge. My edited config file is attached below. > Test it by running: > > /main.py & > > and fetching something with wget: > > setenv http_proxy=localhost:5865 > and use wget to get a file wget --proxy=on > myintranet_serve/index.htm > > > To use with swish-e, in the spider config file > (spider.conf.pl), switch on proxy-ing: > > # start of spider.conf.pl > > my ($filter_sub, $response_sub) = swish_filter(); > > my %main_site = ( > > > base_url => > 'http://hmx-bi35-s6/sitemap.html', > email => > '[email protected]', > keep_alive => 1, # > Try to keep the connection open > filter_content => $filter_sub, # > use SWISH filter > test_url => sub { > my ($uri, $server) = @_; > # enable proxy requests > unless ($::proxy_set++) { > my $ua = $server->{ua}; > $ua->proxy('http', > 'http://localhost:5865'); > } > # return true if not an image, > otherwise false > return $uri->path !~ > /\.(gif|jpeg|png)$/; > > }, > > ); > > @servers = ( \%main_site); > > # end of spider.conf.pl > > And in the main config file I have my usual stuff > plus: > > IndexDir spider.pl > SwishProgParameters spider.conf.pl > IndexFile "web.index" > > > The formatting in the above test might be wonky > because I am using yahoo's poor mail composer. > > Cheers > > Gertjan > > > (proxy server config file). > > [GENERAL] > LISTEN_PORT:5865 > PARENT_PROXY: > PARENT_PROXY_PORT:8080 > PARENT_PROXY_TIMEOUT:15 > ALLOW_EXTERNAL_CLIENTS:0 > FRIENDLY_IPS: > URL_LOG:0 > MAX_CONNECTION_BACKLOG:5 > [CLIENT_HEADER] > [NTLM_AUTH] > NT_HOSTNAME: > NT_DOMAIN:honeywell > USER:e191564 > PASSWORD: > LM_PART:1 > NT_PART:0 > NTLM_FLAGS: 06820000 > NTLM_TO_BASIC:0 > > > > > > > __________________________________________________ > Do You Yahoo!? > Tired of spam? Yahoo! Mail has the best spam protection around > http://mail.yahoo.com > -- Peter Karman . http://peknet.com/ . [email protected]