http authentication on lftp 4.7.x versions

Hi there,

I have been using lftp for some years now, and has been working smoothly 
i can say.

Now i have upgrade to version 4.7.1, and it seems i am having a bit of 
an issue when comes to http authentication.

So, my setup is rather simple, and it has been running for some years, 
through a crontab on a daily task to get the latest backup files from an 
external server.

command from crontab:

/usr/local/bin/lftp -f /usr/home/user/scripts/backup.lftp

the content of the script (backup.lftp) i am running
--
set mirror:order "backup*"
set http:authorization user:pass
set ssl:verify-certificate no
open https://www.mysite.com/transfer
mirror -c --Remove-source-files home /data/public/backup &
at 0610  -- exit top kill &
--

This has been running without any problems up to version 4.6.5:
--
4.6.5
lftp :~> set mirror:order "backup*"
lftp :~> set http:authorization user:pass
lftp :~> set ssl:verify-certificate no
lftp :~> open https://www.mysite.com/transfer
cd: received redirection to `https://www.mysite.com/transfer/'
cd ok, cwd=/transfer
lftp www.mufley.com:/transfer> mirror -c --Remove-source-files home 
/data/public/backup

web logs
mysite.com - transftp [02/May/2016:09:54:03 +0100] "HEAD /transfer 
HTTP/1.1" 301 - "-" "lftp/4.6.5"
mysite.com - transftp [02/May/2016:09:54:03 +0100] "HEAD /transfer/ 
HTTP/1.1" 200 - "-" "lftp/4.6.5"
--

I have upgraded this weekend to version 4.7.1 (tested also on 4.7.0), 
and now:
--
4.7.0/1
lftp :~> set mirror:order "backup*"
lftp :~> set http:authorization user:pass
lftp :~> set ssl:verify-certificate no
lftp :~> open https://www.mysite.com/transfer
(it will cycle now through the below messages)
cd `https://www.mufley.com/transfer' [Connecting...]
cd `https://www.mufley.com/transfer' [Fetching headers...]
cd `https://www.mufley.com/transfer' [Waiting for response...]

web logs
mysite.com - - [02/May/2016:10:57:17 +0100] "HEAD /transfer HTTP/1.1" 
401 - "-" "lftp/4.7.0"
mysite.com - - [02/May/2016:10:57:17 +0100] "HEAD /transfer HTTP/1.1" 
401 - "-" "lftp/4.7.0"
mysite.com - - [02/May/2016:10:57:17 +0100] "HEAD /transfer HTTP/1.1" 
401 - "-" "lftp/4.7.0"
--

No changes have been done to the webserver, and when i use back again 
version 4.6.5 every works fine.

So it seems on the 4.7.x the server replies with a 401 Unauthorized, 
instead of the 301 redirect and 200 ok.
 From what i can understand this seems to be related to the new http 
authentication functionality that has been added to 4.7.x.

Maybe i am missing something in the scripts to be updated to run 
correclty on 4.7.x versions?
I tried to look into the code, but it will take me a bit of time to 
understand, so i decided to drop you this email.

Can you check this when you have some time? Or do you need more 
information, or more debug done?
I will be more than happier to help.

Looking forward to some feedback...

Fred


_______________________________________________
lftp mailing list
[email protected]
http://univ.uniyar.ac.ru/mailman/listinfo/lftp