Re: Changes on repository.apache.org?

Felix Meschberger <[email protected]>
Newsgroups gmane.comp.jakarta.repository
Message-ID <1299234310.2691.3.camel@meschbix>
Hi,

Am Freitag, den 04.03.2011, 10:11 +0000 schrieb Stuart McCulloch:
> On 4 March 2011 10:02, Felix Meschberger <[email protected]> wrote:
>         Hi,
>         
>         Some more background: These scripts use wget to download the
>         release
>         candidate. According to the wget man page wget respects
>         robots.txt 
> 
> 
> FWIW you could add the following line to your local ~/.wgetrc
> 
> 
>    robots=off
> 
> 
> this tells wget to ignore robots.txt - the script should then work

Thanks for the hint. Carsten found this out, too, and it works indeed.

Regards
Felix

>  
>         which in turn contains:
>         
>         > User-agent: *
>         > Disallow: /content/
>         > Disallow: /service/
>         > Allow: /
>         > Allow: /content/sites/
>         
>         Could it be that this prevents wget from working and that
>         robots.txt has
>         recently been changed (IIRC I could get a RC with the scripts
>         on
>         Monday).
>         
>         Thanks and Regards
>         Felix
>         
>         
>         Am Freitag, den 04.03.2011, 08:23 +0100 schrieb Carsten
>         Ziegeler: 
>         
>         > Hi,
>         >
>         > in the Felix and Sling project we use a script to download
>         artifacts
>         > from the staging repository to verify the releases.
>         > It stopped working at some point this week.
>         >
>         > The script uses wget and fetches index.html and traverses
>         the links of
>         > this html page recursively. It seems that now index.html is
>         not
>         > available anymore.
>         >
>         > While
>         >
>         https://repository.apache.org/content/repositories/orgapachefelix-003/org/apache/felix/
>         > returns the html
>         >
>         https://repository.apache.org/content/repositories/orgapachefelix-003/org/apache/felix/index.html
>         >
>         > does not.
>         >
>         > Is anyone aware of any changes here? Can we restore the old
>         behaviour?
>         > Or does someone know how to instruct wget to not append
>         index.html (I
>         > couldn't figure it out)
>         >
>         > Regards
>         > Carsten
>         
>         
>         
> 
> 
> 
> -- 
> Cheers, Stuart
lmpx.com only provides a reader for public news (NNTP) servers. It is not affiliated with the servers or forums shown here and is not responsible for the content of articles, which is written by their respective authors.