Re: Programmatically build a catalog database?

On 02/20/2013 12:21 AM, Petite Abeille wrote:
>
> On Feb 19, 2013, at 8:23 PM, Marcello Perathoner<marcello-ULrl/Sucve/[email protected]>  wrote:
>
>> No. But the rdf files are easy enough to find.
>
> So… how does one actually get these individual rdf files then?
>
> $ curl -IL  http://www.gutenberg.org/ebooks/12345.rdf
>
> HTTP/1.1 403 Forbidden
>
> Ok, so www.gutenberg.org doesn't like curl.

No. And doesn't like any kind of automated access. If you want to do 
that, use a mirror from the mirror list:

   www.gutenberg.org/MIRRORS.ALL


I've tar'ed all rdf files together so you can get them with one request:

$ curl --user-agent "MyBotName/1.0; +mailto:[email protected]" 
http://www.gutenberg.org/feeds/rdf-files.tar.bz2 ...




Regards

-- 
Marcello Perathoner
[email protected]
_______________________________________________
gutvol-d mailing list
gutvol-d-4LCm/o+qPMZ96Xl/[email protected]
http://lists.pglaf.org/mailman/listinfo/gutvol-d