Re: [gutvol-d] Problems downloading PG titles without a web browser
James Simmons <[email protected]> Sun, 10 Feb 2013 18:11:09 -0600
| Newsgroups | gmane.linux.laptop.olpc.sugar,gmane.culture.literature.e-books.gutenberg.volunteers |
|---|---|
| Message-ID | <CAN6VRWxiN4x3vp4cs+yGfoE_wJ6SdyC+GOOSfC-5Zp-=Br4OQw@mail.gmail.com> |
Marcello (and everyone else who replied): It looks like the mirrors have the same policy. I'm currently using this to download from the URL: http://doc.sugarlabs.org/epydocs/sugar.network.GlibURLDownloader-class.html I'm not seeing a way to put a user agent in using this code. It looks like urllib2 supports it. I used the other because I was already using it for collaboration and it gives me a way to do a progress report on the download. I appreciate everyone's detective work and suggestions. James Simmons On Sun, Feb 10, 2013 at 1:22 PM, Marcello Perathoner <[email protected] > wrote: > On 02/10/2013 06:46 PM, James Simmons wrote: > >> I had created an Activity for the One Laptop Per Child project which >> downloads and reads the Plain Text version of PG titles. I use the >> offline >> catalogue and some Python code to list available titles in the catalogue >> that match a search string. For instance the child might enter "Twain" >> and >> get a list of all the books by and about Twain. Then the child can >> download the book using the same program. >> >> This has been working well for years but lately it has stopped working. >> When I try to debug it I see it trying to download this URL for instance: >> >> http://www.gutenberg.org/dirs/**1/1/119/119.zip<http://www.gutenberg.org/dirs/1/1/119/119.zip> >> > > > Supply a user-agent that clearly defines your app and provides a way to > contact you eg. > > OLPCReader/1.0; +http://www.olpc-reader.org/**app-info.html<http://www.olpc-reader.org/app-info.html> > > OLPCReader/1.0; +mailto:[email protected] > > The standard Python-urllib user agent will not do! > > > or > > > use a mirror site. See: www.gutenberg.org/MIRRORS.ALL > > > > > > Regards > > -- > Marcello Perathoner > [email protected] > _______________________________________________ Sugar-devel mailing list [email protected] http://lists.sugarlabs.org/listinfo/sugar-devel