Re: how to download entire feed with wget
"James Holderness" <[email protected]> Fri, 6 Mar 2009 20:31:12 -0000
| Newsgroups | gmane.network.syndication.rss.support |
|---|---|
| Message-ID | <[email protected]> |
Rogers Cadenhead wrote:
> To go back further, you'd have to find an aggregator that saved older
> feed entries, as Google Reader appears to do from your post. I think
> Bloglines does this, and you can request that data with the Bloglines
> API:
You can do the same kind of thing through Google's API. However, bear in
mind that what you're getting back isn't the original feed content - it will
have been processed and altered by whichever of the services you use.
Now there's also a "standard" way to get back archived feed documents -
RFC5005 - but it's very rarely implemented. A couple of the big blogging
sites support something similar, but the reality of how it's implemented in
practice is different enough to make the spec essentially useless. At least
in my experience.
One last warning: If you do try and get something like this working,
remember that some feeds can be huge. When they post multiple messages per
day and have been going for several years, that adds up to a lot of data.
You can find yourself downloading hundreds of pages and thousands of feed
entries.
Regards
James
------------------------------------
Yahoo! Groups Links
<*> To visit your group on the web, go to:
http://groups.yahoo.com/group/rss-public/
<*> Your email settings:
Individual Email | Traditional
<*> To change settings online go to:
http://groups.yahoo.com/group/rss-public/join
(Yahoo! ID required)
<*> To change settings via email:
mailto:[email protected]
mailto:[email protected]
<*> To unsubscribe from this group, send an email to:
[email protected]
<*> Your use of Yahoo! Groups is subject to:
http://docs.yahoo.com/info/terms/