Re: FYI: Feed History extension

"Mark Nottingham" <[email protected]> Fri, 01 Jul 2005 23:17:34 -0000
Newsgroups gmane.network.syndication.rss.devel
Message-ID <[email protected]>
Hi Lucas,

Thanks for the reference. Having a complete archive has been
mentioned by a number of 
people (and was part of the original proposal I made to the Atom WG a
while back), but 
there was a lot of pushback from people who believe that the size of
the complete archive, 
in some cases, will be problematic. 

For example, if your feed has a history that goes back years, and you
have full content in 
the entries, there could be several (if not several tens or even
hundreds) of megabytes of 
content. If an automated (or just malicious) agent got a hold of the
URI for the archived 
feed (e.g., your aggregator subscribed to it) it could spell a lot of
trouble.

The proposal I made allows you to reconstruct the entire state of the
feed, by "walking" 
back through the archives. The downside of this is that potentially,
a number of requests 
need to be made, but with HTTP pipelining, etc., the overhead should
be negligible. 

All of that said, I'd be amenable to having some way of telling if an
archive is a full 
representation of the feed; I dropped it because so many people
(especially including 
implementors) thought it wasn't such a hot idea.

Also, note that fh:prev doesn't disallow the archive from being
complete; i.e., you could 
have one archive file that contains all entries, and just put an
fh:prev on your subscription 
feed that points to it, without any further fh:prev in the archive
(because there are no other 
entries).

WRT stateful -- the interesting case is when it's "false"; that tells
the consumer that they 
shouldn't try to keep a history (many aggregators do this by default
now, so this is a 
graceful way to introduce this explicitly hinted behaviour).

Cheers and thanks,

P.S. I'm not subscribed to e-mails from this list, so if you want to
make sure I see a reply, 
please CC me.

--- In [email protected], Lucas Gonze <lgonze@p...> wrote:
> A related issue came up in the Media RSS group.  Yahoo wanted an 
> 'archive' element to signify that a feed was either complete or
partial, 
> partial meaning that there were entries not included in the feed. 
The 
> purpose was to be able to retrieve (and publish) a complete copy of
the 
> feed.  The main difference between their proposal and yours was
that 
> there were two feed documents -- a current view of the feed with a 
> partial collection of entries and an archive view with a complete 
> collection.
> 
> If your fh:prev element allowed the archive to be complete, meaning
that 
> it includes both previous entries and entries in the current feed,
then 
> these proposals would be almost the same.
> 
> The fh:stateful element seems redundant.  My reading is that you
can 
> safely infer that a feed is stateful when you see an fn:prev
element -- 
> are there situations where that's not true?
> 
> Mark Nottingham wrote:
> 
> >I've put together the draft announced below as a way to allow
feeds'
> >history to be 
> >reconstructed; e.g., if Scripting News supported this (by adding
one
> >tag to the feed and 
> >archived feed headers), you could track Dave's writings back to the
> >very beginning, 
> >automatically.
> >
> >Note that it's submitted to the Atom WG, but it's equally
applicable
> >to RSS; there are RSS 
> >examples, and there shouldn't be any overhead or problem.
> >
> >I've modified my blog feed to demonstrate it:
> >  http://www.mnot.net/blog/index.rdf
> >
> >Comments and suggestions much appreciated,
> >
> >[[[
> >A New Internet-Draft is available from the on-line Internet-Drafts
> >directories.
> >
> >
> >        Title           : Feed History: Enabling Stateful
Syndication
> >        Author(s)       : M. Nottingham
> >        Filename        : draft-nottingham-atom
pub-feed-history-01.txt
> >        Pages           : 10
> >        Date            : 2005-7-1
> >        
> >This document specifies mechanisms that allow feed publishers to
give
> >   hints about the nature of the feed's statefulness, and a means
of
> >   retrieving "missed" entries from a stateful feed.
> >
> >A URL for this Internet-Draft is:
> >http://www.ietf.org/internet-drafts/draft-nottingh
> >am-atompub-feed-history-01.txt
> >
> >To remove yourself from the I-D Announcement list, send a message
to 
> >i-d-announce-request at ietf.org with the word unsubscribe in the
> >body of the message.  
> >You can also visit https://www1.ietf.org/mailman/l
> >istinfo/I-D-announce 
> >to change your subscription settings.
> >
> >
> >Internet-Drafts are also available by anonymous FTP. Login with the
> >username
> >"anonymous" and a password of your e-mail address. After logging
in,
> >type "cd internet-drafts" and then
> >        "get draft-nottingham-atompub-feed-history-01.txt".
> >
> >A list of Internet-Drafts directories can be found in
> >http://www.ietf.org/shadow.html 
> >or ftp://ftp.ietf.org/ietf/1shadow-sites.txt
> >
> >
> >Internet-Drafts can also be obtained by e-mail.
> >
> >Send a message to:
> >        mailserv at ietf.org.
> >In the body type:
> >        "FILE /internet-drafts/draft-nottingham-at
> >ompub-feed-history-01.txt".
> >        
> >NOTE:   The mail server at ietf.org can return the document in
> >        MIME-encoded form by using the "mpack" utility.  To use
this
> >        feature, insert the command "ENCODING mime" before the
"FILE"
> >        command.  To decode the response(s), you will need
"munpack"
> >or
> >        a MIME-compliant mail reader.  Different MIME-compliant
mail
> >readers
> >        exhibit different behavior, especially when dealing with
> >        "multipart" MIME messages (i.e. documents which have been
> >split
> >        up into multiple messages), so check your local
documentation
> >on
> >        how to manipulate these messages.
> >                
> >                
> >Below is the data which will enable a MIME compliant mail reader
> >implementation to automatically retrieve the ASCII version of the
> >Internet-Draft.
> ><ftp://ftp.ietf.org/internet-drafts/draft-nottingh
> >am-atompub-feed-history-01.txt>
> >]]]
> >--- End forwarded message ---
> >
> >
> >
> >
> > 
> >Yahoo! Groups Links
> >
> >
> >
> > 
> >
> >
> >.
> >
> >  
> >




 
Yahoo! Groups Links

<*> To visit your group on the web, go to:
    http://groups.yahoo.com/group/rss-dev/

<*> To unsubscribe from this group, send an email to:
    [email protected]

<*> Your use of Yahoo! Groups is subject to:
    http://docs.yahoo.com/info/terms/