Strawman abuse report format proposal

Steve Atkins <[email protected]> Mon, 27 Sep 2004 20:18:22 -0700
Newsgroups gmane.ietf.asrg.abuserep
Message-ID <[email protected]>
This is a strawman proposal for an abuse reporting format. Comments and
discussion actively encouraged:

Context
~~~~~~~

Primarily the reporting of spam-related issues, though if it can be tweaked
to be appropriate for the reporting of other issues, that's great.

The goal is primarily reporting from individuals (or a representative
of those individuals - such as AOL scomp infrastructure) to ISP abuse
desks rather than sharing of information between abuse desks,
postmasters, filter operators etc. There is space for bulk exchange
of abuse information, primarily machine-to-machine, but this is outside
the scope of this proposal (and likely to be covered by the INCH working
group).

Goals
~~~~~

It must be possible to receive and handle a report with a standard email
client, with no loss of information. That doesn't mean that there can't
be additional machine-readable information that could be used by a smart
ticketing system, but a Mom-n-Pop ISP with a copy of pegasus must be able
to use it.

It should be possible to send a report with a standard email client. If there
is some subset of the functionality that goes beyond a standard email client
then the additional effort to implement that functionality should be minimal.

Requirements
~~~~~~~~~~~~

To handle a report efficiently and reliably, with or without
automation, an abuse desk needs the following features:

 o A complete, uncorrupted copy of the appropriate offending email, or
   logfile data.

 o The reason the email was sent to them - particularly in the case
   where the same report was sent to multiple ISPs for different reasons.
   Some way to do automated routing on that information would be nice.

 o Easy triage. A human must be able to glance at the email and
   understand the context in a few seconds. (If there is addidional
   metadata to allow automated routing that's great, but the data must
   still be available in a human readable form).

   The rule of thumb I've used for a long time is that the first 15 lines
   of the report must be adequate to triage the report.

 o It should be possible to reply to any report via email and reach
   someone who can provide further information.


Minimalist Proposal
~~~~~~~~~~~~~~~~~~~
For any report of unwanted email (whether that be spam, viruses, or simply
an unsubscription request) the full email should be attached to the report
as a MIME attachment (message/rfc822, ideally, but text/plain might be
supported too).

An exception to this might be this: In many cases the sender of the
email is only interested in the body of the message so they can pull
out a unique cookie (such as the message-id, the VERP envelope or
similar) that gives them all the information needed to categorise the
complaint. Most ESPs, for instance, categorise a mail by the triplet
of customer, mailing number and recipient number; that's enough
information for them to categorise a complaint and completely generate
the original mail. Perhaps if there's a header in the original email
of the form 'Abuse-Cookie: <email address> <opaque token>' and a report
is sent to the included email address then only the Abuse-Cookie line
need be sent.

For any report including system logs they must be attached in a
plain-text, human readable format as a MIME text/plain attachment.

(There are ISPs that decline to accept attachments because they use
 Outlook to handle their email, so requiring MIME attachments has a
 few issues. However, ISPs can fairly trivially filter their incoming
 abuse mail to either strip or reject attachments other than of the
 type above. Of course, if the message/rfc822 attachment contains an
 email virus there's still a problem - do we care, or is current virus
 filtering up to the problem?

 But a message with corrupted formating (line wrap, character encoding)
 can be impossible to parse automatically, and difficult to process
 manually, and MIME attachements are the only widely supported way to
 avoid that).

Any time a single MIME attachement is needed the same data should be
supported inline in the message, if possible.

A single line in the body of the message for each recipient, giving
enough information to triage the report. Each line should have an
(optional) tag to define which recipient the information is intended
for, a keyword chosen from a short set of keywords (TBD) to define
different complaint types, e.g SPAM - generic unwanted email
complaint, and an associated (optional) IP address, email address,
hostname or URL.

Following those lines, some human readable text with additional
information if needed. Providing additional (phone) contact
information here is strongly encouraged, especially for security
issues. I'd actually encourage ISPs to prioritise and place more
weight on reports with additional contact information if that
were easy to do.

So, to give an example or three:

For spam received from [email protected]:

    To: [email protected]

    topica SPAM [email protected]

    I didn't ask for this email, blah, blah, blah

    [MIME message/rfc822]

or

    To: [email protected]

    SPAM [email protected]

    [MIME message/rfc822]

or
    To: [email protected]

    SPAM

    [MIME message/rfc822]

or

    To: [email protected]

    SPAM

    Abuse-Cookie: [email protected] MSG-12345-1234567-12345

For a set of proxy attempts from 10.11.12.13, an example.com address:

    To: [email protected]

    PROXY 10.11.12.13

    [MIME text/plain]



For spam coming from a compromised roadrunner customer, 10.3.2.1,
advertising a website hosted on webstuff.net, bounced through a Yahoo
redirector:


    To: [email protected], [email protected], [email protected]

    roadrunner SPAM 10.3.2.1

    yahoo WEB http://rd.yahoo.com?http://spammerdomain.com/foo

    webstuff WEB http://spammerdomain.com/foo


    Blah, blah, spam, blah, blah.

    [MIME message/rfc822]

or

    To: [email protected], [email protected], [email protected]

    roadrunner.com SPAM 10.3.2.1

    yahoo.com WEB http://rd.yahoo.com?http://spammerdomain.com/foo

    webstuff.net WEB http://spammerdomain.com/foo


    Blah, blah, spam, blah, blah.

    [MIME message/rfc822]


This syntax is easy to generate, manually or automatically, and provides
enough data to easily triage the issue, again manually or automatically.

EOF