Re: UTF-8 support / Perl regex \p{} unicode character property in 4.0.x

John Hardin <[email protected]> Thu, 26 Mar 2026 17:53:13 -0700 (PDT)
Newsgroups gmane.mail.spam.spamassassin.general
Message-ID <[email protected]>
On Thu, 26 Mar 2026, Jona Müller wrote:

>> Take a look at the ruleset 25_replace.cf
>>
>>   https://github.com/apache/spamassassin/blob/trunk/rules/25_replace.cf
>
> Thanks.
>
>> Are you looking for _specific_ emojis? Or just any?
>>
>> I will take a look at adding an <EMOJI> tag that covers everything, then you
>> could write a simple subject header rules looking for any emoji, or a
>> sequence of them.
>
> Right now any emoji would be very nice.

Okay, committed. It will _probably_ become available sometime tomorrow if 
masscheck has sufficient corpora - it's been a bit thin lately, which 
delays rule update publication.

> We mostly process corporate mail, high volume plain text mailing
> lists and a few non-profit organizations, emojis are not unheard of but usually
> suspicious. For example 100% of mail with emojis in friendly from is spam.
> In the subject it's more like 70% spam. People have their name and maybe their
> company or department in friendly from, usually nothing else.

Those two should be easy to catch now. In fact, let me add unscored 
subrules for those. They will be available for use in metas even if they 
aren't directly scoring.

>> Targeting *specific* emojis becomes more difficult and may not be worth the
>> effort, though I do notice certain ones (like the eggplant) appear in
>> certain types of spam and are unlikely in ham...
>
> For those very specific ones we have some rules and can add more later, those
> are way less relevant at the moment.

:thumbsup   :)


-- 
  John Hardin KA7OHZ                    http://www.impsec.org/~jhardin/
  [email protected]                         pgpk -a [email protected]
  key: 0xB8732E79 -- 2D8C 34F4 6411 F507 136C  AF76 D822 E6E6 B873 2E79
-----------------------------------------------------------------------
   Maxim XXIX: The enemy of my enemy is my enemy's enemy.
               No more. No less.
-----------------------------------------------------------------------
  528 days since SpaceX caught the SuperHeavy booster on the first try