CVS commit: src/lib/libc/citrus/modules

Module Name:	src
Committed By:	kre
Date:		Sun Jun 28 22:26:51 UTC 2026

Modified Files:
	src/lib/libc/citrus/modules: citrus_utf8.c

Log Message:
Be truly pedantic about UTF-8 encodings

If we're not going to be accepting "legacy" UTF-8
(5 and 6 byte encodings for code points >= 0x00200000 which the
standards don't allow, as they won't fit in UTF-16) then we
certainly should never be able to generate them, and even more
should certainly be pedantic about not allowing the various
forms of mis-coded strings for which there is no justification
but have been known to be used to attempt to violate security.

This, I believe, now enforces all the current restrictions, eg,
it will no longer be possible to encode ascii in 2 bytes (0xc0 '.')
and similar, the shortest legal encoding is all that will be
accepted (and all that will be generated, but that was always true).

It is quite possible that this will break things, probably many
tests, as now random garbage won't be accepted as valid, things
must be properly encodedd.


To generate a diff of this commit:
cvs rdiff -u -r1.19 -r1.20 src/lib/libc/citrus/modules/citrus_utf8.c

Please note that diffs are not public domain; they are subject to the
copyright notices on the relevant files.