Re: Per-page statistics

On Thu, 2003-12-25 at 22:59, Ray Saintonge wrote:

> >So sometimes the word count for the same article after an edit in the
> >wiki might differ but not the substance.
> >
> One should deal with the question in the spirit in which it was asked.

:) 
I can understand my point that Tamil text word count being highly
dependent on the author's writing style being somewhat drawn out.
Apologies. 


> We can, however, measure the relative sizes of two text files. 

If I understood this correctly UTF-8 would proove to be a challenge and
would have to be accounted for.

http://www.unicode.org/faq/unicode_web.html#14

I understand that some have arrived at a figure of 2.5:1 for UTF-8
encoded file size as opposed to the 8-bit Latin-1 like encodings Tamil
has. More tests on Wikipedia content and arriving at a  more appropriate
ratio  should not be too much work to help this route in the case of
Tamil.

Regards,

Ramanan