Re: Re: deco-Math project, step 00_a: exact bin and dec 'ranges' (in gnumeric).

Steven D'Aprano <[email protected]> Mon, 5 Jul 2021 19:45:09 +1000
Newsgroups gmane.comp.gnome.apps.gnumeric
Message-ID <[email protected]>
Hi B,

I don't understand your comments here. For example, you say:

> i'm quite sure that 'crossover' between roundup and rounddown can be 
> avoided and that 0,30000000000000004 can be rounded to 16-digit 0,3 
> with IEEE 754 rounding mode 'ties to even'.

I don't understand what you mean by "crossover", but more importantly, I 
don't understand your comment about 0.3. Gnumeric already rounds down:

    0,30000000000000004

to 0.3 (displayed to 16 decimal places). Of course the true value is:

    0.29999999999999998889776975374843459576368331909179687500000000000

but that will be displayed as 0.3. So I'm not sure why you seem to think 
that Gnumeric is not already doing that.


-- 
Steve