Aw: Re: Re: deco-Math project, step 00_a: exact bin and dec 'ranges' (in gnumeric).

hello @all, hello @Steve,

> I don't understand what you mean by "crossover",

=rounddown(0,24999999999999997;16) -> 0,250000000000000000000, and

=roundup(0,24999999999999997;16) -> 0,249999999999999972244, the operation named 'down' going 'up', you commented about that about 2 weeks ago,

> but more importantly, I

> don't understand your comment about 0.3. Gnumeric already rounds down:

> 0,30000000000000004

> to 0.3 (displayed to 16 decimal places). Of course the true value is: ...

if it does like that it only adapt's the display, but doesn't change the value, and rounding the 17-sign-digit value 0,30000000000000004 to 16 decimals with tools accessible for a user results in: '=round(0,30000000000000004; 16)' -> 0,300000000000000100.

all not helping for 'correct math'.

best regards,

b.

Gesendet: Montag, 05. Juli 2021 um 11:45 Uhr

Von: "Steven D'Aprano" <[email protected]>

An: [email protected]

Betreff: Re: Re: deco-Math project, step 00_a: exact bin and dec 'ranges' (in gnumeric).

Hi B,

I don't understand your comments here. For example, you say:

> i'm quite sure that 'crossover' between roundup and rounddown can be

> avoided and that 0,30000000000000004 can be rounded to 16-digit 0,3

> with IEEE 754 rounding mode 'ties to even'.

I don't understand what you mean by "crossover", but more importantly, I

don't understand your comment about 0.3. Gnumeric already rounds down:

0,30000000000000004

to 0.3 (displayed to 16 decimal places). Of course the true value is:

0.29999999999999998889776975374843459576368331909179687500000000000

but that will be displayed as 0.3. So I'm not sure why you seem to think

that Gnumeric is not already doing that.

--

Steve

_______________________________________________

gnumeric-list mailing list

[email protected]

https://mail.gnome.org/mailman/listinfo/gnumeric-list

_______________________________________________
gnumeric-list mailing list
[email protected]
https://mail.gnome.org/mailman/listinfo/gnumeric-list