Re: Re: Re: Re: deco-Math project, step 00_a: exact bin and dec 'ranges' (in gnumeric).
Steven D'Aprano <[email protected]> Thu, 8 Jul 2021 08:22:53 +1000
| Newsgroups | gmane.comp.gnome.apps.gnumeric |
|---|---|
| Message-ID | <[email protected]> |
On Wed, Jul 07, 2021 at 06:16:46PM -0400, Morten Welinder wrote: > Gnumeric's rounding here is indeed done with > > round_to_int(x * 10^d) / 10^d > > except that round_to_int deliberately misrounds 0.5-1ulp to 1. That's > not important here. Thank you Morten for introducing some reality into this discussion. It's good to have confirmation that this is what Gnumeric is doing. -- Steve