Re: newbie questions, sum over range, rounding of special problematic values
Morten Welinder <[email protected]> Thu, 6 May 2021 19:43:05 -0400
| Newsgroups | gmane.comp.gnome.apps.gnumeric |
|---|---|
| Message-ID | <CANv4PN=6B2jqWCdgW36hVWtEayXSWQ4x_sqiVnyxy8f3qNUSmw@mail.gmail.com> |
1. We use an extension of Kahan summation, see
https://gitlab.gnome.org/GNOME/goffice/-/blob/master/goffice/math/go-accumulator.c
This is done for sum(...), not for a+b
2. We don't even attempt to be smart here. It's pointless as the
partial sums often sit in their own cells and must be displayed.
3. This is based on misunderstandings. Our calculations are based on
base 2. To understand things, read
http://www.gnumeric.org/numerical-issues.html
Morten