III_requantize() accuracy
"Grigory A." <[email protected]>
| Newsgroups | gmane.comp.audio.mad.devel |
|---|---|
| Message-ID | <[email protected]> |
Hi! I am again about accuracy. input parameters exp=0xffffff6d=-147 -> -(36.75) right? value d2=210 >> 210^(4/3)*2^(-36.75)*2^28 ans = 2.89921171527700 my answer 3 MAD 0.15 - #define FPM_INTEL answer 2 What is the problem? Thanks for answer. -- Best regards, Grigory mailto:[email protected]