Re: problem about precision in transform and quantization
hell yu <[email protected]> Wed, 23 Apr 2003 10:15:39 +0800 (CST)
| Newsgroups | gmane.comp.video.h264.devel |
|---|---|
| Message-ID | <[email protected]> |
Thank u :-) Can you explain how "10" is got ? Aitor Garay <[email protected]> wrote: VCEG-025 is superseded by JVT-B038. Even the final standard is not strictly in sync with JVT-B038. /AITOR----- Original Message ----- From: hell yu To: [email protected] Sent: Friday, April 18, 2003 11:30 AMSubject: [Hdot264-devel] problem about precision in transform and quantization In document VCEG-O25, Tabele 2 is given as following:----------------------------------------------------------------------------Luma and chroma transform adn quantization--------------------------------------------------------------------------- | Input bits | Output bits-----------------------------|----------------------|----------------------Forword transform | 9, 11, 13 | 15, 16, 16Quantization | 15, 16, 16 | 10, 12, 14Dequantization | 10, 12, 14 | 15, 17, 19Inverse transform | 15, 17, 19 | 9, 11, 13----------------------------------------------------------------------------In quantization, input data is 15-bits wide. Becasue the max quantMat 13107 is 14-bits wide, the output data should be 12 bits wide after a 17 right shifting. But the it is "10" in the table. Is my understanding wrong?Thanks for your help. --------------------------------- Do You Yahoo!? "禄垄没茫虏毛CCTV-2露禄掳陆驴碌梅虏茅拢潞露炉隆垄陋篓隆垄茅篓拢卢陋碌掳庐茫虏禄 --------------------------------- Do You Yahoo!? "芒路录麓卤矛铆录镁隆掳禄垄篓隆卤赂露炉赂矛梅娄拢卢赂棵茫碌禄垄碌莽潞碌陆掳~