Re: -warmup
Ahmet Göksu <[email protected]>
| Newsgroups | gmane.comp.fonts.freetype.devel |
|---|---|
| Message-ID | <6be86ff5-4eee-4098-9c30-7a226dc443ac@Spark> |
hi, here is the results with chris’ suggestion. (thanks chris) i will check hyperfine. still a bit noise on only load and load_advances. are results acceptable? Best, Goksu goksu.in On 28 Aug 2023 21:19 +0300, Werner LEMBERG <[email protected]>, wrote: > > code
benchmark.html
(text/html, 17.1 KB)
<html>
<head>
<style>
table {
}
th, td {
padding: 3px;
text-align: center;
}
th {
background-color: #ccc;
color: black;
}
.warning{
color: red;
}
.col1 {
background-color: #eee;
}
.highlight {
background-color: #0a0;
}
</style>
</head>
<body>
<h1>Freetype Benchmark Results</h1>
<h2 class="warning">Warning: Baseline and Benchmark have the same commit ID!</h2>
<h2>Info</h2>
<table border="1">
<tr><th>Info</th><th>Baseline</th><th>Benchmark</th></tr>
<tr><td class="col1">Parameters</td><td>-c 750 -w 50</td><td>-c 750 -w 50</td></tr>
<tr><td class="col1">Commit ID</td><td><a href="https://gitlab.freedesktop.org/freetype/freetype/-/commit/f3dfede62f60c718d4aefc9c44b9025822f201d0">f3dfede6</a></td><td><a href="https://gitlab.freedesktop.org/freetype/freetype/-/commit/f3dfede62f60c718d4aefc9c44b9025822f201d0">f3dfede6</a></td></tr>
<tr><td class="col1">Commit Date</td><td>2023-08-18 17:42:53 +0300</td><td>2023-08-18 17:42:53 +0300</td></tr>
<tr><td class="col1">Branch</td><td>GSoC-2023-Ahmet</td><td>GSoC-2023-Ahmet</td></tr>
</table><br/><p>* Average time for single iteration. Smaller values are better.</p><p>** N count in (x | y) format is for showing baseline and benchmark N counts seperately when they differs.</p><h2>Total Results</h2>
<table border="1">
<tr><th>Test</th><th>N</th><th>Baseline (µs)</th> <th>Benchmark (µs)</th><th>Difference (%)</th></tr>
<tr><td class="col1">Load</td><td>375000</td> <td class="highlight">3535.9</td> <td class="">3622.3</td><td>-2.4</td></tr>
<tr><td class="col1">Load_Advances (Normal)</td><td>375000</td> <td class="highlight">3057.8</td> <td class="">3133.8</td><td>-2.5</td></tr>
<tr><td class="col1">Load_Advances (Fast)</td><td>375000</td> <td class="highlight">10.9</td> <td class="">12.5</td><td>-14.7</td></tr>
<tr><td class="col1">Load_Advances (Unscaled)</td><td>375000</td> <td class="highlight">10.0</td> <td class="">10.6</td><td>-6.0</td></tr>
<tr><td class="col1">Render</td><td>375000</td> <td class="highlight">4772.2</td> <td class="">4796.7</td><td>-0.5</td></tr>
<tr><td class="col1">Get_Glyph</td><td>375000</td> <td class="">3418.7</td> <td class="highlight">3415.2</td><td>0.1</td></tr>
<tr><td class="col1">Get_Char_Index</td><td>352500</td> <td class="highlight">9.1</td> <td class="highlight">9.1</td><td>0.0</td></tr>
<tr><td class="col1">Iterate CMap</td><td>3750</td> <td class="highlight">6.5</td> <td class="highlight">6.5</td><td>0.0</td></tr>
<tr><td class="col1">New_Face</td><td>3750</td> <td class="">241.5</td> <td class="highlight">239.9</td><td>0.7</td></tr>
<tr><td class="col1">Embolden</td><td>375000</td> <td class="">3798.9</td> <td class="highlight">3780.3</td><td>0.5</td></tr>
<tr><td class="col1">Stroke</td><td>292750 | 288000</td> <td class="highlight">18049.3</td> <td class="">18067.9</td><td>-0.1</td></tr>
<tr><td class="col1">Get_BBox</td><td>375000</td> <td class="">2826.3</td> <td class="highlight">2764.2</td><td>2.2</td></tr>
<tr><td class="col1">Get_CBox</td><td>375000</td> <td class="">3473.4</td> <td class="highlight">3421.9</td><td>1.5</td></tr>
<tr><td class="col1">New_Face & load glyph(s)</td><td>375000</td> <td class="highlight">555.6</td> <td class="">585.6</td><td>-5.4</td></tr>
<tr><td class="col1">TOTAL</td><td class="col1">4402750 | 4398000</td> <td class="col1">43766.1</td><td class="col1">43866.5</td> <td class="col1">-0.2</td></tr>
</table><br/>
<h3>Results for Roboto_subset.ttf</h2>
<table border="1">
<tr><th>Test</th><th>N</th> <th>* <a href="/Users/gks/Desktop/freetype/objs/baseline/Roboto_subset.txt">Baseline</a> (µs)</th> <th>* <a href="/Users/gks/Desktop/freetype/objs/benchmark/Roboto_subset.txt">Benchmark</a> (µs)</th> <th>Difference (%)</th></tr>
<tr><td class="col1">Load</td><td>90000</td> <td class="lowlight">583.3</td><td class="highlight">575.1</td><td>1.4</td></tr>
<tr><td class="col1">Load_Advances (Normal)</td><td>90000</td> <td class="highlight">487.7</td><td class="lowlight">503.3</td><td>-3.2</td></tr>
<tr><td class="col1">Load_Advances (Fast)</td><td>90000</td> <td class="highlight">2.6</td><td class="lowlight">4.1</td><td>-57.7</td></tr>
<tr><td class="col1">Load_Advances (Unscaled)</td><td>90000</td> <td class="highlight">2.4</td><td class="lowlight">2.4</td><td>0.0</td></tr>
<tr><td class="col1">Render</td><td>90000</td> <td class="highlight">934.1</td><td class="lowlight">941.8</td><td>-0.8</td></tr>
<tr><td class="col1">Get_Glyph</td><td>90000</td> <td class="highlight">582.7</td><td class="lowlight">597.7</td><td>-2.6</td></tr>
<tr><td class="col1">Get_Char_Index</td><td>70500</td> <td class="highlight">1.8</td><td class="lowlight">1.8</td><td>0.0</td></tr>
<tr><td class="col1">Iterate CMap</td><td>750</td> <td class="highlight">1.3</td><td class="lowlight">1.3</td><td>0.0</td></tr>
<tr><td class="col1">New_Face</td><td>750</td> <td class="lowlight">42.5</td><td class="highlight">41.4</td><td>2.6</td></tr>
<tr><td class="col1">Embolden</td><td>90000</td> <td class="highlight">642.9</td><td class="lowlight">655.9</td><td>-2.0</td></tr>
<tr><td class="col1">Stroke</td><td>60000</td> <td class="highlight">4008.7</td><td class="lowlight">4043.7</td><td>-0.9</td></tr>
<tr><td class="col1">Get_BBox</td><td>90000</td> <td class="lowlight">167.6</td><td class="highlight">139.3</td><td>16.9</td></tr>
<tr><td class="col1">Get_CBox</td><td>90000</td> <td class="highlight">592.1</td><td class="lowlight">602.3</td><td>-1.7</td></tr>
<tr><td class="col1">New_Face & load glyph(s)</td><td>90000</td> <td class="highlight">105.0</td><td class="lowlight">105.0</td><td>0.0</td></tr>
<tr><td class="col1">TOTAL</td><td class="col1">2064000</td> <td class="col1">8154.7</td><td class="col1">8215.1</td><td class="col1">0.7</td></tr>
</table><br/>
<h3>Results for Arial_subset.ttf</h2>
<table border="1">
<tr><th>Test</th><th>N</th> <th>* <a href="/Users/gks/Desktop/freetype/objs/baseline/Arial_subset.txt">Baseline</a> (µs)</th> <th>* <a href="/Users/gks/Desktop/freetype/objs/benchmark/Arial_subset.txt">Benchmark</a> (µs)</th> <th>Difference (%)</th></tr>
<tr><td class="col1">Load</td><td>71250</td> <td class="highlight">812.8</td><td class="lowlight">934.1</td><td>-14.9</td></tr>
<tr><td class="col1">Load_Advances (Normal)</td><td>71250</td> <td class="highlight">733.1</td><td class="lowlight">793.3</td><td>-8.2</td></tr>
<tr><td class="col1">Load_Advances (Fast)</td><td>71250</td> <td class="highlight">2.0</td><td class="lowlight">2.1</td><td>-5.0</td></tr>
<tr><td class="col1">Load_Advances (Unscaled)</td><td>71250</td> <td class="highlight">1.9</td><td class="lowlight">1.9</td><td>0.0</td></tr>
<tr><td class="col1">Render</td><td>71250</td> <td class="lowlight">1083.0</td><td class="highlight">1067.4</td><td>1.4</td></tr>
<tr><td class="col1">Get_Glyph</td><td>71250</td> <td class="lowlight">791.0</td><td class="highlight">789.8</td><td>0.2</td></tr>
<tr><td class="col1">Get_Char_Index</td><td>70500</td> <td class="highlight">1.8</td><td class="lowlight">1.8</td><td>0.0</td></tr>
<tr><td class="col1">Iterate CMap</td><td>750</td> <td class="highlight">1.3</td><td class="lowlight">1.3</td><td>0.0</td></tr>
<tr><td class="col1">New_Face</td><td>750</td> <td class="lowlight">51.8</td><td class="highlight">50.0</td><td>3.5</td></tr>
<tr><td class="col1">Embolden</td><td>71250</td> <td class="lowlight">874.9</td><td class="highlight">855.0</td><td>2.3</td></tr>
<tr><td class="col1">Stroke</td><td>57000</td> <td class="lowlight">3480.9</td><td class="highlight">3439.5</td><td>1.2</td></tr>
<tr><td class="col1">Get_BBox</td><td>71250</td> <td class="lowlight">761.9</td><td class="highlight">725.2</td><td>4.8</td></tr>
<tr><td class="col1">Get_CBox</td><td>71250</td> <td class="lowlight">815.3</td><td class="highlight">787.5</td><td>3.4</td></tr>
<tr><td class="col1">New_Face & load glyph(s)</td><td>71250</td> <td class="lowlight">110.7</td><td class="highlight">109.3</td><td>1.3</td></tr>
<tr><td class="col1">TOTAL</td><td class="col1">1683000</td> <td class="col1">9522.4</td><td class="col1">9558.2</td><td class="col1">0.4</td></tr>
</table><br/>
<h3>Results for TimesNewRoman_subset.ttf</h2>
<table border="1">
<tr><th>Test</th><th>N</th> <th>* <a href="/Users/gks/Desktop/freetype/objs/baseline/TimesNewRoman_subset.txt">Baseline</a> (µs)</th> <th>* <a href="/Users/gks/Desktop/freetype/objs/benchmark/TimesNewRoman_subset.txt">Benchmark</a> (µs)</th> <th>Difference (%)</th></tr>
<tr><td class="col1">Load</td><td>71250</td> <td class="lowlight">973.9</td><td class="highlight">944.3</td><td>3.0</td></tr>
<tr><td class="col1">Load_Advances (Normal)</td><td>71250</td> <td class="lowlight">876.2</td><td class="highlight">859.0</td><td>2.0</td></tr>
<tr><td class="col1">Load_Advances (Fast)</td><td>71250</td> <td class="highlight">2.1</td><td class="lowlight">2.1</td><td>0.0</td></tr>
<tr><td class="col1">Load_Advances (Unscaled)</td><td>71250</td> <td class="highlight">1.9</td><td class="lowlight">1.9</td><td>0.0</td></tr>
<tr><td class="col1">Render</td><td>71250</td> <td class="lowlight">1202.7</td><td class="highlight">1191.1</td><td>1.0</td></tr>
<tr><td class="col1">Get_Glyph</td><td>71250</td> <td class="lowlight">945.6</td><td class="highlight">922.5</td><td>2.4</td></tr>
<tr><td class="col1">Get_Char_Index</td><td>70500</td> <td class="highlight">1.8</td><td class="lowlight">1.8</td><td>0.0</td></tr>
<tr><td class="col1">Iterate CMap</td><td>750</td> <td class="highlight">1.3</td><td class="lowlight">1.3</td><td>0.0</td></tr>
<tr><td class="col1">New_Face</td><td>750</td> <td class="highlight">53.6</td><td class="lowlight">54.1</td><td>-0.9</td></tr>
<tr><td class="col1">Embolden</td><td>71250</td> <td class="lowlight">1059.5</td><td class="highlight">1037.2</td><td>2.1</td></tr>
<tr><td class="col1">Stroke</td><td>42750</td> <td class="lowlight">4599.4</td><td class="highlight">4579.5</td><td>0.4</td></tr>
<tr><td class="col1">Get_BBox</td><td>71250</td> <td class="lowlight">895.5</td><td class="highlight">887.5</td><td>0.9</td></tr>
<tr><td class="col1">Get_CBox</td><td>71250</td> <td class="lowlight">966.3</td><td class="highlight">917.1</td><td>5.1</td></tr>
<tr><td class="col1">New_Face & load glyph(s)</td><td>71250</td> <td class="highlight">135.2</td><td class="lowlight">168.5</td><td>-24.6</td></tr>
<tr><td class="col1">TOTAL</td><td class="col1">1654500</td> <td class="col1">11715.0</td><td class="col1">11567.9</td><td class="col1">-1.3</td></tr>
</table><br/>
<h3>Results for Tahoma_subset.ttf</h2>
<table border="1">
<tr><th>Test</th><th>N</th> <th>* <a href="/Users/gks/Desktop/freetype/objs/baseline/Tahoma_subset.txt">Baseline</a> (µs)</th> <th>* <a href="/Users/gks/Desktop/freetype/objs/benchmark/Tahoma_subset.txt">Benchmark</a> (µs)</th> <th>Difference (%)</th></tr>
<tr><td class="col1">Load</td><td>71250</td> <td class="lowlight">572.0</td><td class="highlight">570.3</td><td>0.3</td></tr>
<tr><td class="col1">Load_Advances (Normal)</td><td>71250</td> <td class="highlight">469.6</td><td class="lowlight">525.8</td><td>-12.0</td></tr>
<tr><td class="col1">Load_Advances (Fast)</td><td>71250</td> <td class="highlight">2.1</td><td class="lowlight">2.1</td><td>0.0</td></tr>
<tr><td class="col1">Load_Advances (Unscaled)</td><td>71250</td> <td class="highlight">1.9</td><td class="lowlight">2.5</td><td>-31.6</td></tr>
<tr><td class="col1">Render</td><td>71250</td> <td class="highlight">785.6</td><td class="lowlight">801.5</td><td>-2.0</td></tr>
<tr><td class="col1">Get_Glyph</td><td>71250</td> <td class="highlight">560.0</td><td class="lowlight">564.4</td><td>-0.8</td></tr>
<tr><td class="col1">Get_Char_Index</td><td>70500</td> <td class="highlight">1.8</td><td class="lowlight">1.8</td><td>0.0</td></tr>
<tr><td class="col1">Iterate CMap</td><td>750</td> <td class="highlight">1.3</td><td class="lowlight">1.3</td><td>0.0</td></tr>
<tr><td class="col1">New_Face</td><td>750</td> <td class="highlight">47.1</td><td class="lowlight">47.1</td><td>0.0</td></tr>
<tr><td class="col1">Embolden</td><td>71250</td> <td class="highlight">623.4</td><td class="lowlight">631.7</td><td>-1.3</td></tr>
<tr><td class="col1">Stroke</td><td>66500 | 61750</td> <td class="highlight">3024.6</td><td class="lowlight">3037.9</td><td>-0.4</td></tr>
<tr><td class="col1">Get_BBox</td><td>71250</td> <td class="highlight">509.0</td><td class="lowlight">516.8</td><td>-1.5</td></tr>
<tr><td class="col1">Get_CBox</td><td>71250</td> <td class="highlight">559.1</td><td class="lowlight">568.7</td><td>-1.7</td></tr>
<tr><td class="col1">New_Face & load glyph(s)</td><td>71250</td> <td class="lowlight">103.7</td><td class="highlight">101.9</td><td>1.7</td></tr>
<tr><td class="col1">TOTAL</td><td class="col1">1697250</td> <td class="col1">7261.2</td><td class="col1">7373.8</td><td class="col1">1.6</td></tr>
</table><br/>
<h3>Results for Verdana_subset.ttf</h2>
<table border="1">
<tr><th>Test</th><th>N</th> <th>* <a href="/Users/gks/Desktop/freetype/objs/baseline/Verdana_subset.txt">Baseline</a> (µs)</th> <th>* <a href="/Users/gks/Desktop/freetype/objs/benchmark/Verdana_subset.txt">Benchmark</a> (µs)</th> <th>Difference (%)</th></tr>
<tr><td class="col1">Load</td><td>71250</td> <td class="highlight">593.9</td><td class="lowlight">598.5</td><td>-0.8</td></tr>
<tr><td class="col1">Load_Advances (Normal)</td><td>71250</td> <td class="lowlight">491.2</td><td class="highlight">452.4</td><td>7.9</td></tr>
<tr><td class="col1">Load_Advances (Fast)</td><td>71250</td> <td class="highlight">2.1</td><td class="lowlight">2.1</td><td>0.0</td></tr>
<tr><td class="col1">Load_Advances (Unscaled)</td><td>71250</td> <td class="highlight">1.9</td><td class="lowlight">1.9</td><td>0.0</td></tr>
<tr><td class="col1">Render</td><td>71250</td> <td class="highlight">766.8</td><td class="lowlight">794.9</td><td>-3.7</td></tr>
<tr><td class="col1">Get_Glyph</td><td>71250</td> <td class="highlight">539.4</td><td class="lowlight">540.8</td><td>-0.3</td></tr>
<tr><td class="col1">Get_Char_Index</td><td>70500</td> <td class="highlight">1.9</td><td class="lowlight">1.9</td><td>0.0</td></tr>
<tr><td class="col1">Iterate CMap</td><td>750</td> <td class="highlight">1.3</td><td class="lowlight">1.3</td><td>0.0</td></tr>
<tr><td class="col1">New_Face</td><td>750</td> <td class="highlight">46.5</td><td class="lowlight">47.3</td><td>-1.7</td></tr>
<tr><td class="col1">Embolden</td><td>71250</td> <td class="highlight">598.2</td><td class="lowlight">600.5</td><td>-0.4</td></tr>
<tr><td class="col1">Stroke</td><td>66500</td> <td class="highlight">2935.7</td><td class="lowlight">2967.3</td><td>-1.1</td></tr>
<tr><td class="col1">Get_BBox</td><td>71250</td> <td class="highlight">492.3</td><td class="lowlight">495.4</td><td>-0.6</td></tr>
<tr><td class="col1">Get_CBox</td><td>71250</td> <td class="highlight">540.6</td><td class="lowlight">546.3</td><td>-1.1</td></tr>
<tr><td class="col1">New_Face & load glyph(s)</td><td>71250</td> <td class="lowlight">101.0</td><td class="highlight">100.9</td><td>0.1</td></tr>
<tr><td class="col1">TOTAL</td><td class="col1">1702000</td> <td class="col1">7112.8</td><td class="col1">7151.5</td><td class="col1">0.5</td></tr>
</table><br/>
<center>Freetype Benchmark</center>
</body>
</html>