Re: -warmup

Mon, 07 Aug 2023 05:07:56 -0700 

Hi!
I changed code to warmup with number of iterations.
> What exactly means 'Baseline (ms)'? Is the shown number the time
>  for one loop? For all loops together? Please clarify and mention
>  this on the HTML page.
Clarified that the times are milliseconds for the cumulative time for all 
iterations.
> There seems to be a fundamental math problem in calculating the
>  percentage numbers. For example, looking at the 'TOTAL' field, the
>  percental difference between 2.788 and 2.740 is not -6.1% but -1.7%!
it was average of the all percentages but you are right. I have changed it 
percentage of total time changes.
> Looking at the 'Load_Advances (Unscaled)' row, I think that 100%
>  difference between 0.001 and 0.002 doesn't make any sense. How do
>  you compute the percentage? Is this based on the cumulative time of
>  all loops? If so, and you really get such small numbers, there must
>  be some fine-tuning for high-speed tests (for example, increasing N
>  for this particular test by a factor of 10, say) to get meaningful
>  timing values.
it was cumulative time in milliseconds but converted it microseconds as how it 
was and it seem got better. If any fine-tuning needed since now, i will.

Looking for reply.


Best,
Goksu
goksu.in
On 3 Aug 2023 19:50 +0300, Werner LEMBERG <w...@gnu.org>, wrote:
>
> > It is warming up as the given number of seconds with -w flag before
> > every benchmark test.
> >
> > There are still differences like 100%.. Also, 1 sec warmup means
> > (test count)*(font count) 70 secs for the results.
>
> Mhmm, I'm not sure whether a warmup *time span* makes sense. I would
> rather have thought that every test would get a certain number of
> warmup *loops*. For example, '--warmup 100' means that for a value of
> N=50000, the first 100 loops of each test are not taken into account
> for timing so that effects of the various processor and memory caches,
> the operating system's memory page swapping, etc., etc., doesn't have
> too much influence. This should be just a very small fraction of
> time, not 70s.
>
> > I am thinking of what else can be done and waiting for your test.
>
> Just looking at your most recent HTML page I see some peculiarities.
>
> * What exactly means 'Baseline (ms)'? Is the shown number the time
> for one loop? For all loops together? Please clarify and mention
> this on the HTML page.
>
> * There seems to be a fundamental math problem in calculating the
> percentage numbers. For example, looking at the 'TOTAL' field, the
> percental difference between 2.788 and 2.740 is not -6.1% but -1.7%!
> What am I missing?
>
> * Looking at the 'Load_Advances (Unscaled)' row, I think that 100%
> difference between 0.001 and 0.002 doesn't make any sense. How do
> you compute the percentage? Is this based on the cumulative time of
> all loops? If so, and you really get such small numbers, there must
> be some fine-tuning for high-speed tests (for example, increasing N
> for this particular test by a factor of 10, say) to get meaningful
> timing values.
>
>
> Werner

Freetype Benchmark Results

Warning: Baseline and Benchmark have the same commit ID!

Info

InfoBaselineBenchmark
Parameters-c 1000 -w 100-c 1000 -w 100
Commit IDd7371720d7371720
Commit Date2023-08-03 19:08:57 +03002023-08-03 19:08:57 +0300
BranchGSoC-2023-AhmetGSoC-2023-Ahmet

* Cumulative time for iterations which is better in smaller values

Results for Roboto_subset.ttf

TestN * Baseline (µs) * Benchmark (µs) Difference (%)
Load120000 544769548050-0.6
Load_Advances (Normal)120000 472392483467-2.3
Load_Advances (Fast)120000 281828040.5
Load_Advances (Unscaled)120000 27742875-3.6
Render120000 407268425227-4.4
Get_Glyph120000 160786166644-3.6
Get_Char_Index94000 2728231815.0
Iterate CMap1000 177117183.0
New_Face1000 39404390151.0
Embolden120000 2140852099871.9
Stroke68160 | 65880 162217116184290.2
Get_BBox120000 101134101693-0.6
Get_CBox120000 81055792772.2
New_Face & load glyph(s)120000 97837100719-2.9
TOTAL2726040 375099237822230.8

Results for Arial_subset.ttf

TestN * Baseline (µs) * Benchmark (µs) Difference (%)
Load95000 696891751976-7.9
Load_Advances (Normal)95000 614680740438-20.5
Load_Advances (Fast)95000 22922519-9.9
Load_Advances (Unscaled)95000 21682516-16.1
Render95000 3335063251032.5
Get_Glyph95000 1425961378083.4
Get_Char_Index94000 22893078-34.5
Iterate CMap1000 187517516.6
New_Face1000 49544469655.2
Embolden95000 1926031872432.8
Stroke61750 | 60610 148004814717040.6
Get_BBox95000 92079886743.7
Get_CBox95000 6636966422-0.1
New_Face & load glyph(s)95000 1066691005155.8
TOTAL2214360 378360939267123.8

Results for TimesNewRoman_subset.ttf

TestN * Baseline (µs) * Benchmark (µs) Difference (%)
Load95000 849280869354-2.4
Load_Advances (Normal)95000 7827967599692.9
Load_Advances (Fast)95000 232623150.5
Load_Advances (Unscaled)95000 21472181-1.6
Render95000 355258372212-4.8
Get_Glyph95000 142597145345-1.9
Get_Char_Index94000 251522988.6
Iterate CMap1000 175717241.9
New_Face1000 49602491081.0
Embolden95000 2566862550870.6
Stroke49305 | 48640 154419415404420.2
Get_BBox95000 105618108203-2.4
Get_CBox95000 6745370368-4.3
New_Face & load glyph(s)95000 1261341243251.4
TOTAL2189945 428836343029310.3

Results for Tahoma_subset.ttf

TestN * Baseline (µs) * Benchmark (µs) Difference (%)
Load95000 525068575170-9.5
Load_Advances (Normal)95000 447570455850-1.8
Load_Advances (Fast)95000 232322682.4
Load_Advances (Unscaled)95000 223921693.1
Render95000 311839312159-0.1
Get_Glyph95000 135936137695-1.3
Get_Char_Index94000 22652347-3.6
Iterate CMap1000 17211736-0.9
New_Face1000 4426645632-3.1
Embolden95000 2022351964702.9
Stroke69160 | 67450 156680915556490.7
Get_BBox95000 85721853370.4
Get_CBox95000 63373627611.0
New_Face & load glyph(s)95000 96532945962.0
TOTAL2228610 348789735298391.2

Results for Verdana_subset.ttf

TestN * Baseline (µs) * Benchmark (µs) Difference (%)
Load95000 511496544501-6.5
Load_Advances (Normal)95000 417777433294-3.7
Load_Advances (Fast)95000 235222444.6
Load_Advances (Unscaled)95000 21482194-2.1
Render95000 3163003128501.1
Get_Glyph95000 1427821358124.9
Get_Char_Index94000 22742411-6.0
Iterate CMap1000 17241743-1.1
New_Face1000 4275843630-2.0
Embolden95000 1913451863612.6
Stroke69160 | 70585 15670841568601-0.1
Get_BBox95000 86768835903.7
Get_CBox95000 6395164501-0.9
New_Face & load glyph(s)95000 95327925632.9
TOTAL2231745 344408634742950.9

Freetype Benchmark

Reply via email to