On Mon, Jun 08, 2009 at 01:35:34PM -0400, Diego Novillo wrote:
> On Sun, Jun 7, 2009 at 16:04, Alexandre Oliva<[email protected]> wrote:
>
> > So the question is, what should I measure? Memory use for any specific
> > set of testcases, summarized over a bootstrap with memory use tracking
> > enabled, something else? Likewise for compile time? What else?
>
> Some quick measurements I'd be interested in:
>
> - Size of the IL over some standard code bodies
> (http://gcc.gnu.org/wiki/PerformanceTesting).
> - Memory consumption in cc1/cc1plus at -Ox -g over that set of apps.
Here are data comparing tr...@148582 (last merge point to VTA branch) with
v...@149180 (current VTA branch head), using maxmem2.sh and maxmem-pipe2.py.
Both compilers were built with --enable-checking=release, all numbers are
on x86_64-linux from cc1 resp. cc1plus (*.i resp. *.ii) with -g -quiet and
the options listed in the header line.
The only major compile time memory consumption problem is in VARIOUS/,
particularly pr28071.i where var-tracking goes through roof, I hope Alex
will look into it, worst case we could just silently turn off
flag_var_tracking_assignments in var-tracking.c for functions which have
too many basic blocks and too many VALUEs to track.
I'm now running compilations with -ftime-report, once that finishes will
post statistics for compile time as well, then size of IL.
-O0-m64 -O0-m32 -O1-m64 -O1-m32 -O2-m64 -O2-m32 -O3-m64
-O3-m32 -Os-m64 -Os-m32
GCC tr...@148582 avg 103772 102936 105455 104689 106334 105539 108212
107044 105339 104666
GCC v...@149180 avg 103773 102937 106076 105426 106963 106324 108964
107892 105864 105203
v...@149180/tr...@148582 100.00% 100.00% 100.59% 100.70% 100.59% 100.74%
100.69% 100.79% 100.50% 100.51%
GCC tr...@148582 max 528254 460362 587570 542154 598130 533138 625174
544654 591410 555526
GCC v...@149180 max 528254 460362 579338 540282 598014 547914 627214
561434 578970 553646
v...@149180/tr...@148582 100.00% 100.00% 98.60% 99.65% 99.98% 102.77%
100.33% 103.08% 97.90% 99.66%
FF3D tr...@148582 avg 160478 160379 169280 170735 174005 175407 179056
179874 164380 165596
FF3D v...@149180 avg 160463 160384 171352 173741 176746 178873 182519
183965 165770 167263
v...@149180/tr...@148582 99.99% 100.00% 101.22% 101.76% 101.58% 101.98%
101.93% 102.27% 100.85% 101.01%
FF3D tr...@148582 max 494298 493310 497114 492538 509234 508778 529734
540582 476798 493110
FF3D v...@149180 max 494298 493338 515690 517554 531498 530806 542822
552638 514798 534822
v...@149180/tr...@148582 100.00% 100.01% 103.74% 105.08% 104.37% 104.33%
102.47% 102.23% 107.97% 108.46%
MICO tr...@148582 avg 270379 240593 276524 248775 278922 251851 282331
254687 273297 246126
MICO v...@149180 avg 270328 240570 278185 251241 280705 254305 284368
257374 274451 247978
v...@149180/tr...@148582 99.98% 99.99% 100.60% 100.99% 100.64% 100.97%
100.72% 101.06% 100.42% 100.75%
MICO tr...@148582 max 497802 494486 537502 522602 528098 519598 557086
544478 528158 527110
MICO v...@149180 max 497838 494506 538998 524282 533038 522418 566886
550298 545302 553194
v...@149180/tr...@148582 100.01% 100.00% 100.28% 100.32% 100.94% 100.54%
101.76% 101.07% 103.25% 104.95%
SPEC2K tr...@148582 avg 101353 101091 102610 102519 103434 103358 105819
105165 102910 102884
SPEC2K v...@149180 avg 101349 101092 103087 103067 103936 103914
106482 105914 103360 103395
v...@149180/tr...@148582 100.00% 100.00% 100.46% 100.53% 100.49% 100.54%
100.63% 100.71% 100.44% 100.50%
SPEC2K tr...@148582 max 172526 172678 188594 188810 192194 193514 204014
202330 186690 189914
SPEC2K v...@149180 max 172526 172674 189394 192394 195182 197266
205002 206714 187870 192654
v...@149180/tr...@148582 100.00% 100.00% 100.42% 101.90% 101.55% 101.94%
100.48% 102.17% 100.63% 101.44%
tramp3dtr...@148582 avg 686766 685898 893478 889398 919662 942746 996782
995498 891466 893930
tramp3d...@149180 avg 687558 686494 1030534 1024634 1023046 1020642 1045182
1053774 891838 897942
v...@149180/tr...@148582 100.12% 100.09% 115.34% 115.21% 111.24% 108.26%
104.86% 105.85% 100.04% 100.45%
tramp3dtr...@148582 max 686766 685898 893478 889398 919662 942746 996782
995498 891466 893930
tramp3d...@149180 max 687558 686494 1030534 1024634 1023046 1020642 1045182
1053774 891838 897942
v...@149180/tr...@148582 100.12% 100.09% 115.34% 115.21% 111.24% 108.26%
104.86% 105.85% 100.04% 100.45%
DLV tr...@148582 avg 239153 237855 260962 261421 263187 263827 270711
268845 247990 248256
DLV v...@149180 avg 239135 237804 264511 265722 267777 269264 275713
275005 250084 250658
v...@149180/tr...@148582 99.99% 99.98% 101.36% 101.65% 101.74% 102.06%
101.85% 102.29% 100.84% 100.97%
DLV tr...@148582 max 375554 376498 383990 383798 385438 388962 401438
397650 381074 382142
DLV v...@149180 max 375558 376462 386966 392262 408638 412070 421038
427414 382886 383446
v...@149180/tr...@148582 100.00% 99.99% 100.78% 102.21% 106.02% 105.94%
104.88% 107.48% 100.48% 100.34%
varioustr...@148582 avg 415948 416633 518190 544250 684925 709474 703472
725017 565568 708509
various...@149180 avg 415933 416624 615444 646627 3143720 3642774 3133712
3607254 1646542 3351722
v...@149180/tr...@148582 100.00% 100.00% 118.77% 118.81% 458.99% 513.45%
445.46% 497.54% 291.13% 473.07%
varioustr...@148582 max 544654 547038 686858 705486 1388662 1511014 1413242
1511062 835282 1514758
various...@149180 max 544714 547190 953818 953810 13096222
15577234 13095842 15550054 5811502 14301914
v...@149180/tr...@148582 100.01% 100.03% 138.87% 135.20% 943.08%
1030.91% 926.65% 1029.08% 695.75% 944.17%
Jakub
