On Saturday, August 22, 2020, Ahmed Karaman <ahmedkhaledkara...@gmail.com> wrote:
> Thanks Mr. Aleksandar, > > "Reference" and "latest" already each has its own results directory. > > I meant also source directories of these two should be separate. Name reference source directory qemu-ref or qemu-5.1, let's say. I will try re-running the tests tonight from scratch as you've suggested to > see how things will go. > > I will also add the "-------" line at the beginning as you've suggested. > > Best regards, > Ahmed > > On Sat, Aug 22, 2020, 2:21 PM Aleksandar Markovic < > aleksandar.qemu.de...@gmail.com> wrote: > >> >> >> On Saturday, August 22, 2020, Aleksandar Markovic < >> aleksandar.qemu.de...@gmail.com> wrote: >> >>> >>> >>> On Wednesday, August 19, 2020, Ahmed Karaman < >>> ahmedkhaledkara...@gmail.com> wrote: >>> >>>> Host CPU : Intel(R) Core(TM) i7-8750H CPU @ 2.20GHz >>>> Host Memory : 15.49 GB >>>> >>>> Start Time (UTC) : 2020-08-19 21:00:01 >>>> End Time (UTC) : 2020-08-19 21:32:15 >>>> Execution Time : 0:32:14.021998 >>>> >>>> Status : SUCCESS >>>> >>>> -------------------------------------------------------- >>>> >>>> >>>> I see we did not receive nightly report last night. The cause is most >>> likely the change of our build system that happened yesterday. >>> >>> I think the best approach for you is to start tonight "from scratch". >>> So, with source code tree and all past data deleted - as if you execute the >>> nighlies for the first time ever. This will cause a fresh checkout, and a >>> recreation of 5.1 and 'latest' perfirmace data. >>> >>> >> Sorry, I envision some problems with the approach I described. I think >> you should better create a separate source directory for reference 5.1 >> measurements, and another source directory for all measurements from >> tonight on. That way you will avoid switching between build systems from >> within the same directory. >> >> Thanks, >> Aleksandar >> >> >> >> >>> Unrelated hint: >>> >>> Please include the following (or similar) text right before the tables >>> with results: >>> >>> "'-----' denotes difference less than 0.01%." >>> >>> This way the readers will not be confused with '-----' meaning. >>> >>> Yours, >>> Aleksandar >>> >>> >>>> >>>> SUMMARY REPORT - COMMIT 672b2f26 >>>> -------------------------------------------------------- >>>> AVERAGE RESULTS >>>> -------------------------------------------------------- >>>> Target Instructions Latest v5.1.0 >>>> ---------- -------------------- ---------- ---------- >>>> aarch64 2 118 484 879 ----- ----- >>>> alpha 1 838 407 216 ----- ----- >>>> arm 7 887 992 884 ----- ----- >>>> hppa 4 124 996 474 ----- ----- >>>> m68k 2 453 421 671 ----- ----- >>>> mips 1 812 636 995 ----- ----- >>>> mipsel 1 947 725 352 ----- ----- >>>> mips64 1 862 495 613 ----- ----- >>>> mips64el 1 984 211 702 ----- ----- >>>> ppc 2 394 319 834 ----- ----- >>>> ppc64 2 488 040 622 ----- ----- >>>> ppc64le 2 470 198 016 ----- ----- >>>> riscv64 1 367 774 718 ----- ----- >>>> s390x 3 058 498 362 ----- ----- >>>> sh4 2 278 490 061 ----- ----- >>>> sparc64 3 186 999 246 ----- ----- >>>> x86_64 1 734 475 394 ----- ----- >>>> -------------------------------------------------------- >>>> >>>> DETAILED RESULTS >>>> -------------------------------------------------------- >>>> Test Program: dijkstra_double >>>> -------------------------------------------------------- >>>> Target Instructions Latest v5.1.0 >>>> ---------- -------------------- ---------- ---------- >>>> aarch64 3 019 613 303 ----- ----- >>>> alpha 3 078 110 233 ----- ----- >>>> arm 15 982 079 823 ----- ----- >>>> hppa 7 012 014 505 ----- ----- >>>> m68k 3 914 631 319 ----- ----- >>>> mips 2 979 137 836 ----- ----- >>>> mipsel 3 141 391 810 ----- ----- >>>> mips64 3 163 713 203 ----- ----- >>>> mips64el 3 314 105 619 ----- ----- >>>> ppc 4 692 148 212 ----- ----- >>>> ppc64 4 875 585 404 ----- ----- >>>> ppc64le 4 859 857 200 ----- ----- >>>> riscv64 2 150 267 230 ----- ----- >>>> s390x 4 455 507 359 ----- ----- >>>> sh4 3 816 841 775 ----- ----- >>>> sparc64 4 399 783 149 ----- ----- >>>> x86_64 2 441 371 746 ----- ----- >>>> -------------------------------------------------------- >>>> -------------------------------------------------------- >>>> Test Program: dijkstra_int32 >>>> -------------------------------------------------------- >>>> Target Instructions Latest v5.1.0 >>>> ---------- -------------------- ---------- ---------- >>>> aarch64 2 177 687 656 ----- ----- >>>> alpha 1 462 693 182 ----- ----- >>>> arm 8 048 440 634 ----- ----- >>>> hppa 5 053 362 217 ----- ----- >>>> m68k 1 683 346 196 ----- ----- >>>> mips 1 473 265 047 ----- ----- >>>> mipsel 1 475 326 892 ----- ----- >>>> mips64 1 683 560 350 ----- ----- >>>> mips64el 1 663 467 060 ----- ----- >>>> ppc 1 978 581 291 ----- ----- >>>> ppc64 2 160 088 877 ----- ----- >>>> ppc64le 2 151 841 575 ----- ----- >>>> riscv64 1 323 226 597 ----- ----- >>>> s390x 2 880 509 792 ----- ----- >>>> sh4 1 938 787 291 ----- ----- >>>> sparc64 2 768 217 627 ----- ----- >>>> x86_64 1 521 726 675 ----- ----- >>>> -------------------------------------------------------- >>>> -------------------------------------------------------- >>>> Test Program: matmult_double >>>> -------------------------------------------------------- >>>> Target Instructions Latest v5.1.0 >>>> ---------- -------------------- ---------- ---------- >>>> aarch64 1 408 042 295 ----- ----- >>>> alpha 3 009 129 018 ----- ----- >>>> arm 8 453 187 175 ----- ----- >>>> hppa 3 334 593 464 ----- ----- >>>> m68k 3 309 165 600 ----- ----- >>>> mips 2 252 644 394 ----- ----- >>>> mipsel 3 166 010 232 ----- ----- >>>> mips64 2 266 660 274 ----- ----- >>>> mips64el 3 179 408 969 ----- ----- >>>> ppc 3 108 563 525 ----- ----- >>>> ppc64 3 186 404 684 ----- ----- >>>> ppc64le 3 186 105 591 ----- ----- >>>> riscv64 1 218 230 013 ----- ----- >>>> s390x 2 715 954 030 ----- ----- >>>> sh4 3 330 300 193 ----- ----- >>>> sparc64 3 197 860 268 ----- ----- >>>> x86_64 1 244 922 914 ----- ----- >>>> -------------------------------------------------------- >>>> -------------------------------------------------------- >>>> Test Program: matmult_int32 >>>> -------------------------------------------------------- >>>> Target Instructions Latest v5.1.0 >>>> ---------- -------------------- ---------- ---------- >>>> aarch64 595 215 814 ----- ----- >>>> alpha 369 955 794 ----- ----- >>>> arm 735 842 738 ----- ----- >>>> hppa 666 414 556 ----- ----- >>>> m68k 406 857 412 ----- ----- >>>> mips 497 082 899 ----- ----- >>>> mipsel 497 032 468 ----- ----- >>>> mips64 478 686 174 ----- ----- >>>> mips64el 462 210 845 ----- ----- >>>> ppc 338 165 176 ----- ----- >>>> ppc64 390 046 801 ----- ----- >>>> ppc64le 390 236 162 ----- ----- >>>> riscv64 348 989 619 ----- ----- >>>> s390x 491 496 329 ----- ----- >>>> sh4 399 095 487 ----- ----- >>>> sparc64 490 124 541 ----- ----- >>>> x86_64 399 613 899 ----- ----- >>>> -------------------------------------------------------- >>>> -------------------------------------------------------- >>>> Test Program: qsort_double >>>> -------------------------------------------------------- >>>> Target Instructions Latest v5.1.0 >>>> ---------- -------------------- ---------- ---------- >>>> aarch64 2 645 742 637 ----- ----- >>>> alpha 1 899 562 379 ----- ----- >>>> arm 8 113 107 429 ----- ----- >>>> hppa 3 098 469 739 ----- ----- >>>> m68k 4 302 051 049 ----- ----- >>>> mips 2 060 965 462 ----- ----- >>>> mipsel 2 061 404 232 ----- ----- >>>> mips64 1 933 231 416 ----- ----- >>>> mips64el 1 930 636 000 ----- ----- >>>> ppc 2 673 960 745 ----- ----- >>>> ppc64 2 623 577 315 ----- ----- >>>> ppc64le 2 580 240 728 ----- ----- >>>> riscv64 1 575 021 518 ----- ----- >>>> s390x 2 437 147 903 ----- ----- >>>> sh4 2 520 101 855 ----- ----- >>>> sparc64 3 882 349 298 ----- ----- >>>> x86_64 1 969 776 338 ----- ----- >>>> -------------------------------------------------------- >>>> -------------------------------------------------------- >>>> Test Program: qsort_int32 >>>> -------------------------------------------------------- >>>> Target Instructions Latest v5.1.0 >>>> ---------- -------------------- ---------- ---------- >>>> aarch64 2 131 273 662 ----- ----- >>>> alpha 1 460 090 651 ----- ----- >>>> arm 3 372 526 755 ----- ----- >>>> hppa 2 196 131 815 ----- ----- >>>> m68k 1 779 454 745 ----- ----- >>>> mips 1 500 097 569 ----- ----- >>>> mipsel 1 502 804 063 ----- ----- >>>> mips64 1 497 347 136 ----- ----- >>>> mips64el 1 476 627 156 ----- ----- >>>> ppc 1 667 589 417 ----- ----- >>>> ppc64 1 779 203 387 ----- ----- >>>> ppc64le 1 728 565 582 ----- ----- >>>> riscv64 1 288 897 227 ----- ----- >>>> s390x 2 113 929 796 ----- ----- >>>> sh4 1 878 433 512 ----- ----- >>>> sparc64 3 353 723 284 ----- ----- >>>> x86_64 1 751 619 062 ----- ----- >>>> -------------------------------------------------------- >>>> -------------------------------------------------------- >>>> Test Program: qsort_string >>>> -------------------------------------------------------- >>>> Target Instructions Latest v5.1.0 >>>> ---------- -------------------- ---------- ---------- >>>> aarch64 2 529 811 267 ----- ----- >>>> alpha 1 793 314 577 ----- ----- >>>> arm 7 155 792 109 ----- ----- >>>> hppa 4 595 956 496 ----- ----- >>>> m68k 2 294 974 463 ----- ----- >>>> mips 2 113 124 208 ----- ----- >>>> mipsel 2 110 049 468 ----- ----- >>>> mips64 1 967 925 447 ----- ----- >>>> mips64el 1 950 320 901 ----- ----- >>>> ppc 2 428 056 923 ----- ----- >>>> ppc64 2 404 890 978 ----- ----- >>>> ppc64le 2 385 487 957 ----- ----- >>>> riscv64 1 563 271 793 ----- ----- >>>> s390x 3 934 075 315 ----- ----- >>>> sh4 2 097 732 542 ----- ----- >>>> sparc64 4 131 589 952 ----- ----- >>>> x86_64 2 864 598 485 ----- ----- >>>> -------------------------------------------------------- >>>> -------------------------------------------------------- >>>> Test Program: search_string >>>> -------------------------------------------------------- >>>> Target Instructions Latest v5.1.0 >>>> ---------- -------------------- ---------- ---------- >>>> aarch64 2 440 492 400 ----- ----- >>>> alpha 1 634 401 901 ----- ----- >>>> arm 11 242 966 409 ----- ----- >>>> hppa 7 043 029 003 ----- ----- >>>> m68k 1 936 892 588 ----- ----- >>>> mips 1 624 778 552 ----- ----- >>>> mipsel 1 627 783 657 ----- ----- >>>> mips64 1 908 840 910 ----- ----- >>>> mips64el 1 896 917 069 ----- ----- >>>> ppc 2 267 493 386 ----- ----- >>>> ppc64 2 484 527 533 ----- ----- >>>> ppc64le 2 479 249 335 ----- ----- >>>> riscv64 1 474 293 752 ----- ----- >>>> s390x 5 439 366 376 ----- ----- >>>> sh4 2 246 627 833 ----- ----- >>>> sparc64 3 272 345 849 ----- ----- >>>> x86_64 1 682 174 033 ----- ----- >>>> -------------------------------------------------------- >>>> >>>> >>>> >>>>
