====================================================================================================
SYSBENCH BENCHMARK REPORT compared to staging historical data
====================================================================================================
MACHINE: drizzle-build-n02.wc1.dfw1.stabletransit.com
RUN ID: 1258
RUN DATE: 2012-03-03T19:28:35.356232
WORKLOAD: innodb_1000K_readwrite
SERVER: drizzled
VERSION: lp:~dshrews/drizzle/bug941176
REVISION: 2517
COMMENT: 2517: David Shrewsbury 2012-03-03 [merge] Merge trunk
====================================================================================================
TRENDING OVER LAST 5 runs compared to staging historical data
Conc TPS % Diff from Avg Diff Min Max Avg
STD
====================================================================================================
16 1222.79 -0.85% -10.45 1197.66 1255.44 1233.23
17.02
32 1422.90 -5.06% -75.80 1412.42 1561.14 1498.69
41.95
64 1584.37 -2.24% -36.35 1574.91 1665.31 1620.73
34.18
128 1634.74 -1.74% -28.99 1646.49 1686.99 1663.73
12.09
256 1558.73 -3.87% -62.76 1609.83 1635.83 1621.50
9.72
512 1374.93 +0.52% 7.09 1350.01 1390.78 1367.84
13.26
1024 765.44 +1.65% 12.41 741.37 770.45 753.03
10.27
====================================================================================================
TRENDING OVER Last 20 runs compared to staging historical data
Conc TPS % Diff from Avg Diff Min Max Avg
STD
====================================================================================================
16 1222.79 -4.39% -56.17 1197.66 1329.01 1278.96
34.33
32 1422.90 -5.43% -81.66 1399.72 1618.30 1504.56
54.75
64 1584.37 -1.66% -26.78 1471.04 1689.36 1611.15
49.58
128 1634.74 -3.04% -51.27 1640.77 1731.34 1686.02
25.80
256 1558.73 -5.91% -97.93 1609.83 1719.14 1656.66
26.56
512 1374.93 -5.01% -72.52 1350.01 1488.51 1447.45
43.07
1024 765.44 -14.12% -125.86 741.37 965.44 891.30
73.19
====================================================================================================
TRENDING OVER ALL runs compared to staging historical data
Conc TPS % Diff from Avg Diff Min Max Avg
STD
====================================================================================================
16 1222.79 -6.27% -81.77 345.67 1503.03 1304.55
71.00
32 1422.90 -10.15% -160.76 616.39 1870.18 1583.65
115.59
64 1584.37 -7.41% -126.71 683.67 2059.46 1711.09
134.29
128 1634.74 -7.40% -130.69 1289.29 2051.37 1765.43
105.83
256 1558.73 -8.33% -141.57 1223.81 1824.49 1700.30
60.74
512 1374.93 -1.47% -20.46 661.33 1554.29 1395.39
160.83
1024 765.44 -25.37% -260.25 513.17 1143.07 1025.69
76.46
====================================================================================================
FULL REVISION COMMENTARY:
2515.4.1: Continuous Integr... 2012-03-02 [merge] Merge staging tree to trunk.
2515.3.1: Continuous Integr... 2012-03-02 [merge] Merge build tree to
staging tree.
2515.2.1: Continuous Integr... 2012-03-01 [merge] Merge test tree with
build tree.
2515.1.4: Brian Aker 2012-03-01 Final fix for docs.
2515.1.3: Brian Aker 2012-03-01 Doc fix
2515.1.2: Brian Aker 2012-03-01 Fix for documentation breakage for
strict rst check.
2515.1.1: Brian Aker 2012-03-01 [merge] Merge of patrick
2483.1.12: Patrick Crews 2012-02-20 [merge] Merge trunk
2483.1.11: Patrick Crews 2012-02-20 Updated tests/include.am to
account for removal of file-based trx log randgen suite
2483.1.10: Patrick Crews 2012-02-20 Fixed various options / settings
to get drizzle tests running as we would like. Removed trx_log randgen suite
as discussions have indicated removal of that plugin to be happening soon
2483.1.9: Patrick Crews 2012-02-10 Updates to tests/include.am to
remove unused makedist target
2483.1.8: Patrick Crews 2012-02-09 [merge] Merge trunk
2483.1.7: Patrick Crews 2012-02-09 Updated make targets a bit to
emulate current ones
2483.1.6: Patrick Crews 2012-02-08 Updates to kewpie + test cases
2483.1.5: Patrick Crews 2012-02-08 Stripped down much, much, much
bulk from the kewpie tree
2483.1.4: Patrick Crews 2012-02-01 Added kewpie doc
2483.1.3: Patrick Crews 2012-01-30 Updated docs
2483.1.2: Patrick Crews 2012-01-30 Removed mysql/percona upgrade
datadirs
2483.1.1: Patrick Crews 2012-01-05 [merge] Redo of kewpie merge.
Leaving dbqp in tree as a transition
0.125.83: Patrick Crews 2011-12-30 Added test data file + update /
fix of test case (couldn't run w/ --repeat=2)
0.125.82: Patrick Crews 2011-12-29 Porting of xtrabackup test suite
to kewpie format
0.125.81: patrick crews 2011-12-28 [merge] Fix of adding tar4ibd to
PATH. Needed the dirname, not the binary : (
0.135.1: patrick crews 2011-12-28 Updates to system to add
tar4ibd binary to PATH if one is provided. This is to facilitate xtrabackup
testing
0.125.80: patrick crews 2011-12-22 [merge] Merge fix of lp:907957
0.134.1: patrick crews 2011-12-22 Fix for lp:907957. The test
runner could generate a socket file path that exceeded MySQL's limit of 107
characters. Now, for such cases, we copy the MTR trick of creating a path in
/tmp. Our path is currently uuid_botN.sM.sock, where N = the executor id, and
M = the server number
0.125.79: Patrick Crews 2011-12-21 [merge] Merge trunk
0.133.4: Patrick Crews 2011-12-20 Merge from randgen trunk
0.133.3: Patrick Crews 2011-12-19 Consolidated two test modules
into one
0.133.2: Patrick Crews 2011-12-16 Added 5.1 and percona 5.1 test
beds. Might remove later, but trying things out for now
0.133.1: Patrick Crews 2011-12-16 Added upgrade test cases that
use datadirs generated by other server versions. We try to use a previous
version and a current version's datadir. Also includes code to allow for
running mysql-5.0 servers.
0.125.78: Patrick Crews 2011-12-21 Tweak replace test cases and
updated existing tests to fix minor errors
0.125.77: patrick crews 2011-12-14 [merge] Merge randgen cluster
test changes
0.132.1: Patrick Crews 2011-12-14 Tweaks to randgen cluster tests
and addition of suite_config file
0.125.76: patrick crews 2011-12-14 Fix of commit file import : (
0.125.75: patrick crews 2011-12-14 Refactored existing cluster
tests to use suite-wide config and added new test cases
0.125.74: Patrick Crews 2011-12-13 Updated crashme tests to use
batch mode. This is a bit of a whiff as the crashme test will just die on
errors (rather than trying to continue). However, this solves the problem of
endless timeouts on failures without a lot of time. Attempts at interacting
with the crashme subproc's stdin /stdout were proving unreliable and problematic
0.125.73: Patrick Crews 2011-12-12 Tweaks to innodbCrash2 test case
0.125.72: Patrick Crews 2011-12-12 Updates / polish for the innodb
crash suite
0.125.71: patrick crews 2011-12-12 Tweaked crash tests to use a
suite-wide config file. This allows for easier tweaks to all tests within a
suite. Created base crash test case to clean up individual test case modules /
store common code in one location. Added test-debug output to test cases (vs.
dumb print stmts) and incorporated use of randgen-seed option to avoid needing
random variants (can just change seed and shuffle all tests that are equipped
to change with seed value)
0.125.70: Patrick Crews 2011-12-12 Initial work on making suites
config-file-tunable (for ease of test-tweaking)
0.125.69: patrick crews 2011-12-09 Initial code to allow for the
use of a suite-wide config file that defines common attributes for related tests
0.125.68: Patrick Crews 2011-12-09 Added initial innodb crash tests
+ randgen grammars
0.125.67: Patrick Crews 2011-12-07 Updated handling code to start a
server with a pre-loaded datadir
0.125.66: Patrick Crews 2011-12-07 Catch annoying error and exit if
we hit it
0.125.65: Patrick Crews 2011-12-07 Minor updates to Drizzle log
file name + cosmetic tweaks
0.125.64: patrick crews 2011-12-07 [merge] Merge trunk - many
updates to drizzle test cases
0.131.4: Patrick Crews 2011-12-06 Fix typo : (
0.131.3: Patrick Crews 2011-12-06 Update location of datadir to
be appropriate (in workdir/qp_data)
0.131.2: Patrick Crews 2011-12-06 Added placeholder for dbqp in
docs
0.131.1: Patrick Crews 2011-12-06 Updates of drizzle test cases
to deal with refactoring. Setting no-secure-file-priv when not using mtr/dtr
now as well
0.125.63: patrick crews 2011-12-07 Refactored option parsing to
allow for more flexibility in merging into other trees. Makes this work easier
and handles important directory detection better this way
0.125.62: Patrick Crews 2011-12-05 Remove unused option / attribute
from system_management
0.125.61: patrick crews 2011-12-05 Update of docs + rename of dbqp
to something not so hard on the fingers, eyes, and auto-complete : )
0.125.60: Patrick Crews 2011-12-01 Tweaks to mysqldump merge, port
of updates to BaseTestCase + test updates
0.125.59: Patrick Crews 2011-12-01 [merge] Merge longbow's updates
to mysqldump utility method. We dump to a result file vs. dumping to stdout to
avoid portability issues and be cleaner in how we do things
0.130.1: Valentine Gostev 2011-12-01 Modified take_mysqldump to
use --restult-file rather than stdout
0.125.58: Patrick Crews 2011-11-30 Finished tweaking server objects
for greater control + setup of replication slaves : )
0.125.57: Patrick Crews 2011-11-30 Additional work and fixes to
move server control to the Server objects. This enables more interesting setup
options
0.125.56: patrick crews 2011-11-30 Tweaks to server handling to
allow more flexible and interesting things to be done in tests
0.125.55: Patrick Crews 2011-11-29 Re-add crashing grammar
0.125.54: Patrick Crews 2011-11-29 Redo premature removal of bug
test + workaround in main suite : (
0.125.53: Patrick Crews 2011-11-29 Updates for galera. Handling of
IST addresses + test updates (re-enabled test of ROLLBACK TO SAVEPOINT)
0.125.52: Patrick Crews 2011-11-29 Added new randgen grammar
0.125.51: Patrick Crews 2011-11-29 Ported in Vadim's fixes to
Percona / Galera servers (query-cache-size=0). Also enabled auto-find and add
to PATH for wsrep_sst scripts for galera trees. Also fixed IST address issue
0.125.50: Patrick Crews 2011-11-28 Added test case for
--galera-info option for xtrabackup and rejiggered existing tests slightly
0.125.49: Patrick Crews 2011-11-28 Added subunit output for test
runs (native mode only so far)
0.125.48: Patrick Crews 2011-11-23 Removed debugging bits from
basic_test and rejiggered slave_test to use check_slave_by_query
0.125.47: Patrick Crews 2011-11-22 Fix error in test refactor
0.125.46: Patrick Crews 2011-11-22 Refactor, speed up of test
execution, and reorg of test cases
0.125.45: Patrick Crews 2011-11-21 Rename of directories
0.125.44: Patrick Crews 2011-11-18 Added test case to add a new
node to an already-populated cluster
0.125.43: Patrick Crews 2011-11-18 Defanged translog_concurrent1.yy
to not use ROLLBACK TO SAVEPOINT as it breaks things : )
0.125.42: Patrick Crews 2011-11-18 Added tests of DROP functionality
0.125.41: Patrick Crews 2011-11-18 Added rollback tests
0.125.40: Patrick Crews 2011-11-17 Added tests of various ALTER
TABLE operations
0.125.39: Patrick Crews 2011-11-16 Updates to system to run servers
with galera replication + tests
0.125.38: Patrick Crews 2011-11-14 Tweaks to cluster test + randgen
gendata file
0.125.37: Patrick Crews 2011-11-11 [merge] Merge trunk
0.129.2: patrick crews 2011-11-11 Cleanup of query_cache test case
0.129.1: patrick crews 2011-11-11 Moved crashing test cases to
randgen_bugs suite + cleanup of test cases
0.125.36: Patrick Crews 2011-11-11 Added support for Galera-based
mysql servers / clusters and added a basic test case
0.125.35: patrick crews 2011-11-01 Work on repeating bug 826632.
Test case fails, but only with 7 schemas, 100 tables per schema (table rows =
1-100), and xtrabackup --parallel=50. Reducing schemas, or --parallel value
results in a passing test : /
0.125.34: patrick crews 2011-11-01 Added some test cases for bugs /
bug-hunting in xtrabackup, particularly passing bad values to the --parallel
option
0.125.33: patrick crews 2011-11-01 Better way to use helgrind with
testing
0.125.32: patrick crews 2011-10-31 [merge] Merge stewart's work on
bug856404 query_cache_strip_comments
0.128.1: Stewart Smith 2011-10-31 add randgen test case for
query_cache_strip_comments with odd quote escaping
0.125.31: patrick crews 2011-10-31 [merge] Merge stewart's work on
reproducing bug 758788 (innodb_dict_size_limit)
0.127.1: Stewart Smith 2011-10-31 modify innodb_dict_size test
to set server options so we are able to reproduce a crash within a few seconds
0.125.30: patrick crews 2011-10-31 initial test for
innodb_dict_size_limit bug
0.125.29: Patrick Crews 2011-10-28 Updated slave test so that we
also ensure replication is working between master and slave (simple check)
0.125.28: Patrick Crews 2011-10-28 Update of assertion to check
slave status vs. master
0.125.27: Patrick Crews 2011-10-28 Spawning a slave from a master
xtrabackup and replicating from there : )
0.125.26: Patrick Crews 2011-10-27 Additional progress on testing
our ability to spwan a slave via xtrabackup
0.125.25: patrick crews 2011-10-27 Initial work on 'spawn a slave
via xtrabackup' test
0.125.24: patrick crews 2011-10-27 Allowing that we might not have
direct control over server code, we can read in a config of running servers +
minor tweaks
0.125.23: Patrick Crews 2011-10-26 Cleanup of xtrabackup tests
0.125.22: patrick crews 2011-10-26 Work on cleaning up xtrabackup
tests
0.125.21: Patrick Crews 2011-10-26 Initial xtrabackup test working.
0.125.20: patrick crews 2011-10-26 Tweaks for xtrabackup + mysql
cnf files
0.125.19: Patrick Crews 2011-10-26 Updated --gendata option for
MySQL & Percona Servers + additonal xtrabackup work
0.125.18: patrick crews 2011-10-26 Initial xtrabackup test + code
to make it happen
0.125.17: patrick crews 2011-10-22 [merge] Merge trunk
0.126.1: Patrick Crews 2011-10-20 Rename of directories
0.125.16: patrick crews 2011-10-22 Added handling for non-existent
pid file for new kill_pid() method - eg server crashed
0.125.15: patrick crews 2011-10-20 Tweaks to drizzle randgen tests
0.125.14: patrick crews 2011-10-20 Finish migration of drizzle
randgen tests to native mode
0.125.13: patrick crews 2011-10-20 Migrated drizzle innodb trx log
tests to unittest mode
0.125.12: patrick crews 2011-10-19 Minor fix of output management
0.125.11: patrick crews 2011-10-19 Remove outdated / retired code
0.125.10: patrick crews 2011-10-19 Added crashme and sqlbench
suites / made them unittest mode
0.125.9: patrick crews 2011-10-19 Tweaks and improvements. Made
randgen mode move to native mode (randgen runs = python unittest modules)
0.125.8: patrick crews 2011-10-18 Updated example test - we can
pass our servers and other relevant objects to a test case : )
0.125.7: patrick crews 2011-10-18 Initial docs merge
0.125.6: patrick crews 2011-10-13 Native mode working...mostly
0.125.5: patrick crews 2011-10-13 Code to introduce native
(unittest / python module) mode
0.125.4: patrick crews 2011-10-13 Further progress on using mysql /
percona trees + creation of randgen tests / grammar dir for percona
0.125.3: patrick crews 2011-10-12 Further tweaks for mysql /
percona goodness
0.125.2: patrick crews 2011-10-10 Additional code to run
mysql+percona servers
0.125.1: patrick crews 2011-10-05 Initial branch
_______________________________________________
Mailing list: https://launchpad.net/~drizzle-benchmark
Post to : [email protected]
Unsubscribe : https://launchpad.net/~drizzle-benchmark
More help : https://help.launchpad.net/ListHelp
