====================================================================================================
SYSBENCH BENCHMARK REPORT
====================================================================================================
MACHINE: drizzle-build-n02.wc1.dfw1.stabletransit.com
RUN ID: 1257
RUN DATE: 2012-03-02T15:36:27.133482
WORKLOAD: innodb_1000K_readwrite
SERVER: drizzled
VERSION: staging
REVISION: 2516
COMMENT: 2516: Continuous Integr... 2012-03-02 [merge] Merge staging tree to
trunk.
====================================================================================================
TRENDING OVER LAST 5 runs
Conc TPS % Diff from Avg Diff Min Max Avg
STD
====================================================================================================
16 1239.50 +0.51% 6.27 1197.66 1255.44 1233.23
17.02
32 1494.42 -0.29% -4.28 1412.42 1561.14 1498.69
41.95
64 1617.65 -0.19% -3.08 1574.91 1665.31 1620.73
34.18
128 1652.42 -0.68% -11.31 1646.49 1686.99 1663.73
12.09
256 1630.08 +0.53% 8.58 1609.83 1635.83 1621.50
9.72
512 1355.83 -0.88% -12.01 1350.01 1390.78 1367.84
13.26
1024 745.80 -0.96% -7.23 741.37 770.45 753.03
10.27
====================================================================================================
TRENDING OVER Last 20 runs
Conc TPS % Diff from Avg Diff Min Max Avg
STD
====================================================================================================
16 1239.50 -3.09% -39.46 1197.66 1329.01 1278.96
34.33
32 1494.42 -0.67% -10.14 1399.72 1618.30 1504.56
54.75
64 1617.65 +0.40% 6.50 1471.04 1689.36 1611.15
49.58
128 1652.42 -1.99% -33.59 1640.77 1731.34 1686.02
25.80
256 1630.08 -1.60% -26.58 1609.83 1719.14 1656.66
26.56
512 1355.83 -6.33% -91.62 1350.01 1488.51 1447.45
43.07
1024 745.80 -16.32% -145.50 741.37 965.44 891.30
73.19
====================================================================================================
TRENDING OVER ALL runs
Conc TPS % Diff from Avg Diff Min Max Avg
STD
====================================================================================================
16 1239.50 -4.99% -65.05 345.67 1503.03 1304.55
71.00
32 1494.42 -5.63% -89.24 616.39 1870.18 1583.65
115.59
64 1617.65 -5.46% -93.44 683.67 2059.46 1711.09
134.29
128 1652.42 -6.40% -113.01 1289.29 2051.37 1765.43
105.83
256 1630.08 -4.13% -70.22 1223.81 1824.49 1700.30
60.74
512 1355.83 -2.84% -39.56 661.33 1554.29 1395.39
160.83
1024 745.80 -27.29% -279.89 513.17 1143.07 1025.69
76.46
====================================================================================================
FULL REVISION COMMENTARY:
2515.3.1: Continuous Integr... 2012-03-02 [merge] Merge build tree to staging
tree.
2515.2.1: Continuous Integr... 2012-03-01 [merge] Merge test tree with
build tree.
2515.1.4: Brian Aker 2012-03-01 Final fix for docs.
2515.1.3: Brian Aker 2012-03-01 Doc fix
2515.1.2: Brian Aker 2012-03-01 Fix for documentation breakage for strict
rst check.
2515.1.1: Brian Aker 2012-03-01 [merge] Merge of patrick
2483.1.12: Patrick Crews 2012-02-20 [merge] Merge trunk
2483.1.11: Patrick Crews 2012-02-20 Updated tests/include.am to account
for removal of file-based trx log randgen suite
2483.1.10: Patrick Crews 2012-02-20 Fixed various options / settings to
get drizzle tests running as we would like. Removed trx_log randgen suite as
discussions have indicated removal of that plugin to be happening soon
2483.1.9: Patrick Crews 2012-02-10 Updates to tests/include.am to
remove unused makedist target
2483.1.8: Patrick Crews 2012-02-09 [merge] Merge trunk
2483.1.7: Patrick Crews 2012-02-09 Updated make targets a bit to
emulate current ones
2483.1.6: Patrick Crews 2012-02-08 Updates to kewpie + test cases
2483.1.5: Patrick Crews 2012-02-08 Stripped down much, much, much bulk
from the kewpie tree
2483.1.4: Patrick Crews 2012-02-01 Added kewpie doc
2483.1.3: Patrick Crews 2012-01-30 Updated docs
2483.1.2: Patrick Crews 2012-01-30 Removed mysql/percona upgrade
datadirs
2483.1.1: Patrick Crews 2012-01-05 [merge] Redo of kewpie merge.
Leaving dbqp in tree as a transition
0.125.83: Patrick Crews 2011-12-30 Added test data file + update /
fix of test case (couldn't run w/ --repeat=2)
0.125.82: Patrick Crews 2011-12-29 Porting of xtrabackup test suite
to kewpie format
0.125.81: patrick crews 2011-12-28 [merge] Fix of adding tar4ibd to
PATH. Needed the dirname, not the binary : (
0.135.1: patrick crews 2011-12-28 Updates to system to add tar4ibd
binary to PATH if one is provided. This is to facilitate xtrabackup testing
0.125.80: patrick crews 2011-12-22 [merge] Merge fix of lp:907957
0.134.1: patrick crews 2011-12-22 Fix for lp:907957. The test
runner could generate a socket file path that exceeded MySQL's limit of 107
characters. Now, for such cases, we copy the MTR trick of creating a path in
/tmp. Our path is currently uuid_botN.sM.sock, where N = the executor id, and
M = the server number
0.125.79: Patrick Crews 2011-12-21 [merge] Merge trunk
0.133.4: Patrick Crews 2011-12-20 Merge from randgen trunk
0.133.3: Patrick Crews 2011-12-19 Consolidated two test modules
into one
0.133.2: Patrick Crews 2011-12-16 Added 5.1 and percona 5.1 test
beds. Might remove later, but trying things out for now
0.133.1: Patrick Crews 2011-12-16 Added upgrade test cases that use
datadirs generated by other server versions. We try to use a previous version
and a current version's datadir. Also includes code to allow for running
mysql-5.0 servers.
0.125.78: Patrick Crews 2011-12-21 Tweak replace test cases and
updated existing tests to fix minor errors
0.125.77: patrick crews 2011-12-14 [merge] Merge randgen cluster test
changes
0.132.1: Patrick Crews 2011-12-14 Tweaks to randgen cluster tests
and addition of suite_config file
0.125.76: patrick crews 2011-12-14 Fix of commit file import : (
0.125.75: patrick crews 2011-12-14 Refactored existing cluster tests
to use suite-wide config and added new test cases
0.125.74: Patrick Crews 2011-12-13 Updated crashme tests to use batch
mode. This is a bit of a whiff as the crashme test will just die on errors
(rather than trying to continue). However, this solves the problem of endless
timeouts on failures without a lot of time. Attempts at interacting with the
crashme subproc's stdin /stdout were proving unreliable and problematic
0.125.73: Patrick Crews 2011-12-12 Tweaks to innodbCrash2 test case
0.125.72: Patrick Crews 2011-12-12 Updates / polish for the innodb
crash suite
0.125.71: patrick crews 2011-12-12 Tweaked crash tests to use a
suite-wide config file. This allows for easier tweaks to all tests within a
suite. Created base crash test case to clean up individual test case modules /
store common code in one location. Added test-debug output to test cases (vs.
dumb print stmts) and incorporated use of randgen-seed option to avoid needing
random variants (can just change seed and shuffle all tests that are equipped
to change with seed value)
0.125.70: Patrick Crews 2011-12-12 Initial work on making suites
config-file-tunable (for ease of test-tweaking)
0.125.69: patrick crews 2011-12-09 Initial code to allow for the use
of a suite-wide config file that defines common attributes for related tests
0.125.68: Patrick Crews 2011-12-09 Added initial innodb crash tests +
randgen grammars
0.125.67: Patrick Crews 2011-12-07 Updated handling code to start a
server with a pre-loaded datadir
0.125.66: Patrick Crews 2011-12-07 Catch annoying error and exit if
we hit it
0.125.65: Patrick Crews 2011-12-07 Minor updates to Drizzle log file
name + cosmetic tweaks
0.125.64: patrick crews 2011-12-07 [merge] Merge trunk - many updates
to drizzle test cases
0.131.4: Patrick Crews 2011-12-06 Fix typo : (
0.131.3: Patrick Crews 2011-12-06 Update location of datadir to be
appropriate (in workdir/qp_data)
0.131.2: Patrick Crews 2011-12-06 Added placeholder for dbqp in docs
0.131.1: Patrick Crews 2011-12-06 Updates of drizzle test cases to
deal with refactoring. Setting no-secure-file-priv when not using mtr/dtr now
as well
0.125.63: patrick crews 2011-12-07 Refactored option parsing to allow
for more flexibility in merging into other trees. Makes this work easier and
handles important directory detection better this way
0.125.62: Patrick Crews 2011-12-05 Remove unused option / attribute
from system_management
0.125.61: patrick crews 2011-12-05 Update of docs + rename of dbqp to
something not so hard on the fingers, eyes, and auto-complete : )
0.125.60: Patrick Crews 2011-12-01 Tweaks to mysqldump merge, port of
updates to BaseTestCase + test updates
0.125.59: Patrick Crews 2011-12-01 [merge] Merge longbow's updates to
mysqldump utility method. We dump to a result file vs. dumping to stdout to
avoid portability issues and be cleaner in how we do things
0.130.1: Valentine Gostev 2011-12-01 Modified take_mysqldump to use
--restult-file rather than stdout
0.125.58: Patrick Crews 2011-11-30 Finished tweaking server objects
for greater control + setup of replication slaves : )
0.125.57: Patrick Crews 2011-11-30 Additional work and fixes to move
server control to the Server objects. This enables more interesting setup
options
0.125.56: patrick crews 2011-11-30 Tweaks to server handling to allow
more flexible and interesting things to be done in tests
0.125.55: Patrick Crews 2011-11-29 Re-add crashing grammar
0.125.54: Patrick Crews 2011-11-29 Redo premature removal of bug test
+ workaround in main suite : (
0.125.53: Patrick Crews 2011-11-29 Updates for galera. Handling of
IST addresses + test updates (re-enabled test of ROLLBACK TO SAVEPOINT)
0.125.52: Patrick Crews 2011-11-29 Added new randgen grammar
0.125.51: Patrick Crews 2011-11-29 Ported in Vadim's fixes to Percona
/ Galera servers (query-cache-size=0). Also enabled auto-find and add to PATH
for wsrep_sst scripts for galera trees. Also fixed IST address issue
0.125.50: Patrick Crews 2011-11-28 Added test case for --galera-info
option for xtrabackup and rejiggered existing tests slightly
0.125.49: Patrick Crews 2011-11-28 Added subunit output for test runs
(native mode only so far)
0.125.48: Patrick Crews 2011-11-23 Removed debugging bits from
basic_test and rejiggered slave_test to use check_slave_by_query
0.125.47: Patrick Crews 2011-11-22 Fix error in test refactor
0.125.46: Patrick Crews 2011-11-22 Refactor, speed up of test
execution, and reorg of test cases
0.125.45: Patrick Crews 2011-11-21 Rename of directories
0.125.44: Patrick Crews 2011-11-18 Added test case to add a new node
to an already-populated cluster
0.125.43: Patrick Crews 2011-11-18 Defanged translog_concurrent1.yy
to not use ROLLBACK TO SAVEPOINT as it breaks things : )
0.125.42: Patrick Crews 2011-11-18 Added tests of DROP functionality
0.125.41: Patrick Crews 2011-11-18 Added rollback tests
0.125.40: Patrick Crews 2011-11-17 Added tests of various ALTER TABLE
operations
0.125.39: Patrick Crews 2011-11-16 Updates to system to run servers
with galera replication + tests
0.125.38: Patrick Crews 2011-11-14 Tweaks to cluster test + randgen
gendata file
0.125.37: Patrick Crews 2011-11-11 [merge] Merge trunk
0.129.2: patrick crews 2011-11-11 Cleanup of query_cache test case
0.129.1: patrick crews 2011-11-11 Moved crashing test cases to
randgen_bugs suite + cleanup of test cases
0.125.36: Patrick Crews 2011-11-11 Added support for Galera-based
mysql servers / clusters and added a basic test case
0.125.35: patrick crews 2011-11-01 Work on repeating bug 826632.
Test case fails, but only with 7 schemas, 100 tables per schema (table rows =
1-100), and xtrabackup --parallel=50. Reducing schemas, or --parallel value
results in a passing test : /
0.125.34: patrick crews 2011-11-01 Added some test cases for bugs /
bug-hunting in xtrabackup, particularly passing bad values to the --parallel
option
0.125.33: patrick crews 2011-11-01 Better way to use helgrind with
testing
0.125.32: patrick crews 2011-10-31 [merge] Merge stewart's work on
bug856404 query_cache_strip_comments
0.128.1: Stewart Smith 2011-10-31 add randgen test case for
query_cache_strip_comments with odd quote escaping
0.125.31: patrick crews 2011-10-31 [merge] Merge stewart's work on
reproducing bug 758788 (innodb_dict_size_limit)
0.127.1: Stewart Smith 2011-10-31 modify innodb_dict_size test to
set server options so we are able to reproduce a crash within a few seconds
0.125.30: patrick crews 2011-10-31 initial test for
innodb_dict_size_limit bug
0.125.29: Patrick Crews 2011-10-28 Updated slave test so that we also
ensure replication is working between master and slave (simple check)
0.125.28: Patrick Crews 2011-10-28 Update of assertion to check slave
status vs. master
0.125.27: Patrick Crews 2011-10-28 Spawning a slave from a master
xtrabackup and replicating from there : )
0.125.26: Patrick Crews 2011-10-27 Additional progress on testing our
ability to spwan a slave via xtrabackup
0.125.25: patrick crews 2011-10-27 Initial work on 'spawn a slave via
xtrabackup' test
0.125.24: patrick crews 2011-10-27 Allowing that we might not have
direct control over server code, we can read in a config of running servers +
minor tweaks
0.125.23: Patrick Crews 2011-10-26 Cleanup of xtrabackup tests
0.125.22: patrick crews 2011-10-26 Work on cleaning up xtrabackup
tests
0.125.21: Patrick Crews 2011-10-26 Initial xtrabackup test working.
0.125.20: patrick crews 2011-10-26 Tweaks for xtrabackup + mysql cnf
files
0.125.19: Patrick Crews 2011-10-26 Updated --gendata option for MySQL
& Percona Servers + additonal xtrabackup work
0.125.18: patrick crews 2011-10-26 Initial xtrabackup test + code to
make it happen
0.125.17: patrick crews 2011-10-22 [merge] Merge trunk
0.126.1: Patrick Crews 2011-10-20 Rename of directories
0.125.16: patrick crews 2011-10-22 Added handling for non-existent
pid file for new kill_pid() method - eg server crashed
0.125.15: patrick crews 2011-10-20 Tweaks to drizzle randgen tests
0.125.14: patrick crews 2011-10-20 Finish migration of drizzle
randgen tests to native mode
0.125.13: patrick crews 2011-10-20 Migrated drizzle innodb trx log
tests to unittest mode
0.125.12: patrick crews 2011-10-19 Minor fix of output management
0.125.11: patrick crews 2011-10-19 Remove outdated / retired code
0.125.10: patrick crews 2011-10-19 Added crashme and sqlbench suites
/ made them unittest mode
0.125.9: patrick crews 2011-10-19 Tweaks and improvements. Made
randgen mode move to native mode (randgen runs = python unittest modules)
0.125.8: patrick crews 2011-10-18 Updated example test - we can pass
our servers and other relevant objects to a test case : )
0.125.7: patrick crews 2011-10-18 Initial docs merge
0.125.6: patrick crews 2011-10-13 Native mode working...mostly
0.125.5: patrick crews 2011-10-13 Code to introduce native (unittest
/ python module) mode
0.125.4: patrick crews 2011-10-13 Further progress on using mysql /
percona trees + creation of randgen tests / grammar dir for percona
0.125.3: patrick crews 2011-10-12 Further tweaks for mysql / percona
goodness
0.125.2: patrick crews 2011-10-10 Additional code to run
mysql+percona servers
0.125.1: patrick crews 2011-10-05 Initial branch
_______________________________________________
Mailing list: https://launchpad.net/~drizzle-benchmark
Post to : [email protected]
Unsubscribe : https://launchpad.net/~drizzle-benchmark
More help : https://help.launchpad.net/ListHelp
