====================================================================================================
SYSBENCH BENCHMARK REPORT
====================================================================================================
MACHINE: Drizzle-build-n04
RUN ID: 368
RUN DATE: 2012-03-02T20:32:55.687586
WORKLOAD: innodb_1000K_readwrite
SERVER: drizzled
VERSION: staging
REVISION: 2516
COMMENT: 2516: Continuous Integr... 2012-03-02 [merge] Merge staging tree to
trunk.
====================================================================================================
TRENDING OVER LAST 5 runs
Conc TPS % Diff from Avg Diff Min Max Avg
STD
====================================================================================================
16 1551.82 -0.97% -15.27 1509.46 1598.71 1567.10
27.03
32 1620.26 +2.90% 45.73 1490.81 1654.67 1574.53
57.45
64 1576.42 -1.38% -22.11 1566.49 1646.08 1598.53
29.60
128 1611.10 +0.98% 15.64 1556.30 1623.84 1595.47
19.85
256 1455.89 +0.67% 9.70 1423.10 1469.25 1446.19
15.36
512 1256.20 -0.17% -2.10 1246.62 1270.06 1258.31
7.17
1024 886.56 -0.77% -6.85 872.54 908.66 893.42
10.54
====================================================================================================
TRENDING OVER Last 20 runs
Conc TPS % Diff from Avg Diff Min Max Avg
STD
====================================================================================================
16 1551.82 -1.73% -27.37 1509.46 1676.45 1579.20
38.00
32 1620.26 +2.36% 37.39 1483.85 1691.79 1582.87
51.00
64 1576.42 -2.96% -48.02 1566.49 1673.10 1624.44
30.76
128 1611.10 +0.48% 7.63 1556.30 1628.75 1603.48
18.33
256 1455.89 -0.35% -5.05 1423.10 1482.00 1460.94
13.83
512 1256.20 +0.01% 0.07 1211.60 1282.25 1256.13
12.12
1024 886.56 -0.09% -0.79 859.58 909.67 887.36
12.12
====================================================================================================
TRENDING OVER ALL runs
Conc TPS % Diff from Avg Diff Min Max Avg
STD
====================================================================================================
16 1551.82 -9.21% -157.40 1177.28 1913.94 1709.22
104.00
32 1620.26 -4.67% -79.31 1448.82 1853.08 1699.58
77.11
64 1576.42 -8.25% -141.71 1480.63 1872.32 1718.13
59.62
128 1611.10 -4.12% -69.25 1401.59 1771.41 1680.36
48.17
256 1455.89 -3.73% -56.36 1268.10 1580.87 1512.25
37.13
512 1256.20 -5.34% -70.88 1075.06 1380.41 1327.09
35.70
1024 886.56 -11.32% -113.23 639.68 1065.34 999.79
44.08
====================================================================================================
FULL REVISION COMMENTARY:
2515.3.1: Continuous Integr... 2012-03-02 [merge] Merge build tree to staging
tree.
2515.2.1: Continuous Integr... 2012-03-01 [merge] Merge test tree with
build tree.
2515.1.4: Brian Aker 2012-03-01 Final fix for docs.
2515.1.3: Brian Aker 2012-03-01 Doc fix
2515.1.2: Brian Aker 2012-03-01 Fix for documentation breakage for strict
rst check.
2515.1.1: Brian Aker 2012-03-01 [merge] Merge of patrick
2483.1.12: Patrick Crews 2012-02-20 [merge] Merge trunk
2483.1.11: Patrick Crews 2012-02-20 Updated tests/include.am to account
for removal of file-based trx log randgen suite
2483.1.10: Patrick Crews 2012-02-20 Fixed various options / settings to
get drizzle tests running as we would like. Removed trx_log randgen suite as
discussions have indicated removal of that plugin to be happening soon
2483.1.9: Patrick Crews 2012-02-10 Updates to tests/include.am to
remove unused makedist target
2483.1.8: Patrick Crews 2012-02-09 [merge] Merge trunk
2483.1.7: Patrick Crews 2012-02-09 Updated make targets a bit to
emulate current ones
2483.1.6: Patrick Crews 2012-02-08 Updates to kewpie + test cases
2483.1.5: Patrick Crews 2012-02-08 Stripped down much, much, much bulk
from the kewpie tree
2483.1.4: Patrick Crews 2012-02-01 Added kewpie doc
2483.1.3: Patrick Crews 2012-01-30 Updated docs
2483.1.2: Patrick Crews 2012-01-30 Removed mysql/percona upgrade
datadirs
2483.1.1: Patrick Crews 2012-01-05 [merge] Redo of kewpie merge.
Leaving dbqp in tree as a transition
0.125.83: Patrick Crews 2011-12-30 Added test data file + update /
fix of test case (couldn't run w/ --repeat=2)
0.125.82: Patrick Crews 2011-12-29 Porting of xtrabackup test suite
to kewpie format
0.125.81: patrick crews 2011-12-28 [merge] Fix of adding tar4ibd to
PATH. Needed the dirname, not the binary : (
0.135.1: patrick crews 2011-12-28 Updates to system to add tar4ibd
binary to PATH if one is provided. This is to facilitate xtrabackup testing
0.125.80: patrick crews 2011-12-22 [merge] Merge fix of lp:907957
0.134.1: patrick crews 2011-12-22 Fix for lp:907957. The test
runner could generate a socket file path that exceeded MySQL's limit of 107
characters. Now, for such cases, we copy the MTR trick of creating a path in
/tmp. Our path is currently uuid_botN.sM.sock, where N = the executor id, and
M = the server number
0.125.79: Patrick Crews 2011-12-21 [merge] Merge trunk
0.133.4: Patrick Crews 2011-12-20 Merge from randgen trunk
0.133.3: Patrick Crews 2011-12-19 Consolidated two test modules
into one
0.133.2: Patrick Crews 2011-12-16 Added 5.1 and percona 5.1 test
beds. Might remove later, but trying things out for now
0.133.1: Patrick Crews 2011-12-16 Added upgrade test cases that use
datadirs generated by other server versions. We try to use a previous version
and a current version's datadir. Also includes code to allow for running
mysql-5.0 servers.
0.125.78: Patrick Crews 2011-12-21 Tweak replace test cases and
updated existing tests to fix minor errors
0.125.77: patrick crews 2011-12-14 [merge] Merge randgen cluster test
changes
0.132.1: Patrick Crews 2011-12-14 Tweaks to randgen cluster tests
and addition of suite_config file
0.125.76: patrick crews 2011-12-14 Fix of commit file import : (
0.125.75: patrick crews 2011-12-14 Refactored existing cluster tests
to use suite-wide config and added new test cases
0.125.74: Patrick Crews 2011-12-13 Updated crashme tests to use batch
mode. This is a bit of a whiff as the crashme test will just die on errors
(rather than trying to continue). However, this solves the problem of endless
timeouts on failures without a lot of time. Attempts at interacting with the
crashme subproc's stdin /stdout were proving unreliable and problematic
0.125.73: Patrick Crews 2011-12-12 Tweaks to innodbCrash2 test case
0.125.72: Patrick Crews 2011-12-12 Updates / polish for the innodb
crash suite
0.125.71: patrick crews 2011-12-12 Tweaked crash tests to use a
suite-wide config file. This allows for easier tweaks to all tests within a
suite. Created base crash test case to clean up individual test case modules /
store common code in one location. Added test-debug output to test cases (vs.
dumb print stmts) and incorporated use of randgen-seed option to avoid needing
random variants (can just change seed and shuffle all tests that are equipped
to change with seed value)
0.125.70: Patrick Crews 2011-12-12 Initial work on making suites
config-file-tunable (for ease of test-tweaking)
0.125.69: patrick crews 2011-12-09 Initial code to allow for the use
of a suite-wide config file that defines common attributes for related tests
0.125.68: Patrick Crews 2011-12-09 Added initial innodb crash tests +
randgen grammars
0.125.67: Patrick Crews 2011-12-07 Updated handling code to start a
server with a pre-loaded datadir
0.125.66: Patrick Crews 2011-12-07 Catch annoying error and exit if
we hit it
0.125.65: Patrick Crews 2011-12-07 Minor updates to Drizzle log file
name + cosmetic tweaks
0.125.64: patrick crews 2011-12-07 [merge] Merge trunk - many updates
to drizzle test cases
0.131.4: Patrick Crews 2011-12-06 Fix typo : (
0.131.3: Patrick Crews 2011-12-06 Update location of datadir to be
appropriate (in workdir/qp_data)
0.131.2: Patrick Crews 2011-12-06 Added placeholder for dbqp in docs
0.131.1: Patrick Crews 2011-12-06 Updates of drizzle test cases to
deal with refactoring. Setting no-secure-file-priv when not using mtr/dtr now
as well
0.125.63: patrick crews 2011-12-07 Refactored option parsing to allow
for more flexibility in merging into other trees. Makes this work easier and
handles important directory detection better this way
0.125.62: Patrick Crews 2011-12-05 Remove unused option / attribute
from system_management
0.125.61: patrick crews 2011-12-05 Update of docs + rename of dbqp to
something not so hard on the fingers, eyes, and auto-complete : )
0.125.60: Patrick Crews 2011-12-01 Tweaks to mysqldump merge, port of
updates to BaseTestCase + test updates
0.125.59: Patrick Crews 2011-12-01 [merge] Merge longbow's updates to
mysqldump utility method. We dump to a result file vs. dumping to stdout to
avoid portability issues and be cleaner in how we do things
0.130.1: Valentine Gostev 2011-12-01 Modified take_mysqldump to use
--restult-file rather than stdout
0.125.58: Patrick Crews 2011-11-30 Finished tweaking server objects
for greater control + setup of replication slaves : )
0.125.57: Patrick Crews 2011-11-30 Additional work and fixes to move
server control to the Server objects. This enables more interesting setup
options
0.125.56: patrick crews 2011-11-30 Tweaks to server handling to allow
more flexible and interesting things to be done in tests
0.125.55: Patrick Crews 2011-11-29 Re-add crashing grammar
0.125.54: Patrick Crews 2011-11-29 Redo premature removal of bug test
+ workaround in main suite : (
0.125.53: Patrick Crews 2011-11-29 Updates for galera. Handling of
IST addresses + test updates (re-enabled test of ROLLBACK TO SAVEPOINT)
0.125.52: Patrick Crews 2011-11-29 Added new randgen grammar
0.125.51: Patrick Crews 2011-11-29 Ported in Vadim's fixes to Percona
/ Galera servers (query-cache-size=0). Also enabled auto-find and add to PATH
for wsrep_sst scripts for galera trees. Also fixed IST address issue
0.125.50: Patrick Crews 2011-11-28 Added test case for --galera-info
option for xtrabackup and rejiggered existing tests slightly
0.125.49: Patrick Crews 2011-11-28 Added subunit output for test runs
(native mode only so far)
0.125.48: Patrick Crews 2011-11-23 Removed debugging bits from
basic_test and rejiggered slave_test to use check_slave_by_query
0.125.47: Patrick Crews 2011-11-22 Fix error in test refactor
0.125.46: Patrick Crews 2011-11-22 Refactor, speed up of test
execution, and reorg of test cases
0.125.45: Patrick Crews 2011-11-21 Rename of directories
0.125.44: Patrick Crews 2011-11-18 Added test case to add a new node
to an already-populated cluster
0.125.43: Patrick Crews 2011-11-18 Defanged translog_concurrent1.yy
to not use ROLLBACK TO SAVEPOINT as it breaks things : )
0.125.42: Patrick Crews 2011-11-18 Added tests of DROP functionality
0.125.41: Patrick Crews 2011-11-18 Added rollback tests
0.125.40: Patrick Crews 2011-11-17 Added tests of various ALTER TABLE
operations
0.125.39: Patrick Crews 2011-11-16 Updates to system to run servers
with galera replication + tests
0.125.38: Patrick Crews 2011-11-14 Tweaks to cluster test + randgen
gendata file
0.125.37: Patrick Crews 2011-11-11 [merge] Merge trunk
0.129.2: patrick crews 2011-11-11 Cleanup of query_cache test case
0.129.1: patrick crews 2011-11-11 Moved crashing test cases to
randgen_bugs suite + cleanup of test cases
0.125.36: Patrick Crews 2011-11-11 Added support for Galera-based
mysql servers / clusters and added a basic test case
0.125.35: patrick crews 2011-11-01 Work on repeating bug 826632.
Test case fails, but only with 7 schemas, 100 tables per schema (table rows =
1-100), and xtrabackup --parallel=50. Reducing schemas, or --parallel value
results in a passing test : /
0.125.34: patrick crews 2011-11-01 Added some test cases for bugs /
bug-hunting in xtrabackup, particularly passing bad values to the --parallel
option
0.125.33: patrick crews 2011-11-01 Better way to use helgrind with
testing
0.125.32: patrick crews 2011-10-31 [merge] Merge stewart's work on
bug856404 query_cache_strip_comments
0.128.1: Stewart Smith 2011-10-31 add randgen test case for
query_cache_strip_comments with odd quote escaping
0.125.31: patrick crews 2011-10-31 [merge] Merge stewart's work on
reproducing bug 758788 (innodb_dict_size_limit)
0.127.1: Stewart Smith 2011-10-31 modify innodb_dict_size test to
set server options so we are able to reproduce a crash within a few seconds
0.125.30: patrick crews 2011-10-31 initial test for
innodb_dict_size_limit bug
0.125.29: Patrick Crews 2011-10-28 Updated slave test so that we also
ensure replication is working between master and slave (simple check)
0.125.28: Patrick Crews 2011-10-28 Update of assertion to check slave
status vs. master
0.125.27: Patrick Crews 2011-10-28 Spawning a slave from a master
xtrabackup and replicating from there : )
0.125.26: Patrick Crews 2011-10-27 Additional progress on testing our
ability to spwan a slave via xtrabackup
0.125.25: patrick crews 2011-10-27 Initial work on 'spawn a slave via
xtrabackup' test
0.125.24: patrick crews 2011-10-27 Allowing that we might not have
direct control over server code, we can read in a config of running servers +
minor tweaks
0.125.23: Patrick Crews 2011-10-26 Cleanup of xtrabackup tests
0.125.22: patrick crews 2011-10-26 Work on cleaning up xtrabackup
tests
0.125.21: Patrick Crews 2011-10-26 Initial xtrabackup test working.
0.125.20: patrick crews 2011-10-26 Tweaks for xtrabackup + mysql cnf
files
0.125.19: Patrick Crews 2011-10-26 Updated --gendata option for MySQL
& Percona Servers + additonal xtrabackup work
0.125.18: patrick crews 2011-10-26 Initial xtrabackup test + code to
make it happen
0.125.17: patrick crews 2011-10-22 [merge] Merge trunk
0.126.1: Patrick Crews 2011-10-20 Rename of directories
0.125.16: patrick crews 2011-10-22 Added handling for non-existent
pid file for new kill_pid() method - eg server crashed
0.125.15: patrick crews 2011-10-20 Tweaks to drizzle randgen tests
0.125.14: patrick crews 2011-10-20 Finish migration of drizzle
randgen tests to native mode
0.125.13: patrick crews 2011-10-20 Migrated drizzle innodb trx log
tests to unittest mode
0.125.12: patrick crews 2011-10-19 Minor fix of output management
0.125.11: patrick crews 2011-10-19 Remove outdated / retired code
0.125.10: patrick crews 2011-10-19 Added crashme and sqlbench suites
/ made them unittest mode
0.125.9: patrick crews 2011-10-19 Tweaks and improvements. Made
randgen mode move to native mode (randgen runs = python unittest modules)
0.125.8: patrick crews 2011-10-18 Updated example test - we can pass
our servers and other relevant objects to a test case : )
0.125.7: patrick crews 2011-10-18 Initial docs merge
0.125.6: patrick crews 2011-10-13 Native mode working...mostly
0.125.5: patrick crews 2011-10-13 Code to introduce native (unittest
/ python module) mode
0.125.4: patrick crews 2011-10-13 Further progress on using mysql /
percona trees + creation of randgen tests / grammar dir for percona
0.125.3: patrick crews 2011-10-12 Further tweaks for mysql / percona
goodness
0.125.2: patrick crews 2011-10-10 Additional code to run
mysql+percona servers
0.125.1: patrick crews 2011-10-05 Initial branch
_______________________________________________
Mailing list: https://launchpad.net/~drizzle-benchmark
Post to : [email protected]
Unsubscribe : https://launchpad.net/~drizzle-benchmark
More help : https://help.launchpad.net/ListHelp
