====================================================================================================
SYSBENCH BENCHMARK REPORT
====================================================================================================
MACHINE: Drizzle-build-n04
RUN ID: 354
RUN DATE: 2012-01-17T06:14:19.429491
WORKLOAD: innodb_1000K_readwrite
SERVER: drizzled
VERSION: staging
REVISION: 2494
COMMENT: 2494: Mark Atwood 2012-01-16 [merge] merge
lp:~patrick-crews/drizzle/qp-merge2
====================================================================================================
TRENDING OVER LAST 5 runs
Conc TPS % Diff from Avg Diff Min Max Avg
STD
====================================================================================================
16 1572.33 -0.49% -7.78 1519.54 1633.44 1580.11
33.77
32 1584.70 -0.11% -1.67 1495.22 1633.61 1586.37
38.74
64 1639.47 +0.75% 12.15 1588.04 1670.53 1627.32
26.12
128 1571.45 -1.37% -21.77 1561.57 1621.71 1593.21
18.71
256 1479.70 +1.04% 15.21 1455.37 1482.00 1464.48
8.07
512 1255.50 +0.18% 2.26 1211.60 1282.25 1253.24
20.88
1024 880.91 +0.23% 2.00 871.38 894.61 878.91
5.34
====================================================================================================
TRENDING OVER Last 20 runs
Conc TPS % Diff from Avg Diff Min Max Avg
STD
====================================================================================================
16 1572.33 -3.32% -54.01 1519.54 1794.03 1626.34
66.96
32 1584.70 -3.33% -54.57 1495.22 1748.26 1639.27
64.71
64 1639.47 -0.91% -15.11 1588.04 1736.31 1654.58
43.15
128 1571.45 -3.07% -49.84 1552.50 1685.96 1621.29
35.85
256 1479.70 +0.69% 10.19 1416.89 1503.88 1469.51
21.86
512 1255.50 -2.69% -34.70 1211.60 1334.07 1290.20
37.17
1024 880.91 -7.15% -67.81 870.18 1029.24 948.72
62.75
====================================================================================================
TRENDING OVER ALL runs
Conc TPS % Diff from Avg Diff Min Max Avg
STD
====================================================================================================
16 1572.33 -8.28% -142.03 1177.28 1913.94 1714.36
102.41
32 1584.70 -7.01% -119.55 1448.82 1853.08 1704.25
74.10
64 1639.47 -4.79% -82.48 1480.63 1872.32 1721.95
57.23
128 1571.45 -6.65% -111.87 1401.59 1771.41 1683.32
46.62
256 1479.70 -2.29% -34.65 1268.10 1580.87 1514.35
36.19
512 1255.50 -5.59% -74.40 1075.06 1380.41 1329.90
33.46
1024 880.91 -12.28% -123.27 639.68 1065.34 1004.18
38.94
====================================================================================================
FULL REVISION COMMENTARY:
2483.1.1: Patrick Crews 2012-01-05 [merge] Redo of kewpie merge. Leaving
dbqp in tree as a transition
0.125.83: Patrick Crews 2011-12-30 Added test data file + update / fix of
test case (couldn't run w/ --repeat=2)
0.125.82: Patrick Crews 2011-12-29 Porting of xtrabackup test suite to
kewpie format
0.125.81: patrick crews 2011-12-28 [merge] Fix of adding tar4ibd to PATH.
Needed the dirname, not the binary : (
0.135.1: patrick crews 2011-12-28 Updates to system to add tar4ibd binary
to PATH if one is provided. This is to facilitate xtrabackup testing
0.125.80: patrick crews 2011-12-22 [merge] Merge fix of lp:907957
0.134.1: patrick crews 2011-12-22 Fix for lp:907957. The test runner
could generate a socket file path that exceeded MySQL's limit of 107
characters. Now, for such cases, we copy the MTR trick of creating a path in
/tmp. Our path is currently uuid_botN.sM.sock, where N = the executor id, and
M = the server number
0.125.79: Patrick Crews 2011-12-21 [merge] Merge trunk
0.133.4: Patrick Crews 2011-12-20 Merge from randgen trunk
0.133.3: Patrick Crews 2011-12-19 Consolidated two test modules into one
0.133.2: Patrick Crews 2011-12-16 Added 5.1 and percona 5.1 test beds.
Might remove later, but trying things out for now
0.133.1: Patrick Crews 2011-12-16 Added upgrade test cases that use
datadirs generated by other server versions. We try to use a previous version
and a current version's datadir. Also includes code to allow for running
mysql-5.0 servers.
0.125.78: Patrick Crews 2011-12-21 Tweak replace test cases and updated
existing tests to fix minor errors
0.125.77: patrick crews 2011-12-14 [merge] Merge randgen cluster test
changes
0.132.1: Patrick Crews 2011-12-14 Tweaks to randgen cluster tests and
addition of suite_config file
0.125.76: patrick crews 2011-12-14 Fix of commit file import : (
0.125.75: patrick crews 2011-12-14 Refactored existing cluster tests to use
suite-wide config and added new test cases
0.125.74: Patrick Crews 2011-12-13 Updated crashme tests to use batch mode.
This is a bit of a whiff as the crashme test will just die on errors (rather
than trying to continue). However, this solves the problem of endless timeouts
on failures without a lot of time. Attempts at interacting with the crashme
subproc's stdin /stdout were proving unreliable and problematic
0.125.73: Patrick Crews 2011-12-12 Tweaks to innodbCrash2 test case
0.125.72: Patrick Crews 2011-12-12 Updates / polish for the innodb crash
suite
0.125.71: patrick crews 2011-12-12 Tweaked crash tests to use a suite-wide
config file. This allows for easier tweaks to all tests within a suite.
Created base crash test case to clean up individual test case modules / store
common code in one location. Added test-debug output to test cases (vs. dumb
print stmts) and incorporated use of randgen-seed option to avoid needing
random variants (can just change seed and shuffle all tests that are equipped
to change with seed value)
0.125.70: Patrick Crews 2011-12-12 Initial work on making suites
config-file-tunable (for ease of test-tweaking)
0.125.69: patrick crews 2011-12-09 Initial code to allow for the use of a
suite-wide config file that defines common attributes for related tests
0.125.68: Patrick Crews 2011-12-09 Added initial innodb crash tests +
randgen grammars
0.125.67: Patrick Crews 2011-12-07 Updated handling code to start a server
with a pre-loaded datadir
0.125.66: Patrick Crews 2011-12-07 Catch annoying error and exit if we hit
it
0.125.65: Patrick Crews 2011-12-07 Minor updates to Drizzle log file name +
cosmetic tweaks
0.125.64: patrick crews 2011-12-07 [merge] Merge trunk - many updates to
drizzle test cases
0.131.4: Patrick Crews 2011-12-06 Fix typo : (
0.131.3: Patrick Crews 2011-12-06 Update location of datadir to be
appropriate (in workdir/qp_data)
0.131.2: Patrick Crews 2011-12-06 Added placeholder for dbqp in docs
0.131.1: Patrick Crews 2011-12-06 Updates of drizzle test cases to deal
with refactoring. Setting no-secure-file-priv when not using mtr/dtr now as
well
0.125.63: patrick crews 2011-12-07 Refactored option parsing to allow for
more flexibility in merging into other trees. Makes this work easier and
handles important directory detection better this way
0.125.62: Patrick Crews 2011-12-05 Remove unused option / attribute from
system_management
0.125.61: patrick crews 2011-12-05 Update of docs + rename of dbqp to
something not so hard on the fingers, eyes, and auto-complete : )
0.125.60: Patrick Crews 2011-12-01 Tweaks to mysqldump merge, port of
updates to BaseTestCase + test updates
0.125.59: Patrick Crews 2011-12-01 [merge] Merge longbow's updates to
mysqldump utility method. We dump to a result file vs. dumping to stdout to
avoid portability issues and be cleaner in how we do things
0.130.1: Valentine Gostev 2011-12-01 Modified take_mysqldump to use
--restult-file rather than stdout
0.125.58: Patrick Crews 2011-11-30 Finished tweaking server objects for
greater control + setup of replication slaves : )
0.125.57: Patrick Crews 2011-11-30 Additional work and fixes to move server
control to the Server objects. This enables more interesting setup options
0.125.56: patrick crews 2011-11-30 Tweaks to server handling to allow more
flexible and interesting things to be done in tests
0.125.55: Patrick Crews 2011-11-29 Re-add crashing grammar
0.125.54: Patrick Crews 2011-11-29 Redo premature removal of bug test +
workaround in main suite : (
0.125.53: Patrick Crews 2011-11-29 Updates for galera. Handling of IST
addresses + test updates (re-enabled test of ROLLBACK TO SAVEPOINT)
0.125.52: Patrick Crews 2011-11-29 Added new randgen grammar
0.125.51: Patrick Crews 2011-11-29 Ported in Vadim's fixes to Percona /
Galera servers (query-cache-size=0). Also enabled auto-find and add to PATH
for wsrep_sst scripts for galera trees. Also fixed IST address issue
0.125.50: Patrick Crews 2011-11-28 Added test case for --galera-info option
for xtrabackup and rejiggered existing tests slightly
0.125.49: Patrick Crews 2011-11-28 Added subunit output for test runs
(native mode only so far)
0.125.48: Patrick Crews 2011-11-23 Removed debugging bits from basic_test
and rejiggered slave_test to use check_slave_by_query
0.125.47: Patrick Crews 2011-11-22 Fix error in test refactor
0.125.46: Patrick Crews 2011-11-22 Refactor, speed up of test execution,
and reorg of test cases
0.125.45: Patrick Crews 2011-11-21 Rename of directories
0.125.44: Patrick Crews 2011-11-18 Added test case to add a new node to an
already-populated cluster
0.125.43: Patrick Crews 2011-11-18 Defanged translog_concurrent1.yy to not
use ROLLBACK TO SAVEPOINT as it breaks things : )
0.125.42: Patrick Crews 2011-11-18 Added tests of DROP functionality
0.125.41: Patrick Crews 2011-11-18 Added rollback tests
0.125.40: Patrick Crews 2011-11-17 Added tests of various ALTER TABLE
operations
0.125.39: Patrick Crews 2011-11-16 Updates to system to run servers with
galera replication + tests
0.125.38: Patrick Crews 2011-11-14 Tweaks to cluster test + randgen gendata
file
0.125.37: Patrick Crews 2011-11-11 [merge] Merge trunk
0.129.2: patrick crews 2011-11-11 Cleanup of query_cache test case
0.129.1: patrick crews 2011-11-11 Moved crashing test cases to
randgen_bugs suite + cleanup of test cases
0.125.36: Patrick Crews 2011-11-11 Added support for Galera-based mysql
servers / clusters and added a basic test case
0.125.35: patrick crews 2011-11-01 Work on repeating bug 826632. Test case
fails, but only with 7 schemas, 100 tables per schema (table rows = 1-100), and
xtrabackup --parallel=50. Reducing schemas, or --parallel value results in a
passing test : /
0.125.34: patrick crews 2011-11-01 Added some test cases for bugs /
bug-hunting in xtrabackup, particularly passing bad values to the --parallel
option
0.125.33: patrick crews 2011-11-01 Better way to use helgrind with testing
0.125.32: patrick crews 2011-10-31 [merge] Merge stewart's work on
bug856404 query_cache_strip_comments
0.128.1: Stewart Smith 2011-10-31 add randgen test case for
query_cache_strip_comments with odd quote escaping
0.125.31: patrick crews 2011-10-31 [merge] Merge stewart's work on
reproducing bug 758788 (innodb_dict_size_limit)
0.127.1: Stewart Smith 2011-10-31 modify innodb_dict_size test to set
server options so we are able to reproduce a crash within a few seconds
0.125.30: patrick crews 2011-10-31 initial test for innodb_dict_size_limit
bug
0.125.29: Patrick Crews 2011-10-28 Updated slave test so that we also
ensure replication is working between master and slave (simple check)
0.125.28: Patrick Crews 2011-10-28 Update of assertion to check slave
status vs. master
0.125.27: Patrick Crews 2011-10-28 Spawning a slave from a master
xtrabackup and replicating from there : )
0.125.26: Patrick Crews 2011-10-27 Additional progress on testing our
ability to spwan a slave via xtrabackup
0.125.25: patrick crews 2011-10-27 Initial work on 'spawn a slave via
xtrabackup' test
0.125.24: patrick crews 2011-10-27 Allowing that we might not have direct
control over server code, we can read in a config of running servers + minor
tweaks
0.125.23: Patrick Crews 2011-10-26 Cleanup of xtrabackup tests
0.125.22: patrick crews 2011-10-26 Work on cleaning up xtrabackup tests
0.125.21: Patrick Crews 2011-10-26 Initial xtrabackup test working.
0.125.20: patrick crews 2011-10-26 Tweaks for xtrabackup + mysql cnf files
0.125.19: Patrick Crews 2011-10-26 Updated --gendata option for MySQL &
Percona Servers + additonal xtrabackup work
0.125.18: patrick crews 2011-10-26 Initial xtrabackup test + code to make
it happen
0.125.17: patrick crews 2011-10-22 [merge] Merge trunk
0.126.1: Patrick Crews 2011-10-20 Rename of directories
0.125.16: patrick crews 2011-10-22 Added handling for non-existent pid file
for new kill_pid() method - eg server crashed
0.125.15: patrick crews 2011-10-20 Tweaks to drizzle randgen tests
0.125.14: patrick crews 2011-10-20 Finish migration of drizzle randgen
tests to native mode
0.125.13: patrick crews 2011-10-20 Migrated drizzle innodb trx log tests to
unittest mode
0.125.12: patrick crews 2011-10-19 Minor fix of output management
0.125.11: patrick crews 2011-10-19 Remove outdated / retired code
0.125.10: patrick crews 2011-10-19 Added crashme and sqlbench suites / made
them unittest mode
0.125.9: patrick crews 2011-10-19 Tweaks and improvements. Made randgen
mode move to native mode (randgen runs = python unittest modules)
0.125.8: patrick crews 2011-10-18 Updated example test - we can pass our
servers and other relevant objects to a test case : )
0.125.7: patrick crews 2011-10-18 Initial docs merge
0.125.6: patrick crews 2011-10-13 Native mode working...mostly
0.125.5: patrick crews 2011-10-13 Code to introduce native (unittest /
python module) mode
0.125.4: patrick crews 2011-10-13 Further progress on using mysql / percona
trees + creation of randgen tests / grammar dir for percona
0.125.3: patrick crews 2011-10-12 Further tweaks for mysql / percona
goodness
0.125.2: patrick crews 2011-10-10 Additional code to run mysql+percona
servers
0.125.1: patrick crews 2011-10-05 Initial branch
_______________________________________________
Mailing list: https://launchpad.net/~drizzle-benchmark
Post to : [email protected]
Unsubscribe : https://launchpad.net/~drizzle-benchmark
More help : https://help.launchpad.net/ListHelp
