====================================================================================================
SYSBENCH BENCHMARK REPORT
====================================================================================================
MACHINE: Drizzle-build-n03
RUN ID: 360
RUN DATE: 2012-01-17T03:54:44.452697
WORKLOAD: innodb_1000K_readonly
SERVER: drizzled
VERSION: staging
REVISION: 2494
COMMENT: 2494: Mark Atwood 2012-01-16 [merge] merge
lp:~patrick-crews/drizzle/qp-merge2
====================================================================================================
TRENDING OVER LAST 5 runs
Conc TPS % Diff from Avg Diff Min Max Avg
STD
====================================================================================================
16 2078.36 +0.24% 5.03 2008.21 2111.15 2073.33
24.27
32 2333.44 +1.78% 40.82 2150.60 2362.92 2292.62
55.92
64 2348.18 -0.88% -20.91 2331.05 2410.28 2369.10
21.44
128 2339.20 +0.21% 4.95 2302.35 2369.49 2334.25
20.27
256 2067.77 -0.13% -2.60 2057.37 2096.31 2070.37
10.73
512 1570.67 +0.06% 0.98 1537.45 1663.56 1569.69
31.99
1024 1070.15 -0.96% -10.32 1067.27 1103.55 1080.47
11.86
====================================================================================================
TRENDING OVER Last 20 runs
Conc TPS % Diff from Avg Diff Min Max Avg
STD
====================================================================================================
16 2078.36 -4.53% -98.69 2008.21 2331.32 2177.05
98.45
32 2333.44 -2.24% -53.54 2150.60 2634.38 2386.98
130.57
64 2348.18 -6.19% -155.04 2331.05 2686.59 2503.22
114.29
128 2339.20 -4.92% -121.00 2302.35 2619.25 2460.20
116.36
256 2067.77 -7.03% -156.24 2028.04 2400.67 2224.01
145.21
512 1570.67 -11.79% -210.00 1537.45 1982.17 1780.67
193.65
1024 1070.15 -9.02% -106.09 1066.39 1282.51 1176.24
87.19
====================================================================================================
TRENDING OVER ALL runs
Conc TPS % Diff from Avg Diff Min Max Avg
STD
====================================================================================================
16 2078.36 -10.19% -235.82 2008.21 2556.87 2314.18
71.21
32 2333.44 -9.70% -250.80 2150.60 2774.27 2584.24
110.22
64 2348.18 -11.94% -318.39 2331.05 2831.41 2666.58
72.57
128 2339.20 -10.10% -262.90 2302.35 2725.58 2602.10
58.40
256 2067.77 -12.82% -304.01 2028.04 2500.38 2371.77
63.03
512 1570.67 -19.33% -376.45 1308.74 2051.13 1947.12
76.75
1024 1070.15 -17.21% -222.38 853.85 1445.26 1292.53
64.32
====================================================================================================
FULL REVISION COMMENTARY:
2483.1.1: Patrick Crews 2012-01-05 [merge] Redo of kewpie merge. Leaving
dbqp in tree as a transition
0.125.83: Patrick Crews 2011-12-30 Added test data file + update / fix of
test case (couldn't run w/ --repeat=2)
0.125.82: Patrick Crews 2011-12-29 Porting of xtrabackup test suite to
kewpie format
0.125.81: patrick crews 2011-12-28 [merge] Fix of adding tar4ibd to PATH.
Needed the dirname, not the binary : (
0.135.1: patrick crews 2011-12-28 Updates to system to add tar4ibd binary
to PATH if one is provided. This is to facilitate xtrabackup testing
0.125.80: patrick crews 2011-12-22 [merge] Merge fix of lp:907957
0.134.1: patrick crews 2011-12-22 Fix for lp:907957. The test runner
could generate a socket file path that exceeded MySQL's limit of 107
characters. Now, for such cases, we copy the MTR trick of creating a path in
/tmp. Our path is currently uuid_botN.sM.sock, where N = the executor id, and
M = the server number
0.125.79: Patrick Crews 2011-12-21 [merge] Merge trunk
0.133.4: Patrick Crews 2011-12-20 Merge from randgen trunk
0.133.3: Patrick Crews 2011-12-19 Consolidated two test modules into one
0.133.2: Patrick Crews 2011-12-16 Added 5.1 and percona 5.1 test beds.
Might remove later, but trying things out for now
0.133.1: Patrick Crews 2011-12-16 Added upgrade test cases that use
datadirs generated by other server versions. We try to use a previous version
and a current version's datadir. Also includes code to allow for running
mysql-5.0 servers.
0.125.78: Patrick Crews 2011-12-21 Tweak replace test cases and updated
existing tests to fix minor errors
0.125.77: patrick crews 2011-12-14 [merge] Merge randgen cluster test
changes
0.132.1: Patrick Crews 2011-12-14 Tweaks to randgen cluster tests and
addition of suite_config file
0.125.76: patrick crews 2011-12-14 Fix of commit file import : (
0.125.75: patrick crews 2011-12-14 Refactored existing cluster tests to use
suite-wide config and added new test cases
0.125.74: Patrick Crews 2011-12-13 Updated crashme tests to use batch mode.
This is a bit of a whiff as the crashme test will just die on errors (rather
than trying to continue). However, this solves the problem of endless timeouts
on failures without a lot of time. Attempts at interacting with the crashme
subproc's stdin /stdout were proving unreliable and problematic
0.125.73: Patrick Crews 2011-12-12 Tweaks to innodbCrash2 test case
0.125.72: Patrick Crews 2011-12-12 Updates / polish for the innodb crash
suite
0.125.71: patrick crews 2011-12-12 Tweaked crash tests to use a suite-wide
config file. This allows for easier tweaks to all tests within a suite.
Created base crash test case to clean up individual test case modules / store
common code in one location. Added test-debug output to test cases (vs. dumb
print stmts) and incorporated use of randgen-seed option to avoid needing
random variants (can just change seed and shuffle all tests that are equipped
to change with seed value)
0.125.70: Patrick Crews 2011-12-12 Initial work on making suites
config-file-tunable (for ease of test-tweaking)
0.125.69: patrick crews 2011-12-09 Initial code to allow for the use of a
suite-wide config file that defines common attributes for related tests
0.125.68: Patrick Crews 2011-12-09 Added initial innodb crash tests +
randgen grammars
0.125.67: Patrick Crews 2011-12-07 Updated handling code to start a server
with a pre-loaded datadir
0.125.66: Patrick Crews 2011-12-07 Catch annoying error and exit if we hit
it
0.125.65: Patrick Crews 2011-12-07 Minor updates to Drizzle log file name +
cosmetic tweaks
0.125.64: patrick crews 2011-12-07 [merge] Merge trunk - many updates to
drizzle test cases
0.131.4: Patrick Crews 2011-12-06 Fix typo : (
0.131.3: Patrick Crews 2011-12-06 Update location of datadir to be
appropriate (in workdir/qp_data)
0.131.2: Patrick Crews 2011-12-06 Added placeholder for dbqp in docs
0.131.1: Patrick Crews 2011-12-06 Updates of drizzle test cases to deal
with refactoring. Setting no-secure-file-priv when not using mtr/dtr now as
well
0.125.63: patrick crews 2011-12-07 Refactored option parsing to allow for
more flexibility in merging into other trees. Makes this work easier and
handles important directory detection better this way
0.125.62: Patrick Crews 2011-12-05 Remove unused option / attribute from
system_management
0.125.61: patrick crews 2011-12-05 Update of docs + rename of dbqp to
something not so hard on the fingers, eyes, and auto-complete : )
0.125.60: Patrick Crews 2011-12-01 Tweaks to mysqldump merge, port of
updates to BaseTestCase + test updates
0.125.59: Patrick Crews 2011-12-01 [merge] Merge longbow's updates to
mysqldump utility method. We dump to a result file vs. dumping to stdout to
avoid portability issues and be cleaner in how we do things
0.130.1: Valentine Gostev 2011-12-01 Modified take_mysqldump to use
--restult-file rather than stdout
0.125.58: Patrick Crews 2011-11-30 Finished tweaking server objects for
greater control + setup of replication slaves : )
0.125.57: Patrick Crews 2011-11-30 Additional work and fixes to move server
control to the Server objects. This enables more interesting setup options
0.125.56: patrick crews 2011-11-30 Tweaks to server handling to allow more
flexible and interesting things to be done in tests
0.125.55: Patrick Crews 2011-11-29 Re-add crashing grammar
0.125.54: Patrick Crews 2011-11-29 Redo premature removal of bug test +
workaround in main suite : (
0.125.53: Patrick Crews 2011-11-29 Updates for galera. Handling of IST
addresses + test updates (re-enabled test of ROLLBACK TO SAVEPOINT)
0.125.52: Patrick Crews 2011-11-29 Added new randgen grammar
0.125.51: Patrick Crews 2011-11-29 Ported in Vadim's fixes to Percona /
Galera servers (query-cache-size=0). Also enabled auto-find and add to PATH
for wsrep_sst scripts for galera trees. Also fixed IST address issue
0.125.50: Patrick Crews 2011-11-28 Added test case for --galera-info option
for xtrabackup and rejiggered existing tests slightly
0.125.49: Patrick Crews 2011-11-28 Added subunit output for test runs
(native mode only so far)
0.125.48: Patrick Crews 2011-11-23 Removed debugging bits from basic_test
and rejiggered slave_test to use check_slave_by_query
0.125.47: Patrick Crews 2011-11-22 Fix error in test refactor
0.125.46: Patrick Crews 2011-11-22 Refactor, speed up of test execution,
and reorg of test cases
0.125.45: Patrick Crews 2011-11-21 Rename of directories
0.125.44: Patrick Crews 2011-11-18 Added test case to add a new node to an
already-populated cluster
0.125.43: Patrick Crews 2011-11-18 Defanged translog_concurrent1.yy to not
use ROLLBACK TO SAVEPOINT as it breaks things : )
0.125.42: Patrick Crews 2011-11-18 Added tests of DROP functionality
0.125.41: Patrick Crews 2011-11-18 Added rollback tests
0.125.40: Patrick Crews 2011-11-17 Added tests of various ALTER TABLE
operations
0.125.39: Patrick Crews 2011-11-16 Updates to system to run servers with
galera replication + tests
0.125.38: Patrick Crews 2011-11-14 Tweaks to cluster test + randgen gendata
file
0.125.37: Patrick Crews 2011-11-11 [merge] Merge trunk
0.129.2: patrick crews 2011-11-11 Cleanup of query_cache test case
0.129.1: patrick crews 2011-11-11 Moved crashing test cases to
randgen_bugs suite + cleanup of test cases
0.125.36: Patrick Crews 2011-11-11 Added support for Galera-based mysql
servers / clusters and added a basic test case
0.125.35: patrick crews 2011-11-01 Work on repeating bug 826632. Test case
fails, but only with 7 schemas, 100 tables per schema (table rows = 1-100), and
xtrabackup --parallel=50. Reducing schemas, or --parallel value results in a
passing test : /
0.125.34: patrick crews 2011-11-01 Added some test cases for bugs /
bug-hunting in xtrabackup, particularly passing bad values to the --parallel
option
0.125.33: patrick crews 2011-11-01 Better way to use helgrind with testing
0.125.32: patrick crews 2011-10-31 [merge] Merge stewart's work on
bug856404 query_cache_strip_comments
0.128.1: Stewart Smith 2011-10-31 add randgen test case for
query_cache_strip_comments with odd quote escaping
0.125.31: patrick crews 2011-10-31 [merge] Merge stewart's work on
reproducing bug 758788 (innodb_dict_size_limit)
0.127.1: Stewart Smith 2011-10-31 modify innodb_dict_size test to set
server options so we are able to reproduce a crash within a few seconds
0.125.30: patrick crews 2011-10-31 initial test for innodb_dict_size_limit
bug
0.125.29: Patrick Crews 2011-10-28 Updated slave test so that we also
ensure replication is working between master and slave (simple check)
0.125.28: Patrick Crews 2011-10-28 Update of assertion to check slave
status vs. master
0.125.27: Patrick Crews 2011-10-28 Spawning a slave from a master
xtrabackup and replicating from there : )
0.125.26: Patrick Crews 2011-10-27 Additional progress on testing our
ability to spwan a slave via xtrabackup
0.125.25: patrick crews 2011-10-27 Initial work on 'spawn a slave via
xtrabackup' test
0.125.24: patrick crews 2011-10-27 Allowing that we might not have direct
control over server code, we can read in a config of running servers + minor
tweaks
0.125.23: Patrick Crews 2011-10-26 Cleanup of xtrabackup tests
0.125.22: patrick crews 2011-10-26 Work on cleaning up xtrabackup tests
0.125.21: Patrick Crews 2011-10-26 Initial xtrabackup test working.
0.125.20: patrick crews 2011-10-26 Tweaks for xtrabackup + mysql cnf files
0.125.19: Patrick Crews 2011-10-26 Updated --gendata option for MySQL &
Percona Servers + additonal xtrabackup work
0.125.18: patrick crews 2011-10-26 Initial xtrabackup test + code to make
it happen
0.125.17: patrick crews 2011-10-22 [merge] Merge trunk
0.126.1: Patrick Crews 2011-10-20 Rename of directories
0.125.16: patrick crews 2011-10-22 Added handling for non-existent pid file
for new kill_pid() method - eg server crashed
0.125.15: patrick crews 2011-10-20 Tweaks to drizzle randgen tests
0.125.14: patrick crews 2011-10-20 Finish migration of drizzle randgen
tests to native mode
0.125.13: patrick crews 2011-10-20 Migrated drizzle innodb trx log tests to
unittest mode
0.125.12: patrick crews 2011-10-19 Minor fix of output management
0.125.11: patrick crews 2011-10-19 Remove outdated / retired code
0.125.10: patrick crews 2011-10-19 Added crashme and sqlbench suites / made
them unittest mode
0.125.9: patrick crews 2011-10-19 Tweaks and improvements. Made randgen
mode move to native mode (randgen runs = python unittest modules)
0.125.8: patrick crews 2011-10-18 Updated example test - we can pass our
servers and other relevant objects to a test case : )
0.125.7: patrick crews 2011-10-18 Initial docs merge
0.125.6: patrick crews 2011-10-13 Native mode working...mostly
0.125.5: patrick crews 2011-10-13 Code to introduce native (unittest /
python module) mode
0.125.4: patrick crews 2011-10-13 Further progress on using mysql / percona
trees + creation of randgen tests / grammar dir for percona
0.125.3: patrick crews 2011-10-12 Further tweaks for mysql / percona
goodness
0.125.2: patrick crews 2011-10-10 Additional code to run mysql+percona
servers
0.125.1: patrick crews 2011-10-05 Initial branch
_______________________________________________
Mailing list: https://launchpad.net/~drizzle-benchmark
Post to : [email protected]
Unsubscribe : https://launchpad.net/~drizzle-benchmark
More help : https://help.launchpad.net/ListHelp
