[jira] [Updated] (CASSANDRA-7011) auth_test system_auth_ks_is_alterable_test dtest hangs in 2.1 and 2.0

2014-08-06 Thread Philip Thompson (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-7011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Philip Thompson updated CASSANDRA-7011:
---

Labels: qa-resolved  (was: )

> auth_test system_auth_ks_is_alterable_test dtest hangs in 2.1 and 2.0
> -
>
> Key: CASSANDRA-7011
> URL: https://issues.apache.org/jira/browse/CASSANDRA-7011
> Project: Cassandra
>  Issue Type: Test
>  Components: Tests
>Reporter: Michael Shuler
>Assignee: Philip Thompson
>  Labels: qa-resolved
> Fix For: 2.0.10
>
> Attachments: node1_system.log-7011.txt
>
>
> This test hangs forever. When I hit ctl-c after running the test, then the 
> ccm nodes actually continue running - I think ccm is looking for log lines 
> that never occur until the test is killed(?).
> {noformat}
> $ export MAX_HEAP_SIZE="1G"; export HEAP_NEWSIZE="256M"; ENABLE_VNODES=true 
> PRINT_DEBUG=true nosetests --nocapture --nologcapture --verbosity=3 
> auth_test.py:TestAuth.system_auth_ks_is_alterable_test
> nose.config: INFO: Ignoring files matching ['^\\.', '^_', '^setup\\.py$']
> system_auth_ks_is_alterable_test (auth_test.TestAuth) ... cluster ccm 
> directory: /tmp/dtest-O3AAJr
> ^C
> {noformat}
> Search for (hanging here) below - I typed this prior to hitting ctl-c. Then 
> the nodes start running again and I see "Listening for thrift clients" later 
> on.
> {noformat}
> mshuler@hana:~$ tail -f /tmp/dtest-O3AAJr/test/node*/logs/system.log
> ==> /tmp/dtest-O3AAJr/test/node1/logs/system.log <==
> INFO  [MemtableFlushWriter:2] 2014-04-08 16:45:12,599 Memtable.java:344 - 
> Writing Memtable-schema_columnfamilies@1792243696(1627 serialized bytes, 27 
> ops, 0%/0% of on/off-heap limit)
> INFO  [CompactionExecutor:2] 2014-04-08 16:45:12,603 CompactionTask.java:287 
> - Compacted 4 sstables to 
> [/tmp/dtest-O3AAJr/test/node1/data/system/schema_columns-296e9c049bec3085827dc17d3df2122a/system-schema_columns-ka-13,].
>   14,454 bytes to 11,603 (~80% of original) in 105ms = 0.105386MB/s.  7 total 
> partitions merged to 3.  Partition merge counts were {1:1, 2:1, 4:1, }
> INFO  [MemtableFlushWriter:2] 2014-04-08 16:45:12,668 Memtable.java:378 - 
> Completed flushing 
> /tmp/dtest-O3AAJr/test/node1/flush/system/schema_columnfamilies-45f5b36024bc3f83a3631034ea4fa697/system-schema_columnfamilies-ka-14-Data.db
>  (956 bytes) for commitlog position ReplayPosition(segmentId=1396993504671, 
> position=193292)
> INFO  [MigrationStage:1] 2014-04-08 16:45:12,669 ColumnFamilyStore.java:853 - 
> Enqueuing flush of schema_columns: 6806 (0%) on-heap, 0 (0%) off-heap
> INFO  [MemtableFlushWriter:1] 2014-04-08 16:45:12,670 Memtable.java:344 - 
> Writing Memtable-schema_columns@352928691(1014 serialized bytes, 21 ops, 
> 0%/0% of on/off-heap limit)
> INFO  [CompactionExecutor:1] 2014-04-08 16:45:12,672 CompactionTask.java:287 
> - Compacted 4 sstables to 
> [/tmp/dtest-O3AAJr/test/node1/data/system/schema_keyspaces-b0f2235744583cdb9631c43e59ce3676/system-schema_keyspaces-ka-17,].
>   710 bytes to 233 (~32% of original) in 70ms = 0.003174MB/s.  6 total 
> partitions merged to 3.  Partition merge counts were {1:2, 4:1, }
> INFO  [MemtableFlushWriter:1] 2014-04-08 16:45:12,721 Memtable.java:378 - 
> Completed flushing 
> /tmp/dtest-O3AAJr/test/node1/flush/system/schema_columns-296e9c049bec3085827dc17d3df2122a/system-schema_columns-ka-14-Data.db
>  (435 bytes) for commitlog position ReplayPosition(segmentId=1396993504671, 
> position=193830)
> WARN  [NonPeriodicTasks:1] 2014-04-08 16:45:20,566 FBUtilities.java:359 - 
> Trigger directory doesn't exist, please create it and try again.
> INFO  [NonPeriodicTasks:1] 2014-04-08 16:45:20,570 
> PasswordAuthenticator.java:220 - PasswordAuthenticator created default user 
> 'cassandra'
> INFO  [NonPeriodicTasks:1] 2014-04-08 16:45:21,806 Auth.java:232 - Created 
> default superuser 'cassandra'
> ==> /tmp/dtest-O3AAJr/test/node2/logs/system.log <==
> INFO  [InternalResponseStage:4] 2014-04-08 16:45:12,214 
> ColumnFamilyStore.java:853 - Enqueuing flush of schema_keyspaces: 1004 (0%) 
> on-heap, 0 (0%) off-heap
> INFO  [MemtableFlushWriter:1] 2014-04-08 16:45:12,215 Memtable.java:344 - 
> Writing Memtable-schema_keyspaces@781373873(276 serialized bytes, 6 ops, 
> 0%/0% of on/off-heap limit)
> INFO  [MemtableFlushWriter:1] 2014-04-08 16:45:12,295 Memtable.java:378 - 
> Completed flushing 
> /tmp/dtest-O3AAJr/test/node2/flush/system/schema_keyspaces-b0f2235744583cdb9631c43e59ce3676/system-schema_keyspaces-ka-15-Data.db
>  (179 bytes) for commitlog position ReplayPosition(segmentId=1396993504760, 
> position=243552)
> INFO  [InternalResponseStage:4] 2014-04-08 16:45:12,296 
> ColumnFamilyStore.java:853 - Enqueuing flush of schema_columnfamilies: 34190 
> (0%) on-heap, 0 (0%) off-heap
> INFO  [MemtableFlu

[jira] [Updated] (CASSANDRA-7011) auth_test system_auth_ks_is_alterable_test dtest hangs in 2.1 and 2.0

2014-08-04 Thread Michael Shuler (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-7011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Michael Shuler updated CASSANDRA-7011:
--

Attachment: node1_system.log-7011.txt

Attached ccm node1 system.log from alter_cf_auth_test hanging.  CCM never marks 
the node as up, since it's looking for "Listening for thrift clients..."

{{$ nosetests --verbosity=3 --with-xunit --nocapture --nologcapture 
auth_test.py}} hung on the first test and needed to be interrupted.

Prior to hitting ctl-c on the nosetest, I appended "hanging here.." in the 
system.log - only after interrupting the nosetest, does the node log 
"Initializing system_auth.permissions" and onward, finally starting up fully.

> auth_test system_auth_ks_is_alterable_test dtest hangs in 2.1 and 2.0
> -
>
> Key: CASSANDRA-7011
> URL: https://issues.apache.org/jira/browse/CASSANDRA-7011
> Project: Cassandra
>  Issue Type: Test
>  Components: Tests
>Reporter: Michael Shuler
>Assignee: Michael Shuler
> Fix For: 2.0.10
>
> Attachments: node1_system.log-7011.txt
>
>
> This test hangs forever. When I hit ctl-c after running the test, then the 
> ccm nodes actually continue running - I think ccm is looking for log lines 
> that never occur until the test is killed(?).
> {noformat}
> $ export MAX_HEAP_SIZE="1G"; export HEAP_NEWSIZE="256M"; ENABLE_VNODES=true 
> PRINT_DEBUG=true nosetests --nocapture --nologcapture --verbosity=3 
> auth_test.py:TestAuth.system_auth_ks_is_alterable_test
> nose.config: INFO: Ignoring files matching ['^\\.', '^_', '^setup\\.py$']
> system_auth_ks_is_alterable_test (auth_test.TestAuth) ... cluster ccm 
> directory: /tmp/dtest-O3AAJr
> ^C
> {noformat}
> Search for (hanging here) below - I typed this prior to hitting ctl-c. Then 
> the nodes start running again and I see "Listening for thrift clients" later 
> on.
> {noformat}
> mshuler@hana:~$ tail -f /tmp/dtest-O3AAJr/test/node*/logs/system.log
> ==> /tmp/dtest-O3AAJr/test/node1/logs/system.log <==
> INFO  [MemtableFlushWriter:2] 2014-04-08 16:45:12,599 Memtable.java:344 - 
> Writing Memtable-schema_columnfamilies@1792243696(1627 serialized bytes, 27 
> ops, 0%/0% of on/off-heap limit)
> INFO  [CompactionExecutor:2] 2014-04-08 16:45:12,603 CompactionTask.java:287 
> - Compacted 4 sstables to 
> [/tmp/dtest-O3AAJr/test/node1/data/system/schema_columns-296e9c049bec3085827dc17d3df2122a/system-schema_columns-ka-13,].
>   14,454 bytes to 11,603 (~80% of original) in 105ms = 0.105386MB/s.  7 total 
> partitions merged to 3.  Partition merge counts were {1:1, 2:1, 4:1, }
> INFO  [MemtableFlushWriter:2] 2014-04-08 16:45:12,668 Memtable.java:378 - 
> Completed flushing 
> /tmp/dtest-O3AAJr/test/node1/flush/system/schema_columnfamilies-45f5b36024bc3f83a3631034ea4fa697/system-schema_columnfamilies-ka-14-Data.db
>  (956 bytes) for commitlog position ReplayPosition(segmentId=1396993504671, 
> position=193292)
> INFO  [MigrationStage:1] 2014-04-08 16:45:12,669 ColumnFamilyStore.java:853 - 
> Enqueuing flush of schema_columns: 6806 (0%) on-heap, 0 (0%) off-heap
> INFO  [MemtableFlushWriter:1] 2014-04-08 16:45:12,670 Memtable.java:344 - 
> Writing Memtable-schema_columns@352928691(1014 serialized bytes, 21 ops, 
> 0%/0% of on/off-heap limit)
> INFO  [CompactionExecutor:1] 2014-04-08 16:45:12,672 CompactionTask.java:287 
> - Compacted 4 sstables to 
> [/tmp/dtest-O3AAJr/test/node1/data/system/schema_keyspaces-b0f2235744583cdb9631c43e59ce3676/system-schema_keyspaces-ka-17,].
>   710 bytes to 233 (~32% of original) in 70ms = 0.003174MB/s.  6 total 
> partitions merged to 3.  Partition merge counts were {1:2, 4:1, }
> INFO  [MemtableFlushWriter:1] 2014-04-08 16:45:12,721 Memtable.java:378 - 
> Completed flushing 
> /tmp/dtest-O3AAJr/test/node1/flush/system/schema_columns-296e9c049bec3085827dc17d3df2122a/system-schema_columns-ka-14-Data.db
>  (435 bytes) for commitlog position ReplayPosition(segmentId=1396993504671, 
> position=193830)
> WARN  [NonPeriodicTasks:1] 2014-04-08 16:45:20,566 FBUtilities.java:359 - 
> Trigger directory doesn't exist, please create it and try again.
> INFO  [NonPeriodicTasks:1] 2014-04-08 16:45:20,570 
> PasswordAuthenticator.java:220 - PasswordAuthenticator created default user 
> 'cassandra'
> INFO  [NonPeriodicTasks:1] 2014-04-08 16:45:21,806 Auth.java:232 - Created 
> default superuser 'cassandra'
> ==> /tmp/dtest-O3AAJr/test/node2/logs/system.log <==
> INFO  [InternalResponseStage:4] 2014-04-08 16:45:12,214 
> ColumnFamilyStore.java:853 - Enqueuing flush of schema_keyspaces: 1004 (0%) 
> on-heap, 0 (0%) off-heap
> INFO  [MemtableFlushWriter:1] 2014-04-08 16:45:12,215 Memtable.java:344 - 
> Writing Memtable-schema_keyspaces@781373873(276 serialized bytes, 6 ops, 
> 0%/0% of on/off-heap limit)
> INFO  [MemtableFlushWriter:1]

[jira] [Updated] (CASSANDRA-7011) auth_test system_auth_ks_is_alterable_test dtest hangs in 2.1 and 2.0

2014-08-04 Thread Michael Shuler (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-7011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Michael Shuler updated CASSANDRA-7011:
--

Assignee: Philip Thompson  (was: Michael Shuler)

> auth_test system_auth_ks_is_alterable_test dtest hangs in 2.1 and 2.0
> -
>
> Key: CASSANDRA-7011
> URL: https://issues.apache.org/jira/browse/CASSANDRA-7011
> Project: Cassandra
>  Issue Type: Test
>  Components: Tests
>Reporter: Michael Shuler
>Assignee: Philip Thompson
> Fix For: 2.0.10
>
> Attachments: node1_system.log-7011.txt
>
>
> This test hangs forever. When I hit ctl-c after running the test, then the 
> ccm nodes actually continue running - I think ccm is looking for log lines 
> that never occur until the test is killed(?).
> {noformat}
> $ export MAX_HEAP_SIZE="1G"; export HEAP_NEWSIZE="256M"; ENABLE_VNODES=true 
> PRINT_DEBUG=true nosetests --nocapture --nologcapture --verbosity=3 
> auth_test.py:TestAuth.system_auth_ks_is_alterable_test
> nose.config: INFO: Ignoring files matching ['^\\.', '^_', '^setup\\.py$']
> system_auth_ks_is_alterable_test (auth_test.TestAuth) ... cluster ccm 
> directory: /tmp/dtest-O3AAJr
> ^C
> {noformat}
> Search for (hanging here) below - I typed this prior to hitting ctl-c. Then 
> the nodes start running again and I see "Listening for thrift clients" later 
> on.
> {noformat}
> mshuler@hana:~$ tail -f /tmp/dtest-O3AAJr/test/node*/logs/system.log
> ==> /tmp/dtest-O3AAJr/test/node1/logs/system.log <==
> INFO  [MemtableFlushWriter:2] 2014-04-08 16:45:12,599 Memtable.java:344 - 
> Writing Memtable-schema_columnfamilies@1792243696(1627 serialized bytes, 27 
> ops, 0%/0% of on/off-heap limit)
> INFO  [CompactionExecutor:2] 2014-04-08 16:45:12,603 CompactionTask.java:287 
> - Compacted 4 sstables to 
> [/tmp/dtest-O3AAJr/test/node1/data/system/schema_columns-296e9c049bec3085827dc17d3df2122a/system-schema_columns-ka-13,].
>   14,454 bytes to 11,603 (~80% of original) in 105ms = 0.105386MB/s.  7 total 
> partitions merged to 3.  Partition merge counts were {1:1, 2:1, 4:1, }
> INFO  [MemtableFlushWriter:2] 2014-04-08 16:45:12,668 Memtable.java:378 - 
> Completed flushing 
> /tmp/dtest-O3AAJr/test/node1/flush/system/schema_columnfamilies-45f5b36024bc3f83a3631034ea4fa697/system-schema_columnfamilies-ka-14-Data.db
>  (956 bytes) for commitlog position ReplayPosition(segmentId=1396993504671, 
> position=193292)
> INFO  [MigrationStage:1] 2014-04-08 16:45:12,669 ColumnFamilyStore.java:853 - 
> Enqueuing flush of schema_columns: 6806 (0%) on-heap, 0 (0%) off-heap
> INFO  [MemtableFlushWriter:1] 2014-04-08 16:45:12,670 Memtable.java:344 - 
> Writing Memtable-schema_columns@352928691(1014 serialized bytes, 21 ops, 
> 0%/0% of on/off-heap limit)
> INFO  [CompactionExecutor:1] 2014-04-08 16:45:12,672 CompactionTask.java:287 
> - Compacted 4 sstables to 
> [/tmp/dtest-O3AAJr/test/node1/data/system/schema_keyspaces-b0f2235744583cdb9631c43e59ce3676/system-schema_keyspaces-ka-17,].
>   710 bytes to 233 (~32% of original) in 70ms = 0.003174MB/s.  6 total 
> partitions merged to 3.  Partition merge counts were {1:2, 4:1, }
> INFO  [MemtableFlushWriter:1] 2014-04-08 16:45:12,721 Memtable.java:378 - 
> Completed flushing 
> /tmp/dtest-O3AAJr/test/node1/flush/system/schema_columns-296e9c049bec3085827dc17d3df2122a/system-schema_columns-ka-14-Data.db
>  (435 bytes) for commitlog position ReplayPosition(segmentId=1396993504671, 
> position=193830)
> WARN  [NonPeriodicTasks:1] 2014-04-08 16:45:20,566 FBUtilities.java:359 - 
> Trigger directory doesn't exist, please create it and try again.
> INFO  [NonPeriodicTasks:1] 2014-04-08 16:45:20,570 
> PasswordAuthenticator.java:220 - PasswordAuthenticator created default user 
> 'cassandra'
> INFO  [NonPeriodicTasks:1] 2014-04-08 16:45:21,806 Auth.java:232 - Created 
> default superuser 'cassandra'
> ==> /tmp/dtest-O3AAJr/test/node2/logs/system.log <==
> INFO  [InternalResponseStage:4] 2014-04-08 16:45:12,214 
> ColumnFamilyStore.java:853 - Enqueuing flush of schema_keyspaces: 1004 (0%) 
> on-heap, 0 (0%) off-heap
> INFO  [MemtableFlushWriter:1] 2014-04-08 16:45:12,215 Memtable.java:344 - 
> Writing Memtable-schema_keyspaces@781373873(276 serialized bytes, 6 ops, 
> 0%/0% of on/off-heap limit)
> INFO  [MemtableFlushWriter:1] 2014-04-08 16:45:12,295 Memtable.java:378 - 
> Completed flushing 
> /tmp/dtest-O3AAJr/test/node2/flush/system/schema_keyspaces-b0f2235744583cdb9631c43e59ce3676/system-schema_keyspaces-ka-15-Data.db
>  (179 bytes) for commitlog position ReplayPosition(segmentId=1396993504760, 
> position=243552)
> INFO  [InternalResponseStage:4] 2014-04-08 16:45:12,296 
> ColumnFamilyStore.java:853 - Enqueuing flush of schema_columnfamilies: 34190 
> (0%) on-heap, 0 (0%) off-heap
> INFO  [MemtableFlushWriter:2] 2014-

[jira] [Updated] (CASSANDRA-7011) auth_test system_auth_ks_is_alterable_test dtest hangs in 2.1 and 2.0

2014-06-09 Thread Jonathan Ellis (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-7011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jonathan Ellis updated CASSANDRA-7011:
--

Fix Version/s: (was: 2.1.0)
   2.0.9

> auth_test system_auth_ks_is_alterable_test dtest hangs in 2.1 and 2.0
> -
>
> Key: CASSANDRA-7011
> URL: https://issues.apache.org/jira/browse/CASSANDRA-7011
> Project: Cassandra
>  Issue Type: Test
>  Components: Tests
>Reporter: Michael Shuler
>Assignee: Michael Shuler
> Fix For: 2.0.9
>
>
> This test hangs forever. When I hit ctl-c after running the test, then the 
> ccm nodes actually continue running - I think ccm is looking for log lines 
> that never occur until the test is killed(?).
> {noformat}
> $ export MAX_HEAP_SIZE="1G"; export HEAP_NEWSIZE="256M"; ENABLE_VNODES=true 
> PRINT_DEBUG=true nosetests --nocapture --nologcapture --verbosity=3 
> auth_test.py:TestAuth.system_auth_ks_is_alterable_test
> nose.config: INFO: Ignoring files matching ['^\\.', '^_', '^setup\\.py$']
> system_auth_ks_is_alterable_test (auth_test.TestAuth) ... cluster ccm 
> directory: /tmp/dtest-O3AAJr
> ^C
> {noformat}
> Search for (hanging here) below - I typed this prior to hitting ctl-c. Then 
> the nodes start running again and I see "Listening for thrift clients" later 
> on.
> {noformat}
> mshuler@hana:~$ tail -f /tmp/dtest-O3AAJr/test/node*/logs/system.log
> ==> /tmp/dtest-O3AAJr/test/node1/logs/system.log <==
> INFO  [MemtableFlushWriter:2] 2014-04-08 16:45:12,599 Memtable.java:344 - 
> Writing Memtable-schema_columnfamilies@1792243696(1627 serialized bytes, 27 
> ops, 0%/0% of on/off-heap limit)
> INFO  [CompactionExecutor:2] 2014-04-08 16:45:12,603 CompactionTask.java:287 
> - Compacted 4 sstables to 
> [/tmp/dtest-O3AAJr/test/node1/data/system/schema_columns-296e9c049bec3085827dc17d3df2122a/system-schema_columns-ka-13,].
>   14,454 bytes to 11,603 (~80% of original) in 105ms = 0.105386MB/s.  7 total 
> partitions merged to 3.  Partition merge counts were {1:1, 2:1, 4:1, }
> INFO  [MemtableFlushWriter:2] 2014-04-08 16:45:12,668 Memtable.java:378 - 
> Completed flushing 
> /tmp/dtest-O3AAJr/test/node1/flush/system/schema_columnfamilies-45f5b36024bc3f83a3631034ea4fa697/system-schema_columnfamilies-ka-14-Data.db
>  (956 bytes) for commitlog position ReplayPosition(segmentId=1396993504671, 
> position=193292)
> INFO  [MigrationStage:1] 2014-04-08 16:45:12,669 ColumnFamilyStore.java:853 - 
> Enqueuing flush of schema_columns: 6806 (0%) on-heap, 0 (0%) off-heap
> INFO  [MemtableFlushWriter:1] 2014-04-08 16:45:12,670 Memtable.java:344 - 
> Writing Memtable-schema_columns@352928691(1014 serialized bytes, 21 ops, 
> 0%/0% of on/off-heap limit)
> INFO  [CompactionExecutor:1] 2014-04-08 16:45:12,672 CompactionTask.java:287 
> - Compacted 4 sstables to 
> [/tmp/dtest-O3AAJr/test/node1/data/system/schema_keyspaces-b0f2235744583cdb9631c43e59ce3676/system-schema_keyspaces-ka-17,].
>   710 bytes to 233 (~32% of original) in 70ms = 0.003174MB/s.  6 total 
> partitions merged to 3.  Partition merge counts were {1:2, 4:1, }
> INFO  [MemtableFlushWriter:1] 2014-04-08 16:45:12,721 Memtable.java:378 - 
> Completed flushing 
> /tmp/dtest-O3AAJr/test/node1/flush/system/schema_columns-296e9c049bec3085827dc17d3df2122a/system-schema_columns-ka-14-Data.db
>  (435 bytes) for commitlog position ReplayPosition(segmentId=1396993504671, 
> position=193830)
> WARN  [NonPeriodicTasks:1] 2014-04-08 16:45:20,566 FBUtilities.java:359 - 
> Trigger directory doesn't exist, please create it and try again.
> INFO  [NonPeriodicTasks:1] 2014-04-08 16:45:20,570 
> PasswordAuthenticator.java:220 - PasswordAuthenticator created default user 
> 'cassandra'
> INFO  [NonPeriodicTasks:1] 2014-04-08 16:45:21,806 Auth.java:232 - Created 
> default superuser 'cassandra'
> ==> /tmp/dtest-O3AAJr/test/node2/logs/system.log <==
> INFO  [InternalResponseStage:4] 2014-04-08 16:45:12,214 
> ColumnFamilyStore.java:853 - Enqueuing flush of schema_keyspaces: 1004 (0%) 
> on-heap, 0 (0%) off-heap
> INFO  [MemtableFlushWriter:1] 2014-04-08 16:45:12,215 Memtable.java:344 - 
> Writing Memtable-schema_keyspaces@781373873(276 serialized bytes, 6 ops, 
> 0%/0% of on/off-heap limit)
> INFO  [MemtableFlushWriter:1] 2014-04-08 16:45:12,295 Memtable.java:378 - 
> Completed flushing 
> /tmp/dtest-O3AAJr/test/node2/flush/system/schema_keyspaces-b0f2235744583cdb9631c43e59ce3676/system-schema_keyspaces-ka-15-Data.db
>  (179 bytes) for commitlog position ReplayPosition(segmentId=1396993504760, 
> position=243552)
> INFO  [InternalResponseStage:4] 2014-04-08 16:45:12,296 
> ColumnFamilyStore.java:853 - Enqueuing flush of schema_columnfamilies: 34190 
> (0%) on-heap, 0 (0%) off-heap
> INFO  [MemtableFlushWriter:2] 2014-04-08 16:45:12,297 Memtable.java:344 - 
> Wri

[jira] [Updated] (CASSANDRA-7011) auth_test system_auth_ks_is_alterable_test dtest hangs in 2.1 and 2.0

2014-05-20 Thread Aleksey Yeschenko (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-7011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Aleksey Yeschenko updated CASSANDRA-7011:
-

Assignee: Michael Shuler  (was: Aleksey Yeschenko)

> auth_test system_auth_ks_is_alterable_test dtest hangs in 2.1 and 2.0
> -
>
> Key: CASSANDRA-7011
> URL: https://issues.apache.org/jira/browse/CASSANDRA-7011
> Project: Cassandra
>  Issue Type: Test
>  Components: Tests
>Reporter: Michael Shuler
>Assignee: Michael Shuler
> Fix For: 2.1 rc1
>
>
> This test hangs forever. When I hit ctl-c after running the test, then the 
> ccm nodes actually continue running - I think ccm is looking for log lines 
> that never occur until the test is killed(?).
> {noformat}
> $ export MAX_HEAP_SIZE="1G"; export HEAP_NEWSIZE="256M"; ENABLE_VNODES=true 
> PRINT_DEBUG=true nosetests --nocapture --nologcapture --verbosity=3 
> auth_test.py:TestAuth.system_auth_ks_is_alterable_test
> nose.config: INFO: Ignoring files matching ['^\\.', '^_', '^setup\\.py$']
> system_auth_ks_is_alterable_test (auth_test.TestAuth) ... cluster ccm 
> directory: /tmp/dtest-O3AAJr
> ^C
> {noformat}
> Search for (hanging here) below - I typed this prior to hitting ctl-c. Then 
> the nodes start running again and I see "Listening for thrift clients" later 
> on.
> {noformat}
> mshuler@hana:~$ tail -f /tmp/dtest-O3AAJr/test/node*/logs/system.log
> ==> /tmp/dtest-O3AAJr/test/node1/logs/system.log <==
> INFO  [MemtableFlushWriter:2] 2014-04-08 16:45:12,599 Memtable.java:344 - 
> Writing Memtable-schema_columnfamilies@1792243696(1627 serialized bytes, 27 
> ops, 0%/0% of on/off-heap limit)
> INFO  [CompactionExecutor:2] 2014-04-08 16:45:12,603 CompactionTask.java:287 
> - Compacted 4 sstables to 
> [/tmp/dtest-O3AAJr/test/node1/data/system/schema_columns-296e9c049bec3085827dc17d3df2122a/system-schema_columns-ka-13,].
>   14,454 bytes to 11,603 (~80% of original) in 105ms = 0.105386MB/s.  7 total 
> partitions merged to 3.  Partition merge counts were {1:1, 2:1, 4:1, }
> INFO  [MemtableFlushWriter:2] 2014-04-08 16:45:12,668 Memtable.java:378 - 
> Completed flushing 
> /tmp/dtest-O3AAJr/test/node1/flush/system/schema_columnfamilies-45f5b36024bc3f83a3631034ea4fa697/system-schema_columnfamilies-ka-14-Data.db
>  (956 bytes) for commitlog position ReplayPosition(segmentId=1396993504671, 
> position=193292)
> INFO  [MigrationStage:1] 2014-04-08 16:45:12,669 ColumnFamilyStore.java:853 - 
> Enqueuing flush of schema_columns: 6806 (0%) on-heap, 0 (0%) off-heap
> INFO  [MemtableFlushWriter:1] 2014-04-08 16:45:12,670 Memtable.java:344 - 
> Writing Memtable-schema_columns@352928691(1014 serialized bytes, 21 ops, 
> 0%/0% of on/off-heap limit)
> INFO  [CompactionExecutor:1] 2014-04-08 16:45:12,672 CompactionTask.java:287 
> - Compacted 4 sstables to 
> [/tmp/dtest-O3AAJr/test/node1/data/system/schema_keyspaces-b0f2235744583cdb9631c43e59ce3676/system-schema_keyspaces-ka-17,].
>   710 bytes to 233 (~32% of original) in 70ms = 0.003174MB/s.  6 total 
> partitions merged to 3.  Partition merge counts were {1:2, 4:1, }
> INFO  [MemtableFlushWriter:1] 2014-04-08 16:45:12,721 Memtable.java:378 - 
> Completed flushing 
> /tmp/dtest-O3AAJr/test/node1/flush/system/schema_columns-296e9c049bec3085827dc17d3df2122a/system-schema_columns-ka-14-Data.db
>  (435 bytes) for commitlog position ReplayPosition(segmentId=1396993504671, 
> position=193830)
> WARN  [NonPeriodicTasks:1] 2014-04-08 16:45:20,566 FBUtilities.java:359 - 
> Trigger directory doesn't exist, please create it and try again.
> INFO  [NonPeriodicTasks:1] 2014-04-08 16:45:20,570 
> PasswordAuthenticator.java:220 - PasswordAuthenticator created default user 
> 'cassandra'
> INFO  [NonPeriodicTasks:1] 2014-04-08 16:45:21,806 Auth.java:232 - Created 
> default superuser 'cassandra'
> ==> /tmp/dtest-O3AAJr/test/node2/logs/system.log <==
> INFO  [InternalResponseStage:4] 2014-04-08 16:45:12,214 
> ColumnFamilyStore.java:853 - Enqueuing flush of schema_keyspaces: 1004 (0%) 
> on-heap, 0 (0%) off-heap
> INFO  [MemtableFlushWriter:1] 2014-04-08 16:45:12,215 Memtable.java:344 - 
> Writing Memtable-schema_keyspaces@781373873(276 serialized bytes, 6 ops, 
> 0%/0% of on/off-heap limit)
> INFO  [MemtableFlushWriter:1] 2014-04-08 16:45:12,295 Memtable.java:378 - 
> Completed flushing 
> /tmp/dtest-O3AAJr/test/node2/flush/system/schema_keyspaces-b0f2235744583cdb9631c43e59ce3676/system-schema_keyspaces-ka-15-Data.db
>  (179 bytes) for commitlog position ReplayPosition(segmentId=1396993504760, 
> position=243552)
> INFO  [InternalResponseStage:4] 2014-04-08 16:45:12,296 
> ColumnFamilyStore.java:853 - Enqueuing flush of schema_columnfamilies: 34190 
> (0%) on-heap, 0 (0%) off-heap
> INFO  [MemtableFlushWriter:2] 2014-04-08 16:45:12,297 Memtable.java:344 - 
> W

[jira] [Updated] (CASSANDRA-7011) auth_test system_auth_ks_is_alterable_test dtest hangs in 2.1 and 2.0

2014-05-02 Thread Ryan McGuire (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-7011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ryan McGuire updated CASSANDRA-7011:


Fix Version/s: 2.1 rc1

> auth_test system_auth_ks_is_alterable_test dtest hangs in 2.1 and 2.0
> -
>
> Key: CASSANDRA-7011
> URL: https://issues.apache.org/jira/browse/CASSANDRA-7011
> Project: Cassandra
>  Issue Type: Test
>  Components: Tests
>Reporter: Michael Shuler
>Assignee: Aleksey Yeschenko
> Fix For: 2.1 rc1
>
>
> This test hangs forever. When I hit ctl-c after running the test, then the 
> ccm nodes actually continue running - I think ccm is looking for log lines 
> that never occur until the test is killed(?).
> {noformat}
> $ export MAX_HEAP_SIZE="1G"; export HEAP_NEWSIZE="256M"; ENABLE_VNODES=true 
> PRINT_DEBUG=true nosetests --nocapture --nologcapture --verbosity=3 
> auth_test.py:TestAuth.system_auth_ks_is_alterable_test
> nose.config: INFO: Ignoring files matching ['^\\.', '^_', '^setup\\.py$']
> system_auth_ks_is_alterable_test (auth_test.TestAuth) ... cluster ccm 
> directory: /tmp/dtest-O3AAJr
> ^C
> {noformat}
> Search for (hanging here) below - I typed this prior to hitting ctl-c. Then 
> the nodes start running again and I see "Listening for thrift clients" later 
> on.
> {noformat}
> mshuler@hana:~$ tail -f /tmp/dtest-O3AAJr/test/node*/logs/system.log
> ==> /tmp/dtest-O3AAJr/test/node1/logs/system.log <==
> INFO  [MemtableFlushWriter:2] 2014-04-08 16:45:12,599 Memtable.java:344 - 
> Writing Memtable-schema_columnfamilies@1792243696(1627 serialized bytes, 27 
> ops, 0%/0% of on/off-heap limit)
> INFO  [CompactionExecutor:2] 2014-04-08 16:45:12,603 CompactionTask.java:287 
> - Compacted 4 sstables to 
> [/tmp/dtest-O3AAJr/test/node1/data/system/schema_columns-296e9c049bec3085827dc17d3df2122a/system-schema_columns-ka-13,].
>   14,454 bytes to 11,603 (~80% of original) in 105ms = 0.105386MB/s.  7 total 
> partitions merged to 3.  Partition merge counts were {1:1, 2:1, 4:1, }
> INFO  [MemtableFlushWriter:2] 2014-04-08 16:45:12,668 Memtable.java:378 - 
> Completed flushing 
> /tmp/dtest-O3AAJr/test/node1/flush/system/schema_columnfamilies-45f5b36024bc3f83a3631034ea4fa697/system-schema_columnfamilies-ka-14-Data.db
>  (956 bytes) for commitlog position ReplayPosition(segmentId=1396993504671, 
> position=193292)
> INFO  [MigrationStage:1] 2014-04-08 16:45:12,669 ColumnFamilyStore.java:853 - 
> Enqueuing flush of schema_columns: 6806 (0%) on-heap, 0 (0%) off-heap
> INFO  [MemtableFlushWriter:1] 2014-04-08 16:45:12,670 Memtable.java:344 - 
> Writing Memtable-schema_columns@352928691(1014 serialized bytes, 21 ops, 
> 0%/0% of on/off-heap limit)
> INFO  [CompactionExecutor:1] 2014-04-08 16:45:12,672 CompactionTask.java:287 
> - Compacted 4 sstables to 
> [/tmp/dtest-O3AAJr/test/node1/data/system/schema_keyspaces-b0f2235744583cdb9631c43e59ce3676/system-schema_keyspaces-ka-17,].
>   710 bytes to 233 (~32% of original) in 70ms = 0.003174MB/s.  6 total 
> partitions merged to 3.  Partition merge counts were {1:2, 4:1, }
> INFO  [MemtableFlushWriter:1] 2014-04-08 16:45:12,721 Memtable.java:378 - 
> Completed flushing 
> /tmp/dtest-O3AAJr/test/node1/flush/system/schema_columns-296e9c049bec3085827dc17d3df2122a/system-schema_columns-ka-14-Data.db
>  (435 bytes) for commitlog position ReplayPosition(segmentId=1396993504671, 
> position=193830)
> WARN  [NonPeriodicTasks:1] 2014-04-08 16:45:20,566 FBUtilities.java:359 - 
> Trigger directory doesn't exist, please create it and try again.
> INFO  [NonPeriodicTasks:1] 2014-04-08 16:45:20,570 
> PasswordAuthenticator.java:220 - PasswordAuthenticator created default user 
> 'cassandra'
> INFO  [NonPeriodicTasks:1] 2014-04-08 16:45:21,806 Auth.java:232 - Created 
> default superuser 'cassandra'
> ==> /tmp/dtest-O3AAJr/test/node2/logs/system.log <==
> INFO  [InternalResponseStage:4] 2014-04-08 16:45:12,214 
> ColumnFamilyStore.java:853 - Enqueuing flush of schema_keyspaces: 1004 (0%) 
> on-heap, 0 (0%) off-heap
> INFO  [MemtableFlushWriter:1] 2014-04-08 16:45:12,215 Memtable.java:344 - 
> Writing Memtable-schema_keyspaces@781373873(276 serialized bytes, 6 ops, 
> 0%/0% of on/off-heap limit)
> INFO  [MemtableFlushWriter:1] 2014-04-08 16:45:12,295 Memtable.java:378 - 
> Completed flushing 
> /tmp/dtest-O3AAJr/test/node2/flush/system/schema_keyspaces-b0f2235744583cdb9631c43e59ce3676/system-schema_keyspaces-ka-15-Data.db
>  (179 bytes) for commitlog position ReplayPosition(segmentId=1396993504760, 
> position=243552)
> INFO  [InternalResponseStage:4] 2014-04-08 16:45:12,296 
> ColumnFamilyStore.java:853 - Enqueuing flush of schema_columnfamilies: 34190 
> (0%) on-heap, 0 (0%) off-heap
> INFO  [MemtableFlushWriter:2] 2014-04-08 16:45:12,297 Memtable.java:344 - 
> Writing Memtable-schema_columnfamili

[jira] [Updated] (CASSANDRA-7011) auth_test system_auth_ks_is_alterable_test dtest hangs in 2.1 and 2.0

2014-04-29 Thread Ryan McGuire (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-7011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ryan McGuire updated CASSANDRA-7011:


Flagged: Impediment

> auth_test system_auth_ks_is_alterable_test dtest hangs in 2.1 and 2.0
> -
>
> Key: CASSANDRA-7011
> URL: https://issues.apache.org/jira/browse/CASSANDRA-7011
> Project: Cassandra
>  Issue Type: Test
>  Components: Tests
>Reporter: Michael Shuler
>Assignee: Aleksey Yeschenko
>
> This test hangs forever. When I hit ctl-c after running the test, then the 
> ccm nodes actually continue running - I think ccm is looking for log lines 
> that never occur until the test is killed(?).
> {noformat}
> $ export MAX_HEAP_SIZE="1G"; export HEAP_NEWSIZE="256M"; ENABLE_VNODES=true 
> PRINT_DEBUG=true nosetests --nocapture --nologcapture --verbosity=3 
> auth_test.py:TestAuth.system_auth_ks_is_alterable_test
> nose.config: INFO: Ignoring files matching ['^\\.', '^_', '^setup\\.py$']
> system_auth_ks_is_alterable_test (auth_test.TestAuth) ... cluster ccm 
> directory: /tmp/dtest-O3AAJr
> ^C
> {noformat}
> Search for (hanging here) below - I typed this prior to hitting ctl-c. Then 
> the nodes start running again and I see "Listening for thrift clients" later 
> on.
> {noformat}
> mshuler@hana:~$ tail -f /tmp/dtest-O3AAJr/test/node*/logs/system.log
> ==> /tmp/dtest-O3AAJr/test/node1/logs/system.log <==
> INFO  [MemtableFlushWriter:2] 2014-04-08 16:45:12,599 Memtable.java:344 - 
> Writing Memtable-schema_columnfamilies@1792243696(1627 serialized bytes, 27 
> ops, 0%/0% of on/off-heap limit)
> INFO  [CompactionExecutor:2] 2014-04-08 16:45:12,603 CompactionTask.java:287 
> - Compacted 4 sstables to 
> [/tmp/dtest-O3AAJr/test/node1/data/system/schema_columns-296e9c049bec3085827dc17d3df2122a/system-schema_columns-ka-13,].
>   14,454 bytes to 11,603 (~80% of original) in 105ms = 0.105386MB/s.  7 total 
> partitions merged to 3.  Partition merge counts were {1:1, 2:1, 4:1, }
> INFO  [MemtableFlushWriter:2] 2014-04-08 16:45:12,668 Memtable.java:378 - 
> Completed flushing 
> /tmp/dtest-O3AAJr/test/node1/flush/system/schema_columnfamilies-45f5b36024bc3f83a3631034ea4fa697/system-schema_columnfamilies-ka-14-Data.db
>  (956 bytes) for commitlog position ReplayPosition(segmentId=1396993504671, 
> position=193292)
> INFO  [MigrationStage:1] 2014-04-08 16:45:12,669 ColumnFamilyStore.java:853 - 
> Enqueuing flush of schema_columns: 6806 (0%) on-heap, 0 (0%) off-heap
> INFO  [MemtableFlushWriter:1] 2014-04-08 16:45:12,670 Memtable.java:344 - 
> Writing Memtable-schema_columns@352928691(1014 serialized bytes, 21 ops, 
> 0%/0% of on/off-heap limit)
> INFO  [CompactionExecutor:1] 2014-04-08 16:45:12,672 CompactionTask.java:287 
> - Compacted 4 sstables to 
> [/tmp/dtest-O3AAJr/test/node1/data/system/schema_keyspaces-b0f2235744583cdb9631c43e59ce3676/system-schema_keyspaces-ka-17,].
>   710 bytes to 233 (~32% of original) in 70ms = 0.003174MB/s.  6 total 
> partitions merged to 3.  Partition merge counts were {1:2, 4:1, }
> INFO  [MemtableFlushWriter:1] 2014-04-08 16:45:12,721 Memtable.java:378 - 
> Completed flushing 
> /tmp/dtest-O3AAJr/test/node1/flush/system/schema_columns-296e9c049bec3085827dc17d3df2122a/system-schema_columns-ka-14-Data.db
>  (435 bytes) for commitlog position ReplayPosition(segmentId=1396993504671, 
> position=193830)
> WARN  [NonPeriodicTasks:1] 2014-04-08 16:45:20,566 FBUtilities.java:359 - 
> Trigger directory doesn't exist, please create it and try again.
> INFO  [NonPeriodicTasks:1] 2014-04-08 16:45:20,570 
> PasswordAuthenticator.java:220 - PasswordAuthenticator created default user 
> 'cassandra'
> INFO  [NonPeriodicTasks:1] 2014-04-08 16:45:21,806 Auth.java:232 - Created 
> default superuser 'cassandra'
> ==> /tmp/dtest-O3AAJr/test/node2/logs/system.log <==
> INFO  [InternalResponseStage:4] 2014-04-08 16:45:12,214 
> ColumnFamilyStore.java:853 - Enqueuing flush of schema_keyspaces: 1004 (0%) 
> on-heap, 0 (0%) off-heap
> INFO  [MemtableFlushWriter:1] 2014-04-08 16:45:12,215 Memtable.java:344 - 
> Writing Memtable-schema_keyspaces@781373873(276 serialized bytes, 6 ops, 
> 0%/0% of on/off-heap limit)
> INFO  [MemtableFlushWriter:1] 2014-04-08 16:45:12,295 Memtable.java:378 - 
> Completed flushing 
> /tmp/dtest-O3AAJr/test/node2/flush/system/schema_keyspaces-b0f2235744583cdb9631c43e59ce3676/system-schema_keyspaces-ka-15-Data.db
>  (179 bytes) for commitlog position ReplayPosition(segmentId=1396993504760, 
> position=243552)
> INFO  [InternalResponseStage:4] 2014-04-08 16:45:12,296 
> ColumnFamilyStore.java:853 - Enqueuing flush of schema_columnfamilies: 34190 
> (0%) on-heap, 0 (0%) off-heap
> INFO  [MemtableFlushWriter:2] 2014-04-08 16:45:12,297 Memtable.java:344 - 
> Writing Memtable-schema_columnfamilies@2077216447(5746 serialized bytes,

[jira] [Updated] (CASSANDRA-7011) auth_test system_auth_ks_is_alterable_test dtest hangs in 2.1 and 2.0

2014-04-29 Thread Ryan McGuire (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-7011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ryan McGuire updated CASSANDRA-7011:


Flagged:   (was: Impediment)

> auth_test system_auth_ks_is_alterable_test dtest hangs in 2.1 and 2.0
> -
>
> Key: CASSANDRA-7011
> URL: https://issues.apache.org/jira/browse/CASSANDRA-7011
> Project: Cassandra
>  Issue Type: Test
>  Components: Tests
>Reporter: Michael Shuler
>Assignee: Aleksey Yeschenko
>
> This test hangs forever. When I hit ctl-c after running the test, then the 
> ccm nodes actually continue running - I think ccm is looking for log lines 
> that never occur until the test is killed(?).
> {noformat}
> $ export MAX_HEAP_SIZE="1G"; export HEAP_NEWSIZE="256M"; ENABLE_VNODES=true 
> PRINT_DEBUG=true nosetests --nocapture --nologcapture --verbosity=3 
> auth_test.py:TestAuth.system_auth_ks_is_alterable_test
> nose.config: INFO: Ignoring files matching ['^\\.', '^_', '^setup\\.py$']
> system_auth_ks_is_alterable_test (auth_test.TestAuth) ... cluster ccm 
> directory: /tmp/dtest-O3AAJr
> ^C
> {noformat}
> Search for (hanging here) below - I typed this prior to hitting ctl-c. Then 
> the nodes start running again and I see "Listening for thrift clients" later 
> on.
> {noformat}
> mshuler@hana:~$ tail -f /tmp/dtest-O3AAJr/test/node*/logs/system.log
> ==> /tmp/dtest-O3AAJr/test/node1/logs/system.log <==
> INFO  [MemtableFlushWriter:2] 2014-04-08 16:45:12,599 Memtable.java:344 - 
> Writing Memtable-schema_columnfamilies@1792243696(1627 serialized bytes, 27 
> ops, 0%/0% of on/off-heap limit)
> INFO  [CompactionExecutor:2] 2014-04-08 16:45:12,603 CompactionTask.java:287 
> - Compacted 4 sstables to 
> [/tmp/dtest-O3AAJr/test/node1/data/system/schema_columns-296e9c049bec3085827dc17d3df2122a/system-schema_columns-ka-13,].
>   14,454 bytes to 11,603 (~80% of original) in 105ms = 0.105386MB/s.  7 total 
> partitions merged to 3.  Partition merge counts were {1:1, 2:1, 4:1, }
> INFO  [MemtableFlushWriter:2] 2014-04-08 16:45:12,668 Memtable.java:378 - 
> Completed flushing 
> /tmp/dtest-O3AAJr/test/node1/flush/system/schema_columnfamilies-45f5b36024bc3f83a3631034ea4fa697/system-schema_columnfamilies-ka-14-Data.db
>  (956 bytes) for commitlog position ReplayPosition(segmentId=1396993504671, 
> position=193292)
> INFO  [MigrationStage:1] 2014-04-08 16:45:12,669 ColumnFamilyStore.java:853 - 
> Enqueuing flush of schema_columns: 6806 (0%) on-heap, 0 (0%) off-heap
> INFO  [MemtableFlushWriter:1] 2014-04-08 16:45:12,670 Memtable.java:344 - 
> Writing Memtable-schema_columns@352928691(1014 serialized bytes, 21 ops, 
> 0%/0% of on/off-heap limit)
> INFO  [CompactionExecutor:1] 2014-04-08 16:45:12,672 CompactionTask.java:287 
> - Compacted 4 sstables to 
> [/tmp/dtest-O3AAJr/test/node1/data/system/schema_keyspaces-b0f2235744583cdb9631c43e59ce3676/system-schema_keyspaces-ka-17,].
>   710 bytes to 233 (~32% of original) in 70ms = 0.003174MB/s.  6 total 
> partitions merged to 3.  Partition merge counts were {1:2, 4:1, }
> INFO  [MemtableFlushWriter:1] 2014-04-08 16:45:12,721 Memtable.java:378 - 
> Completed flushing 
> /tmp/dtest-O3AAJr/test/node1/flush/system/schema_columns-296e9c049bec3085827dc17d3df2122a/system-schema_columns-ka-14-Data.db
>  (435 bytes) for commitlog position ReplayPosition(segmentId=1396993504671, 
> position=193830)
> WARN  [NonPeriodicTasks:1] 2014-04-08 16:45:20,566 FBUtilities.java:359 - 
> Trigger directory doesn't exist, please create it and try again.
> INFO  [NonPeriodicTasks:1] 2014-04-08 16:45:20,570 
> PasswordAuthenticator.java:220 - PasswordAuthenticator created default user 
> 'cassandra'
> INFO  [NonPeriodicTasks:1] 2014-04-08 16:45:21,806 Auth.java:232 - Created 
> default superuser 'cassandra'
> ==> /tmp/dtest-O3AAJr/test/node2/logs/system.log <==
> INFO  [InternalResponseStage:4] 2014-04-08 16:45:12,214 
> ColumnFamilyStore.java:853 - Enqueuing flush of schema_keyspaces: 1004 (0%) 
> on-heap, 0 (0%) off-heap
> INFO  [MemtableFlushWriter:1] 2014-04-08 16:45:12,215 Memtable.java:344 - 
> Writing Memtable-schema_keyspaces@781373873(276 serialized bytes, 6 ops, 
> 0%/0% of on/off-heap limit)
> INFO  [MemtableFlushWriter:1] 2014-04-08 16:45:12,295 Memtable.java:378 - 
> Completed flushing 
> /tmp/dtest-O3AAJr/test/node2/flush/system/schema_keyspaces-b0f2235744583cdb9631c43e59ce3676/system-schema_keyspaces-ka-15-Data.db
>  (179 bytes) for commitlog position ReplayPosition(segmentId=1396993504760, 
> position=243552)
> INFO  [InternalResponseStage:4] 2014-04-08 16:45:12,296 
> ColumnFamilyStore.java:853 - Enqueuing flush of schema_columnfamilies: 34190 
> (0%) on-heap, 0 (0%) off-heap
> INFO  [MemtableFlushWriter:2] 2014-04-08 16:45:12,297 Memtable.java:344 - 
> Writing Memtable-schema_columnfamilies@2077216447(5746 serializ