[ https://issues.apache.org/jira/browse/CASSANDRA-7011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14086345#comment-14086345 ]
Philip Thompson commented on CASSANDRA-7011: -------------------------------------------- The original system_auth_ks still hangs for me, but with a fresh checkout of 2.1, alter_cf_auth_test no longer hangs. It was clearly hanging on the log search for "Listening for thrift clients....", but i'm not sure why yet as that was in the logs. > auth_test system_auth_ks_is_alterable_test dtest hangs in 2.1 and 2.0 > --------------------------------------------------------------------- > > Key: CASSANDRA-7011 > URL: https://issues.apache.org/jira/browse/CASSANDRA-7011 > Project: Cassandra > Issue Type: Test > Components: Tests > Reporter: Michael Shuler > Assignee: Philip Thompson > Fix For: 2.0.10 > > Attachments: node1_system.log-7011.txt > > > This test hangs forever. When I hit ctl-c after running the test, then the > ccm nodes actually continue running - I think ccm is looking for log lines > that never occur until the test is killed(?). > {noformat} > $ export MAX_HEAP_SIZE="1G"; export HEAP_NEWSIZE="256M"; ENABLE_VNODES=true > PRINT_DEBUG=true nosetests --nocapture --nologcapture --verbosity=3 > auth_test.py:TestAuth.system_auth_ks_is_alterable_test > nose.config: INFO: Ignoring files matching ['^\\.', '^_', '^setup\\.py$'] > system_auth_ks_is_alterable_test (auth_test.TestAuth) ... cluster ccm > directory: /tmp/dtest-O3AAJr > ^C > {noformat} > Search for (hanging here) below - I typed this prior to hitting ctl-c. Then > the nodes start running again and I see "Listening for thrift clients" later > on. > {noformat} > mshuler@hana:~$ tail -f /tmp/dtest-O3AAJr/test/node*/logs/system.log > ==> /tmp/dtest-O3AAJr/test/node1/logs/system.log <== > INFO [MemtableFlushWriter:2] 2014-04-08 16:45:12,599 Memtable.java:344 - > Writing Memtable-schema_columnfamilies@1792243696(1627 serialized bytes, 27 > ops, 0%/0% of on/off-heap limit) > INFO [CompactionExecutor:2] 2014-04-08 16:45:12,603 CompactionTask.java:287 > - Compacted 4 sstables to > [/tmp/dtest-O3AAJr/test/node1/data/system/schema_columns-296e9c049bec3085827dc17d3df2122a/system-schema_columns-ka-13,]. > 14,454 bytes to 11,603 (~80% of original) in 105ms = 0.105386MB/s. 7 total > partitions merged to 3. Partition merge counts were {1:1, 2:1, 4:1, } > INFO [MemtableFlushWriter:2] 2014-04-08 16:45:12,668 Memtable.java:378 - > Completed flushing > /tmp/dtest-O3AAJr/test/node1/flush/system/schema_columnfamilies-45f5b36024bc3f83a3631034ea4fa697/system-schema_columnfamilies-ka-14-Data.db > (956 bytes) for commitlog position ReplayPosition(segmentId=1396993504671, > position=193292) > INFO [MigrationStage:1] 2014-04-08 16:45:12,669 ColumnFamilyStore.java:853 - > Enqueuing flush of schema_columns: 6806 (0%) on-heap, 0 (0%) off-heap > INFO [MemtableFlushWriter:1] 2014-04-08 16:45:12,670 Memtable.java:344 - > Writing Memtable-schema_columns@352928691(1014 serialized bytes, 21 ops, > 0%/0% of on/off-heap limit) > INFO [CompactionExecutor:1] 2014-04-08 16:45:12,672 CompactionTask.java:287 > - Compacted 4 sstables to > [/tmp/dtest-O3AAJr/test/node1/data/system/schema_keyspaces-b0f2235744583cdb9631c43e59ce3676/system-schema_keyspaces-ka-17,]. > 710 bytes to 233 (~32% of original) in 70ms = 0.003174MB/s. 6 total > partitions merged to 3. Partition merge counts were {1:2, 4:1, } > INFO [MemtableFlushWriter:1] 2014-04-08 16:45:12,721 Memtable.java:378 - > Completed flushing > /tmp/dtest-O3AAJr/test/node1/flush/system/schema_columns-296e9c049bec3085827dc17d3df2122a/system-schema_columns-ka-14-Data.db > (435 bytes) for commitlog position ReplayPosition(segmentId=1396993504671, > position=193830) > WARN [NonPeriodicTasks:1] 2014-04-08 16:45:20,566 FBUtilities.java:359 - > Trigger directory doesn't exist, please create it and try again. > INFO [NonPeriodicTasks:1] 2014-04-08 16:45:20,570 > PasswordAuthenticator.java:220 - PasswordAuthenticator created default user > 'cassandra' > INFO [NonPeriodicTasks:1] 2014-04-08 16:45:21,806 Auth.java:232 - Created > default superuser 'cassandra' > ==> /tmp/dtest-O3AAJr/test/node2/logs/system.log <== > INFO [InternalResponseStage:4] 2014-04-08 16:45:12,214 > ColumnFamilyStore.java:853 - Enqueuing flush of schema_keyspaces: 1004 (0%) > on-heap, 0 (0%) off-heap > INFO [MemtableFlushWriter:1] 2014-04-08 16:45:12,215 Memtable.java:344 - > Writing Memtable-schema_keyspaces@781373873(276 serialized bytes, 6 ops, > 0%/0% of on/off-heap limit) > INFO [MemtableFlushWriter:1] 2014-04-08 16:45:12,295 Memtable.java:378 - > Completed flushing > /tmp/dtest-O3AAJr/test/node2/flush/system/schema_keyspaces-b0f2235744583cdb9631c43e59ce3676/system-schema_keyspaces-ka-15-Data.db > (179 bytes) for commitlog position ReplayPosition(segmentId=1396993504760, > position=243552) > INFO [InternalResponseStage:4] 2014-04-08 16:45:12,296 > ColumnFamilyStore.java:853 - Enqueuing flush of schema_columnfamilies: 34190 > (0%) on-heap, 0 (0%) off-heap > INFO [MemtableFlushWriter:2] 2014-04-08 16:45:12,297 Memtable.java:344 - > Writing Memtable-schema_columnfamilies@2077216447(5746 serialized bytes, 108 > ops, 0%/0% of on/off-heap limit) > INFO [MemtableFlushWriter:2] 2014-04-08 16:45:12,369 Memtable.java:378 - > Completed flushing > /tmp/dtest-O3AAJr/test/node2/flush/system/schema_columnfamilies-45f5b36024bc3f83a3631034ea4fa697/system-schema_columnfamilies-ka-12-Data.db > (2088 bytes) for commitlog position ReplayPosition(segmentId=1396993504760, > position=243552) > INFO [InternalResponseStage:4] 2014-04-08 16:45:12,370 > ColumnFamilyStore.java:853 - Enqueuing flush of schema_columns: 37408 (0%) > on-heap, 0 (0%) off-heap > INFO [CompactionExecutor:4] 2014-04-08 16:45:12,371 CompactionTask.java:131 > - Compacting > [SSTableReader(path='/tmp/dtest-O3AAJr/test/node2/data/system/schema_columnfamilies-45f5b36024bc3f83a3631034ea4fa697/system-schema_columnfamilies-ka-9-Data.db'), > > SSTableReader(path='/tmp/dtest-O3AAJr/test/node2/flush/system/schema_columnfamilies-45f5b36024bc3f83a3631034ea4fa697/system-schema_columnfamilies-ka-11-Data.db'), > > SSTableReader(path='/tmp/dtest-O3AAJr/test/node2/flush/system/schema_columnfamilies-45f5b36024bc3f83a3631034ea4fa697/system-schema_columnfamilies-ka-10-Data.db'), > > SSTableReader(path='/tmp/dtest-O3AAJr/test/node2/flush/system/schema_columnfamilies-45f5b36024bc3f83a3631034ea4fa697/system-schema_columnfamilies-ka-12-Data.db')] > INFO [MemtableFlushWriter:1] 2014-04-08 16:45:12,371 Memtable.java:344 - > Writing Memtable-schema_columns@2003573271(5173 serialized bytes, 119 ops, > 0%/0% of on/off-heap limit) > WARN [NonPeriodicTasks:1] 2014-04-08 16:45:20,248 FBUtilities.java:359 - > Trigger directory doesn't exist, please create it and try again. > ==> /tmp/dtest-O3AAJr/test/node3/logs/system.log <== > INFO [MemtableFlushWriter:1] 2014-04-08 16:45:11,654 Memtable.java:344 - > Writing Memtable-schema_keyspaces@789549279(276 serialized bytes, 6 ops, > 0%/0% of on/off-heap limit) > INFO [MemtableFlushWriter:1] 2014-04-08 16:45:11,788 Memtable.java:378 - > Completed flushing > /tmp/dtest-O3AAJr/test/node3/flush/system/schema_keyspaces-b0f2235744583cdb9631c43e59ce3676/system-schema_keyspaces-ka-14-Data.db > (179 bytes) for commitlog position ReplayPosition(segmentId=1396993504533, > position=193958) > INFO [InternalResponseStage:1] 2014-04-08 16:45:11,789 > ColumnFamilyStore.java:853 - Enqueuing flush of schema_columnfamilies: 34192 > (0%) on-heap, 0 (0%) off-heap > INFO [MemtableFlushWriter:2] 2014-04-08 16:45:11,790 Memtable.java:344 - > Writing Memtable-schema_columnfamilies@1695849916(5746 serialized bytes, 108 > ops, 0%/0% of on/off-heap limit) > INFO [MemtableFlushWriter:2] 2014-04-08 16:45:11,898 Memtable.java:378 - > Completed flushing > /tmp/dtest-O3AAJr/test/node3/flush/system/schema_columnfamilies-45f5b36024bc3f83a3631034ea4fa697/system-schema_columnfamilies-ka-11-Data.db > (2087 bytes) for commitlog position ReplayPosition(segmentId=1396993504533, > position=194091) > INFO [InternalResponseStage:1] 2014-04-08 16:45:11,899 > ColumnFamilyStore.java:853 - Enqueuing flush of schema_columns: 37410 (0%) > on-heap, 0 (0%) off-heap > INFO [MemtableFlushWriter:1] 2014-04-08 16:45:11,900 Memtable.java:344 - > Writing Memtable-schema_columns@2090391222(5173 serialized bytes, 119 ops, > 0%/0% of on/off-heap limit) > INFO [MemtableFlushWriter:1] 2014-04-08 16:45:11,998 Memtable.java:378 - > Completed flushing > /tmp/dtest-O3AAJr/test/node3/flush/system/schema_columns-296e9c049bec3085827dc17d3df2122a/system-schema_columns-ka-11-Data.db > (1700 bytes) for commitlog position ReplayPosition(segmentId=1396993504533, > position=194091) > INFO [main] 2014-04-08 16:45:18,654 CassandraDaemon.java:533 - No gossip > backlog; proceeding > WARN [NonPeriodicTasks:1] 2014-04-08 16:45:20,131 FBUtilities.java:359 - > Trigger directory doesn't exist, please create it and try again. > (hanging here) > ==> /tmp/dtest-O3AAJr/test/node2/logs/system.log <== > INFO [NonPeriodicTasks:1] 2014-04-08 16:49:02,863 > PasswordAuthenticator.java:220 - PasswordAuthenticator created default user > 'cassandra' > ==> /tmp/dtest-O3AAJr/test/node3/logs/system.log <== > INFO [NonPeriodicTasks:1] 2014-04-08 16:49:02,888 > PasswordAuthenticator.java:220 - PasswordAuthenticator created default user > 'cassandra' > ==> /tmp/dtest-O3AAJr/test/node2/logs/system.log <== > INFO [MemtableFlushWriter:1] 2014-04-08 16:49:02,919 Memtable.java:378 - > Completed flushing > /tmp/dtest-O3AAJr/test/node2/flush/system/schema_columns-296e9c049bec3085827dc17d3df2122a/system-schema_columns-ka-12-Data.db > (1699 bytes) for commitlog position ReplayPosition(segmentId=1396993504760, > position=243552) > INFO [CompactionExecutor:5] 2014-04-08 16:49:02,922 CompactionTask.java:131 > - Compacting > [SSTableReader(path='/tmp/dtest-O3AAJr/test/node2/data/system/schema_columns-296e9c049bec3085827dc17d3df2122a/system-schema_columns-ka-9-Data.db'), > > SSTableReader(path='/tmp/dtest-O3AAJr/test/node2/flush/system/schema_columns-296e9c049bec3085827dc17d3df2122a/system-schema_columns-ka-11-Data.db'), > > SSTableReader(path='/tmp/dtest-O3AAJr/test/node2/flush/system/schema_columns-296e9c049bec3085827dc17d3df2122a/system-schema_columns-ka-10-Data.db'), > > SSTableReader(path='/tmp/dtest-O3AAJr/test/node2/flush/system/schema_columns-296e9c049bec3085827dc17d3df2122a/system-schema_columns-ka-12-Data.db')] > ==> /tmp/dtest-O3AAJr/test/node3/logs/system.log <== > INFO [InternalResponseStage:3] 2014-04-08 16:49:02,959 > ColumnFamilyStore.java:853 - Enqueuing flush of schema_keyspaces: 1006 (0%) > on-heap, 0 (0%) off-heap > INFO [MemtableFlushWriter:3] 2014-04-08 16:49:02,960 Memtable.java:344 - > Writing Memtable-schema_keyspaces@44265998(276 serialized bytes, 6 ops, 0%/0% > of on/off-heap limit) > ==> /tmp/dtest-O3AAJr/test/node2/logs/system.log <== > INFO [MigrationStage:1] 2014-04-08 16:49:02,970 ColumnFamilyStore.java:853 - > Enqueuing flush of schema_keyspaces: 501 (0%) on-heap, 0 (0%) off-heap > INFO [MemtableFlushWriter:3] 2014-04-08 16:49:02,972 Memtable.java:344 - > Writing Memtable-schema_keyspaces@603519674(138 serialized bytes, 3 ops, > 0%/0% of on/off-heap limit) > ==> /tmp/dtest-O3AAJr/test/node3/logs/system.log <== > INFO [main] 2014-04-08 16:49:03,029 Server.java:159 - Starting listening for > CQL clients on /127.0.0.3:9042... > ==> /tmp/dtest-O3AAJr/test/node2/logs/system.log <== > INFO [CompactionExecutor:4] 2014-04-08 16:49:03,064 CompactionTask.java:287 > - Compacted 4 sstables to > [/tmp/dtest-O3AAJr/test/node2/data/system/schema_columnfamilies-45f5b36024bc3f83a3631034ea4fa697/system-schema_columnfamilies-ka-13,]. > 13,907 bytes to 7,643 (~54% of original) in 213ms = 0.034220MB/s. 9 total > partitions merged to 3. Partition merge counts were {1:1, 4:2, } > ==> /tmp/dtest-O3AAJr/test/node3/logs/system.log <== > INFO [MemtableFlushWriter:3] 2014-04-08 16:49:03,069 Memtable.java:378 - > Completed flushing > /tmp/dtest-O3AAJr/test/node3/flush/system/schema_keyspaces-b0f2235744583cdb9631c43e59ce3676/system-schema_keyspaces-ka-15-Data.db > (179 bytes) for commitlog position ReplayPosition(segmentId=1396993504533, > position=213470) > INFO [InternalResponseStage:3] 2014-04-08 16:49:03,071 > ColumnFamilyStore.java:853 - Enqueuing flush of schema_columnfamilies: 42850 > (0%) on-heap, 0 (0%) off-heap > INFO [MemtableFlushWriter:1] 2014-04-08 16:49:03,071 Memtable.java:344 - > Writing Memtable-schema_columnfamilies@666219518(7373 serialized bytes, 135 > ops, 0%/0% of on/off-heap limit) > ==> /tmp/dtest-O3AAJr/test/node2/logs/system.log <== > INFO [MemtableFlushWriter:3] 2014-04-08 16:49:03,087 Memtable.java:378 - > Completed flushing > /tmp/dtest-O3AAJr/test/node2/flush/system/schema_keyspaces-b0f2235744583cdb9631c43e59ce3676/system-schema_keyspaces-ka-16-Data.db > (159 bytes) for commitlog position ReplayPosition(segmentId=1396993504760, > position=247475) > INFO [CompactionExecutor:5] 2014-04-08 16:49:03,090 CompactionTask.java:287 > - Compacted 4 sstables to > [/tmp/dtest-O3AAJr/test/node2/data/system/schema_columns-296e9c049bec3085827dc17d3df2122a/system-schema_columns-ka-13,]. > 16,411 bytes to 11,314 (~68% of original) in 165ms = 0.065393MB/s. 9 total > partitions merged to 3. Partition merge counts were {1:1, 4:2, } > INFO [CompactionExecutor:6] 2014-04-08 16:49:03,090 CompactionTask.java:131 > - Compacting > [SSTableReader(path='/tmp/dtest-O3AAJr/test/node2/flush/system/schema_keyspaces-b0f2235744583cdb9631c43e59ce3676/system-schema_keyspaces-ka-14-Data.db'), > > SSTableReader(path='/tmp/dtest-O3AAJr/test/node2/data/system/schema_keyspaces-b0f2235744583cdb9631c43e59ce3676/system-schema_keyspaces-ka-13-Data.db'), > > SSTableReader(path='/tmp/dtest-O3AAJr/test/node2/flush/system/schema_keyspaces-b0f2235744583cdb9631c43e59ce3676/system-schema_keyspaces-ka-15-Data.db'), > > SSTableReader(path='/tmp/dtest-O3AAJr/test/node2/flush/system/schema_keyspaces-b0f2235744583cdb9631c43e59ce3676/system-schema_keyspaces-ka-16-Data.db')] > INFO [MigrationStage:1] 2014-04-08 16:49:03,091 ColumnFamilyStore.java:853 - > Enqueuing flush of schema_columnfamilies: 8799 (0%) on-heap, 0 (0%) off-heap > ==> /tmp/dtest-O3AAJr/test/node3/logs/system.log <== > INFO [main] 2014-04-08 16:49:03,091 ThriftServer.java:119 - Binding thrift > service to /127.0.0.3:9160 > ==> /tmp/dtest-O3AAJr/test/node2/logs/system.log <== > INFO [MemtableFlushWriter:1] 2014-04-08 16:49:03,091 Memtable.java:344 - > Writing Memtable-schema_columnfamilies@1821762369(1609 serialized bytes, 27 > ops, 0%/0% of on/off-heap limit) > ==> /tmp/dtest-O3AAJr/test/node3/logs/system.log <== > INFO [Thread-8] 2014-04-08 16:49:03,098 ThriftServer.java:136 - Listening > for thrift clients... > INFO [MemtableFlushWriter:1] 2014-04-08 16:49:03,166 Memtable.java:378 - > Completed flushing > /tmp/dtest-O3AAJr/test/node3/flush/system/schema_columnfamilies-45f5b36024bc3f83a3631034ea4fa697/system-schema_columnfamilies-ka-12-Data.db > (2536 bytes) for commitlog position ReplayPosition(segmentId=1396993504533, > position=213470) > INFO [InternalResponseStage:3] 2014-04-08 16:49:03,167 > ColumnFamilyStore.java:853 - Enqueuing flush of schema_columns: 44033 (0%) > on-heap, 0 (0%) off-heap > INFO [MemtableFlushWriter:3] 2014-04-08 16:49:03,168 Memtable.java:344 - > Writing Memtable-schema_columns@1052245443(6187 serialized bytes, 140 ops, > 0%/0% of on/off-heap limit) > INFO [CompactionExecutor:8] 2014-04-08 16:49:03,168 CompactionTask.java:131 > - Compacting > [SSTableReader(path='/tmp/dtest-O3AAJr/test/node3/flush/system/schema_columnfamilies-45f5b36024bc3f83a3631034ea4fa697/system-schema_columnfamilies-ka-11-Data.db'), > > SSTableReader(path='/tmp/dtest-O3AAJr/test/node3/flush/system/schema_columnfamilies-45f5b36024bc3f83a3631034ea4fa697/system-schema_columnfamilies-ka-10-Data.db'), > > SSTableReader(path='/tmp/dtest-O3AAJr/test/node3/flush/system/schema_columnfamilies-45f5b36024bc3f83a3631034ea4fa697/system-schema_columnfamilies-ka-12-Data.db'), > > SSTableReader(path='/tmp/dtest-O3AAJr/test/node3/data/system/schema_columnfamilies-45f5b36024bc3f83a3631034ea4fa697/system-schema_columnfamilies-ka-9-Data.db')] > ==> /tmp/dtest-O3AAJr/test/node2/logs/system.log <== > INFO [MemtableFlushWriter:1] 2014-04-08 16:49:03,203 Memtable.java:378 - > Completed flushing > /tmp/dtest-O3AAJr/test/node2/flush/system/schema_columnfamilies-45f5b36024bc3f83a3631034ea4fa697/system-schema_columnfamilies-ka-14-Data.db > (949 bytes) for commitlog position ReplayPosition(segmentId=1396993504760, > position=248454) > INFO [MigrationStage:1] 2014-04-08 16:49:03,204 ColumnFamilyStore.java:853 - > Enqueuing flush of schema_columns: 6833 (0%) on-heap, 0 (0%) off-heap > INFO [MemtableFlushWriter:3] 2014-04-08 16:49:03,205 Memtable.java:344 - > Writing Memtable-schema_columns@1698728310(1041 serialized bytes, 21 ops, > 0%/0% of on/off-heap limit) > INFO [CompactionExecutor:6] 2014-04-08 16:49:03,218 CompactionTask.java:287 > - Compacted 4 sstables to > [/tmp/dtest-O3AAJr/test/node2/data/system/schema_keyspaces-b0f2235744583cdb9631c43e59ce3676/system-schema_keyspaces-ka-17,]. > 750 bytes to 233 (~31% of original) in 125ms = 0.001778MB/s. 8 total > partitions merged to 3. Partition merge counts were {1:1, 3:1, 4:1, } > ==> /tmp/dtest-O3AAJr/test/node3/logs/system.log <== > INFO [MemtableFlushWriter:3] 2014-04-08 16:49:03,278 Memtable.java:378 - > Completed flushing > /tmp/dtest-O3AAJr/test/node3/flush/system/schema_columns-296e9c049bec3085827dc17d3df2122a/system-schema_columns-ka-12-Data.db > (1990 bytes) for commitlog position ReplayPosition(segmentId=1396993504533, > position=213470) > INFO [CompactionExecutor:5] 2014-04-08 16:49:03,279 CompactionTask.java:131 > - Compacting > [SSTableReader(path='/tmp/dtest-O3AAJr/test/node3/flush/system/schema_columns-296e9c049bec3085827dc17d3df2122a/system-schema_columns-ka-10-Data.db'), > > SSTableReader(path='/tmp/dtest-O3AAJr/test/node3/flush/system/schema_columns-296e9c049bec3085827dc17d3df2122a/system-schema_columns-ka-11-Data.db'), > > SSTableReader(path='/tmp/dtest-O3AAJr/test/node3/data/system/schema_columns-296e9c049bec3085827dc17d3df2122a/system-schema_columns-ka-9-Data.db'), > > SSTableReader(path='/tmp/dtest-O3AAJr/test/node3/flush/system/schema_columns-296e9c049bec3085827dc17d3df2122a/system-schema_columns-ka-12-Data.db')] > ==> /tmp/dtest-O3AAJr/test/node2/logs/system.log <== > INFO [MemtableFlushWriter:3] 2014-04-08 16:49:03,310 Memtable.java:378 - > Completed flushing > /tmp/dtest-O3AAJr/test/node2/flush/system/schema_columns-296e9c049bec3085827dc17d3df2122a/system-schema_columns-ka-14-Data.db > (431 bytes) for commitlog position ReplayPosition(segmentId=1396993504760, > position=248454) > ==> /tmp/dtest-O3AAJr/test/node3/logs/system.log <== > INFO [CompactionExecutor:8] 2014-04-08 16:49:03,313 CompactionTask.java:287 > - Compacted 4 sstables to > [/tmp/dtest-O3AAJr/test/node3/data/system/schema_columnfamilies-45f5b36024bc3f83a3631034ea4fa697/system-schema_columnfamilies-ka-13,]. > 14,821 bytes to 8,115 (~54% of original) in 140ms = 0.055279MB/s. 9 total > partitions merged to 3. Partition merge counts were {1:1, 4:2, } > INFO [MigrationStage:1] 2014-04-08 16:49:03,313 ColumnFamilyStore.java:853 - > Enqueuing flush of schema_keyspaces: 502 (0%) on-heap, 0 (0%) off-heap > INFO [MemtableFlushWriter:1] 2014-04-08 16:49:03,315 Memtable.java:344 - > Writing Memtable-schema_keyspaces@901379409(138 serialized bytes, 3 ops, > 0%/0% of on/off-heap limit) > ==> /tmp/dtest-O3AAJr/test/node2/logs/system.log <== > INFO [MigrationStage:1] 2014-04-08 16:49:03,332 ColumnFamilyStore.java:853 - > Enqueuing flush of schema_keyspaces: 501 (0%) on-heap, 0 (0%) off-heap > INFO [MemtableFlushWriter:1] 2014-04-08 16:49:03,333 Memtable.java:344 - > Writing Memtable-schema_keyspaces@1181313624(138 serialized bytes, 3 ops, > 0%/0% of on/off-heap limit) > ==> /tmp/dtest-O3AAJr/test/node3/logs/system.log <== > INFO [MemtableFlushWriter:1] 2014-04-08 16:49:03,392 Memtable.java:378 - > Completed flushing > /tmp/dtest-O3AAJr/test/node3/flush/system/schema_keyspaces-b0f2235744583cdb9631c43e59ce3676/system-schema_keyspaces-ka-16-Data.db > (159 bytes) for commitlog position ReplayPosition(segmentId=1396993504533, > position=217732) > INFO [MigrationStage:1] 2014-04-08 16:49:03,397 ColumnFamilyStore.java:853 - > Enqueuing flush of schema_columnfamilies: 8818 (0%) on-heap, 0 (0%) off-heap > INFO [CompactionExecutor:7] 2014-04-08 16:49:03,397 CompactionTask.java:131 > - Compacting > [SSTableReader(path='/tmp/dtest-O3AAJr/test/node3/flush/system/schema_keyspaces-b0f2235744583cdb9631c43e59ce3676/system-schema_keyspaces-ka-14-Data.db'), > > SSTableReader(path='/tmp/dtest-O3AAJr/test/node3/data/system/schema_keyspaces-b0f2235744583cdb9631c43e59ce3676/system-schema_keyspaces-ka-13-Data.db'), > > SSTableReader(path='/tmp/dtest-O3AAJr/test/node3/flush/system/schema_keyspaces-b0f2235744583cdb9631c43e59ce3676/system-schema_keyspaces-ka-15-Data.db'), > > SSTableReader(path='/tmp/dtest-O3AAJr/test/node3/flush/system/schema_keyspaces-b0f2235744583cdb9631c43e59ce3676/system-schema_keyspaces-ka-16-Data.db')] > INFO [MemtableFlushWriter:3] 2014-04-08 16:49:03,400 Memtable.java:344 - > Writing Memtable-schema_columnfamilies@2077765501(1627 serialized bytes, 27 > ops, 0%/0% of on/off-heap limit) > INFO [CompactionExecutor:5] 2014-04-08 16:49:03,405 CompactionTask.java:287 > - Compacted 4 sstables to > [/tmp/dtest-O3AAJr/test/node3/data/system/schema_columns-296e9c049bec3085827dc17d3df2122a/system-schema_columns-ka-13,]. > 16,987 bytes to 11,600 (~68% of original) in 123ms = 0.089940MB/s. 9 total > partitions merged to 3. Partition merge counts were {1:1, 4:2, } > ==> /tmp/dtest-O3AAJr/test/node2/logs/system.log <== > INFO [MemtableFlushWriter:1] 2014-04-08 16:49:03,418 Memtable.java:378 - > Completed flushing > /tmp/dtest-O3AAJr/test/node2/flush/system/schema_keyspaces-b0f2235744583cdb9631c43e59ce3676/system-schema_keyspaces-ka-18-Data.db > (159 bytes) for commitlog position ReplayPosition(segmentId=1396993504760, > position=252763) > INFO [MigrationStage:1] 2014-04-08 16:49:03,419 ColumnFamilyStore.java:853 - > Enqueuing flush of schema_columnfamilies: 8817 (0%) on-heap, 0 (0%) off-heap > INFO [MemtableFlushWriter:3] 2014-04-08 16:49:03,420 Memtable.java:344 - > Writing Memtable-schema_columnfamilies@495883972(1627 serialized bytes, 27 > ops, 0%/0% of on/off-heap limit) > ==> /tmp/dtest-O3AAJr/test/node3/logs/system.log <== > INFO [MemtableFlushWriter:3] 2014-04-08 16:49:03,483 Memtable.java:378 - > Completed flushing > /tmp/dtest-O3AAJr/test/node3/flush/system/schema_columnfamilies-45f5b36024bc3f83a3631034ea4fa697/system-schema_columnfamilies-ka-14-Data.db > (956 bytes) for commitlog position ReplayPosition(segmentId=1396993504533, > position=217732) > INFO [MigrationStage:1] 2014-04-08 16:49:03,484 ColumnFamilyStore.java:853 - > Enqueuing flush of schema_columns: 6807 (0%) on-heap, 0 (0%) off-heap > INFO [MemtableFlushWriter:1] 2014-04-08 16:49:03,485 Memtable.java:344 - > Writing Memtable-schema_columns@365627698(1014 serialized bytes, 21 ops, > 0%/0% of on/off-heap limit) > ==> /tmp/dtest-O3AAJr/test/node2/logs/system.log <== > INFO [MemtableFlushWriter:3] 2014-04-08 16:49:03,519 Memtable.java:378 - > Completed flushing > /tmp/dtest-O3AAJr/test/node2/flush/system/schema_columnfamilies-45f5b36024bc3f83a3631034ea4fa697/system-schema_columnfamilies-ka-15-Data.db > (956 bytes) for commitlog position ReplayPosition(segmentId=1396993504760, > position=252896) > INFO [MigrationStage:1] 2014-04-08 16:49:03,520 ColumnFamilyStore.java:853 - > Enqueuing flush of schema_columns: 6806 (0%) on-heap, 0 (0%) off-heap > INFO [MemtableFlushWriter:1] 2014-04-08 16:49:03,521 Memtable.java:344 - > Writing Memtable-schema_columns@1830789468(1014 serialized bytes, 21 ops, > 0%/0% of on/off-heap limit) > ==> /tmp/dtest-O3AAJr/test/node3/logs/system.log <== > INFO [CompactionExecutor:7] 2014-04-08 16:49:03,523 CompactionTask.java:287 > - Compacted 4 sstables to > [/tmp/dtest-O3AAJr/test/node3/data/system/schema_keyspaces-b0f2235744583cdb9631c43e59ce3676/system-schema_keyspaces-ka-17,]. > 750 bytes to 233 (~31% of original) in 122ms = 0.001821MB/s. 8 total > partitions merged to 3. Partition merge counts were {1:1, 3:1, 4:1, } > INFO [MemtableFlushWriter:1] 2014-04-08 16:49:03,562 Memtable.java:378 - > Completed flushing > /tmp/dtest-O3AAJr/test/node3/flush/system/schema_columns-296e9c049bec3085827dc17d3df2122a/system-schema_columns-ka-14-Data.db > (435 bytes) for commitlog position ReplayPosition(segmentId=1396993504533, > position=218351) > ==> /tmp/dtest-O3AAJr/test/node2/logs/system.log <== > INFO [MemtableFlushWriter:1] 2014-04-08 16:49:03,581 Memtable.java:378 - > Completed flushing > /tmp/dtest-O3AAJr/test/node2/flush/system/schema_columns-296e9c049bec3085827dc17d3df2122a/system-schema_columns-ka-15-Data.db > (435 bytes) for commitlog position ReplayPosition(segmentId=1396993504760, > position=252896) > ==> /tmp/dtest-O3AAJr/test/node3/logs/system.log <== > INFO [MigrationStage:1] 2014-04-08 16:49:03,586 ColumnFamilyStore.java:853 - > Enqueuing flush of schema_keyspaces: 502 (0%) on-heap, 0 (0%) off-heap > INFO [MemtableFlushWriter:3] 2014-04-08 16:49:03,586 Memtable.java:344 - > Writing Memtable-schema_keyspaces@543512535(138 serialized bytes, 3 ops, > 0%/0% of on/off-heap limit) > ==> /tmp/dtest-O3AAJr/test/node2/logs/system.log <== > INFO [MigrationStage:1] 2014-04-08 16:49:03,604 DefsTables.java:388 - > Loading > org.apache.cassandra.config.CFMetaData@1327e4ff[cfId=2d324e48-3275-3517-8dd5-9a2c5b0856c5,ksName=system_auth,cfName=permissions,cfType=Standard,comparator=org.apache.cassandra.db.marshal.CompositeType(org.apache.cassandra.db.marshal.UTF8Type,org.apache.cassandra.db.marshal.UTF8Type,org.apache.cassandra.db.marshal.ColumnToCollectionType(7065726d697373696f6e73:org.apache.cassandra.db.marshal.SetType(org.apache.cassandra.db.marshal.UTF8Type))),comment=,readRepairChance=0.1,dclocalReadRepairChance=0.0,gcGraceSeconds=7776000,defaultValidator=org.apache.cassandra.db.marshal.BytesType,keyValidator=org.apache.cassandra.db.marshal.UTF8Type,minCompactionThreshold=4,maxCompactionThreshold=32,columnMetadata={java.nio.HeapByteBuffer[pos=0 > lim=11 cap=11]=ColumnDefinition{name=permissions, > type=org.apache.cassandra.db.marshal.SetType(org.apache.cassandra.db.marshal.UTF8Type), > kind=REGULAR, componentIndex=1, indexName=null, indexType=null}, > java.nio.HeapByteBuffer[pos=0 lim=8 cap=8]=ColumnDefinition{name=username, > type=org.apache.cassandra.db.marshal.UTF8Type, kind=PARTITION_KEY, > componentIndex=null, indexName=null, indexType=null}, > java.nio.HeapByteBuffer[pos=0 lim=8 cap=8]=ColumnDefinition{name=resource, > type=org.apache.cassandra.db.marshal.UTF8Type, kind=CLUSTERING_COLUMN, > componentIndex=0, indexName=null, > indexType=null}},compactionStrategyClass=class > org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy,compactionStrategyOptions={},compressionParameters={sstable_compression=org.apache.cassandra.io.compress.LZ4Compressor},bloomFilterFpChance=0.01,memtableFlushPeriod=0,caching={"keys":"ALL", > > "rows_per_partition":"NONE"},defaultTimeToLive=0,minIndexInterval=128,maxIndexInterval=2048,speculativeRetry=99.0PERCENTILE,populateIoCacheOnFlush=false,droppedColumns={},triggers={}] > INFO [MigrationStage:1] 2014-04-08 16:49:03,610 ColumnFamilyStore.java:283 - > Initializing system_auth.permissions > INFO [main] 2014-04-08 16:49:03,622 CassandraDaemon.java:501 - Waiting for > gossip to settle before accepting client requests... > INFO [InternalResponseStage:5] 2014-04-08 16:49:03,625 > ColumnFamilyStore.java:853 - Enqueuing flush of schema_keyspaces: 1004 (0%) > on-heap, 0 (0%) off-heap > INFO [MemtableFlushWriter:3] 2014-04-08 16:49:03,626 Memtable.java:344 - > Writing Memtable-schema_keyspaces@2064761560(276 serialized bytes, 6 ops, > 0%/0% of on/off-heap limit) > ==> /tmp/dtest-O3AAJr/test/node3/logs/system.log <== > INFO [MemtableFlushWriter:3] 2014-04-08 16:49:03,664 Memtable.java:378 - > Completed flushing > /tmp/dtest-O3AAJr/test/node3/flush/system/schema_keyspaces-b0f2235744583cdb9631c43e59ce3676/system-schema_keyspaces-ka-18-Data.db > (159 bytes) for commitlog position ReplayPosition(segmentId=1396993504533, > position=222660) > INFO [MigrationStage:1] 2014-04-08 16:49:03,665 ColumnFamilyStore.java:853 - > Enqueuing flush of schema_columnfamilies: 8818 (0%) on-heap, 0 (0%) off-heap > INFO [MemtableFlushWriter:1] 2014-04-08 16:49:03,666 Memtable.java:344 - > Writing Memtable-schema_columnfamilies@1464552123(1627 serialized bytes, 27 > ops, 0%/0% of on/off-heap limit) > <...> > {noformat} -- This message was sent by Atlassian JIRA (v6.2#6252)