Hi, I have a new error on the same cluster is this related to the same error.
25/25 STG-Cass3 INFO [ScheduledTasks:1] 2011-12-18 10:55:28,147 StatusLogger.java (line 88) Bedrock.BlogEntry 0,0 0/0 0/200000 STG-Cass3 INFO [ScheduledTasks:1] 2011-12-18 10:55:28,147 StatusLogger.java (line 88) City.Attractions 1636995,858216765 30000/30000 30000/30000 STG-Cass3 INFO [ScheduledTasks:1] 2011-12-18 10:55:28,147 StatusLogger.java (line 88) City.CityResources 117299,86895482 1266/5000 5000/5000 STG-Cass3 INFO [ScheduledTasks:1] 2011-12-18 10:55:28,147 StatusLogger.java (line 88) City.AttractionCheckins 0,0 0/0 588/588 STG-Cass3 ERROR [EXPIRING-MAP-TIMER-1] 2011-12-18 10:55:32,371 AbstractCassandraDaemon.java (line 133) Fatal exception in thread Thread STG-Cass3 ERROR [EXPIRING-MAP-TIMER-1] 2011-12-18 10:55:32,371 java.lang.AssertionError: ec2-50-19-254-159.compute-1.amazonaws.com/10.5.7.76 STG-Cass3 ERROR [EXPIRING-MAP-TIMER-1] 2011-12-18 10:55:32,371 at org.apache.cassandra.service.StorageProxy.scheduleLocalHint(StorageProxy.jav a:339) STG-Cass3 ERROR [EXPIRING-MAP-TIMER-1] 2011-12-18 10:55:32,371 at org.apache.cassandra.net.MessagingService.scheduleMutationHint(MessagingServ ice.java:201) STG-Cass3 ERROR [EXPIRING-MAP-TIMER-1] 2011-12-18 10:55:32,371 at org.apache.cassandra.net.MessagingService.access$500(MessagingService.java:6 4) STG-Cass3 ERROR [EXPIRING-MAP-TIMER-1] 2011-12-18 10:55:32,371 at org.apache.cassandra.net.MessagingService$2.apply(MessagingService.java:175) STG-Cass3 ERROR [EXPIRING-MAP-TIMER-1] 2011-12-18 10:55:32,371 at org.apache.cassandra.net.MessagingService$2.apply(MessagingService.java:152) STG-Cass3 ERROR [EXPIRING-MAP-TIMER-1] 2011-12-18 10:55:32,371 at org.apache.cassandra.utils.ExpiringMap$1.run(ExpiringMap.java:89) STG-Cass3 ERROR [EXPIRING-MAP-TIMER-1] 2011-12-18 10:55:32,371 at java.util.TimerThread.mainLoop(Timer.java:512) STG-Cass3 ERROR [EXPIRING-MAP-TIMER-1] 2011-12-18 10:55:32,371 at java.util.TimerThread.run(Timer.java:462) Thanks Michael -----Original Message----- From: Jonathan Ellis [mailto:jbel...@gmail.com] Sent: Tuesday, December 13, 2011 6:01 PM To: dev@cassandra.apache.org Subject: Re: 1.0.3 cassandra java.lang.AssertionError It means a garbage collection took 0 ms, which is unexpected. It's harmless. On Tue, Dec 13, 2011 at 1:16 AM, Michael Vaknine <micha...@citypath.com> wrote: > Hi, > I am running a 4 cluster cassandra with replication factor 3. > I have upgraded to 1.0.3 from 0.7.6 > After a week of work I get this errors. > Does someone know what they mean? > > Thanks > Michael > > > STG-Cass1 INFO [COMMIT-LOG-WRITER] 2011-12-12 22:51:19,943 CommitLogSegment.java (line 60) Creating new commitlog segment /var/lib/cassandra/commitlog/CommitLog-1323730279943.log > STG-Cass1 INFO [ScheduledTasks:1] 2011-12-12 22:51:40,961 GCInspector.java (line 123) GC for ParNew: 256 ms for 1 collections, 8255093264 used; max is 12863930368 > STG-Cass2 INFO [ScheduledTasks:1] 2011-12-12 22:52:29,082 GCInspector.java (line 123) GC for ParNew: 376 ms for 1 collections, 5685486648 used; max is 10716446720 > STG-Cass4 INFO [OptionalTasks:1] 2011-12-12 22:52:29,997 MeteredFlusher.java (line 62) flushing high-traffic column family CFS(Keyspace='City', ColumnFamily='Attractions') (estimated 1077151192 bytes) > STG-Cass4 INFO [OptionalTasks:1] 2011-12-12 22:52:29,997 ColumnFamilyStore.java (line 688) Enqueuing flush of Memtable-Attractions.Attractions_09partition_idx@914182009(1019770/3881818 serialized/live bytes, 30282 ops) > STG-Cass4 INFO [OptionalTasks:1] 2011-12-12 22:52:29,998 ColumnFamilyStore.java (line 688) Enqueuing flush of Memtable-Attractions@977851880(193229347/1073269374 serialized/live bytes, 2552353 ops) > STG-Cass4 INFO [FlushWriter:10] 2011-12-12 22:52:29,998 Memtable.java (line 239) Writing Memtable-Attractions.Attractions_09partition_idx@914182009(1019770/3881818 serialized/live bytes, 30282 ops) > STG-Cass4 INFO [FlushWriter:10] 2011-12-12 22:52:30,060 Memtable.java (line 275) Completed flushing /var/lib/cassandra/data/City/Attractions.Attractions_09partition_idx-hb-94-D ata.db (206749 bytes) > STG-Cass4 INFO [FlushWriter:10] 2011-12-12 22:52:30,061 Memtable.java (line 239) Writing Memtable-Attractions@977851880(193229347/1073269374 serialized/live bytes, 2552353 ops) > STG-Cass4 INFO [CompactionExecutor:25] 2011-12-12 22:52:30,061 CompactionTask.java (line 112) Compacting [SSTableReader(path='/var/lib/cassandra/data/City/Attractions.Attractions_09 partition_idx-hb-93-Data.db'), SSTableReader(path='/var/lib/cassandra/data/City/Attractions.Attractions_09p artition_idx-hb-92-Data.db'), SSTableReader(path='/var/lib/cassandra/data/City/Attractions.Attractions_09p artition_idx-hb-94-Data.db'), SSTableReader(path='/var/lib/cassandra/data/City/Attractions.Attractions_09p artition_idx-hb-90-Data.db')] > STG-Cass4 INFO [ScheduledTasks:1] 2011-12-12 22:52:30,468 GCInspector.java (line 123) GC for ParNew: 249 ms for 1 collections, 6580227336 used; max is 12863930368 > STG-Cass4 INFO [OptionalTasks:1] 2011-12-12 22:52:31,002 MeteredFlusher.java (line 62) flushing high-traffic column family CFS(Keyspace='User', ColumnFamily='Users') (estimated 874561935 bytes) > STG-Cass4 INFO [OptionalTasks:1] 2011-12-12 22:52:31,014 ColumnFamilyStore.java (line 688) Enqueuing flush of Memtable-Users.Users_09partition_idx@547620508(44385880/142668900 serialized/live bytes, 688387 ops) > STG-Cass4 INFO [OptionalTasks:1] 2011-12-12 22:52:31,014 ColumnFamilyStore.java (line 688) Enqueuing flush of Memtable-Users@1890450561(79912773/731893035 serialized/live bytes, 1549850 ops) > STG-Cass4 INFO [CompactionExecutor:25] 2011-12-12 22:52:31,248 CompactionTask.java (line 213) Compacted to . 3,342,843 to 2,631,394 (~78% of original) bytes for 1 keys at 2.114147MB/s. Time: 1,187ms. > STG-Cass4 INFO [FlushWriter:10] 2011-12-12 22:52:34,646 Memtable.java (line 275) Completed flushing /var/lib/cassandra/data/City/Attractions-hb-1301-Data.db (91834237 bytes) > STG-Cass4 INFO [CompactionExecutor:25] 2011-12-12 22:52:34,647 CompactionTask.java (line 112) Compacting [SSTableReader(path='/var/lib/cassandra/data/City/Attractions-hb-1298-Data.d b'), SSTableReader(path='/var/lib/cassandra/data/City/Attractions-hb-1299-Data.db '), SSTableReader(path='/var/lib/cassandra/data/City/Attractions-hb-1301-Data.db '), SSTableReader(path='/var/lib/cassandra/data/City/Attractions-hb-1300-Data.db ')] > STG-Cass4 INFO [FlushWriter:10] 2011-12-12 22:52:34,648 Memtable.java (line 239) Writing Memtable-Users.Users_09partition_idx@547620508(44385880/142668900 serialized/live bytes, 688387 ops) > STG-Cass4 INFO [FlushWriter:10] 2011-12-12 22:52:35,036 Memtable.java (line 275) Completed flushing /var/lib/cassandra/data/User/Users.Users_09partition_idx-hb-62-Data.db (4078473 bytes) > STG-Cass4 INFO [FlushWriter:10] 2011-12-12 22:52:35,036 Memtable.java (line 239) Writing Memtable-Users@1890450561(79912773/731893035 serialized/live bytes, 1549850 ops) > STG-Cass4 INFO [FlushWriter:10] 2011-12-12 22:52:38,616 Memtable.java (line 275) Completed flushing /var/lib/cassandra/data/User/Users-hb-1335-Data.db (40788153 bytes) > STG-Cass4 INFO [CompactionExecutor:25] 2011-12-12 22:53:20,669 CompactionTask.java (line 213) Compacted to . 483,546,752 to 240,371,887 (~49% of original) bytes for 23,806 keys at 4.981020MB/s. Time: 46,022ms. > STG-Cass4 ERROR [ScheduledTasks:1] 2011-12-12 22:55:26,554 AbstractCassandraDaemon.java (line 133) Fatal exception in thread Thread > STG-Cass4 ERROR [ScheduledTasks:1] 2011-12-12 22:55:26,554 java.lang.AssertionError > STG-Cass4 ERROR [ScheduledTasks:1] 2011-12-12 22:55:26,554 at org.apache.cassandra.service.GCInspector.logGCResults(GCInspector.java:103) > STG-Cass4 ERROR [ScheduledTasks:1] 2011-12-12 22:55:26,554 at org.apache.cassandra.service.GCInspector.access$000(GCInspector.java:41) > STG-Cass4 ERROR [ScheduledTasks:1] 2011-12-12 22:55:26,554 at org.apache.cassandra.service.GCInspector$1.run(GCInspector.java:85) > STG-Cass4 ERROR [ScheduledTasks:1] 2011-12-12 22:55:26,554 at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441) > STG-Cass4 ERROR [ScheduledTasks:1] 2011-12-12 22:55:26,554 at java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:317) > STG-Cass4 ERROR [ScheduledTasks:1] 2011-12-12 22:55:26,554 at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:150) > STG-Cass4 ERROR [ScheduledTasks:1] 2011-12-12 22:55:26,554 at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$ 101(ScheduledThreadPoolExecutor.java:98) > STG-Cass4 ERROR [ScheduledTasks:1] 2011-12-12 22:55:26,554 at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.runPeri odic(ScheduledThreadPoolExecutor.java:181) > STG-Cass4 ERROR [ScheduledTasks:1] 2011-12-12 22:55:26,554 at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Sch eduledThreadPoolExecutor.java:205) > STG-Cass4 ERROR [ScheduledTasks:1] 2011-12-12 22:55:26,554 at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.ja va:886) > STG-Cass4 ERROR [ScheduledTasks:1] 2011-12-12 22:55:26,554 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:9 08) > STG-Cass4 ERROR [ScheduledTasks:1] 2011-12-12 22:55:26,554 at java.lang.Thread.run(Thread.java:619) > -- Jonathan Ellis Project Chair, Apache Cassandra co-founder of DataStax, the source for professional Cassandra support http://www.datastax.com