Thanks dushan.
On Thu, Dec 19, 2013 at 9:56 PM, Dushan Abeyruwan <dus...@wso2.com> wrote: > Hi Malintha, > Please refer the section "Cassandra Tuning" it has relevant fine tune > information > > Cheers > Dushan > > > On Thu, Dec 19, 2013 at 3:17 PM, Malintha Adikari <malin...@wso2.com>wrote: > >> Hi, >> >> I am working on a issue in which the Cassandra server in the production >> has crashed. According to the customer's Cassandra log[1] the problem may >> be an OutOfMemory in Apache cassandra. I think we have to tune Cassandra >> parameters to solve this. Is there any other way to solve this issue ? How >> to tune Cassandra parameters to have optimum memory usage ? >> >> >> 1. log >> >> >> INFO 16:32:17,353 QpidKeySpace.NodeQueues 0,0 >> WARN 16:32:17,353 Heap is 0.9997729675985393 full. You may need to >> reduce memtable and/or cache sizes. Cassandra will now flush up to the two >> largest memtables to free up memory. Adjust flush_largest_memtables_at >> threshold in cassandra.yaml if you don't want Cassandra to do this >> automatically >> WARN 16:32:17,353 Flushing CFS(Keyspace='QpidKeySpace', >> ColumnFamily='MessageCountDetails') to relieve memory pressure >> INFO 16:32:17,761 MessagingService shutting down server thread. >> ERROR 16:38:08,647 Exception in thread Thread[ReadStage:186,5,main] >> java.lang.OutOfMemoryError: Java heap space >> at java.nio.ByteBuffer.wrap(ByteBuffer.java:350) >> at java.nio.ByteBuffer.wrap(ByteBuffer.java:373) >> at >> org.apache.cassandra.io.util.RandomAccessReader.readBytes(RandomAccessReader.java:391) >> >> at >> org.apache.cassandra.utils.ByteBufferUtil.read(ByteBufferUtil.java:392) >> at >> org.apache.cassandra.utils.ByteBufferUtil.readWithShortLength(ByteBufferUtil.java:371) >> >> at >> org.apache.cassandra.db.OnDiskAtom$Serializer.deserializeFromSSTable(OnDiskAtom.java:84) >> >> at >> org.apache.cassandra.db.OnDiskAtom$Serializer.deserializeFromSSTable(OnDiskAtom.java:73) >> >> at >> org.apache.cassandra.db.columniterator.IndexedSliceReader$IndexedBlockFetcher.getNextBlock(IndexedSliceReader.java:370) >> >> at >> org.apache.cassandra.db.columniterator.IndexedSliceReader$IndexedBlockFetcher.fetchMoreData(IndexedSliceReader.java:325) >> >> at >> org.apache.cassandra.db.columniterator.IndexedSliceReader.computeNext(IndexedSliceReader.java:151) >> >> at >> org.apache.cassandra.db.columniterator.IndexedSliceReader.computeNext(IndexedSliceReader.java:48) >> >> at >> com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:143) >> >> at >> com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:138) >> >> at >> org.apache.cassandra.db.columniterator.SSTableSliceIterator.hasNext(SSTableSliceIterator.java:90) >> >> at >> org.apache.cassandra.db.filter.QueryFilter$2.getNext(QueryFilter.java:171) >> at >> org.apache.cassandra.db.filter.QueryFilter$2.hasNext(QueryFilter.java:154) >> at >> org.apache.cassandra.utils.MergeIterator$Candidate.advance(MergeIterator.java:143) >> >> at >> org.apache.cassandra.utils.MergeIterator$ManyToOne.advance(MergeIterator.java:122) >> >> at >> org.apache.cassandra.utils.MergeIterator$ManyToOne.computeNext(MergeIterator.java:96) >> >> at >> com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:143) >> >> at >> com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:138) >> >> at >> org.apache.cassandra.db.filter.SliceQueryFilter.collectReducedColumns(SliceQueryFilter.java:157) >> >> at >> org.apache.cassandra.db.filter.QueryFilter.collateColumns(QueryFilter.java:136) >> >> at >> org.apache.cassandra.db.filter.QueryFilter.collateOnDiskAtom(QueryFilter.java:84) >> >> at >> org.apache.cassandra.db.CollationController.collectAllData(CollationController.java:293) >> >> at >> org.apache.cassandra.db.CollationController.getTopLevelColumns(CollationController.java:65) >> >> at >> org.apache.cassandra.db.ColumnFamilyStore.getTopLevelColumns(ColumnFamilyStore.java:1357) >> >> at >> org.apache.cassandra.db.ColumnFamilyStore.getColumnFamily(ColumnFamilyStore.java:1214) >> >> at >> org.apache.cassandra.db.ColumnFamilyStore.getColumnFamily(ColumnFamilyStore.java:1126) >> >> at org.apache.cassandra.db.Table.getRow(Table.java:347) >> at >> org.apache.cassandra.db.SliceFromReadCommand.getRow(SliceFromReadCommand.java:70) >> >> at >> org.apache.cassandra.service.StorageProxy$LocalReadRunnable.runMayThrow(StorageProxy.java:1052) >> >> >> >> -- >> *Malintha Adikari* >> Software Engineer >> WSO2 Inc.; http://wso2.com >> lean.enterprise.middleware >> >> mobile: +94 71 2312958 >> > > > > -- > Dushan Abeyruwan > Associate Tech Lead > *Integration Technologies Team* > *Comitter Apache Synpase* > *WSO2 Inc. http://wso2.com/ <http://wso2.com/>* > *Mobile:(0094)713942042* > -- *Malintha Adikari* Software Engineer WSO2 Inc.; http://wso2.com lean.enterprise.middleware mobile: +94 71 2312958
_______________________________________________ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
