010-07-23
>
>
>
> 发件人： 王一锋
> 发送时间： 2010-07-23 09:38:15
> 收件人： user
> 抄送：
> 主题： Re: Re: Re: What is consuming the heap?
> Yes, we are doing a lot of inserts.
>
> But how can CASSANDRA-1042 cause an OutOfMemory?
> And we are using multigetSlice(). We
The version we are using is 0.6.1
2010-07-23
发件人： 王一锋
发送时间： 2010-07-23 09:38:15
收件人： user
抄送：
主题： Re: Re: Re: What is consuming the heap?
Yes, we are doing a lot of inserts.
But how can CASSANDRA-1042 cause an OutOfMemory?
And we are using multigetSlice(). We are not doing any
Yes, we are doing a lot of inserts.
But how can CASSANDRA-1042 cause an OutOfMemory?
And we are using multigetSlice(). We are not doing any get_range_slice() at all.
2010-07-23
发件人： Jonathan Ellis
发送时间： 2010-07-21 21:17:21
收件人： user
抄送：
主题： Re: Re: What is consuming the heap?
On
.OutOfMemoryError: Java heap space
at
org.apache.cassandra.net.IncomingTcpConnection.run(IncomingTcpConnection.java:71)
2010-07-23
发件人： Peter Schuller
发送时间： 2010-07-21 14:35:36
收件人： user
抄送：
主题： Re: Re: What is consuming the heap?
> So the bloom filters reside in memory completely?
Yes. The point of bloom
On Tue, Jul 20, 2010 at 11:33 PM, Peter Schuller
wrote:
>> INFO [GC inspection] 2010-07-21 01:01:49,661 GCInspector.java (line 110) GC for ConcurrentMarkSweep: 11748 ms, 413673472 reclaimed leaving 9779542600 used; max is 10873667584
>> ERROR [Thread-35] 2010-07-21 01:02:10,941 CassandraDaemon.ja
> So the bloom filters reside in memory completely?
Yes. The point of bloom filters in cassandra is to act as a fast way
to determine whether sstables need to be consulted. This check
involves random access into the bloom filter. It needs to be in memory
for this to be effective.
But due to the n
> INFO [GC inspection] 2010-07-21 01:01:49,661 GCInspector.java (line 110) GC for ConcurrentMarkSweep: 11748 ms, 413673472 reclaimed leaving 9779542600 used; max is 10873667584
> ERROR [Thread-35] 2010-07-21 01:02:10,941 CassandraDaemon.java (line 78) Fatal exception in thread Thread[Thread-35,5,m
no, I'm using QUORUM for both writes and reads
Replication factor is 3
2010-07-21
发件人： Dathan Pattishall
发送时间： 2010-07-21 12:51:32
收件人： user
抄送：
主题： Re: Re: What is consuming the heap?
By off chance on writes are you using ConsistencyLevel::ZERO?
On Tue, Jul 20, 2010 at
010-07-20 21:45:08
> *收件人：* user
> *抄送：*
> *主题：* Re: What is consuming the heap?
>
> > heap size is 10G and the load of data per node was around 300G, 16-core CPU,
> Are the 300 GB made up of *really* small values? Per SS table bloom
> filters do consume memory, but you&#
ace
2010-07-21
发件人： Peter Schuller
发送时间： 2010-07-20 21:45:08
收件人： user
抄送：
主题： Re: What is consuming the heap?
> heap size is 10G and the load of data per node was around 300G, 16-core CPU,
Are the 300 GB made up of *really* small values? Per SS table bloom
filters do consume memo
： Jonathan Ellis
发送时间： 2010-07-20 19:26:11
收件人： user
抄送：
主题： Re: What is consuming the heap?
you should post the full stack trace.
2010/7/20 王一锋 :
> In my cluster, I have set both KeysCached and RowsCached of my column family
> on all nodes to "0",
> but it still happened that
> heap size is 10G and the load of data per node was around 300G, 16-core CPU,
Are the 300 GB made up of *really* small values? Per SS table bloom
filters do consume memory, but you'd have to have a *lot* of *really*
small values for a 300 GB database to cause bloom filters to be a
significant par
you should post the full stack trace.
2010/7/20 王一锋 :
> In my cluster, I have set both KeysCached and RowsCached of my column family
> on all nodes to "0",
> but it still happened that a few nodes crashed because of OutOfMemory
> (from the gc.log, a full gc wasn't able to free up any memory space)
There is some more information here about memory usage.
http://wiki.apache.org/cassandra/StorageConfiguration
/J
Från: 王一锋 [mailto:wangyif...@aspire-tech.com]
Skickat: den 20 juli 2010 08:56
Till: user
Ämne: Re: SV: What is consuming the heap?
No, I don't think so. Because I'm
No, I don't think so. Because I'm not using supercolumn and size of a column
will not exceed 1M
2010-07-20
发件人： Thorvaldsson Justus
发送时间： 2010-07-20 14:52:22
收件人： 'user@cassandra.apache.org'
抄送：
主题： SV: What is consuming the heap?
Supercolumn/column must fit
Supercolumn/column must fit into node memory
It could be?
/Justus
Från: 王一锋 [mailto:wangyif...@aspire-tech.com]
Skickat: den 20 juli 2010 08:48
Till: user
Ämne: What is consuming the heap?
In my cluster, I have set both KeysCached and RowsCached of my column family on
all nodes to "0&quo
In my cluster, I have set both KeysCached and RowsCached of my column family on
all nodes to "0",
but it still happened that a few nodes crashed because of OutOfMemory
(from the gc.log, a full gc wasn't able to free up any memory space),
what else can be consuming the heap?
heap size is 10G an
17 matches
Mail list logo
