Hi, zhangshuai.ustc ,
is this problem solved? Can we help more on the subject?
--
View this message in context:
http://apache-ignite-users.70518.x6.nabble.com/OOM-when-using-Ignite-as-HDFS-Cache-tp11900p12297.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.
17 3:35 PM
To: user@ignite.apache.org
Subject: Re: OOM when using Ignite as HDFS Cache
Are you getting "GC Overhead limit exceeded" OOME?
I think you could always move IGFS data block cache off heap if it is not the
case already.
I am wondering why you've set block size to 4 GB for Ig
Friday, April 14, 2017 2:36 PM
To: user@ignite.apache.org
Subject: Re: OOM when using Ignite as HDFS Cache
I would not expect any of the things that you mention. A cache is not
supposed to slow down writing. This does not make sense from my point
of view. Splitting a block into several smalle
t on HDFS with block size 64MB. Is there any configuration for it?
I'm not sure I understand your question, but block size for HDFS is
configured in Hadoop config file.
-Dmitry.
--
View this message in context:
http://apache-ignite-users.70518.x6.nabble.com/OOM-when-using-Ignite-as-H
able. Cache eviction would not solve it because there do have
more data than cache capacity.
-Original Message-
From: Jörn Franke [mailto:jornfra...@gmail.com]
Sent: Friday, April 14, 2017 2:36 PM
To: user@ignite.apache.org
Subject: Re: OOM when using Ignite as HDFS Cache
I would not ex
n I write a file to Ignite with block size to 4GB, but I finally found it
> on HDFS with block size 64MB. Is there any configuration for it?
>
> -Original Message-
> From: dkarachentsev [mailto:dkarachent...@gridgain.com]
> Sent: Thursday, April 13, 2017 11:21 PM
> To: user@ignit
70518.x6.nabble.com/OOM-when-using-Ignite-as-HDFS-Cache-tp11900p11956.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.
Hi Shuai,
Could you please take heap dump on OOME and find what objects consume
memory? There would be a lot of byte[] objects, please find the nearest GC
root for them.
Thanks!
-Dmitry.
--
View this message in context:
http://apache-ignite-users.70518.x6.nabble.com/OOM-when-using-Ignite
Ping…
From: 张帅 [mailto:satan.stud...@gmail.com] On Behalf Of zhangshuai.u...@gmail.com
Sent: Wednesday, April 12, 2017 5:29 PM
To: user@ignite.apache.org
Subject: OOM when using Ignite as HDFS Cache
Hi there,
I’d like to use Ignite as HDFS Cache in my cluster but failed with OOM error