RE: OOM when using Ignite as HDFS Cache

2017-04-27 Thread Ivan Veselovsky
Hi, zhangshuai.ustc , is this problem solved? Can we help more on the subject? -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/OOM-when-using-Ignite-as-HDFS-Cache-tp11900p12297.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

RE: OOM when using Ignite as HDFS Cache

2017-04-18 Thread zhangshuai.ustc
17 3:35 PM To: user@ignite.apache.org Subject: Re: OOM when using Ignite as HDFS Cache Are you getting "GC Overhead limit exceeded" OOME? I think you could always move IGFS data block cache off heap if it is not the case already. I am wondering why you've set block size to 4 GB for Ig

Re: OOM when using Ignite as HDFS Cache

2017-04-18 Thread Kamil Misuth
Friday, April 14, 2017 2:36 PM To: user@ignite.apache.org Subject: Re: OOM when using Ignite as HDFS Cache I would not expect any of the things that you mention. A cache is not supposed to slow down writing. This does not make sense from my point of view. Splitting a block into several smalle

RE: OOM when using Ignite as HDFS Cache

2017-04-14 Thread dkarachentsev
t on HDFS with block size 64MB. Is there any configuration for it? I'm not sure I understand your question, but block size for HDFS is configured in Hadoop config file. -Dmitry. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/OOM-when-using-Ignite-as-H

RE: OOM when using Ignite as HDFS Cache

2017-04-14 Thread 张帅
able. Cache eviction would not solve it because there do have more data than cache capacity. -Original Message- From: Jörn Franke [mailto:jornfra...@gmail.com] Sent: Friday, April 14, 2017 2:36 PM To: user@ignite.apache.org Subject: Re: OOM when using Ignite as HDFS Cache I would not ex

Re: OOM when using Ignite as HDFS Cache

2017-04-14 Thread Jörn Franke
n I write a file to Ignite with block size to 4GB, but I finally found it > on HDFS with block size 64MB. Is there any configuration for it? > > -Original Message- > From: dkarachentsev [mailto:dkarachent...@gridgain.com] > Sent: Thursday, April 13, 2017 11:21 PM > To: user@ignit

RE: OOM when using Ignite as HDFS Cache

2017-04-14 Thread zhangshuai.ustc
70518.x6.nabble.com/OOM-when-using-Ignite-as-HDFS-Cache-tp11900p11956.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: OOM when using Ignite as HDFS Cache

2017-04-13 Thread dkarachentsev
Hi Shuai, Could you please take heap dump on OOME and find what objects consume memory? There would be a lot of byte[] objects, please find the nearest GC root for them. Thanks! -Dmitry. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/OOM-when-using-Ignite

RE: OOM when using Ignite as HDFS Cache

2017-04-12 Thread 张帅
Ping… From: 张帅 [mailto:satan.stud...@gmail.com] On Behalf Of zhangshuai.u...@gmail.com Sent: Wednesday, April 12, 2017 5:29 PM To: user@ignite.apache.org Subject: OOM when using Ignite as HDFS Cache Hi there, I’d like to use Ignite as HDFS Cache in my cluster but failed with OOM error