RE: OOM when using Ignite as HDFS Cache

2017-04-18 Thread zhangshuai.ustc
Yes, I'm getting "GC Overhead limit exceeded" OOME and I think this is an unexpected behavior. I'll try the off heap options days later. Thanks for your advice. I'm providing HDFS server to our customers. As you know, HDFS is not friendly to many small files. We sometimes need to merge files

RE: OOM when using Ignite as HDFS Cache

2017-04-14 Thread zhangshuai.ustc
I think it's a kind of misconfiguration. The Ignite document just mentioned about how to configuration HDFS as a secondary filesystem but nothing about how to restrict the memory usage to avoid OOME. https://apacheignite.readme.io/v1.0/docs/igfs-secondary-file-system Assume I configured the