Well, it is quite important the off-heap setting and now I am curios about
other parameters, I hope everything else is well documented or not missleading.
Best,
Ovidiu
> On 12 Feb 2016, at 19:18, Sean Owen wrote:
>
> I don't think much more is said since in fact it would
Sea; user@spark.apache.org
Subject: Re: off-heap certain operations
I don't think much more is said since in fact it would affect parts of
the implementations of lots of operations -- anything touching
Tungsten. It wouldn't be meaningful to try to list everything.
The difference is allocating memory on
Spark1.6 do not recommend to use off-heap memory.
>
>
> -- 原始邮件 --
> *发件人:* "Ovidiu-Cristian MARCU";<ovidiu-cristian.ma...@inria.fr>;
> *发送时间:* 2016年2月12日(星期五) 凌晨5:51
> *收件人:* "user"<user@spark.apache.org>;
> *主题:*
I found nothing about the certain operations. Still not clear, certain is poor
documentation. Can someone give an answer so I can consider using this new
release?
spark.memory.offHeap.enabled
If true, Spark will attempt to use off-heap memory for certain operations.
> On 12 Feb 2016, at 13:21,
??) 5:51
??: "user"<user@spark.apache.org>;
????: off-heap certain operations
Hi,
Reading though the latest documentation for Memory management I can see that
the parameter spark.memory.offHeap.enabled (true by default) is described with
??If true, Spark will attempt to
Hi,
Reading though the latest documentation for Memory management I can see that
the parameter spark.memory.offHeap.enabled (true by default) is described with
‘If true, Spark will attempt to use off-heap memory for certain operations’ [1].
Can you please describe the certain operations you