Re: off-heap certain operations

Well, it is quite important the off-heap setting and now I am curios about other parameters, I hope everything else is well documented or not missleading. Best, Ovidiu > On 12 Feb 2016, at 19:18, Sean Owen wrote: > > I don't think much more is said since in fact it would

Re: off-heap certain operations

Sea; user@spark.apache.org Subject: Re: off-heap certain operations I don't think much more is said since in fact it would affect parts of the implementations of lots of operations -- anything touching Tungsten. It wouldn't be meaningful to try to list everything. The difference is allocating memory on

Re: off-heap certain operations

Spark1.6 do not recommend to use off-heap memory. > > > -- 原始邮件 -- > *发件人:* "Ovidiu-Cristian MARCU";<ovidiu-cristian.ma...@inria.fr>; > *发送时间:* 2016年2月12日(星期五) 凌晨5:51 > *收件人:* "user"<user@spark.apache.org>; > *主题:*

Re: off-heap certain operations

I found nothing about the certain operations. Still not clear, certain is poor documentation. Can someone give an answer so I can consider using this new release? spark.memory.offHeap.enabled If true, Spark will attempt to use off-heap memory for certain operations. > On 12 Feb 2016, at 13:21,

??????off-heap certain operations

??) 5:51 ??: "user"<user@spark.apache.org>; ????: off-heap certain operations Hi, Reading though the latest documentation for Memory management I can see that the parameter spark.memory.offHeap.enabled (true by default) is described with ??If true, Spark will attempt to

off-heap certain operations

Hi, Reading though the latest documentation for Memory management I can see that the parameter spark.memory.offHeap.enabled (true by default) is described with ‘If true, Spark will attempt to use off-heap memory for certain operations’ [1]. Can you please describe the certain operations you