Re: What should be the ideal value(unit) for spark.memory.offheap.size

2016-01-08 Thread Umesh Kacha
tp://spark.apache.org/docs/latest/configuration.html#spark-properties). >> >> In your case, 5GB would be specified as 5g. >> >> >> >> On 6 January 2016 at 10:29, unk1102 <umesh.ka...@gmail.com> wrote: >> >>> >> >>> Hi As part

What should be the ideal value(unit) for spark.memory.offheap.size

2016-01-06 Thread unk1102
Hi As part of Spark 1.6 release what should be ideal value or unit for spark.memory.offheap.size I have set as 5000 I assume it will be 5GB is it correct? Please guide. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/What-should-be-the-ideal-value-unit

Re: What should be the ideal value(unit) for spark.memory.offheap.size

2016-01-06 Thread Ted Yu
http://spark.apache.org/docs/latest/configuration.html#spark-properties). > >> In your case, 5GB would be specified as 5g. > >> > >> On 6 January 2016 at 10:29, unk1102 <umesh.ka...@gmail.com> wrote: > >>> > >>> Hi As p

Re: What should be the ideal value(unit) for spark.memory.offheap.size

2016-01-06 Thread Marcelo Vanzin
t; In your case, 5GB would be specified as 5g. >> >> On 6 January 2016 at 10:29, unk1102 <umesh.ka...@gmail.com> wrote: >>> >>> Hi As part of Spark 1.6 release what should be ideal value or unit for >>> spark.memory.offheap.size I have set as 5000 I assum

Re: What should be the ideal value(unit) for spark.memory.offheap.size

2016-01-06 Thread Ted Yu
ion guide for a description on units ( > http://spark.apache.org/docs/latest/configuration.html#spark-properties). > In your case, 5GB would be specified as 5g. > > On 6 January 2016 at 10:29, unk1102 <umesh.ka...@gmail.com> wrote: > >> Hi As part of Spark 1.6 releas

Re: What should be the ideal value(unit) for spark.memory.offheap.size

2016-01-06 Thread Jakob Odersky
at should be ideal value or unit for > spark.memory.offheap.size I have set as 5000 I assume it will be 5GB is it > correct? Please guide. > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/What-should-be-the-ideal-value-unit-for-spark