All,
Does anyone meet memory leak issue with spark streaming and spark sql in
spark 1.5.1? I can see the memory is increasing all the time when running
this simple sample:
val sc = new SparkContext(conf)
val sqlContext = new HiveContext(sc)
import sqlContext.implicits._
+dev list
On Wed, Oct 14, 2015 at 1:07 AM, Terry Hoo wrote:
> All,
>
> Does anyone meet memory leak issue with spark streaming and spark sql in
> spark 1.5.1? I can see the memory is increasing all the time when running
> this simple sample:
>
> val sc = new SparkContext(conf)
>
Thanks for reporting it Terry. I submitted a PR to fix it:
https://github.com/apache/spark/pull/9132
Best Regards,
Shixiong Zhu
2015-10-15 2:39 GMT+08:00 Reynold Xin :
> +dev list
>
> On Wed, Oct 14, 2015 at 1:07 AM, Terry Hoo wrote:
>
>> All,
>>
>> Does anyone meet memory leak issue with spark