Re: Spark Streaming Job Keeps growing memory over time

Hi Sandeep, I have not enabled check pointing. I will try enabling check pointing and observe the memory pattern. but what you really want to correlate with check pointing . I don't know much about check-pointing. Thanks and rgds Aashish Kumar Software Engineer Avekshaa Technologies (P) Ltd.

Re: Spark Streaming Job Keeps growing memory over time

Hi Aashish, Do you have checkpointing enabled ? if not, Can you try enabling checkpointing and observe the memory pattern. Thanks, Sandeep ᐧ On Tue, Aug 9, 2016 at 4:25 PM, Mich Talebzadeh wrote: > Hi Aashish, > > You are running in standalone mode with one node > >

Re: Spark Streaming Job Keeps growing memory over time

a worker.and also in > > spark_env.sh file , setting any configuration related to executor comes > > under YARN only mode. > > I have also tried running example program but same problem. > > Any help would be greatly appreciated, > > Thanks > > > > > -- &g

Spark Streaming Job Keeps growing memory over time

n > spark_env.sh file , setting any configuration related to executor comes > under YARN only mode. I have also tried running example program but same problem. Any help would be greatly appreciated, Thanks -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.