Re: Spark driver using Spark Streaming shows increasing memory/CPU usage

[Apologies if the end of the last email was only included as an attachment - MacMail seems to do that with the rest of the message if an attachment appears inline. I‘m sending again for clarity.] Hi Tathagata, Thanks for your quick reply! I’ll add some more detail below about what I’m doing -

Re: Spark driver using Spark Streaming shows increasing memory/CPU usage

Hi Tathagata, Thanks for your quick reply! I’ll add some more detail below about what I’m doing - I’ve tried a lot of variations on the code to debug this, with monitoring enabled, but I didn’t want to overwhelm the issue description to start with ;-) On 30 Jun 2015, at 19:30, Tathagata Das