Can you elaborate more on from where you are streaming the data and what type of consumer you are using etc?
Thanks Best Regards On Tue, Mar 29, 2016 at 6:10 PM, Mayur Mohite <mayur.moh...@applift.com> wrote: > Hi, > > We are running spark streaming app on a single machine and we have > configured spark executor memory to 30G. > We noticed that after running the app for 12 hours, spark streaming > started spilling ALL the data to disk even though we have configured > sufficient memory for spark to use for storage. > > -Mayur > > Learn more about our inaugural *FirstScreen Conference > <http://www.firstscreenconf.com/>*! > *Where the worlds of mobile advertising and technology meet!* > > June 15, 2016 @ Urania Berlin >
