All,
I am seeing an odd issue with my streaming application. I am running Spark
1.4.1, Scala 2.10. Our streaming application has a batch time of two
minutes. The application runs well for a reasonable period of time (4-8
hours). It processes the same data in approximately the same amount of
ti
Hi Bryan,
when this happens do you check OS to see the amount of memory free and cpu
usage. sounds like another application may be creeping in.
OS tools like free and top may provide some clue.
Also you may see a number of skips in Spark GUI that could not be processed.
Dr Mich Talebzadeh
Li
