, May 21, 2014 at 2:35 PM, Mohit Jaggi mohitja...@gmail.com wrote:
Hi,
I changed my application to use Joda time instead of java.util.Date and I
started getting this:
WARN ExternalAppendOnlyMap: Spilling in-memory map of 484 MB to disk (1
time so far)
What does this mean? How can I fix
this:
WARN ExternalAppendOnlyMap: Spilling in-memory map of 484 MB to disk (1
time so far)
What does this mean? How can I fix this? Due to this a small job takes
forever.
Mohit.
P.S.: I am using kyro serialization, have played around with several
values of sparkRddMemFraction
://spark.apache.org/docs/latest/tuning.html#data-serialization
On Wed, May 21, 2014 at 2:35 PM, Mohit Jaggi mohitja...@gmail.com wrote:
Hi,
I changed my application to use Joda time instead of java.util.Date and I
started getting this:
WARN ExternalAppendOnlyMap: Spilling in-memory map of 484 MB
