RE: Why I didn't see the benefits of using KryoSerializer

2015-03-20 Thread java8964
that in Spark SQL? Thanks Yong From: iras...@cloudera.com Date: Fri, 20 Mar 2015 11:54:38 -0500 Subject: Re: Why I didn't see the benefits of using KryoSerializer To: java8...@hotmail.com CC: user@spark.apache.org Hi Yong, yes I think your analysis is correct. I'd imagine almost all serializers out

Re: Why I didn't see the benefits of using KryoSerializer

2015-03-20 Thread Imran Rashid
with the KryoSerializer, so maybe I am total wrong about its usage. Thanks Yong -- From: java8...@hotmail.com To: user@spark.apache.org Subject: Why I didn't see the benefits of using KryoSerializer Date: Tue, 17 Mar 2015 12:01:35 -0400 Hi, I am new to Spark. I tried

RE: Why I didn't see the benefits of using KryoSerializer

2015-03-19 Thread java8964
wrong about its usage. Thanks Yong From: java8...@hotmail.com To: user@spark.apache.org Subject: Why I didn't see the benefits of using KryoSerializer Date: Tue, 17 Mar 2015 12:01:35 -0400 Hi, I am new to Spark. I tried to understand the memory benefits of using KryoSerializer. I have this one

Why I didn't see the benefits of using KryoSerializer

2015-03-17 Thread java8964
Hi, I am new to Spark. I tried to understand the memory benefits of using KryoSerializer. I have this one box standalone test environment, which is 24 cores with 24G memory. I installed Hadoop 2.2 plus Spark 1.2.0. I put one text file in the hdfs about 1.2G. Here is the settings in the