I am May 3rd commit:
commit 49549d5a1a867c3ba25f5e4aec351d4102444bc0
Author: WangTaoTheTonic wangtao...@huawei.com
Date: Sun May 3 00:47:47 2015 +0100
[SPARK-7031] [THRIFTSERVER] let thrift server take SPARK_DAEMON_MEMORY
and SPARK_DAEMON_JAVA_OPTS
On Sat, May 23, 2015 at 7:54 PM, Josh
Ah right I misread this. I get it but I dont think the PR fixes this. Let
me comment there.
On May 24, 2015 3:56 PM, Sean Owen so...@cloudera.com wrote:
Wait, isn't the error message just saying you can't set 8mb buffers? So it
is correctly parsing the args. I don't understand why this has to
Wait, isn't the error message just saying you can't set 8mb buffers? So it
is correctly parsing the args. I don't understand why this has to do with
parsing the value. That much works.
On May 24, 2015 2:04 AM, Debasish Das debasish.da...@gmail.com wrote:
Hi,
I am on last week's master but all
Please update to the following:
commit c2f0821aad3b82dcd327e914c9b297e92526649d
Author: Zhang, Liye liye.zh...@intel.com
Date: Fri May 8 09:10:58 2015 +0100
[SPARK-7392] [CORE] bugfix: Kryo buffer size cannot be larger than 2M
On Sun, May 24, 2015 at 8:04 AM, Debasish Das
Hi,
I am on last week's master but all the examples that set up the following
.set(spark.kryoserializer.buffer, 8m)
are failing with the following error:
Exception in thread main java.lang.IllegalArgumentException:
spark.kryoserializer.buffer must be less than 2048 mb, got: + 8192 mb.
looks
bq. it shuld be 8mb
Please use the above syntax.
Cheers
On Sat, May 23, 2015 at 6:04 PM, Debasish Das debasish.da...@gmail.com
wrote:
Hi,
I am on last week's master but all the examples that set up the following
.set(spark.kryoserializer.buffer, 8m)
are failing with the following error:
Tried 8mb...still I am failing on the same error...
On Sat, May 23, 2015 at 6:10 PM, Ted Yu yuzhih...@gmail.com wrote:
bq. it shuld be 8mb
Please use the above syntax.
Cheers
On Sat, May 23, 2015 at 6:04 PM, Debasish Das debasish.da...@gmail.com
wrote:
Hi,
I am on last week's master
Pardon me.
Please use '8192k'
Cheers
On Sat, May 23, 2015 at 6:24 PM, Debasish Das debasish.da...@gmail.com
wrote:
Tried 8mb...still I am failing on the same error...
On Sat, May 23, 2015 at 6:10 PM, Ted Yu yuzhih...@gmail.com wrote:
bq. it shuld be 8mb
Please use the above syntax.
Which commit of master are you building off? It looks like there was a
bugfix for an issue related to KryoSerializer buffer configuration:
https://github.com/apache/spark/pull/5934
That patch was committed two weeks ago, but you mentioned that you're
building off a newer version of master.
