submitted as an app in
spark-submit yarn-client mode. I am not sure whether this is due to difference
between spark-shell and spark-submit or yarn vs non-yarn mode.
Date: Wed, 24 Sep 2014 22:13:35 -0700
Subject: Re: MLUtils.loadLibSVMFile error
From: liquan...@gmail.com
To: ssti...@live.com
CC
22:13:35 -0700
Subject: Re: MLUtils.loadLibSVMFile error
From: liquan...@gmail.com
To: ssti...@live.com
CC: so...@cloudera.com; user@spark.apache.org
Hi Sameer,
I think there are two things that you can do
1) What is your current driver-memory or executor-memory, you can try to
Increate
Hi All,
When I try to load dataset using MLUtils.loadLibSVMFile, I have the following
problem. Any help will be greatly appreciated!
Code snippet:
import org.apache.spark.mllib.regression.LabeledPoint
import org.apache.spark.mllib.util.MLUtils
import org.apache.spark.rdd.RDD
import
Hi Sameer,
This seems to be a file format issue. Can you make sure that your data
satisfies the format?
Each line of libsvm format is as follows:
label index1:value1 index2:value2 ...
Thanks,
Liquan
On Wed, Sep 24, 2014 at 3:02 PM, Sameer Tilak ssti...@live.com wrote:
Hi All,
When I
)
From: so...@cloudera.com
Date: Wed, 24 Sep 2014 23:07:27 +0100
Subject: Re: MLUtils.loadLibSVMFile error
To: ssti...@live.com
Well, why not show some of the file? it's pretty certain there is a
problem with the format. The large repeated stack trace doesn't say
anything more.
On Wed, Sep 24
: MLUtils.loadLibSVMFile error
To: ssti...@live.com
Well, why not show some of the file? it's pretty certain there is a
problem with the format. The large repeated stack trace doesn't say
anything more.
On Wed, Sep 24, 2014 at 11:02 PM, Sameer Tilak ssti...@live.com wrote:
Hi All