RE: MLUtils.loadLibSVMFile error

2014-09-25 Thread Sameer Tilak
submitted as an app in spark-submit yarn-client mode. I am not sure whether this is due to difference between spark-shell and spark-submit or yarn vs non-yarn mode. Date: Wed, 24 Sep 2014 22:13:35 -0700 Subject: Re: MLUtils.loadLibSVMFile error From: liquan...@gmail.com To: ssti...@live.com CC

Re: MLUtils.loadLibSVMFile error

2014-09-25 Thread Liquan Pei
22:13:35 -0700 Subject: Re: MLUtils.loadLibSVMFile error From: liquan...@gmail.com To: ssti...@live.com CC: so...@cloudera.com; user@spark.apache.org Hi Sameer, I think there are two things that you can do 1) What is your current driver-memory or executor-memory, you can try to Increate

Re: MLUtils.loadLibSVMFile error

2014-09-24 Thread Liquan Pei
Hi Sameer, This seems to be a file format issue. Can you make sure that your data satisfies the format? Each line of libsvm format is as follows: label index1:value1 index2:value2 ... Thanks, Liquan On Wed, Sep 24, 2014 at 3:02 PM, Sameer Tilak ssti...@live.com wrote: Hi All, When I

RE: MLUtils.loadLibSVMFile error

2014-09-24 Thread Sameer Tilak
) From: so...@cloudera.com Date: Wed, 24 Sep 2014 23:07:27 +0100 Subject: Re: MLUtils.loadLibSVMFile error To: ssti...@live.com Well, why not show some of the file? it's pretty certain there is a problem with the format. The large repeated stack trace doesn't say anything more. On Wed, Sep 24

Re: MLUtils.loadLibSVMFile error

2014-09-24 Thread Liquan Pei
: MLUtils.loadLibSVMFile error To: ssti...@live.com Well, why not show some of the file? it's pretty certain there is a problem with the format. The large repeated stack trace doesn't say anything more. On Wed, Sep 24, 2014 at 11:02 PM, Sameer Tilak ssti...@live.com wrote: Hi All