RE: Date and decimal datatype not working

2015-04-02 Thread BASAK, ANANDA
first code ran successfully giving me some confidence, now I will explore more. Regards Ananda From: BASAK, ANANDA Sent: Thursday, March 26, 2015 4:55 PM To: Dean Wampler Cc: Yin Huai; user@spark.apache.org Subject: RE: Date and decimal datatype not working Thanks all. I am installing Spark 1.3

RE: Date and decimal datatype not working

2015-03-26 Thread BASAK, ANANDA
To: BASAK, ANANDA Cc: Yin Huai; user@spark.apache.org Subject: Re: Date and decimal datatype not working Recall that the input isn't actually read until to do something that forces evaluation, like call saveAsTextFile. You didn't show the whole stack trace here, but it probably occurred while

RE: Date and decimal datatype not working

2015-03-25 Thread BASAK, ANANDA
-213-7092 From: Yin Huai [mailto:yh...@databricks.com] Sent: Monday, March 23, 2015 8:55 PM To: BASAK, ANANDA Cc: user@spark.apache.org Subject: Re: Date and decimal datatype not working To store to csv file, you can use Spark-CSVhttps://github.com/databricks/spark-csv library. On Mon, Mar 23

Re: Date and decimal datatype not working

2015-03-25 Thread Dean Wampler
: 425-213-7092 *From:* Yin Huai [mailto:yh...@databricks.com] *Sent:* Monday, March 23, 2015 8:55 PM *To:* BASAK, ANANDA *Cc:* user@spark.apache.org *Subject:* Re: Date and decimal datatype not working To store to csv file, you can use Spark-CSV https://github.com/databricks/spark-csv

RE: Date and decimal datatype not working

2015-03-23 Thread BASAK, ANANDA
not working Ok, thanks for the suggestions. Let me try and will confirm all. Regards Ananda From: Yin Huai [mailto:yh...@databricks.com] Sent: Tuesday, March 17, 2015 3:04 PM To: BASAK, ANANDA Cc: user@spark.apache.org Subject: Re: Date and decimal datatype not working p(0) is a String. So, you

Re: Date and decimal datatype not working

2015-03-23 Thread Yin Huai
--- Ananda Basak Ph: 425-213-7092 *From:* BASAK, ANANDA *Sent:* Tuesday, March 17, 2015 3:08 PM *To:* Yin Huai *Cc:* user@spark.apache.org *Subject:* RE: Date and decimal datatype not working Ok, thanks for the suggestions. Let me try and will confirm all. Regards Ananda

RE: Date and decimal datatype not working

2015-03-17 Thread BASAK, ANANDA
Ok, thanks for the suggestions. Let me try and will confirm all. Regards Ananda From: Yin Huai [mailto:yh...@databricks.com] Sent: Tuesday, March 17, 2015 3:04 PM To: BASAK, ANANDA Cc: user@spark.apache.org Subject: Re: Date and decimal datatype not working p(0) is a String. So, you need

Re: Date and decimal datatype not working

2015-03-17 Thread Yin Huai
p(0) is a String. So, you need to explicitly convert it to a Long. e.g. p(0).trim.toLong. You also need to do it for p(2). For those BigDecimals value, you need to create BigDecimal objects from your String values. On Tue, Mar 17, 2015 at 5:55 PM, BASAK, ANANDA ab9...@att.com wrote: Hi All,