I need some help to convert the date pattern in my Scala code for Spark 1.3. I
am reading the dates from two flat files having two different date formats.
File 1:
2015-03-27
File 2:
02-OCT-12
09-MAR-13
This format of file 2 is not being recognized by my Spark SQL when I am
comparing it in a
first code ran successfully giving me some confidence, now I
will explore more.
Regards
Ananda
From: BASAK, ANANDA
Sent: Thursday, March 26, 2015 4:55 PM
To: Dean Wampler
Cc: Yin Huai; user@spark.apache.org
Subject: RE: Date and decimal datatype not working
Thanks all. I am installing Spark 1.3
To: BASAK, ANANDA
Cc: Yin Huai; user@spark.apache.org
Subject: Re: Date and decimal datatype not working
Recall that the input isn't actually read until to do something that forces
evaluation, like call saveAsTextFile. You didn't show the whole stack trace
here, but it probably occurred while
-213-7092
From: Yin Huai [mailto:yh...@databricks.com]
Sent: Monday, March 23, 2015 8:55 PM
To: BASAK, ANANDA
Cc: user@spark.apache.org
Subject: Re: Date and decimal datatype not working
To store to csv file, you can use
Spark-CSVhttps://github.com/databricks/spark-csv library.
On Mon, Mar 23
error. Can you please
help me to write a proper syntax to store output in a CSV file?
Thanks Regards
---
Ananda Basak
Ph: 425-213-7092
From: BASAK, ANANDA
Sent: Tuesday, March 17, 2015 3:08 PM
To: Yin Huai
Cc: user@spark.apache.org
Subject: RE: Date and decimal datatype
Ok, thanks for the suggestions. Let me try and will confirm all.
Regards
Ananda
From: Yin Huai [mailto:yh...@databricks.com]
Sent: Tuesday, March 17, 2015 3:04 PM
To: BASAK, ANANDA
Cc: user@spark.apache.org
Subject: Re: Date and decimal datatype not working
p(0) is a String. So, you need
Hi All,
I am very new in Spark world. Just started some test coding from last week. I
am using spark-1.2.1-bin-hadoop2.4 and scala coding.
I am having issues while using Date and decimal data types. Following is my
code that I am simply running on scala prompt. I am trying to define a table
and
Hi All,
I am very new in Spark world. Just started some test coding from last week. I
am using spark-1.2.1-bin-hadoop2.4 and scala coding.
I am having issues while using Date and decimal data types. Following is my
code that I am simply running on scala prompt. I am trying to define a table
and
