Re: spark sql: timestamp in json - fails

2014-10-20 Thread Michael Armbrust
I think you are running into a bug that will be fixed by this PR: https://github.com/apache/spark/pull/2850 On Mon, Oct 20, 2014 at 4:34 PM, tridib tridib.sama...@live.com wrote: Hello Experts, After repeated attempt I am unable to run query on map json date string. I tried two approaches:

Re: spark sql: timestamp in json - fails

2014-10-20 Thread Yin Huai
Hi Tridib, For the second approach, can you attach the complete stack trace? Thanks, Yin On Mon, Oct 20, 2014 at 8:24 PM, Michael Armbrust mich...@databricks.com wrote: I think you are running into a bug that will be fixed by this PR: https://github.com/apache/spark/pull/2850 On Mon, Oct

RE: spark sql: timestamp in json - fails

2014-10-20 Thread Wang, Daoyuan
: tridib; u...@spark.incubator.apache.org Subject: Re: spark sql: timestamp in json - fails Hi Tridib, For the second approach, can you attach the complete stack trace? Thanks, Yin On Mon, Oct 20, 2014 at 8:24 PM, Michael Armbrust mich...@databricks.commailto:mich...@databricks.com wrote: I think

Re: spark sql: timestamp in json - fails

2014-10-20 Thread Yin Huai
sql: timestamp in json - fails Hi Tridib, For the second approach, can you attach the complete stack trace? Thanks, Yin On Mon, Oct 20, 2014 at 8:24 PM, Michael Armbrust mich...@databricks.com wrote: I think you are running into a bug that will be fixed by this PR: https

RE: spark sql: timestamp in json - fails

2014-10-20 Thread Wang, Daoyuan
; u...@spark.incubator.apache.orgmailto:u...@spark.incubator.apache.org Subject: Re: spark sql: timestamp in json - fails Hi Tridib, For the second approach, can you attach the complete stack trace? Thanks, Yin On Mon, Oct 20, 2014 at 8:24 PM, Michael Armbrust mich

RE: spark sql: timestamp in json - fails

2014-10-20 Thread Wang, Daoyuan
Seems I made a mistake… From: Wang, Daoyuan Sent: Tuesday, October 21, 2014 10:35 AM To: 'Yin Huai' Cc: Michael Armbrust; tridib; u...@spark.incubator.apache.org Subject: RE: spark sql: timestamp in json - fails I got that, it is in JsonRDD.java of `typeOfPrimitiveValues`. I’ll fix

Re: spark sql: timestamp in json - fails

2014-10-20 Thread tridib
Stack trace for my second case: 2014-10-20 23:00:36,903 ERROR [Executor task launch worker-0] executor.Executor (Logging.scala:logError(96)) - Exception in task 0.0 in stage 0.0 (TID 0) scala.MatchError: TimestampType (of class org.apache.spark.sql.catalyst.types.TimestampType$) at

RE: spark sql: timestamp in json - fails

2014-10-20 Thread Wang, Daoyuan
sql: timestamp in json - fails Stack trace for my second case: 2014-10-20 23:00:36,903 ERROR [Executor task launch worker-0] executor.Executor (Logging.scala:logError(96)) - Exception in task 0.0 in stage 0.0 (TID 0) scala.MatchError: TimestampType (of class

RE: spark sql: timestamp in json - fails

2014-10-20 Thread tridib
Spark 1.1.0 -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/spark-sql-timestamp-in-json-fails-tp16864p16888.html Sent from the Apache Spark User List mailing list archive at Nabble.com. -

RE: spark sql: timestamp in json - fails

2014-10-20 Thread Wang, Daoyuan
The exception of second approach, has been resolved by SPARK-3853. Thanks, Daoyuan -Original Message- From: Wang, Daoyuan [mailto:daoyuan.w...@intel.com] Sent: Tuesday, October 21, 2014 11:06 AM To: tridib; u...@spark.incubator.apache.org Subject: RE: spark sql: timestamp in json

RE: spark sql: timestamp in json - fails

2014-10-20 Thread Wang, Daoyuan
Subject: RE: spark sql: timestamp in json - fails Spark 1.1.0 -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/spark-sql-timestamp-in-json-fails-tp16864p16888.html Sent from the Apache Spark User List mailing list archive at Nabble.com