Re: How to get 2 years prior date from currentdate using Spark Sql

2016-09-07 Thread Yong Zhang
equest for this issue: https://github.com/apache/spark/pull/6782 From: Yong Zhang <java8...@hotmail.com> Sent: Wednesday, September 7, 2016 9:13 AM To: farman.bsse1855; dev@spark.apache.org Subject: Re: How to get 2 years prior date from currentdate using Spark

Re: How to get 2 years prior date from currentdate using Spark Sql

2016-09-07 Thread Yong Zhang
https://issues.apache.org/jira/browse/SPARK-8185 [SPARK-8185] date/time function: datediff - ASF JIRA issues.apache.org Spark; SPARK-8159 Improve expression function coverage (Spark 1.5) SPARK-8185; date/time function: datediff

Re: Outer Explode needed

2016-07-26 Thread Yong Zhang
The reason of no response is that this feature is not available yet. You can vote and following this JIRA https://issues.apache.org/jira/browse/SPARK-13721, if you really need this feature. Yong From: Don Drake Sent: Monday, July 25,

RE: Eliminating shuffle write and spill disk IO reads/writes in Spark

2016-04-01 Thread Yong Zhang
Is there a configuration in the Spark of location of "shuffle spilling"? I didn't recall ever see that one. Can you share it out? It will be good for a test writing to RAM Disk if that configuration is available. Thanks Yong From: r...@databricks.com Date: Fri, 1 Apr 2016 15:32:23 -0700