Re: Spark 2.0 - SQL Subqueries.

2016-05-21 Thread Reynold Xin
https://issues.apache.org/jira/browse/SPARK-15078 was just a bunch of test
harness and added no new functionality. To reduce confusion, I just
backported it into branch-2.0 so SPARK-15078 is now in 2.0 too.

Can you paste a query you were testing?


On Sat, May 21, 2016 at 10:49 AM, Kamalesh Nair 
wrote:

> Hi,
>
> From the Spark 2.0 Release webinar what I understood is, the newer version
> have significantly expanded the SQL capabilities of Spark, with the
> introduction of a new ANSI SQL parser and support for Subqueries.  It also
> says, Spark 2.0 can run all the 99 TPC-DS queries, which require many of
> the
> SQL:2003 features.
>
> I was testing out Spark 2.0 (apache/branch-2.0 preview) Technical Preview
> provided by Databricks and observed that the Spark SQL Subqueries are now
> supported in Where Clause which is great but it is not supported in Select
> Clause itself. Below listed is the error message displayed.
>
> "Error in SQL statement: AnalysisException: Predicate sub-queries can only
> be used in a Filter"
>
> Is it work in progress planned for the final release or a miss ?
>
> Also, I could find a related JIRA # SPARK-15078 being resolved in Spark
> 2.1.0 version. If this is what address this issue then kindly let me know
> the tentative release dates for Spark 2.1.0. Instead of Spark 2.0 in mid
> June would it be Spark 2.1.0 that would be released during the same time ?
>
> Thanks in advanace for your prompt reply !
>
>
>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/Spark-2-0-SQL-Subqueries-tp26993.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>
> -
> To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
> For additional commands, e-mail: user-h...@spark.apache.org
>
>


Spark 2.0 - SQL Subqueries.

2016-05-21 Thread Kamalesh Nair
Hi, 

>From the Spark 2.0 Release webinar what I understood is, the newer version
have significantly expanded the SQL capabilities of Spark, with the
introduction of a new ANSI SQL parser and support for Subqueries.  It also
says, Spark 2.0 can run all the 99 TPC-DS queries, which require many of the
SQL:2003 features.

I was testing out Spark 2.0 (apache/branch-2.0 preview) Technical Preview
provided by Databricks and observed that the Spark SQL Subqueries are now
supported in Where Clause which is great but it is not supported in Select
Clause itself. Below listed is the error message displayed.

"Error in SQL statement: AnalysisException: Predicate sub-queries can only
be used in a Filter"

Is it work in progress planned for the final release or a miss ? 

Also, I could find a related JIRA # SPARK-15078 being resolved in Spark
2.1.0 version. If this is what address this issue then kindly let me know
the tentative release dates for Spark 2.1.0. Instead of Spark 2.0 in mid
June would it be Spark 2.1.0 that would be released during the same time ?

Thanks in advanace for your prompt reply !





--
View this message in context: 
http://apache-spark-user-list.1001560.n3.nabble.com/Spark-2-0-SQL-Subqueries-tp26993.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

-
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h...@spark.apache.org