Re: Does spark-1.3.0 support the analytic functions defined in Hive, such as row_number, rank

2015-03-16 Thread Arush Kharbanda
You can track the issue here.

https://issues.apache.org/jira/browse/SPARK-1442

Its currently not supported, i guess the test cases are work in progress.


On Mon, Mar 16, 2015 at 12:44 PM, hseagle hsxup...@gmail.com wrote:

 Hi all,

  I'm wondering whether the latest spark-1.3.0 supports the windowing
 and
 analytic funtions in hive, such as row_number, rank and etc.

  Indeed, I've done some testing by using spark-shell and found that
 row_number is not supported yet.

  But I still found that there were some test case related to row_number
 and other analytics functions. These test cases is defined in

 sql/hive/target/scala-2.10/test-classes/ql/src/test/queries/clientpositive/windowing_multipartitioning.q

 So my question is divided into two parts, One is whether the analytics
 function is supported or not, the othere one is that if it's not supported
 why there are still some test cases

 hseagle



 --
 View this message in context:
 http://apache-spark-user-list.1001560.n3.nabble.com/Does-spark-1-3-0-support-the-analytic-functions-defined-in-Hive-such-as-row-number-rank-tp22072.html
 Sent from the Apache Spark User List mailing list archive at Nabble.com.

 -
 To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
 For additional commands, e-mail: user-h...@spark.apache.org




-- 

[image: Sigmoid Analytics] http://htmlsig.com/www.sigmoidanalytics.com

*Arush Kharbanda* || Technical Teamlead

ar...@sigmoidanalytics.com || www.sigmoidanalytics.com


Does spark-1.3.0 support the analytic functions defined in Hive, such as row_number, rank

2015-03-16 Thread hseagle
Hi all,

 I'm wondering whether the latest spark-1.3.0 supports the windowing and
analytic funtions in hive, such as row_number, rank and etc.
 
 Indeed, I've done some testing by using spark-shell and found that
row_number is not supported yet.

 But I still found that there were some test case related to row_number
and other analytics functions. These test cases is defined in
sql/hive/target/scala-2.10/test-classes/ql/src/test/queries/clientpositive/windowing_multipartitioning.q

So my question is divided into two parts, One is whether the analytics
function is supported or not, the othere one is that if it's not supported
why there are still some test cases

hseagle



--
View this message in context: 
http://apache-spark-user-list.1001560.n3.nabble.com/Does-spark-1-3-0-support-the-analytic-functions-defined-in-Hive-such-as-row-number-rank-tp22072.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

-
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h...@spark.apache.org