[GitHub] spark pull request #19327: [WIP] Implement stream-stream outer joins.

2017-09-25 Thread joseph-torres
Github user joseph-torres commented on a diff in the pull request: https://github.com/apache/spark/pull/19327#discussion_r140968754 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/state/SymmetricHashJoinStateManager.scala --- @@ -87,70 +87,157 @@ class S

[GitHub] spark issue #19181: [SPARK-21907][CORE] oom during spill

2017-09-25 Thread eyalfa
Github user eyalfa commented on the issue: https://github.com/apache/spark/pull/19181 @hvanhovell ? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@sp

[GitHub] spark issue #18747: [WIP][SPARK-20822][SQL] Generate code to directly get va...

2017-09-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18747 **[Test build #82182 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82182/testReport)** for PR 18747 at commit [`2508593`](https://github.com/apache/spark/commit/25

[GitHub] spark issue #19349: [SPARK-22125][PYSPARK][SQL] Enable Arrow Stream format f...

2017-09-25 Thread ueshin
Github user ueshin commented on the issue: https://github.com/apache/spark/pull/19349 The performance test I did in my local based on @BryanCutler's (https://github.com/apache/spark/pull/18659#issuecomment-315879173) is as follows: ```python from pyspark.sql.functions imp

[GitHub] spark issue #19343: [SPARK-22121][CORE] Correct database location for nameno...

2017-09-25 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/19343 Spark SQL might not be deployed in the HDFS system. Conceptually, this HDFS-specific codes should not be part of our `HiveExternalCatalog` --- -

[GitHub] spark issue #19346: [SAPRK-20785][WEB-UI][SQL] Spark should provide jump lin...

2017-09-25 Thread jerryshao
Github user jerryshao commented on the issue: https://github.com/apache/spark/pull/19346 GLTM. @gatorsmile , would you please take a look at this PR, is it good for you? --- - To unsubscribe, e-mail: reviews-unsubsc

[GitHub] spark issue #19175: [SPARK-21964][SQL]Enable splitting the Aggregate (on Exp...

2017-09-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19175 **[Test build #82181 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82181/testReport)** for PR 19175 at commit [`c87edeb`](https://github.com/apache/spark/commit/c8

[GitHub] spark issue #19343: [SPARK-22121][CORE] Correct database location for nameno...

2017-09-25 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/19343 This is not `[CORE]`. The title should be updated to `[SQL]` --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.or

[GitHub] spark issue #19346: [SAPRK-20785][WEB-UI][SQL] Spark should provide jump lin...

2017-09-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19346 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #19346: [SAPRK-20785][WEB-UI][SQL] Spark should provide jump lin...

2017-09-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19346 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82171/ Test PASSed. ---

[GitHub] spark issue #19346: [SAPRK-20785][WEB-UI][SQL] Spark should provide jump lin...

2017-09-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19346 **[Test build #82171 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82171/testReport)** for PR 19346 at commit [`305689f`](https://github.com/apache/spark/commit/3

[GitHub] spark issue #19349: [SPARK-22125][PYSPARK][SQL] Enable Arrow Stream format f...

2017-09-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19349 **[Test build #82180 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82180/testReport)** for PR 19349 at commit [`14aa3b6`](https://github.com/apache/spark/commit/14

[GitHub] spark issue #19338: [SPARK-22123][CORE] Add latest failure reason for task s...

2017-09-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19338 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82169/ Test PASSed. ---

[GitHub] spark issue #19338: [SPARK-22123][CORE] Add latest failure reason for task s...

2017-09-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19338 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #19338: [SPARK-22123][CORE] Add latest failure reason for task s...

2017-09-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19338 **[Test build #82169 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82169/testReport)** for PR 19338 at commit [`57190ef`](https://github.com/apache/spark/commit/5

[GitHub] spark issue #19186: [SPARK-21972][ML] Add param handlePersistence

2017-09-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19186 **[Test build #82179 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82179/testReport)** for PR 19186 at commit [`18f9903`](https://github.com/apache/spark/commit/18

[GitHub] spark issue #19175: [SPARK-21964][SQL]Enable splitting the Aggregate (on Exp...

2017-09-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19175 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #19175: [SPARK-21964][SQL]Enable splitting the Aggregate (on Exp...

2017-09-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19175 **[Test build #82178 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82178/testReport)** for PR 19175 at commit [`44ecbca`](https://github.com/apache/spark/commit/4

[GitHub] spark issue #19175: [SPARK-21964][SQL]Enable splitting the Aggregate (on Exp...

2017-09-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19175 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82178/ Test FAILed. ---

[GitHub] spark issue #19345: [SPARK-22124][SQL] Sample and Limit should also defer in...

2017-09-25 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/19345 cc @cloud-fan or @hvanhovell This should be a straightforward change. Please take a quick look. Thanks. --- - To unsubscribe, e-m

[GitHub] spark issue #19349: [SPARK-22125][PYSPARK][SQL] Enable Arrow Stream format f...

2017-09-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19349 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #19349: [SPARK-22125][PYSPARK][SQL] Enable Arrow Stream format f...

2017-09-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19349 **[Test build #82175 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82175/testReport)** for PR 19349 at commit [`e62d619`](https://github.com/apache/spark/commit/e

[GitHub] spark issue #19349: [SPARK-22125][PYSPARK][SQL] Enable Arrow Stream format f...

2017-09-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19349 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82175/ Test FAILed. ---

[GitHub] spark issue #19175: [SPARK-21964][SQL]Enable splitting the Aggregate (on Exp...

2017-09-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19175 **[Test build #82178 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82178/testReport)** for PR 19175 at commit [`44ecbca`](https://github.com/apache/spark/commit/44

[GitHub] spark issue #19175: [SPARK-21964][SQL]Enable splitting the Aggregate (on Exp...

2017-09-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19175 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #19175: [SPARK-21964][SQL]Enable splitting the Aggregate (on Exp...

2017-09-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19175 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82177/ Test FAILed. ---

[GitHub] spark issue #19175: [SPARK-21964][SQL]Enable splitting the Aggregate (on Exp...

2017-09-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19175 **[Test build #82177 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82177/testReport)** for PR 19175 at commit [`9448371`](https://github.com/apache/spark/commit/9

[GitHub] spark issue #19175: [SPARK-21964][SQL]Enable splitting the Aggregate (on Exp...

2017-09-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19175 **[Test build #82177 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82177/testReport)** for PR 19175 at commit [`9448371`](https://github.com/apache/spark/commit/94

[GitHub] spark issue #19349: [SPARK-22125][PYSPARK][SQL] Enable Arrow Stream format f...

2017-09-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19349 **[Test build #82175 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82175/testReport)** for PR 19349 at commit [`e62d619`](https://github.com/apache/spark/commit/e6

[GitHub] spark issue #19287: [SPARK-22074][Core] Task killed by other attempt task sh...

2017-09-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19287 **[Test build #82176 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82176/testReport)** for PR 19287 at commit [`039591d`](https://github.com/apache/spark/commit/03

[GitHub] spark issue #19349: [SPARK-22125][PYSPARK][SQL] Enable Arrow Stream format f...

2017-09-25 Thread ueshin
Github user ueshin commented on the issue: https://github.com/apache/spark/pull/19349 cc @BryanCutler @HyukjinKwon @viirya @cloud-fan --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark pull request #19349: [SPARK-22125][PYSPARK][SQL] Enable Arrow Stream f...

2017-09-25 Thread ueshin
GitHub user ueshin opened a pull request: https://github.com/apache/spark/pull/19349 [SPARK-22125][PYSPARK][SQL] Enable Arrow Stream format for vectorized UDF. ## What changes were proposed in this pull request? Currently we use Arrow File format to communicate with Python w

[GitHub] spark pull request #19342: [MINOR][SparkR] minor fixes for CRAN compliance

2017-09-25 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/19342#discussion_r140958369 --- Diff: R/pkg/DESCRIPTION --- @@ -59,3 +59,4 @@ Collate: 'window.R' RoxygenNote: 5.0.1 VignetteBuilder: knitr +SystemRequirement

[GitHub] spark pull request #19342: [MINOR][SparkR] minor fixes for CRAN compliance

2017-09-25 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/19342#discussion_r140958315 --- Diff: R/pkg/DESCRIPTION --- @@ -59,3 +59,4 @@ Collate: 'window.R' RoxygenNote: 5.0.1 VignetteBuilder: knitr +SystemRequirement

[GitHub] spark pull request #19342: [MINOR][SparkR] minor fixes for CRAN compliance

2017-09-25 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/19342#discussion_r140957541 --- Diff: R/pkg/DESCRIPTION --- @@ -59,3 +59,4 @@ Collate: 'window.R' RoxygenNote: 5.0.1 VignetteBuilder: knitr +SystemRequirement

[GitHub] spark pull request #19342: [MINOR][SparkR] minor fixes for CRAN compliance

2017-09-25 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/19342#discussion_r140957870 --- Diff: R/pkg/R/DataFrame.R --- @@ -3250,6 +3250,7 @@ setMethod("attach", function(what, pos = 2, name = deparse(substitute(what)), war

[GitHub] spark issue #19330: [SPARK-18134][SQL] Orderable MapType

2017-09-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19330 **[Test build #82174 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82174/testReport)** for PR 19330 at commit [`0385487`](https://github.com/apache/spark/commit/03

[GitHub] spark issue #19345: [SPARK-22124][SQL] Sample and Limit should also defer in...

2017-09-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19345 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #19345: [SPARK-22124][SQL] Sample and Limit should also defer in...

2017-09-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19345 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82168/ Test PASSed. ---

[GitHub] spark issue #19345: [SPARK-22124][SQL] Sample and Limit should also defer in...

2017-09-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19345 **[Test build #82168 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82168/testReport)** for PR 19345 at commit [`0252663`](https://github.com/apache/spark/commit/0

[GitHub] spark issue #19330: Orderable MapType

2017-09-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19330 **[Test build #82173 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82173/testReport)** for PR 19330 at commit [`33e532b`](https://github.com/apache/spark/commit/33

[GitHub] spark issue #19343: [SPARK-22121][CORE] Correct database location for nameno...

2017-09-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19343 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #19343: [SPARK-22121][CORE] Correct database location for nameno...

2017-09-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19343 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82170/ Test PASSed. ---

[GitHub] spark issue #19343: [SPARK-22121][CORE] Correct database location for nameno...

2017-09-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19343 **[Test build #82170 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82170/testReport)** for PR 19343 at commit [`c6acdf2`](https://github.com/apache/spark/commit/c

[GitHub] spark issue #19348: [BUILD] Close stale PRs

2017-09-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19348 **[Test build #82172 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82172/testReport)** for PR 19348 at commit [`a71bb48`](https://github.com/apache/spark/commit/a7

[GitHub] spark issue #19344: [SPARK-22122][SQL] Respect WITH clauses to count input r...

2017-09-25 Thread maropu
Github user maropu commented on the issue: https://github.com/apache/spark/pull/19344 @gatorsmile if you get time, please check this. thanks. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For add

[GitHub] spark pull request #19348: [BUILD] Close stale PRs

2017-09-25 Thread HyukjinKwon
GitHub user HyukjinKwon opened a pull request: https://github.com/apache/spark/pull/19348 [BUILD] Close stale PRs Closes #13794 Closes #18474 Closes #18897 Closes #18978 Closes #19152 Closes #19238 Closes #19295 Closes #19334 Closes #19335 Closes #

[GitHub] spark issue #18887: [SPARK-20642][core] Store FsHistoryProvider listing data...

2017-09-25 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/18887 LGTM --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.ap

[GitHub] spark issue #18887: [SPARK-20642][core] Store FsHistoryProvider listing data...

2017-09-25 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/18887 Thanks for your work! --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: revi

[GitHub] spark issue #19336: [SPARK-21947][SS] Check and report error when monotonica...

2017-09-25 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/19336 cc @zsxwing for review. Thanks. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail

[GitHub] spark issue #18817: [SPARK-21612] Allow unicode strings in __getitem__ of St...

2017-09-25 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/18817 ping @rik-coenders --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: review

[GitHub] spark issue #19344: [SPARK-22122][SQL] Respect WITH clauses to count input r...

2017-09-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19344 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #19344: [SPARK-22122][SQL] Respect WITH clauses to count input r...

2017-09-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19344 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82167/ Test PASSed. ---

[GitHub] spark issue #19344: [SPARK-22122][SQL] Respect WITH clauses to count input r...

2017-09-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19344 **[Test build #82167 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82167/testReport)** for PR 19344 at commit [`d9be37e`](https://github.com/apache/spark/commit/d

[GitHub] spark issue #19347: Branch 2.2 sparkmlib's output of many algorithms is not ...

2017-09-25 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/19347 @ithjz, If you'd like to ask a question, please ask this to the mailing list (see https://spark.apache.org/community.html). Could you close this please? --- -

[GitHub] spark issue #19347: Branch 2.2 sparkmlib's output of many algorithms is not ...

2017-09-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19347 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark pull request #19347: Branch 2.2 sparkmlib's output of many algorithms ...

2017-09-25 Thread ithjz
GitHub user ithjz opened a pull request: https://github.com/apache/spark/pull/19347 Branch 2.2 sparkmlib'soutput of many algorithms is not clear What's the use of these **results?** JavaGradientBoostingRegressionExample Test Mean

[GitHub] spark issue #19346: Spark should provide jump links and add (count) in the S...

2017-09-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19346 **[Test build #82171 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82171/testReport)** for PR 19346 at commit [`305689f`](https://github.com/apache/spark/commit/30

[GitHub] spark issue #19346: Spark should provide jump links and add (count) in the S...

2017-09-25 Thread jerryshao
Github user jerryshao commented on the issue: https://github.com/apache/spark/pull/19346 Please fix the title. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: revie

[GitHub] spark issue #19346: Spark should provide jump links and add (count) in the S...

2017-09-25 Thread jerryshao
Github user jerryshao commented on the issue: https://github.com/apache/spark/pull/19346 ok to test. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@sp

[GitHub] spark pull request #19346: Spark should provide jump links and add (count) i...

2017-09-25 Thread guoxiaolongzte
Github user guoxiaolongzte closed the pull request at: https://github.com/apache/spark/pull/19346 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache

[GitHub] spark issue #19346: Spark should provide jump links and add (count) in the S...

2017-09-25 Thread guoxiaolongzte
Github user guoxiaolongzte commented on the issue: https://github.com/apache/spark/pull/19346 @HyukjinKwon @jerryshao @ajbozarth In the new PR I fix the indentation problem. Thanks. The latest verification results are as follows: ![3](https://user-images.githubu

[GitHub] spark pull request #18015: [SAPRK-20785][WEB-UI][SQL]Spark should provide ju...

2017-09-25 Thread guoxiaolongzte
Github user guoxiaolongzte closed the pull request at: https://github.com/apache/spark/pull/18015 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache

[GitHub] spark pull request #19346: Spark should provide jump links and add (count) i...

2017-09-25 Thread guoxiaolongzte
GitHub user guoxiaolongzte reopened a pull request: https://github.com/apache/spark/pull/19346 Spark should provide jump links and add (count) in the SQL web ui. ## What changes were proposed in this pull request? propose: it provide links that jump to Running Queri

[GitHub] spark issue #19346: Spark should provide jump links and add (count) in the S...

2017-09-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19346 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #18015: [SAPRK-20785][WEB-UI][SQL]Spark should provide jump link...

2017-09-25 Thread guoxiaolongzte
Github user guoxiaolongzte commented on the issue: https://github.com/apache/spark/pull/18015 Sorry, I accidentally deleted the code branch. I'm going to close this PR. I created a new PR https://github.com/apache/spark/pull/19346, which was modified and created based on the latest co

[GitHub] spark pull request #19346: Spark should provide jump links and add (count) i...

2017-09-25 Thread guoxiaolongzte
GitHub user guoxiaolongzte opened a pull request: https://github.com/apache/spark/pull/19346 Spark should provide jump links and add (count) in the SQL web ui. ## What changes were proposed in this pull request? propose: it provide links that jump to Running Queries

[GitHub] spark issue #18576: [SPARK-21351][SQL] Update nullability based on children'...

2017-09-25 Thread maropu
Github user maropu commented on the issue: https://github.com/apache/spark/pull/18576 kindly ping --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark

[GitHub] spark issue #18931: [SPARK-21717][SQL] Decouple consume functions of physica...

2017-09-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18931 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82164/ Test PASSed. ---

[GitHub] spark issue #18931: [SPARK-21717][SQL] Decouple consume functions of physica...

2017-09-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18931 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #18931: [SPARK-21717][SQL] Decouple consume functions of physica...

2017-09-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18931 **[Test build #82164 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82164/testReport)** for PR 18931 at commit [`b75ce8f`](https://github.com/apache/spark/commit/b

[GitHub] spark issue #18931: [SPARK-21717][SQL] Decouple consume functions of physica...

2017-09-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18931 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #18931: [SPARK-21717][SQL] Decouple consume functions of physica...

2017-09-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18931 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82165/ Test PASSed. ---

[GitHub] spark issue #18931: [SPARK-21717][SQL] Decouple consume functions of physica...

2017-09-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18931 **[Test build #82165 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82165/testReport)** for PR 18931 at commit [`e36ec3c`](https://github.com/apache/spark/commit/e

[GitHub] spark issue #19335: mapPartitions Api

2017-09-25 Thread caneGuy
Github user caneGuy commented on the issue: https://github.com/apache/spark/pull/19335 在spark-user list提问吧: http://apache-spark-user-list.1001560.n3.nabble.com/ 2017-09-25 11:29 GMT+08:00 listenLearning : > 您好,最近我在开发的时候遇到一ä¸

[GitHub] spark issue #19343: [SPARK-22121][CORE] Correct database location for nameno...

2017-09-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19343 **[Test build #82170 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82170/testReport)** for PR 19343 at commit [`c6acdf2`](https://github.com/apache/spark/commit/c6

[GitHub] spark issue #19327: [WIP] Implement stream-stream outer joins.

2017-09-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19327 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #19327: [WIP] Implement stream-stream outer joins.

2017-09-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19327 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82163/ Test PASSed. ---

[GitHub] spark issue #19327: [WIP] Implement stream-stream outer joins.

2017-09-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19327 **[Test build #82163 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82163/testReport)** for PR 19327 at commit [`8d83155`](https://github.com/apache/spark/commit/8

[GitHub] spark issue #19338: [SPARK-22123][CORE] Add latest failure reason for task s...

2017-09-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19338 **[Test build #82169 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82169/testReport)** for PR 19338 at commit [`57190ef`](https://github.com/apache/spark/commit/57

[GitHub] spark issue #19327: [WIP] Implement stream-stream outer joins.

2017-09-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19327 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82162/ Test PASSed. ---

[GitHub] spark issue #19327: [WIP] Implement stream-stream outer joins.

2017-09-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19327 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #19327: [WIP] Implement stream-stream outer joins.

2017-09-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19327 **[Test build #82162 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82162/testReport)** for PR 19327 at commit [`02b3352`](https://github.com/apache/spark/commit/0

[GitHub] spark issue #19345: [SPARK-22124][SQL] Sample and Limit should also defer in...

2017-09-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19345 **[Test build #82168 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82168/testReport)** for PR 19345 at commit [`0252663`](https://github.com/apache/spark/commit/02

[GitHub] spark pull request #19345: [SPARK-22124][SQL] Sample and Limit should also d...

2017-09-25 Thread viirya
GitHub user viirya opened a pull request: https://github.com/apache/spark/pull/19345 [SPARK-22124][SQL] Sample and Limit should also defer input evaluation under codegen ## What changes were proposed in this pull request? We can override `usedInputs` to claim that an operat

[GitHub] spark pull request #19325: [SPARK-22106][PYSPARK][SQL] Disable 0-parameter p...

2017-09-25 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/19325 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request #19338: [SPARK-22123][CORE] Add latest failure reason for...

2017-09-25 Thread caneGuy
Github user caneGuy commented on a diff in the pull request: https://github.com/apache/spark/pull/19338#discussion_r140941633 --- Diff: core/src/main/scala/org/apache/spark/scheduler/TaskSetBlacklist.scala --- @@ -94,7 +96,9 @@ private[scheduler] class TaskSetBlacklist(val conf: S

[GitHub] spark pull request #19325: [SPARK-22106][PYSPARK][SQL] Disable 0-parameter p...

2017-09-25 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/19325#discussion_r140941580 --- Diff: python/pyspark/sql/functions.py --- @@ -2183,14 +2187,28 @@ def pandas_udf(f=None, returnType=StringType()): :param f: python function

[GitHub] spark issue #19325: [SPARK-22106][PYSPARK][SQL] Disable 0-parameter pandas_u...

2017-09-25 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/19325 Merged to master. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews

[GitHub] spark pull request #19325: [SPARK-22106][PYSPARK][SQL] Disable 0-parameter p...

2017-09-25 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/19325#discussion_r140941134 --- Diff: python/pyspark/sql/functions.py --- @@ -2183,14 +2187,28 @@ def pandas_udf(f=None, returnType=StringType()): :param f: python function

[GitHub] spark pull request #19325: [SPARK-22106][PYSPARK][SQL] Disable 0-parameter p...

2017-09-25 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/19325#discussion_r140940569 --- Diff: python/pyspark/sql/functions.py --- @@ -2183,14 +2187,28 @@ def pandas_udf(f=None, returnType=StringType()): :param f: python function if u

[GitHub] spark issue #19338: [SPARK-21539][CORE] Add latest failure reason for task s...

2017-09-25 Thread caneGuy
Github user caneGuy commented on the issue: https://github.com/apache/spark/pull/19338 Thanks for your time @squito I will open an other jira for this pr.And update code as soon as possible. --- - To unsubscribe, e-

[GitHub] spark issue #18015: [SAPRK-20785][WEB-UI][SQL]Spark should provide jump link...

2017-09-25 Thread jerryshao
Github user jerryshao commented on the issue: https://github.com/apache/spark/pull/18015 There's still left comment not addressed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional com

[GitHub] spark issue #19344: [SPARK-22122][SQL] Respect WITH clauses to count input r...

2017-09-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19344 **[Test build #82167 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82167/testReport)** for PR 19344 at commit [`d9be37e`](https://github.com/apache/spark/commit/d9

[GitHub] spark pull request #19344: [SPARK-22122][SQL] Respect WITH clauses to count ...

2017-09-25 Thread maropu
GitHub user maropu opened a pull request: https://github.com/apache/spark/pull/19344 [SPARK-22122][SQL] Respect WITH clauses to count input rows in TPCDSQueryBenchmark ## What changes were proposed in this pull request? Since the current code ignores WITH clauses to check input

[GitHub] spark issue #19343: [SPARK-22121][CORE] Correct database location for nameno...

2017-09-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19343 **[Test build #82166 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82166/testReport)** for PR 19343 at commit [`c2e125e`](https://github.com/apache/spark/commit/c

[GitHub] spark issue #19343: [SPARK-22121][CORE] Correct database location for nameno...

2017-09-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19343 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark pull request #19325: [SPARK-22106][PYSPARK][SQL] Disable 0-parameter p...

2017-09-25 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/19325#discussion_r140938172 --- Diff: python/pyspark/sql/functions.py --- @@ -2183,14 +2187,28 @@ def pandas_udf(f=None, returnType=StringType()): :param f: python function

[GitHub] spark issue #19343: [SPARK-22121][CORE] Correct database location for nameno...

2017-09-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19343 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82166/ Test FAILed. ---

[GitHub] spark issue #18015: [SAPRK-20785][WEB-UI][SQL]Spark should provide jump link...

2017-09-25 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/18015 I think @jerryshao is an active committer who knows this one better than me. Since he is here, let me leave it to him. --- -

  1   2   3   4   >