[GitHub] spark pull request #18934: [SPARK-21721][SQL] Clear FileSystem deleteOnExit ...

2017-08-14 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/18934#discussion_r132917727 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/SQLQuerySuite.scala --- @@ -2021,4 +2038,22 @@ class SQLQuerySuite extends QueryTest

[GitHub] spark pull request #18939: [WIP][SPARK-21724][SQL][DOC] Adds since informati...

2017-08-14 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/18939#discussion_r132915571 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/datetimeExpressions.scala --- @@ -1279,7 +1305,8 @@ case class

[GitHub] spark pull request #18939: [WIP][SPARK-21724][SQL][DOC] Adds since informati...

2017-08-14 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/18939#discussion_r132915521 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/datetimeExpressions.scala --- @@ -1244,7 +1269,8 @@ case class

[GitHub] spark pull request #18939: [WIP][SPARK-21724][SQL][DOC] Adds since informati...

2017-08-14 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/18939#discussion_r132914601 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/datetimeExpressions.scala --- @@ -174,7 +177,8 @@ case class

[GitHub] spark pull request #18939: [WIP][SPARK-21724][SQL][DOC] Adds since informati...

2017-08-14 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/18939#discussion_r132914965 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/datetimeExpressions.scala --- @@ -362,7 +372,8 @@ case class

[GitHub] spark pull request #18939: [WIP][SPARK-21724][SQL][DOC] Adds since informati...

2017-08-14 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/18939#discussion_r132915440 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/datetimeExpressions.scala --- @@ -1140,7 +1163,8 @@ case class

[GitHub] spark pull request #18939: [WIP][SPARK-21724][SQL][DOC] Adds since informati...

2017-08-14 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/18939#discussion_r132915311 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/datetimeExpressions.scala --- @@ -867,7 +886,8 @@ case class

[GitHub] spark pull request #18934: [SPARK-21721][SQL] Clear FileSystem deleteOnExit ...

2017-08-14 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/18934#discussion_r132916693 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/execution/InsertIntoHiveTable.scala --- @@ -423,7 +423,14 @@ case class InsertIntoHiveTable(

[GitHub] spark pull request #18939: [WIP][SPARK-21724][SQL][DOC] Adds since informati...

2017-08-14 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/18939#discussion_r132914680 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/datetimeExpressions.scala --- @@ -263,7 +269,8 @@ case class

[GitHub] spark pull request #18939: [WIP][SPARK-21724][SQL][DOC] Adds since informati...

2017-08-14 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/18939#discussion_r132914574 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/datetimeExpressions.scala --- @@ -141,7 +143,8 @@ case class

[GitHub] spark pull request #18939: [WIP][SPARK-21724][SQL][DOC] Adds since informati...

2017-08-14 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/18939#discussion_r132915500 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/datetimeExpressions.scala --- @@ -1203,7 +1227,8 @@ case class

[GitHub] spark pull request #18939: [WIP][SPARK-21724][SQL][DOC] Adds since informati...

2017-08-14 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/18939#discussion_r132914490 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/datetimeExpressions.scala --- @@ -53,7 +53,8 @@ trait

[GitHub] spark pull request #18939: [WIP][SPARK-21724][SQL][DOC] Adds since informati...

2017-08-14 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/18939#discussion_r132915051 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/datetimeExpressions.scala --- @@ -493,7 +507,8 @@ case class

[GitHub] spark pull request #18939: [WIP][SPARK-21724][SQL][DOC] Adds since informati...

2017-08-14 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/18939#discussion_r132914631 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/datetimeExpressions.scala --- @@ -203,7 +207,8 @@ case class

[GitHub] spark pull request #18939: [WIP][SPARK-21724][SQL][DOC] Adds since informati...

2017-08-14 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/18939#discussion_r132915333 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/datetimeExpressions.scala --- @@ -968,7 +988,8 @@ case class

[GitHub] spark pull request #18939: [WIP][SPARK-21724][SQL][DOC] Adds since informati...

2017-08-14 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/18939#discussion_r132915008 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/datetimeExpressions.scala --- @@ -409,7 +421,8 @@ case class

[GitHub] spark pull request #18939: [WIP][SPARK-21724][SQL][DOC] Adds since informati...

2017-08-14 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/18939#discussion_r132914987 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/datetimeExpressions.scala --- @@ -385,7 +396,8 @@ case class

[GitHub] spark pull request #18939: [WIP][SPARK-21724][SQL][DOC] Adds since informati...

2017-08-14 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/18939#discussion_r132915240 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/datetimeExpressions.scala --- @@ -724,7 +741,8 @@ abstract class

[GitHub] spark pull request #18939: [WIP][SPARK-21724][SQL][DOC] Adds since informati...

2017-08-14 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/18939#discussion_r132914547 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/datetimeExpressions.scala --- @@ -81,7 +82,8 @@ case class

[GitHub] spark pull request #18939: [WIP][SPARK-21724][SQL][DOC] Adds since informati...

2017-08-14 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/18939#discussion_r132915205 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/datetimeExpressions.scala --- @@ -574,7 +590,8 @@ case class

[GitHub] spark pull request #18939: [WIP][SPARK-21724][SQL][DOC] Adds since informati...

2017-08-14 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/18939#discussion_r132915280 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/datetimeExpressions.scala --- @@ -833,7 +851,8 @@ case class

[GitHub] spark pull request #18939: [WIP][SPARK-21724][SQL][DOC] Adds since informati...

2017-08-14 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/18939#discussion_r132914911 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/datetimeExpressions.scala --- @@ -316,7 +324,8 @@ case class

[GitHub] spark pull request #18939: [WIP][SPARK-21724][SQL][DOC] Adds since informati...

2017-08-14 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/18939#discussion_r132915594 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/datetimeExpressions.scala --- @@ -1359,7 +1386,8 @@ case class

[GitHub] spark pull request #18939: [WIP][SPARK-21724][SQL][DOC] Adds since informati...

2017-08-14 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/18939#discussion_r132915025 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/datetimeExpressions.scala --- @@ -447,7 +460,8 @@ case class

[GitHub] spark pull request #18934: [SPARK-21721][SQL] Clear FileSystem deleteOnExit ...

2017-08-14 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/18934#discussion_r132916627 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/SQLQuerySuite.scala --- @@ -156,69 +156,71 @@ class SQLQuerySuite extends QueryTest

[GitHub] spark pull request #18939: [WIP][SPARK-21724][SQL][DOC] Adds since informati...

2017-08-14 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/18939#discussion_r132914940 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/datetimeExpressions.scala --- @@ -339,7 +348,8 @@ case class

[GitHub] spark pull request #18939: [WIP][SPARK-21724][SQL][DOC] Adds since informati...

2017-08-14 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/18939#discussion_r132914659 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/datetimeExpressions.scala --- @@ -233,7 +238,8 @@ case class

[GitHub] spark pull request #18939: [WIP][SPARK-21724][SQL][DOC] Adds since informati...

2017-08-14 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/18939#discussion_r132915406 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/datetimeExpressions.scala --- @@ -1097,7 +1119,8 @@ case class

[GitHub] spark pull request #18939: [WIP][SPARK-21724][SQL][DOC] Adds since informati...

2017-08-14 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/18939#discussion_r132914707 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/datetimeExpressions.scala --- @@ -293,7 +300,8 @@ case class

[GitHub] spark pull request #18939: [WIP][SPARK-21724][SQL][DOC] Adds since informati...

2017-08-14 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/18939#discussion_r132915380 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/datetimeExpressions.scala --- @@ -1061,7 +1082,8 @@ case class

[GitHub] spark pull request #18939: [WIP][SPARK-21724][SQL][DOC] Adds since informati...

2017-08-14 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/18939#discussion_r132915118 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/datetimeExpressions.scala --- @@ -534,7 +549,8 @@ case class

[GitHub] spark issue #18920: [SPARK-19471][SQL]AggregationIterator does not initializ...

2017-08-14 Thread DonnyZone
Github user DonnyZone commented on the issue: https://github.com/apache/spark/pull/18920 retest please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark pull request #18934: [SPARK-21721][SQL] Clear FileSystem deleteOnExit ...

2017-08-14 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/18934#discussion_r132915021 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/SQLQuerySuite.scala --- @@ -156,69 +156,71 @@ class SQLQuerySuite extends QueryTest

[GitHub] spark pull request #18934: [SPARK-21721][SQL] Clear FileSystem deleteOnExit ...

2017-08-14 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/18934#discussion_r132914869 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/execution/InsertIntoHiveTable.scala --- @@ -423,7 +423,14 @@ case class InsertIntoHiveTable(

[GitHub] spark issue #18914: [MINOR][SQL][TEST]no uncache table in joinsuite test

2017-08-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18914 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/80617/ Test PASSed. ---

[GitHub] spark issue #18914: [MINOR][SQL][TEST]no uncache table in joinsuite test

2017-08-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18914 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18934: [SPARK-21721][SQL] Clear FileSystem deleteOnExit cache w...

2017-08-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18934 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/80621/ Test PASSed. ---

[GitHub] spark issue #18914: [MINOR][SQL][TEST]no uncache table in joinsuite test

2017-08-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18914 **[Test build #80617 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80617/testReport)** for PR 18914 at commit

[GitHub] spark issue #18934: [SPARK-21721][SQL] Clear FileSystem deleteOnExit cache w...

2017-08-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18934 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18934: [SPARK-21721][SQL] Clear FileSystem deleteOnExit cache w...

2017-08-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18934 **[Test build #80621 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80621/testReport)** for PR 18934 at commit

[GitHub] spark pull request #18939: [WIP][SPARK-21724][SQL][DOC] Adds since informati...

2017-08-14 Thread HyukjinKwon
GitHub user HyukjinKwon opened a pull request: https://github.com/apache/spark/pull/18939 [WIP][SPARK-21724][SQL][DOC] Adds since information in the documentation of date functions ## What changes were proposed in this pull request? This PR adds `since` annotation in

[GitHub] spark pull request #15704: [SPARK-17732][SQL] ALTER TABLE DROP PARTITION sho...

2017-08-14 Thread DazhuangSu
Github user DazhuangSu commented on a diff in the pull request: https://github.com/apache/spark/pull/15704#discussion_r132893104 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/ddl.scala --- @@ -418,27 +419,55 @@ case class

[GitHub] spark issue #18872: [SPARK-21723][ML] Fix writing LibSVM (key not found: num...

2017-08-14 Thread ProtD
Github user ProtD commented on the issue: https://github.com/apache/spark/pull/18872 @srowen Ok, I created and linked a JIRA. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18118: [SPARK-20199][ML] : Provided featureSubsetStrategy to GB...

2017-08-14 Thread pralabhkumar
Github user pralabhkumar commented on the issue: https://github.com/apache/spark/pull/18118 @MLnick @sethah please find some time to look into this .It will be really great if we can include this feature in spark 2.3 --- If your project is set up for it, you can reply to this email

[GitHub] spark pull request #18938: [SPARK-21363][SQL] Prevent name duplication in (g...

2017-08-14 Thread maropu
GitHub user maropu opened a pull request: https://github.com/apache/spark/pull/18938 [SPARK-21363][SQL] Prevent name duplication in (global/local) temporary views ## What changes were proposed in this pull request? This pr prevented name duplication in (global/local) temporary

[GitHub] spark issue #18887: [SPARK-20642][core] Store FsHistoryProvider listing data...

2017-08-14 Thread jerryshao
Github user jerryshao commented on the issue: https://github.com/apache/spark/pull/18887 Looks like it is a little big to understand fastly, I need to download the patch and play it at first :). --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark issue #18468: [SPARK-20783][SQL] Create CachedBatchColumnVector to abs...

2017-08-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18468 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18468: [SPARK-20783][SQL] Create CachedBatchColumnVector to abs...

2017-08-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18468 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/80619/ Test FAILed. ---

[GitHub] spark issue #18468: [SPARK-20783][SQL] Create CachedBatchColumnVector to abs...

2017-08-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18468 **[Test build #80619 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80619/testReport)** for PR 18468 at commit

[GitHub] spark issue #18936: [SPARK-21688][ML][MLLIB] make native BLAS the first choi...

2017-08-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18936 **[Test build #80620 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80620/testReport)** for PR 18936 at commit

[GitHub] spark issue #18936: [SPARK-21688][ML][MLLIB] make native BLAS the first choi...

2017-08-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18936 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/80620/ Test PASSed. ---

[GitHub] spark issue #18936: [SPARK-21688][ML][MLLIB] make native BLAS the first choi...

2017-08-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18936 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18936: [SPARK-21688][ML][MLLIB] make native BLAS the first choi...

2017-08-14 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/18936 These aren't the only places these operations are called from F2JBLAS. You'd need all of them right? CC @dbtsai --- If your project is set up for it, you can reply to this email and have

[GitHub] spark pull request #18915: [SPARK-21176][WEB UI] Format worker page links to...

2017-08-14 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/18915 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #18931: [SPARK-21717][SQL][WIP] Decouple consume functions of ph...

2017-08-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18931 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18931: [SPARK-21717][SQL][WIP] Decouple consume functions of ph...

2017-08-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18931 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/80616/ Test FAILed. ---

[GitHub] spark issue #18931: [SPARK-21717][SQL][WIP] Decouple consume functions of ph...

2017-08-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18931 **[Test build #80616 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80616/testReport)** for PR 18931 at commit

[GitHub] spark pull request #18905: [SPARK-21660][YARN][Shuffle] Yarn ShuffleService ...

2017-08-14 Thread jerryshao
Github user jerryshao commented on a diff in the pull request: https://github.com/apache/spark/pull/18905#discussion_r132901938 --- Diff: common/network-yarn/src/main/java/org/apache/spark/network/yarn/YarnShuffleService.java --- @@ -378,6 +408,18 @@ protected File

[GitHub] spark issue #18915: [SPARK-21176][WEB UI] Format worker page links to work w...

2017-08-14 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/18915 Merged to master, but, now I realize this was attached to an existing JIRA. Is it really the same issue? the problem is that that was marked as resolved in 2.2.0 but this can't be in 2.2.0 of

[GitHub] spark pull request #18905: [SPARK-21660][YARN][Shuffle] Yarn ShuffleService ...

2017-08-14 Thread jerryshao
Github user jerryshao commented on a diff in the pull request: https://github.com/apache/spark/pull/18905#discussion_r132896967 --- Diff: common/network-yarn/src/main/java/org/apache/spark/network/yarn/YarnShuffleService.java --- @@ -333,33 +333,63 @@ protected Path

[GitHub] spark pull request #18905: [SPARK-21660][YARN][Shuffle] Yarn ShuffleService ...

2017-08-14 Thread jerryshao
Github user jerryshao commented on a diff in the pull request: https://github.com/apache/spark/pull/18905#discussion_r132897003 --- Diff: common/network-yarn/src/main/java/org/apache/spark/network/yarn/YarnShuffleService.java --- @@ -333,33 +333,63 @@ protected Path

[GitHub] spark pull request #18905: [SPARK-21660][YARN][Shuffle] Yarn ShuffleService ...

2017-08-14 Thread jerryshao
Github user jerryshao commented on a diff in the pull request: https://github.com/apache/spark/pull/18905#discussion_r132901109 --- Diff: common/network-yarn/src/main/java/org/apache/spark/network/yarn/YarnShuffleService.java --- @@ -333,33 +333,63 @@ protected Path

[GitHub] spark pull request #18918: [SPARK-21707][SQL]Improvement a special case for ...

2017-08-14 Thread heary-cao
Github user heary-cao commented on a diff in the pull request: https://github.com/apache/spark/pull/18918#discussion_r132902343 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala --- @@ -522,6 +522,8 @@ object ColumnPruning extends

[GitHub] spark issue #18937: [MINOR] Remove false comment from planStreamingAggregati...

2017-08-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18937 **[Test build #80623 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80623/testReport)** for PR 18937 at commit

[GitHub] spark pull request #18937: [MINOR] Remove false comment from planStreamingAg...

2017-08-14 Thread juliuszsompolski
GitHub user juliuszsompolski opened a pull request: https://github.com/apache/spark/pull/18937 [MINOR] Remove false comment from planStreamingAggregation ## What changes were proposed in this pull request? AggUtils.planStreamingAggregation has some comments about DISTINCT

[GitHub] spark issue #18933: [WIP][SPARK-21722][SQL][PYTHON] Enable timezone-aware ti...

2017-08-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18933 **[Test build #80622 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80622/testReport)** for PR 18933 at commit

[GitHub] spark issue #18920: [SPARK-19471][SQL]AggregationIterator does not initializ...

2017-08-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18920 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18920: [SPARK-19471][SQL]AggregationIterator does not initializ...

2017-08-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18920 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/80615/ Test FAILed. ---

[GitHub] spark issue #18920: [SPARK-19471][SQL]AggregationIterator does not initializ...

2017-08-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18920 **[Test build #80615 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80615/testReport)** for PR 18920 at commit

[GitHub] spark issue #18929: [MINOR][LAUNCHER]remove never used String in SparkLaunch...

2017-08-14 Thread jerryshao
Github user jerryshao commented on the issue: https://github.com/apache/spark/pull/18929 My only concern is that some external projects which rely on this static variables will be broken because of this change, since they're public available, we cannot stop users to rely on them

[GitHub] spark issue #18934: [SPARK-21721][SQL] Clear FileSystem deleteOnExit cache w...

2017-08-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18934 **[Test build #80621 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80621/testReport)** for PR 18934 at commit

[GitHub] spark issue #18936: [SPARK-21688][ML][MLLIB] make native BLAS the first choi...

2017-08-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18936 **[Test build #80620 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80620/testReport)** for PR 18936 at commit

[GitHub] spark issue #18787: [SPARK-21583][SQL] Create a ColumnarBatch from ArrowColu...

2017-08-14 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/18787 Actually I think `ReadOnlyColumnVector` may not be a good abstraction. Ideally `ColumnVector` should be read only, and then we have a `MutableColumnVector` with write interfaces. @ueshin is

[GitHub] spark issue #18934: [SPARK-21721][SQL] Clear FileSystem deleteOnExit cache w...

2017-08-14 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/18934 retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark pull request #18936: [SPARK-21688][ML][MLLIB] make native BLAS the fir...

2017-08-14 Thread VinceShieh
GitHub user VinceShieh opened a pull request: https://github.com/apache/spark/pull/18936 [SPARK-21688][ML][MLLIB] make native BLAS the first choice for BLAS level 1 operations for dense data ## What changes were proposed in this pull request? In this PR, we make native BLAS, if

[GitHub] spark pull request #18918: [SPARK-21707][SQL]Improvement a special case for ...

2017-08-14 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/18918#discussion_r132891196 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala --- @@ -522,6 +522,8 @@ object ColumnPruning extends

[GitHub] spark pull request #18865: [SPARK-21610][SQL] Corrupt records are not handle...

2017-08-14 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/18865#discussion_r132889074 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/json/JsonFileFormat.scala --- @@ -114,7 +114,16 @@ class JsonFileFormat

[GitHub] spark issue #18468: [SPARK-20783][SQL] Create CachedBatchColumnVector to abs...

2017-08-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18468 **[Test build #80619 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80619/testReport)** for PR 18468 at commit

[GitHub] spark issue #18918: [SPARK-21707][SQL]Improvement a special case for non-det...

2017-08-14 Thread heary-cao
Github user heary-cao commented on the issue: https://github.com/apache/spark/pull/18918 @gatorsmile I tried to modify PhysicalOperation's collectProjectsAndFilters, Added an match case: ``` case Project(fields, child: LeafNode) if !fields.forall(_.deterministic)

[GitHub] spark issue #18468: [SPARK-20783][SQL] Create CachedBatchColumnVector to abs...

2017-08-14 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/18468 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #18935: [SPARK-9104][CORE] Expose Netty memory metrics in Spark

2017-08-14 Thread jerryshao
Github user jerryshao commented on the issue: https://github.com/apache/spark/pull/18935 @jsoltren @squito I take the liberty to get another shot of exposing Netty memory metrics. This PR doesn't address any display related things, only expose memory usage from Netty client factory

[GitHub] spark issue #18734: [SPARK-21070][PYSPARK] Attempt to update cloudpickle aga...

2017-08-14 Thread ueshin
Github user ueshin commented on the issue: https://github.com/apache/spark/pull/18734 Thank you for cc-ing me. I looked over this and it looks good to me except for a comment https://github.com/apache/spark/pull/18734#discussion_r130763298. I was not exactly sure if we could

[GitHub] spark issue #18935: [SPARK-9104][CORE] Expose Netty memory metrics in Spark

2017-08-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18935 **[Test build #80618 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80618/testReport)** for PR 18935 at commit

[GitHub] spark pull request #18935: [SPARK-9104][CORE] Expose Netty memory metrics in...

2017-08-14 Thread jerryshao
GitHub user jerryshao opened a pull request: https://github.com/apache/spark/pull/18935 [SPARK-9104][CORE] Expose Netty memory metrics in Spark ## What changes were proposed in this pull request? This PR exposes Netty memory usage for Spark's `TransportClientFactory` and

[GitHub] spark issue #18914: [MINOR][SQL][TEST]no uncache table in joinsuite test

2017-08-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18914 **[Test build #80617 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80617/testReport)** for PR 18914 at commit

[GitHub] spark issue #18914: [MINOR][SQL][TEST]no uncache table in joinsuite test

2017-08-14 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/18914 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #18931: [SPARK-21717][SQL][WIP] Decouple consume functions of ph...

2017-08-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18931 **[Test build #80616 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80616/testReport)** for PR 18931 at commit

[GitHub] spark issue #18931: [SPARK-21717][SQL][WIP] Decouple consume functions of ph...

2017-08-14 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/18931 retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #18934: [SPARK-21721][SQL] Clear FileSystem deleteOnExit cache w...

2017-08-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18934 **[Test build #80614 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80614/testReport)** for PR 18934 at commit

[GitHub] spark issue #18931: [SPARK-21717][SQL][WIP] Decouple consume functions of ph...

2017-08-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18931 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18934: [SPARK-21721][SQL] Clear FileSystem deleteOnExit cache w...

2017-08-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18934 **[Test build #80613 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80613/testReport)** for PR 18934 at commit

[GitHub] spark issue #18934: [SPARK-21721][SQL] Clear FileSystem deleteOnExit cache w...

2017-08-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18934 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18934: [SPARK-21721][SQL] Clear FileSystem deleteOnExit cache w...

2017-08-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18934 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18914: [MINOR][SQL][TEST]no uncache table in joinsuite test

2017-08-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18914 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18931: [SPARK-21717][SQL][WIP] Decouple consume functions of ph...

2017-08-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18931 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/80612/ Test FAILed. ---

[GitHub] spark issue #18914: [MINOR][SQL][TEST]no uncache table in joinsuite test

2017-08-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18914 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/80611/ Test FAILed. ---

[GitHub] spark issue #18934: [SPARK-21721][SQL] Clear FileSystem deleteOnExit cache w...

2017-08-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18934 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/80613/ Test FAILed. ---

[GitHub] spark issue #18934: [SPARK-21721][SQL] Clear FileSystem deleteOnExit cache w...

2017-08-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18934 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/80614/ Test FAILed. ---

[GitHub] spark issue #18756: [SPARK-21548][SQL] "Support insert into serial columns o...

2017-08-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18756 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/80610/ Test FAILed. ---

[GitHub] spark issue #18914: [MINOR][SQL][TEST]no uncache table in joinsuite test

2017-08-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18914 **[Test build #80611 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80611/testReport)** for PR 18914 at commit

<    1   2   3   4   5   >