[GitHub] spark issue #18103: [SPARK-20876][SQL]If the input parameter is float type f...

2017-05-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18103 **[Test build #77345 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77345/testReport)** for PR 18103 at commit [`37f0ff3`](https://github.com/apache/spark/commit/3

[GitHub] spark issue #18103: [SPARK-20876][SQL]If the input parameter is float type f...

2017-05-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18103 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18103: [SPARK-20876][SQL]If the input parameter is float type f...

2017-05-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18103 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77345/ Test PASSed. ---

[GitHub] spark pull request #9571: [SPARK-11373] [CORE] Add metrics to the History Se...

2017-05-25 Thread steveloughran
Github user steveloughran closed the pull request at: https://github.com/apache/spark/pull/9571 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] spark issue #17094: [SPARK-19762][ML] Hierarchy for consolidating ML aggrega...

2017-05-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17094 **[Test build #77360 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77360/testReport)** for PR 17094 at commit [`f8b84a7`](https://github.com/apache/spark/commit/f8

[GitHub] spark issue #17094: [SPARK-19762][ML] Hierarchy for consolidating ML aggrega...

2017-05-25 Thread sethah
Github user sethah commented on the issue: https://github.com/apache/spark/pull/17094 cc @srowen also --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark issue #18074: [DOCS][MINOR] Scaladoc fixes (aka typo hunting)

2017-05-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18074 **[Test build #77348 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77348/testReport)** for PR 18074 at commit [`9479ccc`](https://github.com/apache/spark/commit/9

[GitHub] spark issue #18074: [DOCS][MINOR] Scaladoc fixes (aka typo hunting)

2017-05-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18074 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77348/ Test PASSed. ---

[GitHub] spark issue #17150: [SPARK-19810][BUILD][CORE] Remove support for Scala 2.10

2017-05-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17150 **[Test build #3754 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3754/testReport)** for PR 17150 at commit [`7a30de4`](https://github.com/apache/spark/commit/7

[GitHub] spark issue #18016: [SPARK-20786][SQL]Improve ceil and floor handle the valu...

2017-05-25 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/18016 hm guys please don’t use the end-to-end tests to test expression behavior. use unit tests which automatically tests code gen, interpreted, and different data types. --- If your project is set up fo

[GitHub] spark issue #18074: [DOCS][MINOR] Scaladoc fixes (aka typo hunting)

2017-05-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18074 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18086: [SPARK-20854][SQL] Extend hint syntax to support express...

2017-05-25 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/18086 cc @gatorsmile @cloud-fan @hvanhovell --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #18091: [SPARK-20868][CORE] UnsafeShuffleWriter should verify th...

2017-05-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18091 **[Test build #77350 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77350/testReport)** for PR 18091 at commit [`c79de07`](https://github.com/apache/spark/commit/c

[GitHub] spark issue #18091: [SPARK-20868][CORE] UnsafeShuffleWriter should verify th...

2017-05-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18091 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark pull request #18074: [DOCS][MINOR] Scaladoc fixes (aka typo hunting)

2017-05-25 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/18074#discussion_r118457024 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/window/WindowExec.scala --- @@ -153,19 +153,24 @@ case class WindowExec( }

[GitHub] spark issue #18091: [SPARK-20868][CORE] UnsafeShuffleWriter should verify th...

2017-05-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18091 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77350/ Test FAILed. ---

[GitHub] spark issue #18046: [SPARK-20749][SQL] Built-in SQL Function Support - all v...

2017-05-25 Thread kiszk
Github user kiszk commented on the issue: https://github.com/apache/spark/pull/18046 @gatorsmile Do I have to do additional things for this PR? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark issue #18047: [SPARK-20750][SQL] Built-in SQL Function Support - REPLA...

2017-05-25 Thread kiszk
Github user kiszk commented on the issue: https://github.com/apache/spark/pull/18047 ping @gatorsmile --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark issue #18074: [DOCS][MINOR] Scaladoc fixes (aka typo hunting)

2017-05-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18074 **[Test build #77352 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77352/testReport)** for PR 18074 at commit [`10104f2`](https://github.com/apache/spark/commit/1

[GitHub] spark issue #18074: [DOCS][MINOR] Scaladoc fixes (aka typo hunting)

2017-05-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18074 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77352/ Test PASSed. ---

[GitHub] spark issue #18074: [DOCS][MINOR] Scaladoc fixes (aka typo hunting)

2017-05-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18074 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18105: [SPARK-20881] [SQL] Use Hive's stats in metastore when c...

2017-05-25 Thread wzhfy
Github user wzhfy commented on the issue: https://github.com/apache/spark/pull/18105 cc @cloud-fan @gatorsmile --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #18042: [SPARK-20817][core] Fix to return "Unknown processor" on...

2017-05-25 Thread kiszk
Github user kiszk commented on the issue: https://github.com/apache/spark/pull/18042 It is due to differences among CPU architectures. Here are original outputs of `/proc/info` It is used to identify CPU architecture and its model. **POWER** ``` > cat /proc/cpuinfo

[GitHub] spark issue #18042: [SPARK-20817][core] Fix to return "Unknown processor" on...

2017-05-25 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/18042 Yeah I get that, but does it cause a problem? it won't if it's just for display, but that's what I'm asking. --- If your project is set up for it, you can reply to this email and have your reply app

[GitHub] spark issue #18042: [SPARK-20817][core] Fix to return "Unknown processor" on...

2017-05-25 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/18042 Does this really matter? I'd rather not complicate the actual code for it to display properly in some niche hardware that very few people use. --- If your project is set up for it, you can reply to t

[GitHub] spark issue #18084: [SPARK-19900][core]Remove driver when relaunching.

2017-05-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18084 **[Test build #77353 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77353/testReport)** for PR 18084 at commit [`6ab9a0f`](https://github.com/apache/spark/commit/6

[GitHub] spark issue #18084: [SPARK-19900][core]Remove driver when relaunching.

2017-05-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18084 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18084: [SPARK-19900][core]Remove driver when relaunching.

2017-05-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18084 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77353/ Test FAILed. ---

[GitHub] spark issue #18102: [SPARK-20875] Spark should print the log when the direct...

2017-05-25 Thread liu-zhaokun
Github user liu-zhaokun commented on the issue: https://github.com/apache/spark/pull/18102 @srowen Thanks for your reply. I made changes based on your opinion.Please review it soon. --- If your project is set up for it, you can reply to this email and have your reply appear on G

[GitHub] spark issue #18067: [SPARK-20849][DOC][SPARKR] Document R DecisionTree

2017-05-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18067 **[Test build #77351 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77351/testReport)** for PR 18067 at commit [`1a97e42`](https://github.com/apache/spark/commit/1

[GitHub] spark issue #18067: [SPARK-20849][DOC][SPARKR] Document R DecisionTree

2017-05-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18067 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77351/ Test PASSed. ---

[GitHub] spark issue #18067: [SPARK-20849][DOC][SPARKR] Document R DecisionTree

2017-05-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18067 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark pull request #18102: [SPARK-20875] Spark should print the log when the...

2017-05-25 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/18102#discussion_r118462261 --- Diff: core/src/main/scala/org/apache/spark/util/Utils.scala --- @@ -1004,6 +1004,7 @@ private[spark] object Utils extends Logging { for (ch

[GitHub] spark issue #18105: [SPARK-20881] [SQL] Use Hive's stats in metastore when c...

2017-05-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18105 **[Test build #77359 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77359/testReport)** for PR 18105 at commit [`4655292`](https://github.com/apache/spark/commit/4

[GitHub] spark issue #18105: [SPARK-20881] [SQL] Use Hive's stats in metastore when c...

2017-05-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18105 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18105: [SPARK-20881] [SQL] Use Hive's stats in metastore when c...

2017-05-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18105 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77359/ Test FAILed. ---

[GitHub] spark issue #18102: [SPARK-20875] Spark should print the log when the direct...

2017-05-25 Thread liu-zhaokun
Github user liu-zhaokun commented on the issue: https://github.com/apache/spark/pull/18102 @srowen Thanks for your patience. I modified again.Please review it. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #17094: [SPARK-19762][ML] Hierarchy for consolidating ML aggrega...

2017-05-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17094 **[Test build #77360 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77360/testReport)** for PR 17094 at commit [`f8b84a7`](https://github.com/apache/spark/commit/f

[GitHub] spark issue #17094: [SPARK-19762][ML] Hierarchy for consolidating ML aggrega...

2017-05-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17094 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17094: [SPARK-19762][ML] Hierarchy for consolidating ML aggrega...

2017-05-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17094 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77360/ Test PASSed. ---

[GitHub] spark pull request #18106: [SPARK-20754][SQL] Support TRUNC (number)

2017-05-25 Thread wangyum
GitHub user wangyum opened a pull request: https://github.com/apache/spark/pull/18106 [SPARK-20754][SQL] Support TRUNC (number) ## What changes were proposed in this pull request? Add support for `TRUNC(number)`, it's similar to Oracle [TRUNC(number)](https://docs.oracle.co

[GitHub] spark issue #18106: [SPARK-20754][SQL] Support TRUNC (number)

2017-05-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18106 **[Test build #77361 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77361/testReport)** for PR 18106 at commit [`a5ade70`](https://github.com/apache/spark/commit/a5

[GitHub] spark pull request #18107: [SPARK-20883][SPARK-20376][SS] Refactored StateSt...

2017-05-25 Thread tdas
GitHub user tdas opened a pull request: https://github.com/apache/spark/pull/18107 [SPARK-20883][SPARK-20376][SS] Refactored StateStore APIs and added conf to choose implementation ## What changes were proposed in this pull request? A bunch of changes to the StateStore

[GitHub] spark pull request #18107: [SPARK-20883][SPARK-20376][SS] Refactored StateSt...

2017-05-25 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/18107#discussion_r118465084 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala --- @@ -552,6 +552,15 @@ object SQLConf { .booleanConf .cre

[GitHub] spark issue #18107: [SPARK-20883][SPARK-20376][SS] Refactored StateStore API...

2017-05-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18107 **[Test build #77362 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77362/testReport)** for PR 18107 at commit [`03f5bf3`](https://github.com/apache/spark/commit/03

[GitHub] spark issue #18107: [SPARK-20883][SPARK-20376][SS] Refactored StateStore API...

2017-05-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18107 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18107: [SPARK-20883][SPARK-20376][SS] Refactored StateStore API...

2017-05-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18107 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77362/ Test FAILed. ---

[GitHub] spark issue #18107: [SPARK-20883][SPARK-20376][SS] Refactored StateStore API...

2017-05-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18107 **[Test build #77362 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77362/testReport)** for PR 18107 at commit [`03f5bf3`](https://github.com/apache/spark/commit/0

[GitHub] spark pull request #18107: [SPARK-20883][SPARK-20376][SS] Refactored StateSt...

2017-05-25 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/18107#discussion_r118465998 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/state/StateStore.scala --- @@ -105,25 +102,42 @@ trait StateStore { /** Trait

[GitHub] spark pull request #18107: [SPARK-20883][SPARK-20376][SS] Refactored StateSt...

2017-05-25 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/18107#discussion_r118465966 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/state/StateStore.scala --- @@ -47,31 +60,25 @@ trait StateStore { /** Versio

[GitHub] spark pull request #18107: [SPARK-20883][SPARK-20376][SS] Refactored StateSt...

2017-05-25 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/18107#discussion_r118465937 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/state/StateStore.scala --- @@ -29,12 +29,25 @@ import org.apache.spark.SparkEnv

[GitHub] spark issue #18092: [SPARK-20640][CORE]Make rpc timeout and retry for shuffl...

2017-05-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18092 **[Test build #77356 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77356/testReport)** for PR 18092 at commit [`bb1801e`](https://github.com/apache/spark/commit/b

[GitHub] spark pull request #18107: [SPARK-20883][SPARK-20376][SS] Refactored StateSt...

2017-05-25 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/18107#discussion_r118466139 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/statefulOperators.scala --- @@ -165,54 +189,87 @@ case class StateStoreSaveExec(

[GitHub] spark issue #18092: [SPARK-20640][CORE]Make rpc timeout and retry for shuffl...

2017-05-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18092 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18092: [SPARK-20640][CORE]Make rpc timeout and retry for shuffl...

2017-05-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18092 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77356/ Test PASSed. ---

[GitHub] spark issue #18107: [SPARK-20883][SPARK-20376][SS] Refactored StateStore API...

2017-05-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18107 **[Test build #77363 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77363/testReport)** for PR 18107 at commit [`d645b41`](https://github.com/apache/spark/commit/d6

[GitHub] spark issue #18107: [SPARK-20883][SPARK-20376][SS] Refactored StateStore API...

2017-05-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18107 **[Test build #3755 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3755/testReport)** for PR 18107 at commit [`d645b41`](https://github.com/apache/spark/commit/d

[GitHub] spark pull request #18086: [SPARK-20854][SQL] Extend hint syntax to support ...

2017-05-25 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/18086#discussion_r118467522 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/parser/AstBuilder.scala --- @@ -533,13 +533,16 @@ class AstBuilder(conf: SQLConf) ext

[GitHub] spark pull request #18086: [SPARK-20854][SQL] Extend hint syntax to support ...

2017-05-25 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/18086#discussion_r118467587 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/parser/AstBuilder.scala --- @@ -533,13 +533,16 @@ class AstBuilder(conf: SQLConf) ext

[GitHub] spark pull request #18086: [SPARK-20854][SQL] Extend hint syntax to support ...

2017-05-25 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/18086#discussion_r118467770 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/hints.scala --- @@ -25,7 +25,7 @@ import org.apache.spark.sql.internal.

[GitHub] spark issue #18091: [SPARK-20868][CORE] UnsafeShuffleWriter should verify th...

2017-05-25 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/18091 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark pull request #18064: [SPARK-20213][SQL] Fix DataFrameWriter operations...

2017-05-25 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/18064#discussion_r118468240 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/DataSource.scala --- @@ -426,36 +418,35 @@ case class DataSource( /

[GitHub] spark issue #18091: [SPARK-20868][CORE] UnsafeShuffleWriter should verify th...

2017-05-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18091 **[Test build #77364 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77364/testReport)** for PR 18091 at commit [`c79de07`](https://github.com/apache/spark/commit/c7

[GitHub] spark issue #18102: [SPARK-20875] Spark should print the log when the direct...

2017-05-25 Thread liu-zhaokun
Github user liu-zhaokun commented on the issue: https://github.com/apache/spark/pull/18102 I found there are some mistakes.So I modify the PR again.Please review it. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #18105: [SPARK-20881] [SQL] Use Hive's stats in metastore when c...

2017-05-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18105 **[Test build #77365 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77365/testReport)** for PR 18105 at commit [`59619ee`](https://github.com/apache/spark/commit/59

[GitHub] spark pull request #18102: [SPARK-20875] Spark should print the log when the...

2017-05-25 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/18102#discussion_r118470469 --- Diff: core/src/main/scala/org/apache/spark/util/Utils.scala --- @@ -1015,7 +1015,9 @@ private[spark] object Utils extends Logging { Sh

[GitHub] spark pull request #18108: [SPARK-20884] Spark' masters will be both standby...

2017-05-25 Thread liu-zhaokun
GitHub user liu-zhaokun opened a pull request: https://github.com/apache/spark/pull/18108 [SPARK-20884] Spark' masters will be both standby due to the bug of curator [https://issues.apache.org/jira/browse/SPARK-20884](https://issues.apache.org/jira/browse/SPARK-20884) I built a

[GitHub] spark issue #18108: [SPARK-20884] Spark' masters will be both standby due to...

2017-05-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18108 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark pull request #18064: [SPARK-20213][SQL] Fix DataFrameWriter operations...

2017-05-25 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/18064#discussion_r118473002 --- Diff: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaWriter.scala --- @@ -86,12 +86,10 @@ private[kafka010] object KafkaWr

[GitHub] spark issue #18064: [SPARK-20213][SQL] Fix DataFrameWriter operations in SQL...

2017-05-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18064 **[Test build #77366 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77366/testReport)** for PR 18064 at commit [`513bb9b`](https://github.com/apache/spark/commit/51

[GitHub] spark pull request #18086: [SPARK-20854][SQL] Extend hint syntax to support ...

2017-05-25 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/18086#discussion_r118473083 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/parser/AstBuilder.scala --- @@ -533,13 +533,16 @@ class AstBuilder(conf: SQLConf) extends

[GitHub] spark issue #18089: [SPARK-19281][FOLLOWUP][ML] Minor fix for PySpark FPGrow...

2017-05-25 Thread yanboliang
Github user yanboliang commented on the issue: https://github.com/apache/spark/pull/18089 Merged into master and branch-2.2. Thanks for reviewing. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request #18089: [SPARK-19281][FOLLOWUP][ML] Minor fix for PySpark...

2017-05-25 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/18089 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request #18064: [SPARK-20213][SQL] Fix DataFrameWriter operations...

2017-05-25 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/18064#discussion_r118474770 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/test/TestHive.scala --- @@ -294,32 +294,31 @@ private[hive] class TestHiveSparkSession(

[GitHub] spark issue #18058: [SPARK-20768][PYSPARK][ML] Expose numPartitions (expert)...

2017-05-25 Thread yanboliang
Github user yanboliang commented on the issue: https://github.com/apache/spark/pull/18058 @facaiy Could you resolve merge conflicts? Then I can get this in. Thanks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #18102: [SPARK-20875] Spark should print the log when the direct...

2017-05-25 Thread liu-zhaokun
Github user liu-zhaokun commented on the issue: https://github.com/apache/spark/pull/18102 @HyukjinKwon Thanks for your reply. I made changes based on your opinion.Please review it soon. --- If your project is set up for it, you can reply to this email and have your reply appear

[GitHub] spark issue #17150: [SPARK-19810][BUILD][CORE] Remove support for Scala 2.10

2017-05-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17150 **[Test build #3754 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3754/testReport)** for PR 17150 at commit [`7a30de4`](https://github.com/apache/spark/commit/

[GitHub] spark issue #18014: [SPARK-20783][SQL] Enhance ColumnVector to keep UnsafeAr...

2017-05-25 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/18014 I think option 2 is better. `ColumnVector.getArray()` should be as fast as possible. The caller side may just get an element from this array and then the final projection doesn't need to copy an a

[GitHub] spark issue #17113: [SPARK-13669][Core] Improve the blacklist mechanism to h...

2017-05-25 Thread jerryshao
Github user jerryshao commented on the issue: https://github.com/apache/spark/pull/17113 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #17113: [SPARK-13669][Core] Improve the blacklist mechanism to h...

2017-05-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17113 **[Test build #77367 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77367/testReport)** for PR 17113 at commit [`44c7108`](https://github.com/apache/spark/commit/44

[GitHub] spark pull request #17094: [SPARK-19762][ML] Hierarchy for consolidating ML ...

2017-05-25 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/17094#discussion_r118475804 --- Diff: mllib/src/main/scala/org/apache/spark/ml/optim/aggregator/LeastSquaresAggregator.scala --- @@ -0,0 +1,224 @@ +/* + * Licensed to the Apach

[GitHub] spark pull request #17094: [SPARK-19762][ML] Hierarchy for consolidating ML ...

2017-05-25 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/17094#discussion_r118476130 --- Diff: mllib/src/main/scala/org/apache/spark/ml/optim/aggregator/DifferentiableLossAggregator.scala --- @@ -0,0 +1,88 @@ +/* + * Licensed to the

[GitHub] spark pull request #17094: [SPARK-19762][ML] Hierarchy for consolidating ML ...

2017-05-25 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/17094#discussion_r118476253 --- Diff: mllib/src/main/scala/org/apache/spark/ml/optim/loss/DifferentiableRegularization.scala --- @@ -0,0 +1,68 @@ +/* + * Licensed to the Apache

[GitHub] spark issue #18106: [SPARK-20754][SQL] Support TRUNC (number)

2017-05-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18106 **[Test build #77361 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77361/testReport)** for PR 18106 at commit [`a5ade70`](https://github.com/apache/spark/commit/a

[GitHub] spark issue #18106: [SPARK-20754][SQL] Support TRUNC (number)

2017-05-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18106 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77361/ Test FAILed. ---

[GitHub] spark issue #18106: [SPARK-20754][SQL] Support TRUNC (number)

2017-05-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18106 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17150: [SPARK-19810][BUILD][CORE] Remove support for Scala 2.10

2017-05-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17150 **[Test build #3756 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3756/testReport)** for PR 17150 at commit [`7a30de4`](https://github.com/apache/spark/commit/7

[GitHub] spark issue #18105: [SPARK-20881] [SQL] Use Hive's stats in metastore when c...

2017-05-25 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/18105 I think we should always trust Spark's table stats over Hive's, no matter CBO is on or not. If users update the stats at hive side, it's their own responsibility to update it at Spark side.

[GitHub] spark issue #18064: [SPARK-20213][SQL] Fix DataFrameWriter operations in SQL...

2017-05-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18064 **[Test build #77368 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77368/testReport)** for PR 18064 at commit [`bc7608a`](https://github.com/apache/spark/commit/bc

[GitHub] spark issue #18058: [SPARK-20768][PYSPARK][ML] Expose numPartitions (expert)...

2017-05-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18058 **[Test build #77369 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77369/testReport)** for PR 18058 at commit [`fcaee9e`](https://github.com/apache/spark/commit/fc

[GitHub] spark issue #18060: [SPARK-20835][Core]It should exit directly when the --to...

2017-05-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18060 **[Test build #3757 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3757/testReport)** for PR 18060 at commit [`eae0f3d`](https://github.com/apache/spark/commit/e

[GitHub] spark issue #18015: [SAPRK-20785][WEB-UI][SQL]Spark should provide jump link...

2017-05-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18015 **[Test build #3758 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3758/testReport)** for PR 18015 at commit [`db108bc`](https://github.com/apache/spark/commit/d

[GitHub] spark issue #18107: [SPARK-20883][SPARK-20376][SS] Refactored StateStore API...

2017-05-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18107 **[Test build #3755 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3755/testReport)** for PR 18107 at commit [`d645b41`](https://github.com/apache/spark/commit/

[GitHub] spark issue #18107: [SPARK-20883][SPARK-20376][SS] Refactored StateStore API...

2017-05-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18107 **[Test build #77363 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77363/testReport)** for PR 18107 at commit [`d645b41`](https://github.com/apache/spark/commit/d

[GitHub] spark issue #18107: [SPARK-20883][SPARK-20376][SS] Refactored StateStore API...

2017-05-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18107 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77363/ Test FAILed. ---

[GitHub] spark issue #18107: [SPARK-20883][SPARK-20376][SS] Refactored StateStore API...

2017-05-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18107 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18060: [SPARK-20835][Core]It should exit directly when the --to...

2017-05-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18060 **[Test build #3757 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3757/testReport)** for PR 18060 at commit [`eae0f3d`](https://github.com/apache/spark/commit/

[GitHub] spark issue #18015: [SAPRK-20785][WEB-UI][SQL]Spark should provide jump link...

2017-05-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18015 **[Test build #3758 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3758/testReport)** for PR 18015 at commit [`db108bc`](https://github.com/apache/spark/commit/

[GitHub] spark issue #18058: [SPARK-20768][PYSPARK][ML] Expose numPartitions (expert)...

2017-05-25 Thread facaiy
Github user facaiy commented on the issue: https://github.com/apache/spark/pull/18058 Resolved. By the way, Which one is preferable, rebase or merge? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your p

[GitHub] spark pull request #17770: [SPARK-20392][SQL] Set barrier to prevent re-ente...

2017-05-25 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/17770#discussion_r118479696 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala --- @@ -203,7 +206,7 @@ class Dataset[T] private[sql]( * `fromRow` method late

<    1   2   3   4   5   6   >