[GitHub] spark issue #14200: [SPARK-16528][SQL] Fix NPE problem in HiveClientImpl

2016-07-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14200 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14181: [SPARK-15382][SQL] Fix a rule to push down projects bene...

2016-07-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14181 **[Test build #62309 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62309/consoleFull)** for PR 14181 at commit [`ca23f4f`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14181: [SPARK-15382][SQL] Fix a rule to push down projects bene...

2016-07-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14181 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14181: [SPARK-15382][SQL] Fix a rule to push down projects bene...

2016-07-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14181 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62309/ Test FAILed. ---

[GitHub] spark issue #14136: [SPARK-16282][SQL] Implement percentile SQL function.

2016-07-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14136 **[Test build #62315 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62315/consoleFull)** for PR 14136 at commit [`2194c9e`](https://github.com/apache/spark/commit/2

[GitHub] spark issue #14150: [SPARK-16494] [ML] Upgrade breeze version to 0.12

2016-07-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14150 **[Test build #62316 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62316/consoleFull)** for PR 14150 at commit [`0192f99`](https://github.com/apache/spark/commit/0

[GitHub] spark pull request #13051: [SPARK-15271] [MESOS] Allow force pulling executo...

2016-07-14 Thread philipphoffmann
Github user philipphoffmann commented on a diff in the pull request: https://github.com/apache/spark/pull/13051#discussion_r70797441 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosSchedulerBackendUtil.scala --- @@ -134,6 +137,32 @@ private[mesos] objec

[GitHub] spark pull request #13051: [SPARK-15271] [MESOS] Allow force pulling executo...

2016-07-14 Thread philipphoffmann
Github user philipphoffmann commented on a diff in the pull request: https://github.com/apache/spark/pull/13051#discussion_r70797577 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosClusterScheduler.scala --- @@ -517,16 +517,10 @@ private[spark] class Me

[GitHub] spark issue #13051: [SPARK-15271] [MESOS] Allow force pulling executor docke...

2016-07-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13051 **[Test build #62317 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62317/consoleFull)** for PR 13051 at commit [`c2d4b7f`](https://github.com/apache/spark/commit/c

[GitHub] spark issue #13911: [SPARK-16215][SQL] Reduce runtime overhead of a program ...

2016-07-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13911 **[Test build #62312 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62312/consoleFull)** for PR 13911 at commit [`4b70df9`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13911: [SPARK-16215][SQL] Reduce runtime overhead of a program ...

2016-07-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13911 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13911: [SPARK-16215][SQL] Reduce runtime overhead of a program ...

2016-07-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13911 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62312/ Test PASSed. ---

[GitHub] spark issue #14197: [SPARK-14963][Minor][YARN] Fix typo in YarnShuffleServic...

2016-07-14 Thread jerryshao
Github user jerryshao commented on the issue: https://github.com/apache/spark/pull/14197 Ping @tgravescs , please help to review, this typo is introduce by SPARK-14963. Thanks a lot. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHu

[GitHub] spark pull request #14191: [SPARK-16217][SQL] Support SELECT INTO statement

2016-07-14 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/14191#discussion_r70801792 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/SparkSqlParser.scala --- @@ -1376,4 +1376,62 @@ class SparkSqlAstBuilder(conf: SQLConf) e

[GitHub] spark pull request #14201: [SPARK-14702] Expose SparkLauncher's ProcessBuild...

2016-07-14 Thread andreweduffy
GitHub user andreweduffy opened a pull request: https://github.com/apache/spark/pull/14201 [SPARK-14702] Expose SparkLauncher's ProcessBuilder for user flexibility ## What changes were proposed in this pull request? Adds a few public methods to `SparkLauncher` to allow confi

[GitHub] spark issue #14201: [SPARK-14702] Expose SparkLauncher's ProcessBuilder for ...

2016-07-14 Thread andreweduffy
Github user andreweduffy commented on the issue: https://github.com/apache/spark/pull/14201 Replaces #14185, @vanzin --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #14136: [SPARK-16282][SQL] Implement percentile SQL function.

2016-07-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14136 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14136: [SPARK-16282][SQL] Implement percentile SQL function.

2016-07-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14136 **[Test build #62315 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62315/consoleFull)** for PR 14136 at commit [`2194c9e`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14136: [SPARK-16282][SQL] Implement percentile SQL function.

2016-07-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14136 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62315/ Test FAILed. ---

[GitHub] spark issue #14201: [SPARK-14702] Expose SparkLauncher's ProcessBuilder for ...

2016-07-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14201 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark issue #14197: [SPARK-14963][Minor][YARN] Fix typo in YarnShuffleServic...

2016-07-14 Thread tgravescs
Github user tgravescs commented on the issue: https://github.com/apache/spark/pull/14197 +1. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the fe

[GitHub] spark issue #9571: [SPARK-11373] [CORE] Add metrics to the History Server an...

2016-07-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/9571 **[Test build #62318 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62318/consoleFull)** for PR 9571 at commit [`6e7f466`](https://github.com/apache/spark/commit/6e7

[GitHub] spark issue #9571: [SPARK-11373] [CORE] Add metrics to the History Server an...

2016-07-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/9571 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62318/ Test FAILed. --- I

[GitHub] spark pull request #14197: [SPARK-14963][Minor][YARN] Fix typo in YarnShuffl...

2016-07-14 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/14197 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #9571: [SPARK-11373] [CORE] Add metrics to the History Server an...

2016-07-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/9571 **[Test build #62318 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62318/consoleFull)** for PR 9571 at commit [`6e7f466`](https://github.com/apache/spark/commit/6e

[GitHub] spark issue #9571: [SPARK-11373] [CORE] Add metrics to the History Server an...

2016-07-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/9571 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature en

[GitHub] spark issue #9571: [SPARK-11373] [CORE] Add metrics to the History Server an...

2016-07-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/9571 **[Test build #62319 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62319/consoleFull)** for PR 9571 at commit [`3971241`](https://github.com/apache/spark/commit/397

[GitHub] spark issue #9571: [SPARK-11373] [CORE] Add metrics to the History Server an...

2016-07-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/9571 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature en

[GitHub] spark issue #9571: [SPARK-11373] [CORE] Add metrics to the History Server an...

2016-07-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/9571 **[Test build #62319 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62319/consoleFull)** for PR 9571 at commit [`3971241`](https://github.com/apache/spark/commit/39

[GitHub] spark issue #9571: [SPARK-11373] [CORE] Add metrics to the History Server an...

2016-07-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/9571 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62319/ Test FAILed. --- I

[GitHub] spark issue #9571: [SPARK-11373] [CORE] Add metrics to the History Server an...

2016-07-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/9571 **[Test build #62320 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62320/consoleFull)** for PR 9571 at commit [`0b8db8b`](https://github.com/apache/spark/commit/0b8

[GitHub] spark issue #9571: [SPARK-11373] [CORE] Add metrics to the History Server an...

2016-07-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/9571 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature en

[GitHub] spark issue #9571: [SPARK-11373] [CORE] Add metrics to the History Server an...

2016-07-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/9571 **[Test build #62320 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62320/consoleFull)** for PR 9571 at commit [`0b8db8b`](https://github.com/apache/spark/commit/0b

[GitHub] spark issue #9571: [SPARK-11373] [CORE] Add metrics to the History Server an...

2016-07-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/9571 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62320/ Test FAILed. --- I

[GitHub] spark issue #9571: [SPARK-11373] [CORE] Add metrics to the History Server an...

2016-07-14 Thread steveloughran
Github user steveloughran commented on the issue: https://github.com/apache/spark/pull/9571 This patch adds separate average values of the load times vs merge times per event; this shows ~2x difference in replay from load in the test case., These `.time` gauges are little lamb

[GitHub] spark issue #9571: [SPARK-11373] [CORE] Add metrics to the History Server an...

2016-07-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/9571 **[Test build #62321 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62321/consoleFull)** for PR 9571 at commit [`4b2046f`](https://github.com/apache/spark/commit/4b2

[GitHub] spark issue #14150: [SPARK-16494] [ML] Upgrade breeze version to 0.12

2016-07-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14150 **[Test build #62316 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62316/consoleFull)** for PR 14150 at commit [`0192f99`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14150: [SPARK-16494] [ML] Upgrade breeze version to 0.12

2016-07-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14150 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14150: [SPARK-16494] [ML] Upgrade breeze version to 0.12

2016-07-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14150 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62316/ Test PASSed. ---

[GitHub] spark issue #13051: [SPARK-15271] [MESOS] Allow force pulling executor docke...

2016-07-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13051 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62317/ Test PASSed. ---

[GitHub] spark issue #13051: [SPARK-15271] [MESOS] Allow force pulling executor docke...

2016-07-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13051 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14162: [SPARK-16505][yarn] Optionally propagate error during sh...

2016-07-14 Thread tgravescs
Github user tgravescs commented on the issue: https://github.com/apache/spark/pull/14162 +1, thanks for fixing up the docs. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enable

[GitHub] spark pull request #14140: [SPARK-16426][MLlib] Fix bug that caused NaNs in ...

2016-07-14 Thread neggert
Github user neggert commented on a diff in the pull request: https://github.com/apache/spark/pull/14140#discussion_r70816925 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/regression/IsotonicRegression.scala --- @@ -408,9 +409,11 @@ class IsotonicRegression private (private

[GitHub] spark pull request #14140: [SPARK-16426][MLlib] Fix bug that caused NaNs in ...

2016-07-14 Thread neggert
Github user neggert commented on a diff in the pull request: https://github.com/apache/spark/pull/14140#discussion_r70818220 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/regression/IsotonicRegression.scala --- @@ -408,9 +409,11 @@ class IsotonicRegression private (private

[GitHub] spark pull request #14162: [SPARK-16505][yarn] Optionally propagate error du...

2016-07-14 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/14162 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #13051: [SPARK-15271] [MESOS] Allow force pulling executor docke...

2016-07-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13051 **[Test build #62317 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62317/consoleFull)** for PR 13051 at commit [`c2d4b7f`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14140: [SPARK-16426][MLlib] Fix bug that caused NaNs in Isotoni...

2016-07-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14140 **[Test build #62323 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62323/consoleFull)** for PR 14140 at commit [`6222452`](https://github.com/apache/spark/commit/6

[GitHub] spark issue #14181: [SPARK-15382][SQL] Fix a rule to push down projects bene...

2016-07-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14181 **[Test build #62322 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62322/consoleFull)** for PR 14181 at commit [`a50d3dc`](https://github.com/apache/spark/commit/a

[GitHub] spark pull request #14202: [SPARK-16230] [CORE] CoarseGrainedExecutorBackend...

2016-07-14 Thread tejasapatil
GitHub user tejasapatil opened a pull request: https://github.com/apache/spark/pull/14202 [SPARK-16230] [CORE] CoarseGrainedExecutorBackend to self kill if there is an exception while creating an Executor ## What changes were proposed in this pull request? With the fix from

[GitHub] spark issue #14202: [SPARK-16230] [CORE] CoarseGrainedExecutorBackend to sel...

2016-07-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14202 **[Test build #62324 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62324/consoleFull)** for PR 14202 at commit [`0c71699`](https://github.com/apache/spark/commit/0

[GitHub] spark pull request #14140: [SPARK-16426][MLlib] Fix bug that caused NaNs in ...

2016-07-14 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/14140#discussion_r70819198 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/regression/IsotonicRegression.scala --- @@ -408,9 +409,11 @@ class IsotonicRegression private (private

[GitHub] spark pull request #14150: [SPARK-16494] [ML] Upgrade breeze version to 0.12

2016-07-14 Thread yanboliang
Github user yanboliang commented on a diff in the pull request: https://github.com/apache/spark/pull/14150#discussion_r70820419 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/clustering/LDAModel.scala --- @@ -784,7 +784,13 @@ class DistributedLDAModel private[clustering] (

[GitHub] spark pull request #14150: [SPARK-16494] [ML] Upgrade breeze version to 0.12

2016-07-14 Thread yanboliang
Github user yanboliang commented on a diff in the pull request: https://github.com/apache/spark/pull/14150#discussion_r70821003 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/clustering/LDAOptimizer.scala --- @@ -508,8 +508,9 @@ final class OnlineLDAOptimizer extends LDAOpti

[GitHub] spark issue #14150: [SPARK-16494] [ML] Upgrade breeze version to 0.12

2016-07-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14150 **[Test build #62325 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62325/consoleFull)** for PR 14150 at commit [`70e13f2`](https://github.com/apache/spark/commit/7

[GitHub] spark pull request #14150: [SPARK-16494] [ML] Upgrade breeze version to 0.12

2016-07-14 Thread yanboliang
Github user yanboliang commented on a diff in the pull request: https://github.com/apache/spark/pull/14150#discussion_r70821947 --- Diff: mllib/src/test/scala/org/apache/spark/mllib/clustering/LDASuite.scala --- @@ -118,8 +118,8 @@ class LDASuite extends SparkFunSuite with MLlibTe

[GitHub] spark pull request #14136: [SPARK-16282][SQL] Implement percentile SQL funct...

2016-07-14 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/14136#discussion_r70822426 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregate/Percentile.scala --- @@ -0,0 +1,172 @@ +/* + * Licensed

[GitHub] spark pull request #14136: [SPARK-16282][SQL] Implement percentile SQL funct...

2016-07-14 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/14136#discussion_r70822633 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregate/Percentile.scala --- @@ -0,0 +1,172 @@ +/* + * Licensed

[GitHub] spark pull request #14136: [SPARK-16282][SQL] Implement percentile SQL funct...

2016-07-14 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/14136#discussion_r70822715 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregate/Percentile.scala --- @@ -0,0 +1,172 @@ +/* + * Licensed

[GitHub] spark pull request #14150: [SPARK-16494] [ML] Upgrade breeze version to 0.12

2016-07-14 Thread yanboliang
Github user yanboliang commented on a diff in the pull request: https://github.com/apache/spark/pull/14150#discussion_r70822797 --- Diff: mllib/src/test/scala/org/apache/spark/mllib/feature/PCASuite.scala --- @@ -42,7 +43,9 @@ class PCASuite extends SparkFunSuite with MLlibTestSpa

[GitHub] spark pull request #14136: [SPARK-16282][SQL] Implement percentile SQL funct...

2016-07-14 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/14136#discussion_r70822992 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregate/Percentile.scala --- @@ -0,0 +1,148 @@ +/* + * Licensed

[GitHub] spark pull request #14136: [SPARK-16282][SQL] Implement percentile SQL funct...

2016-07-14 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/14136#discussion_r70823276 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregate/Percentile.scala --- @@ -0,0 +1,172 @@ +/* + * Licensed

[GitHub] spark pull request #14136: [SPARK-16282][SQL] Implement percentile SQL funct...

2016-07-14 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/14136#discussion_r70823475 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregate/Percentile.scala --- @@ -0,0 +1,172 @@ +/* + * Licensed

[GitHub] spark pull request #14136: [SPARK-16282][SQL] Implement percentile SQL funct...

2016-07-14 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/14136#discussion_r70823811 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregate/Percentile.scala --- @@ -0,0 +1,172 @@ +/* + * Licensed

[GitHub] spark pull request #13670: [SPARK-15951] Change Executors Page to use datata...

2016-07-14 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/13670#discussion_r70824105 --- Diff: core/src/main/resources/org/apache/spark/ui/static/executorspage.js --- @@ -0,0 +1,458 @@ +/* + * Licensed to the Apache Software Foundat

[GitHub] spark pull request #14150: [SPARK-16494] [ML] Upgrade breeze version to 0.12

2016-07-14 Thread yanboliang
Github user yanboliang commented on a diff in the pull request: https://github.com/apache/spark/pull/14150#discussion_r70823371 --- Diff: dev/deps/spark-deps-hadoop-2.7 --- @@ -163,6 +163,7 @@ scala-parser-combinators_2.11-1.0.4.jar scala-reflect-2.11.8.jar scala-xml_2.11-

[GitHub] spark pull request #14186: [SPARK-16530] [SQL] [TRIVIAL] Wrong Parser Keywor...

2016-07-14 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/14186 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #14199: [SPARK-16543][SQL] Rename the columns of `SHOW PARTITION...

2016-07-14 Thread hvanhovell
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/14199 LGTM - merging to master. Thanks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enable

[GitHub] spark issue #14186: [SPARK-16530] [SQL] [TRIVIAL] Wrong Parser Keyword in AL...

2016-07-14 Thread hvanhovell
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/14186 Merging to master. Thanks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and w

[GitHub] spark pull request #13670: [SPARK-15951] Change Executors Page to use datata...

2016-07-14 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/13670#discussion_r70825433 --- Diff: core/src/main/resources/org/apache/spark/ui/static/executorspage.js --- @@ -0,0 +1,458 @@ +/* + * Licensed to the Apache Software Foundat

[GitHub] spark pull request #13670: [SPARK-15951] Change Executors Page to use datata...

2016-07-14 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/13670#discussion_r70826021 --- Diff: core/src/main/resources/org/apache/spark/ui/static/executorspage.js --- @@ -0,0 +1,458 @@ +/* + * Licensed to the Apache Software Foundat

[GitHub] spark pull request #13670: [SPARK-15951] Change Executors Page to use datata...

2016-07-14 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/13670#discussion_r70826778 --- Diff: docs/monitoring.md --- @@ -288,7 +288,11 @@ where `[base-app-id]` is the YARN application ID. /applications/[app-id]/exec

[GitHub] spark issue #14140: [SPARK-16426][MLlib] Fix bug that caused NaNs in Isotoni...

2016-07-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14140 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62323/ Test PASSed. ---

[GitHub] spark issue #14140: [SPARK-16426][MLlib] Fix bug that caused NaNs in Isotoni...

2016-07-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14140 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark pull request #14199: [SPARK-16543][SQL] Rename the columns of `SHOW PA...

2016-07-14 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/14199 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #14081: [SPARK-16403][Examples] Cleanup to remove unused imports...

2016-07-14 Thread BryanCutler
Github user BryanCutler commented on the issue: https://github.com/apache/spark/pull/14081 Thanks @srowen! On Jul 14, 2016 1:16 AM, "asfgit" wrote: > Closed #14081 via e3f8a03 >

[GitHub] spark issue #14140: [SPARK-16426][MLlib] Fix bug that caused NaNs in Isotoni...

2016-07-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14140 **[Test build #62323 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62323/consoleFull)** for PR 14140 at commit [`6222452`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #14203: update python dataframe.drop

2016-07-14 Thread WeichenXu123
GitHub user WeichenXu123 opened a pull request: https://github.com/apache/spark/pull/14203 update python dataframe.drop ## What changes were proposed in this pull request? Make `dataframe.drop` API in python support multi-columns parameters, so that it is the same with s

[GitHub] spark issue #14203: [SPARK-16546][SQL][PySpark] update python dataframe.drop

2016-07-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14203 **[Test build #62326 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62326/consoleFull)** for PR 14203 at commit [`22053e7`](https://github.com/apache/spark/commit/2

[GitHub] spark issue #9571: [SPARK-11373] [CORE] Add metrics to the History Server an...

2016-07-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/9571 **[Test build #62321 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62321/consoleFull)** for PR 9571 at commit [`4b2046f`](https://github.com/apache/spark/commit/4b

[GitHub] spark issue #14204: [SPARK-16520] [WEBUI] Link executors to corresponding wo...

2016-07-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14204 **[Test build #62327 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62327/consoleFull)** for PR 14204 at commit [`21a5abc`](https://github.com/apache/spark/commit/2

[GitHub] spark issue #9571: [SPARK-11373] [CORE] Add metrics to the History Server an...

2016-07-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/9571 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature en

[GitHub] spark issue #9571: [SPARK-11373] [CORE] Add metrics to the History Server an...

2016-07-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/9571 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62321/ Test PASSed. --- I

[GitHub] spark pull request #14204: [SPARK-16520] [WEBUI] Link executors to correspon...

2016-07-14 Thread nblintao
GitHub user nblintao opened a pull request: https://github.com/apache/spark/pull/14204 [SPARK-16520] [WEBUI] Link executors to corresponding worker pages ## What changes were proposed in this pull request? Added a new column named "Worker" in the Executor Page of the web UI.

[GitHub] spark issue #14204: [SPARK-16520] [WEBUI] Link executors to corresponding wo...

2016-07-14 Thread nblintao
Github user nblintao commented on the issue: https://github.com/apache/spark/pull/14204 It looks like this if we use the worker URL as the placeholder (instead of "Worker") in the column Worker. Please note the text (the URL of the worker) is different from its href (the URL of the Wo

[GitHub] spark issue #14181: [SPARK-15382][SQL] Fix a rule to push down projects bene...

2016-07-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14181 **[Test build #62322 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62322/consoleFull)** for PR 14181 at commit [`a50d3dc`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #14136: [SPARK-16282][SQL] Implement percentile SQL funct...

2016-07-14 Thread vectorijk
Github user vectorijk commented on a diff in the pull request: https://github.com/apache/spark/pull/14136#discussion_r70834638 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/DataFrameAggregateSuite.scala --- @@ -475,4 +475,20 @@ class DataFrameAggregateSuite extends QueryTe

[GitHub] spark issue #14181: [SPARK-15382][SQL] Fix a rule to push down projects bene...

2016-07-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14181 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62322/ Test FAILed. ---

[GitHub] spark issue #14136: [SPARK-16282][SQL] Implement percentile SQL function.

2016-07-14 Thread vectorijk
Github user vectorijk commented on the issue: https://github.com/apache/spark/pull/14136 We also need to remove line here https://github.com/apache/spark/blob/master/sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveSessionCatalog.scala#L240. --- If your project is set up for it,

[GitHub] spark issue #14203: [SPARK-16546][SQL][PySpark] update python dataframe.drop

2016-07-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14203 **[Test build #62326 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62326/consoleFull)** for PR 14203 at commit [`22053e7`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14203: [SPARK-16546][SQL][PySpark] update python dataframe.drop

2016-07-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14203 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14181: [SPARK-15382][SQL] Fix a rule to push down projects bene...

2016-07-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14181 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14203: [SPARK-16546][SQL][PySpark] update python dataframe.drop

2016-07-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14203 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62326/ Test PASSed. ---

[GitHub] spark issue #14204: [SPARK-16520] [WEBUI] Link executors to corresponding wo...

2016-07-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14204 **[Test build #62327 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62327/consoleFull)** for PR 14204 at commit [`21a5abc`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14204: [SPARK-16520] [WEBUI] Link executors to corresponding wo...

2016-07-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14204 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62327/ Test FAILed. ---

[GitHub] spark issue #14204: [SPARK-16520] [WEBUI] Link executors to corresponding wo...

2016-07-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14204 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark pull request #14205: [SPARK-16547] [CORE] EventLoggingListener to auto...

2016-07-14 Thread tejasapatil
GitHub user tejasapatil opened a pull request: https://github.com/apache/spark/pull/14205 [SPARK-16547] [CORE] EventLoggingListener to auto create log base dir if it does not exist ## What changes were proposed in this pull request? When the HDFS namenode gets changed or re

[GitHub] spark issue #14199: [SPARK-16543][SQL] Rename the columns of `SHOW PARTITION...

2016-07-14 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/14199 Thank you, @hvanhovell --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wi

[GitHub] spark issue #14158: [SPARK-13547] [SQL] [WEBUI] Add SQL query in web UI's SQ...

2016-07-14 Thread nblintao
Github user nblintao commented on the issue: https://github.com/apache/spark/pull/14158 @ajbozarth @felixcheung Thanks for viewing and discussing! I plan to implement the two updates I mentioned above. The idea of clipboard sounds awesome, but I think we might need more discussion abo

[GitHub] spark issue #14204: [SPARK-16520] [WEBUI] Link executors to corresponding wo...

2016-07-14 Thread nblintao
Github user nblintao commented on the issue: https://github.com/apache/spark/pull/14204 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark pull request #14185: [SPARK-14702][SUBMIT] Expose SparkLauncher's Proc...

2016-07-14 Thread andreweduffy
Github user andreweduffy closed the pull request at: https://github.com/apache/spark/pull/14185 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

<    1   2   3   4   5   6   >