[GitHub] spark pull request #14546: [SPARK-16955][SQL] Using ordinals in ORDER BY and...

2016-08-08 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/14546#discussion_r73994581 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala --- @@ -1252,7 +1252,8 @@ class Analyzer( c

[GitHub] spark pull request #14522: [Spark-16508][SparkR] Split docs for arrange and ...

2016-08-08 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/14522#discussion_r73994436 --- Diff: R/pkg/R/generics.R --- @@ -771,6 +771,10 @@ setGeneric("over", function(x, window) { standardGeneric("over") })

[GitHub] spark issue #14552: [SPARK-16952] don't lookup spark home directory when exe...

2016-08-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14552 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63404/ Test FAILed. ---

[GitHub] spark issue #14552: [SPARK-16952] don't lookup spark home directory when exe...

2016-08-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14552 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14550: [SPARK-16959] [SQL] Rebuild Table Comment when Retrievin...

2016-08-08 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/14550 do you know why we put comment in table properties instead of table comment field? Some hive tricks? --- If your project is set up for it, you can reply to this email and have your reply appear o

[GitHub] spark issue #14552: [SPARK-16952] don't lookup spark home directory when exe...

2016-08-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14552 **[Test build #63404 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63404/consoleFull)** for PR 14552 at commit [`a19cec7`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #14550: [SPARK-16959] [SQL] Rebuild Table Comment when Re...

2016-08-08 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/14550#discussion_r73994067 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveDDLSuite.scala --- @@ -135,7 +135,9 @@ class HiveDDLSuite sql(s"CRE

[GitHub] spark pull request #14298: [SPARK-16283][SQL] Implement `percentile_approx` ...

2016-08-08 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/14298#discussion_r73993906 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregate/PercentileApprox.scala --- @@ -0,0 +1,462 @@ +/* + * Lic

[GitHub] spark issue #10846: [SPARK-12920][SQL] Fix high CPU usage in spark thrift se...

2016-08-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/10846 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63402/ Test PASSed. ---

[GitHub] spark issue #10846: [SPARK-12920][SQL] Fix high CPU usage in spark thrift se...

2016-08-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/10846 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #10846: [SPARK-12920][SQL] Fix high CPU usage in spark thrift se...

2016-08-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/10846 **[Test build #63402 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63402/consoleFull)** for PR 10846 at commit [`b23ddc5`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14520: [SPARK-16934][ML][MLLib] Improve LogisticCostFun to avoi...

2016-08-08 Thread sethah
Github user sethah commented on the issue: https://github.com/apache/spark/pull/14520 The change here does not really affect serialization. Spark automatically broadcasts the coefficients each time calculate is called before, and marking it as a broadcast variable explicitly won't lik

[GitHub] spark pull request #14298: [SPARK-16283][SQL] Implement `percentile_approx` ...

2016-08-08 Thread lw-lin
Github user lw-lin commented on a diff in the pull request: https://github.com/apache/spark/pull/14298#discussion_r73993189 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregate/PercentileApprox.scala --- @@ -0,0 +1,462 @@ +/* + * Licens

[GitHub] spark issue #13886: [SPARK-16185] [SQL] Better Error Messages When Creating ...

2016-08-08 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/13886 We can create a new rule for this kind of check and put it only in sql module, i.e. `SessionState` --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark pull request #13886: [SPARK-16185] [SQL] Better Error Messages When Cr...

2016-08-08 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/13886#discussion_r73992751 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/rules.scala --- @@ -285,6 +290,9 @@ private[sql] case class PreWriteCheck(con

[GitHub] spark issue #14549: Update docs to include SASL support for RPC

2016-08-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14549 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63391/ Test FAILed. ---

[GitHub] spark issue #14549: Update docs to include SASL support for RPC

2016-08-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14549 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14549: Update docs to include SASL support for RPC

2016-08-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14549 **[Test build #63391 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63391/consoleFull)** for PR 14549 at commit [`5da8db6`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14546: [SPARK-16955][SQL] Using ordinals in ORDER BY and GROUP ...

2016-08-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14546 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63401/ Test PASSed. ---

[GitHub] spark issue #14546: [SPARK-16955][SQL] Using ordinals in ORDER BY and GROUP ...

2016-08-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14546 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13907: [SPARK-16209] [SQL] Convert Hive Tables in PARQUET/ORC t...

2016-08-08 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/13907 I don't think it's a very useful feature, and we may surprise users as they do use hive syntax to specify row format. For advanced users, they can easily use `USING xxx` to explicitly crea

[GitHub] spark issue #14546: [SPARK-16955][SQL] Using ordinals in ORDER BY and GROUP ...

2016-08-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14546 **[Test build #63401 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63401/consoleFull)** for PR 14546 at commit [`7386ed6`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14180: Wheelhouse and VirtualEnv support

2016-08-08 Thread zjffdu
Github user zjffdu commented on the issue: https://github.com/apache/spark/pull/14180 ping @Stibbons Any updates ? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wi

[GitHub] spark issue #14534: [SPARK-16941]Use concurrentHashMap instead of scala Map ...

2016-08-08 Thread SaintBacchus
Github user SaintBacchus commented on the issue: https://github.com/apache/spark/pull/14534 cc/ @srowen Is this OK? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wi

[GitHub] spark pull request #13886: [SPARK-16185] [SQL] Better Error Messages When Cr...

2016-08-08 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/13886#discussion_r73991594 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/rules.scala --- @@ -285,6 +290,9 @@ private[sql] case class PreWriteCheck(co

[GitHub] spark pull request #14298: [SPARK-16283][SQL] Implement `percentile_approx` ...

2016-08-08 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/14298#discussion_r73991551 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregate/PercentileApprox.scala --- @@ -0,0 +1,462 @@ +/* + * Lic

[GitHub] spark issue #14547: [SPARK-16718][MLlib] gbm-style treeboost [WIP]

2016-08-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14547 **[Test build #63407 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63407/consoleFull)** for PR 14547 at commit [`cfaee0f`](https://github.com/apache/spark/commit/c

[GitHub] spark issue #14547: [SPARK-16718][MLlib] gbm-style treeboost [WIP]

2016-08-08 Thread vlad17
Github user vlad17 commented on the issue: https://github.com/apache/spark/pull/14547 @sethah Thanks for the FYI. I'm pretty confident that it'll help since now we're directly optimizing the loss function. However, it would be nice to prove this. Unfortunately, the example I linked ab

[GitHub] spark issue #14546: [SPARK-16955][SQL] Using ordinals in ORDER BY and GROUP ...

2016-08-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14546 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63398/ Test PASSed. ---

[GitHub] spark issue #14546: [SPARK-16955][SQL] Using ordinals in ORDER BY and GROUP ...

2016-08-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14546 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14511: [SPARK-16927] [SPARK-16923] Override task properties at ...

2016-08-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14511 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63396/ Test PASSed. ---

[GitHub] spark issue #14511: [SPARK-16927] [SPARK-16923] Override task properties at ...

2016-08-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14511 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14546: [SPARK-16955][SQL] Using ordinals in ORDER BY and GROUP ...

2016-08-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14546 **[Test build #63398 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63398/consoleFull)** for PR 14546 at commit [`12bd144`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14511: [SPARK-16927] [SPARK-16923] Override task properties at ...

2016-08-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14511 **[Test build #63396 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63396/consoleFull)** for PR 14511 at commit [`d6c25f0`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #14298: [SPARK-16283][SQL] Implement `percentile_approx` ...

2016-08-08 Thread lw-lin
Github user lw-lin commented on a diff in the pull request: https://github.com/apache/spark/pull/14298#discussion_r73990892 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregate/PercentileApprox.scala --- @@ -0,0 +1,462 @@ +/* + * Licens

[GitHub] spark issue #14552: [SPARK-16952] don't lookup spark home directory when exe...

2016-08-08 Thread drcrallen
Github user drcrallen commented on the issue: https://github.com/apache/spark/pull/14552 super cool, thanks @mgummelt ! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled an

[GitHub] spark issue #14553: [WIP] [SPARK-16963] Initial version of changes to Source...

2016-08-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14553 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark pull request #14546: [SPARK-16955][SQL] Using ordinals in ORDER BY and...

2016-08-08 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/14546#discussion_r73990474 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala --- @@ -1252,7 +1252,8 @@ class Analyzer( case

[GitHub] spark pull request #14553: [WIP] [SPARK-16963] Initial version of changes to...

2016-08-08 Thread frreiss
GitHub user frreiss opened a pull request: https://github.com/apache/spark/pull/14553 [WIP] [SPARK-16963] Initial version of changes to Source trait ## What changes were proposed in this pull request? Initial proposed changes to the Source trait such that the scheduler can

[GitHub] spark issue #14550: [SPARK-16959] [SQL] Rebuild Table Comment when Retrievin...

2016-08-08 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/14550 cc @cloud-fan . This is a tiny fix. Could you review this? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request #14518: [SPARK-16610][SQL] Add `orc.compress` as an alias...

2016-08-08 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/14518 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #14518: [SPARK-16610][SQL] Add `orc.compress` as an alias for `c...

2016-08-08 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/14518 thanks, merging to master and 2.0! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enable

[GitHub] spark issue #14531: [SPARK-16943] [SPARK-16942] [SQL] Fix multiple bugs in C...

2016-08-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14531 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63393/ Test PASSed. ---

[GitHub] spark issue #14531: [SPARK-16943] [SPARK-16942] [SQL] Fix multiple bugs in C...

2016-08-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14531 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14538: [SPARK-16960][SQL] Deprecate approxCountDistinct, toDegr...

2016-08-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14538 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14538: [SPARK-16960][SQL] Deprecate approxCountDistinct, toDegr...

2016-08-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14538 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63394/ Test PASSed. ---

[GitHub] spark issue #14531: [SPARK-16943] [SPARK-16942] [SQL] Fix multiple bugs in C...

2016-08-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14531 **[Test build #63393 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63393/consoleFull)** for PR 14531 at commit [`8434777`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14538: [SPARK-16960][SQL] Deprecate approxCountDistinct, toDegr...

2016-08-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14538 **[Test build #63394 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63394/consoleFull)** for PR 14538 at commit [`247a93d`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13146: [SPARK-13081][PYSPARK][SPARK_SUBMIT]. Allow set pythonEx...

2016-08-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13146 **[Test build #63406 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63406/consoleFull)** for PR 13146 at commit [`8e1600e`](https://github.com/apache/spark/commit/8

[GitHub] spark issue #14518: [SPARK-16610][SQL] Add `orc.compress` as an alias for `c...

2016-08-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14518 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63397/ Test PASSed. ---

[GitHub] spark issue #14518: [SPARK-16610][SQL] Add `orc.compress` as an alias for `c...

2016-08-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14518 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14518: [SPARK-16610][SQL] Add `orc.compress` as an alias for `c...

2016-08-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14518 **[Test build #63397 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63397/consoleFull)** for PR 14518 at commit [`e4d6999`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #14509: [SPARK-16924][SQL] - Support option("inferSchema"...

2016-08-08 Thread xwu0226
Github user xwu0226 closed the pull request at: https://github.com/apache/spark/pull/14509 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is en

[GitHub] spark issue #10846: [SPARK-12920][SQL] Fix high CPU usage in spark thrift se...

2016-08-08 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/10846 @rajeshbalamohan can you also update the PR title and summary? thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark issue #14520: [SPARK-16934][ML][MLLib] Improve LogisticCostFun to avoi...

2016-08-08 Thread WeichenXu123
Github user WeichenXu123 commented on the issue: https://github.com/apache/spark/pull/14520 @MLnick The main improvement here is about `localFeaturesStd`, in previous code, each calling on `CostFun.calculate` will do a serialization and broadcast on vector. mark `localFeat

[GitHub] spark issue #14552: [SPARK-16952] don't lookup spark home directory when exe...

2016-08-08 Thread mgummelt
Github user mgummelt commented on the issue: https://github.com/apache/spark/pull/14552 cc @drcrallen --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or i

[GitHub] spark pull request #14552: [SPARK-16952] don't lookup spark home directory w...

2016-08-08 Thread mgummelt
GitHub user mgummelt opened a pull request: https://github.com/apache/spark/pull/14552 [SPARK-16952] don't lookup spark home directory when executor uri is set ## What changes were proposed in this pull request? remove requirement to set spark.mesos.executor.home when spark.

[GitHub] spark issue #14552: [SPARK-16952] don't lookup spark home directory when exe...

2016-08-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14552 **[Test build #63404 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63404/consoleFull)** for PR 14552 at commit [`a19cec7`](https://github.com/apache/spark/commit/a

[GitHub] spark issue #14065: [SPARK-14743][YARN] Add a configurable credential manage...

2016-08-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14065 **[Test build #63405 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63405/consoleFull)** for PR 14065 at commit [`71df428`](https://github.com/apache/spark/commit/7

[GitHub] spark issue #14447: [SPARK-16445][MLlib][SparkR] Multilayer Perceptron Class...

2016-08-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14447 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13146: [SPARK-13081][PYSPARK][SPARK_SUBMIT]. Allow set pythonEx...

2016-08-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13146 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14447: [SPARK-16445][MLlib][SparkR] Multilayer Perceptron Class...

2016-08-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14447 **[Test build #63399 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63399/consoleFull)** for PR 14447 at commit [`a3f5bb5`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #14542: [SPARK-16930][yarn] Fix a couple of races in clus...

2016-08-08 Thread jerryshao
Github user jerryshao commented on a diff in the pull request: https://github.com/apache/spark/pull/14542#discussion_r73987834 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/ApplicationMaster.scala --- @@ -404,7 +410,8 @@ private[spark] class ApplicationMaster(

[GitHub] spark issue #13146: [SPARK-13081][PYSPARK][SPARK_SUBMIT]. Allow set pythonEx...

2016-08-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13146 **[Test build #63403 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63403/consoleFull)** for PR 13146 at commit [`1e9053a`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14447: [SPARK-16445][MLlib][SparkR] Multilayer Perceptron Class...

2016-08-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14447 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63399/ Test FAILed. ---

[GitHub] spark issue #13146: [SPARK-13081][PYSPARK][SPARK_SUBMIT]. Allow set pythonEx...

2016-08-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13146 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63403/ Test FAILed. ---

[GitHub] spark issue #13146: [SPARK-13081][PYSPARK][SPARK_SUBMIT]. Allow set pythonEx...

2016-08-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13146 **[Test build #63403 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63403/consoleFull)** for PR 13146 at commit [`1e9053a`](https://github.com/apache/spark/commit/1

[GitHub] spark pull request #13886: [SPARK-16185] [SQL] Better Error Messages When Cr...

2016-08-08 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/13886#discussion_r73986950 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/rules.scala --- @@ -285,6 +290,9 @@ private[sql] case class PreWriteCheck(con

[GitHub] spark issue #14534: [SPARK-16941]Use concurrentHashMap instead of scala Map ...

2016-08-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14534 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63400/ Test PASSed. ---

[GitHub] spark issue #14534: [SPARK-16941]Use concurrentHashMap instead of scala Map ...

2016-08-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14534 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14534: [SPARK-16941]Use concurrentHashMap instead of scala Map ...

2016-08-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14534 **[Test build #63400 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63400/consoleFull)** for PR 14534 at commit [`592d817`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #14182: [SPARK-16444][SparkR]: Isotonic Regression wrappe...

2016-08-08 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/14182#discussion_r73985582 --- Diff: R/pkg/R/mllib.R --- @@ -292,6 +299,83 @@ setMethod("summary", signature(object = "NaiveBayesModel"), return(list(apriori = apr

[GitHub] spark issue #14550: [SPARK-16959] [SQL] Rebuild Table Comment when Retrievin...

2016-08-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14550 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63392/ Test PASSed. ---

[GitHub] spark issue #14550: [SPARK-16959] [SQL] Rebuild Table Comment when Retrievin...

2016-08-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14550 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14550: [SPARK-16959] [SQL] Rebuild Table Comment when Retrievin...

2016-08-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14550 **[Test build #63392 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63392/consoleFull)** for PR 14550 at commit [`e546af5`](https://github.com/apache/spark/commit/

[GitHub] spark issue #10846: [SPARK-12920][SQL] Fix high CPU usage in spark thrift se...

2016-08-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/10846 **[Test build #63402 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63402/consoleFull)** for PR 10846 at commit [`b23ddc5`](https://github.com/apache/spark/commit/b

[GitHub] spark pull request #14182: [SPARK-16444][SparkR]: Isotonic Regression wrappe...

2016-08-08 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/14182#discussion_r73984871 --- Diff: R/pkg/R/mllib.R --- @@ -292,6 +299,83 @@ setMethod("summary", signature(object = "NaiveBayesModel"), return(list(apriori = apr

[GitHub] spark issue #14531: [SPARK-16943] [SPARK-16942] [SQL] Fix multiple bugs in C...

2016-08-08 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/14531 Sure, will do it. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wi

[GitHub] spark issue #10846: [SPARK-12920][SQL] Fix high CPU usage in spark thrift se...

2016-08-08 Thread rajeshbalamohan
Github user rajeshbalamohan commented on the issue: https://github.com/apache/spark/pull/10846 They take longer to clean up. If queries are executed continuously, major portion of thrift server wastes time in GC-ing. IAC, I have removed the HadoopRDD in the recent commit and c

[GitHub] spark pull request #13886: [SPARK-16185] [SQL] Better Error Messages When Cr...

2016-08-08 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/13886#discussion_r73984812 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/rules.scala --- @@ -285,6 +290,9 @@ private[sql] case class PreWriteCheck(co

[GitHub] spark issue #14531: [SPARK-16943] [SPARK-16942] [SQL] Fix multiple bugs in C...

2016-08-08 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/14531 Can we improve the class doc for `CreateTableLikeCommand` to explain the expected semantic? thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark issue #14551: [SPARK-16961][CORE] Fixed off-by-one error that biased r...

2016-08-08 Thread nicklavers
Github user nicklavers commented on the issue: https://github.com/apache/spark/pull/14551 Thanks @HyukjinKwon! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #14546: [SPARK-16955][SQL] Using ordinals in ORDER BY and GROUP ...

2016-08-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14546 **[Test build #63401 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63401/consoleFull)** for PR 14546 at commit [`7386ed6`](https://github.com/apache/spark/commit/7

[GitHub] spark issue #13738: [SPARK-11227][CORE] UnknownHostException can be thrown w...

2016-08-08 Thread sarutak
Github user sarutak commented on the issue: https://github.com/apache/spark/pull/13738 @tgravescs No problem. Have a nice vacation :) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark issue #14534: [SPARK-16941]Add SynchronizedMap trait with Map in Spark...

2016-08-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14534 **[Test build #63400 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63400/consoleFull)** for PR 14534 at commit [`592d817`](https://github.com/apache/spark/commit/5

[GitHub] spark issue #12990: [SPARK-15083] [Web UI] Limit total tasks displayed on We...

2016-08-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/12990 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63390/ Test PASSed. ---

[GitHub] spark issue #12990: [SPARK-15083] [Web UI] Limit total tasks displayed on We...

2016-08-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/12990 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark pull request #14522: [Spark-16508][SparkR] Split docs for arrange and ...

2016-08-08 Thread junyangq
Github user junyangq commented on a diff in the pull request: https://github.com/apache/spark/pull/14522#discussion_r73983727 --- Diff: R/pkg/R/generics.R --- @@ -771,6 +771,10 @@ setGeneric("over", function(x, window) { standardGeneric("over") }) ##

[GitHub] spark issue #12990: [SPARK-15083] [Web UI] Limit total tasks displayed on We...

2016-08-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/12990 **[Test build #63390 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63390/consoleFull)** for PR 12990 at commit [`593b294`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14489: [MINOR][SparkR] R API documentation for "coltypes" is co...

2016-08-08 Thread keypointt
Github user keypointt commented on the issue: https://github.com/apache/spark/pull/14489 @shivaram --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if t

[GitHub] spark issue #14551: Fixed off-by-one error that biased randomizeInPlace

2016-08-08 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/14551 Hi, @nicklavers, just in case you might not know, fixing the title such as `[SPARK-16961][CORE] ...` will automatically add the link of this PR to the JIRA as described in https://cwiki.apache

[GitHub] spark pull request #14522: [Spark-16508][SparkR] Split docs for arrange and ...

2016-08-08 Thread junyangq
Github user junyangq commented on a diff in the pull request: https://github.com/apache/spark/pull/14522#discussion_r73983612 --- Diff: R/pkg/R/generics.R --- @@ -771,6 +771,10 @@ setGeneric("over", function(x, window) { standardGeneric("over") }) ##

[GitHub] spark pull request #14182: [SPARK-16444][SparkR]: Isotonic Regression wrappe...

2016-08-08 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/14182#discussion_r73983532 --- Diff: R/pkg/R/mllib.R --- @@ -292,6 +299,83 @@ setMethod("summary", signature(object = "NaiveBayesModel"), return(list(apriori = apr

[GitHub] spark pull request #14218: [SPARK-16563][SQL] fix spark sql thrift server Fe...

2016-08-08 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/14218 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request #14531: [SPARK-16943] [SPARK-16942] [SQL] Fix multiple bu...

2016-08-08 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/14531#discussion_r73983398 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/tables.scala --- @@ -80,13 +80,49 @@ case class CreateTableLikeCommand(

[GitHub] spark issue #14218: [SPARK-16563][SQL] fix spark sql thrift server FetchResu...

2016-08-08 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/14218 Merging in master/branch-2.0. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wis

[GitHub] spark issue #14447: [SPARK-16445][MLlib][SparkR] Multilayer Perceptron Class...

2016-08-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14447 **[Test build #63399 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63399/consoleFull)** for PR 14447 at commit [`a3f5bb5`](https://github.com/apache/spark/commit/a

[GitHub] spark issue #14509: [SPARK-16924][SQL] - Support option("inferSchema", true)...

2016-08-08 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/14509 Thank you for all your comments as well. Maybe we can close this if you think this is not an issue. --- If your project is set up for it, you can reply to this email and have your reply appear

[GitHub] spark pull request #14539: [SPARK-16947][SQL] Improve type coercion for inli...

2016-08-08 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/14539#discussion_r73982911 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/DataFrameSuite.scala --- @@ -1192,8 +1192,8 @@ class DataFrameSuite extends QueryTest with SharedSQ

[GitHub] spark pull request #14539: [SPARK-16947][SQL] Improve type coercion for inli...

2016-08-08 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/14539#discussion_r73982800 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/parser/PlanParserSuite.scala --- @@ -424,19 +424,26 @@ class PlanParserSuite extends P

<    1   2   3   4   5   6   7   >