[GitHub] spark issue #16781: [SPARK-12297][SQL] Hive compatibility for Parquet Timest...

2017-04-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16781 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16781: [SPARK-12297][SQL] Hive compatibility for Parquet Timest...

2017-04-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16781 **[Test build #76141 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76141/testReport)** for PR 16781 at commit

[GitHub] spark issue #17724: [SPARK-18127] Add hooks and extension points to Spark

2017-04-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17724 **[Test build #76146 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76146/testReport)** for PR 17724 at commit

[GitHub] spark issue #17761: [SPARK-20461][Core][SS]Use UninterruptibleThread for Exe...

2017-04-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17761 **[Test build #76145 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76145/testReport)** for PR 17761 at commit

[GitHub] spark pull request #17728: [SPARK-20437][R] R wrappers for rollup and cube

2017-04-25 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/17728#discussion_r113278764 --- Diff: R/pkg/R/DataFrame.R --- @@ -3642,3 +3643,74 @@ setMethod("checkpoint", df <- callJMethod(x@sdf, "checkpoint",

[GitHub] spark pull request #17728: [SPARK-20437][R] R wrappers for rollup and cube

2017-04-25 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/17728#discussion_r113278677 --- Diff: R/pkg/R/DataFrame.R --- @@ -3642,3 +3643,74 @@ setMethod("checkpoint", df <- callJMethod(x@sdf, "checkpoint",

[GitHub] spark pull request #17728: [SPARK-20437][R] R wrappers for rollup and cube

2017-04-25 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/17728#discussion_r113278517 --- Diff: R/pkg/R/DataFrame.R --- @@ -3642,3 +3643,74 @@ setMethod("checkpoint", df <- callJMethod(x@sdf, "checkpoint",

[GitHub] spark issue #17596: [SPARK-12837][CORE] Do not send the name of internal acc...

2017-04-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17596 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76136/ Test FAILed. ---

[GitHub] spark issue #17596: [SPARK-12837][CORE] Do not send the name of internal acc...

2017-04-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17596 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17596: [SPARK-12837][CORE] Do not send the name of internal acc...

2017-04-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17596 **[Test build #76136 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76136/testReport)** for PR 17596 at commit

[GitHub] spark pull request #17761: [SPARK-20461][Core][SS]Use UninterruptibleThread ...

2017-04-25 Thread kunalkhamar
Github user kunalkhamar commented on a diff in the pull request: https://github.com/apache/spark/pull/17761#discussion_r113274024 --- Diff: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/CachedKafkaConsumer.scala --- @@ -62,11 +63,20 @@ private[kafka010]

[GitHub] spark issue #17761: [SPARK-20461][Core][SS]Use UninterruptibleThread for Exe...

2017-04-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17761 **[Test build #76144 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76144/testReport)** for PR 17761 at commit

[GitHub] spark pull request #17761: [SPARK-20461][Core][SS]Use UninterruptibleThread ...

2017-04-25 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/17761#discussion_r113273935 --- Diff: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/CachedKafkaConsumer.scala --- @@ -62,11 +63,20 @@ private[kafka010] case class

[GitHub] spark pull request #17761: [SPARK-20461][Core][SS]Use UninterruptibleThread ...

2017-04-25 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/17761#discussion_r113273103 --- Diff: core/src/main/scala/org/apache/spark/executor/Executor.scala --- @@ -84,7 +86,20 @@ private[spark] class Executor( } // Start

[GitHub] spark pull request #15125: [SPARK-5484][GraphX] Periodically do checkpoint i...

2017-04-25 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15125 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #17761: [SPARK-20461][Core][SS]Use UninterruptibleThread ...

2017-04-25 Thread zsxwing
GitHub user zsxwing opened a pull request: https://github.com/apache/spark/pull/17761 [SPARK-20461][Core][SS]Use UninterruptibleThread for Executor and fix the potential hang in CachedKafkaConsumer ## What changes were proposed in this pull request? This PR changes

[GitHub] spark issue #15125: [SPARK-5484][GraphX] Periodically do checkpoint in Prege...

2017-04-25 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/15125 merged to master/2.2 I talked to Ankur about this change offline. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request #17728: [SPARK-20437][R] R wrappers for rollup and cube

2017-04-25 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/17728#discussion_r113270143 --- Diff: R/pkg/R/DataFrame.R --- @@ -1321,7 +1321,7 @@ setMethod("toRDD", #' Groups the SparkDataFrame using the specified columns, so we can run

[GitHub] spark pull request #17757: [Minor][ML] Fix some PySpark & SparkR flaky tests

2017-04-25 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/17757#discussion_r113269591 --- Diff: R/pkg/inst/tests/testthat/test_mllib_classification.R --- @@ -284,22 +284,11 @@ test_that("spark.mlp", { c("1.0", "1.0",

[GitHub] spark issue #17725: [SPARK-20435][CORE] More thorough redaction of sensitive...

2017-04-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17725 **[Test build #76143 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76143/testReport)** for PR 17725 at commit

[GitHub] spark issue #17757: [Minor][ML] Fix some PySpark & SparkR flaky tests

2017-04-25 Thread dbtsai
Github user dbtsai commented on the issue: https://github.com/apache/spark/pull/17757 LGTM. Please merge the current master to resolve the conflicts. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark issue #17746: [SPARK-20449][ML] Upgrade breeze version to 0.13.1

2017-04-25 Thread dbtsai
Github user dbtsai commented on the issue: https://github.com/apache/spark/pull/17746 @srowen Couple APIs changes in Breeze 0.13 are not source code compatible with 0.12. We should tell users about that in the release note, and they need to do their migration if they are using Breeze

[GitHub] spark issue #17746: [SPARK-20449][ML] Upgrade breeze version to 0.13.1

2017-04-25 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/17746 Not that I have any specific concern, but did anyone look at the changes from 0.12 to 0.13 to see if anything might be breaking? probably not, but it does leak into the user classpath --- If your

[GitHub] spark issue #17759: [DOCS] Fix a typo in Encoder.clsTag

2017-04-25 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/17759 Yes, but we generally ask people to do a more comprehensive sweep for typos if they're going to bother. It's a lot of overhead to merge a bunch of these --- If your project is set up for it, you

[GitHub] spark issue #17746: [SPARK-20449][ML] Upgrade breeze version to 0.13.1

2017-04-25 Thread dbtsai
Github user dbtsai commented on the issue: https://github.com/apache/spark/pull/17746 Many thanks for @WeichenXu123 helping to fix this bug in breeze! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request #17746: [SPARK-20449][ML] Upgrade breeze version to 0.13....

2017-04-25 Thread dbtsai
Github user dbtsai commented on a diff in the pull request: https://github.com/apache/spark/pull/17746#discussion_r113256277 --- Diff: R/pkg/inst/tests/testthat/test_mllib_classification.R --- @@ -288,18 +288,18 @@ test_that("spark.mlp", { c(0, 0, 0, 0, 0, 5, 5, 5, 5, 5,

[GitHub] spark pull request #17746: [SPARK-20449][ML] Upgrade breeze version to 0.13....

2017-04-25 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/17746 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-04-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17758 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76138/ Test FAILed. ---

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-04-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17758 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-04-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17758 **[Test build #76138 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76138/testReport)** for PR 17758 at commit

[GitHub] spark issue #17596: [SPARK-12837][CORE] Do not send the name of internal acc...

2017-04-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17596 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76134/ Test PASSed. ---

[GitHub] spark issue #17596: [SPARK-12837][CORE] Do not send the name of internal acc...

2017-04-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17596 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17596: [SPARK-12837][CORE] Do not send the name of internal acc...

2017-04-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17596 **[Test build #76134 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76134/testReport)** for PR 17596 at commit

[GitHub] spark issue #17746: [SPARK-20449][ML] Upgrade breeze version to 0.13.1

2017-04-25 Thread dbtsai
Github user dbtsai commented on the issue: https://github.com/apache/spark/pull/17746 LGTM. Merged into master and branch 2.2 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17649: [SPARK-20380][SQL] Output table comment for DESC FORMATT...

2017-04-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17649 **[Test build #76142 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76142/testReport)** for PR 17649 at commit

[GitHub] spark issue #16781: [SPARK-12297][SQL] Hive compatibility for Parquet Timest...

2017-04-25 Thread squito
Github user squito commented on the issue: https://github.com/apache/spark/pull/16781 @ueshin updated per your feedback. I should have explained that the last update *did* handle partition tables (it added the second call to `getStorageTzOptions` in `HiveMetastoreCatalog`),

[GitHub] spark issue #16781: [SPARK-12297][SQL] Hive compatibility for Parquet Timest...

2017-04-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16781 **[Test build #76141 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76141/testReport)** for PR 16781 at commit

[GitHub] spark issue #17760: [SPARK-20439] [SQL] [Backport-2.1] Fix Catalog API listT...

2017-04-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17760 **[Test build #76140 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76140/testReport)** for PR 17760 at commit

[GitHub] spark pull request #17760: [SPARK-20439] [SQL] [Backport-2.1] Fix Catalog AP...

2017-04-25 Thread gatorsmile
GitHub user gatorsmile opened a pull request: https://github.com/apache/spark/pull/17760 [SPARK-20439] [SQL] [Backport-2.1] Fix Catalog API listTables and getTable when failed to fetch table metadata ### What changes were proposed in this pull request? This PR is to

[GitHub] spark issue #17649: [SPARK-20380][SQL] Output table comment for DESC FORMATT...

2017-04-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17649 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17649: [SPARK-20380][SQL] Output table comment for DESC FORMATT...

2017-04-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17649 **[Test build #76139 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76139/testReport)** for PR 17649 at commit

[GitHub] spark issue #17649: [SPARK-20380][SQL] Output table comment for DESC FORMATT...

2017-04-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17649 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76139/ Test FAILed. ---

[GitHub] spark issue #17649: [SPARK-20380][SQL] Output table comment for DESC FORMATT...

2017-04-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17649 **[Test build #76139 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76139/testReport)** for PR 17649 at commit

[GitHub] spark issue #17759: [DOCS] Fix a typo in Encoder.clsTag

2017-04-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17759 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request #17759: [DOCS] Fix a typo in Encoder.clsTag

2017-04-25 Thread mineo
GitHub user mineo opened a pull request: https://github.com/apache/spark/pull/17759 [DOCS] Fix a typo in Encoder.clsTag ## What changes were proposed in this pull request? Fixes a typo: `and` -> `an` ## How was this patch tested? Not at all. You can

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-04-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17758 **[Test build #76138 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76138/testReport)** for PR 17758 at commit

[GitHub] spark issue #17727: [SQL][MINOR] Remove misleading comment (and tags do bett...

2017-04-25 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/17727 Hm I don't think the comment makes sense ... --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-04-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17758 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-04-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17758 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76137/ Test FAILed. ---

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-04-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17758 **[Test build #76137 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76137/testReport)** for PR 17758 at commit

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-04-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17758 **[Test build #76137 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76137/testReport)** for PR 17758 at commit

[GitHub] spark pull request #17758: [SPARK-20460][SQL] Make it more consistent to han...

2017-04-25 Thread maropu
GitHub user maropu opened a pull request: https://github.com/apache/spark/pull/17758 [SPARK-20460][SQL] Make it more consistent to handle column name duplication ## What changes were proposed in this pull request? This pr made it more consistent to handle column name

[GitHub] spark issue #17540: [SPARK-20213][SQL][UI] Fix DataFrameWriter operations in...

2017-04-25 Thread rdblue
Github user rdblue commented on the issue: https://github.com/apache/spark/pull/17540 @zsxwing, what do you think the right way forward is? The "problem" with this patch seems to actually be a wide-spread problem with the data sources API -- it doesn't correctly link into SQL plans.

[GitHub] spark pull request #17540: [SPARK-20213][SQL][UI] Fix DataFrameWriter operat...

2017-04-25 Thread rdblue
Github user rdblue commented on a diff in the pull request: https://github.com/apache/spark/pull/17540#discussion_r113225697 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/FileFormatWriter.scala --- @@ -161,50 +161,51 @@ object FileFormatWriter

[GitHub] spark issue #17728: [SPARK-20437][R] R wrappers for rollup and cube

2017-04-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17728 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17728: [SPARK-20437][R] R wrappers for rollup and cube

2017-04-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17728 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76135/ Test PASSed. ---

[GitHub] spark issue #17728: [SPARK-20437][R] R wrappers for rollup and cube

2017-04-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17728 **[Test build #76135 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76135/testReport)** for PR 17728 at commit

[GitHub] spark pull request #17130: [SPARK-19791] [ML] Add doc and example for fpgrow...

2017-04-25 Thread hhbyyh
Github user hhbyyh commented on a diff in the pull request: https://github.com/apache/spark/pull/17130#discussion_r113220960 --- Diff: mllib/src/main/scala/org/apache/spark/ml/fpm/FPGrowth.scala --- @@ -268,12 +269,8 @@ class FPGrowthModel private[ml] ( val predictUDF =

[GitHub] spark issue #17673: [SPARK-20372] [ML] Word2Vec Continuous Bag of Words mode...

2017-04-25 Thread Krimit
Github user Krimit commented on the issue: https://github.com/apache/spark/pull/17673 I'm happy to take a look! I'll have some time to dig in deeper tomorrow. Some of my initial impressions: * There's a lot going on here, I agree with @hhbyyh that it would be cleaner to put the

[GitHub] spark pull request #17757: [Minor][ML] Fix some PySpark & SparkR flaky tests

2017-04-25 Thread yanboliang
Github user yanboliang commented on a diff in the pull request: https://github.com/apache/spark/pull/17757#discussion_r113215088 --- Diff: R/pkg/inst/tests/testthat/test_mllib_classification.R --- @@ -284,22 +284,11 @@ test_that("spark.mlp", { c("1.0", "1.0",

[GitHub] spark issue #17596: [SPARK-12837][CORE] Do not send the name of internal acc...

2017-04-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17596 **[Test build #76136 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76136/testReport)** for PR 17596 at commit

[GitHub] spark issue #17728: [SPARK-20437][R] R wrappers for rollup and cube

2017-04-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17728 **[Test build #76135 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76135/testReport)** for PR 17728 at commit

[GitHub] spark issue #17596: [SPARK-12837][CORE] Do not send the accumulator name to ...

2017-04-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17596 **[Test build #76134 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76134/testReport)** for PR 17596 at commit

[GitHub] spark issue #17735: [SPARK-20441][SPARK-20432][SS] Within the same streaming...

2017-04-25 Thread lw-lin
Github user lw-lin commented on the issue: https://github.com/apache/spark/pull/17735 @zsxwing @brkyvz would you take a look at this? thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark issue #17757: [Minor][ML] Fix some PySpark & SparkR flaky tests

2017-04-25 Thread yanboliang
Github user yanboliang commented on the issue: https://github.com/apache/spark/pull/17757 @HyukjinKwon We hit this issue at #17746 when we upgrade breeze to 0.13.1. Since these tests don't converged, we check intermediate result which is vulnerable, so I switched to check the last

[GitHub] spark issue #17728: [SPARK-20437][R] R wrappers for rollup and cube

2017-04-25 Thread zero323
Github user zero323 commented on the issue: https://github.com/apache/spark/pull/17728 I actually. I wasn't sure about this in the first place. Let me spread it between `details` and `examples`. --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark issue #17757: [Minor][ML] Fix some PySpark & SparkR flaky tests

2017-04-25 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/17757 Hi @yanboliang, do you mind if I ask why they were flaky? I am just curious and want to know. --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark pull request #17658: [SPARK-20355] Add per application spark version o...

2017-04-25 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/17658#discussion_r113196872 --- Diff: core/src/main/scala/org/apache/spark/ui/SparkUI.scala --- @@ -139,6 +140,8 @@ private[spark] abstract class SparkUITab(parent: SparkUI, prefix:

[GitHub] spark issue #17658: [SPARK-20355] Add per application spark version on the h...

2017-04-25 Thread tgravescs
Github user tgravescs commented on the issue: https://github.com/apache/spark/pull/17658 Jenkins, test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request #17748: [SPARK-19812] YARN shuffle service fails to reloc...

2017-04-25 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/17748#discussion_r113192444 --- Diff: common/network-yarn/src/main/java/org/apache/spark/network/yarn/YarnShuffleService.java --- @@ -363,25 +362,29 @@ protected File

[GitHub] spark issue #17757: [Minor][ML] Fix some PySpark & SparkR flaky tests

2017-04-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17757 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76133/ Test PASSed. ---

[GitHub] spark issue #17757: [Minor][ML] Fix some PySpark & SparkR flaky tests

2017-04-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17757 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17757: [Minor][ML] Fix some PySpark & SparkR flaky tests

2017-04-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17757 **[Test build #76133 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76133/testReport)** for PR 17757 at commit

[GitHub] spark pull request #17686: [SPARK-20393][Webu UI] Strengthen Spark to preven...

2017-04-25 Thread n-marion
Github user n-marion commented on a diff in the pull request: https://github.com/apache/spark/pull/17686#discussion_r113188759 --- Diff: core/src/main/scala/org/apache/spark/ui/UIUtils.scala --- @@ -527,4 +530,24 @@ private[spark] object UIUtils extends Logging {

[GitHub] spark pull request #17686: [SPARK-20393][Webu UI] Strengthen Spark to preven...

2017-04-25 Thread n-marion
Github user n-marion commented on a diff in the pull request: https://github.com/apache/spark/pull/17686#discussion_r113188711 --- Diff: core/src/main/scala/org/apache/spark/ui/UIUtils.scala --- @@ -27,13 +27,16 @@ import scala.xml.transform.{RewriteRule, RuleTransformer}

[GitHub] spark issue #17757: [Minor][ML] Fix some PySpark & SparkR flaky tests

2017-04-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17757 **[Test build #76133 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76133/testReport)** for PR 17757 at commit

[GitHub] spark pull request #17757: [Minor][ML] Fix some PySpark & SparkR flaky tests

2017-04-25 Thread yanboliang
GitHub user yanboliang opened a pull request: https://github.com/apache/spark/pull/17757 [Minor][ML] Fix some PySpark & SparkR flaky tests ## What changes were proposed in this pull request? Fix some PySpark & SparkR flaky tests. ## How was this patch tested?

[GitHub] spark issue #17727: [SQL][MINOR] Remove misleading comment (and tags do bett...

2017-04-25 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/17727 @rxin would be able to judge this --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #17542: Corrects interval notation in doc comment

2017-04-25 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/17542 Ping @w3iBStime can you update this or close? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request #17686: [SPARK-20393][Webu UI] Strengthen Spark to preven...

2017-04-25 Thread n-marion
Github user n-marion commented on a diff in the pull request: https://github.com/apache/spark/pull/17686#discussion_r113173559 --- Diff: core/src/main/scala/org/apache/spark/ui/UIUtils.scala --- @@ -527,4 +530,24 @@ private[spark] object UIUtils extends Logging {

[GitHub] spark pull request #17686: [SPARK-20393][Webu UI] Strengthen Spark to preven...

2017-04-25 Thread n-marion
Github user n-marion commented on a diff in the pull request: https://github.com/apache/spark/pull/17686#discussion_r113172804 --- Diff: core/src/main/scala/org/apache/spark/ui/UIUtils.scala --- @@ -27,13 +27,16 @@ import scala.xml.transform.{RewriteRule, RuleTransformer}

[GitHub] spark issue #17744: [SPARK-20426] Lazy initialization of FileSegmentManagedB...

2017-04-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17744 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76132/ Test PASSed. ---

[GitHub] spark issue #17744: [SPARK-20426] Lazy initialization of FileSegmentManagedB...

2017-04-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17744 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17744: [SPARK-20426] Lazy initialization of FileSegmentManagedB...

2017-04-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17744 **[Test build #76132 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76132/testReport)** for PR 17744 at commit

[GitHub] spark issue #17744: [SPARK-20426] Lazy initialization of FileSegmentManagedB...

2017-04-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17744 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76131/ Test PASSed. ---

[GitHub] spark issue #17744: [SPARK-20426] Lazy initialization of FileSegmentManagedB...

2017-04-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17744 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17744: [SPARK-20426] Lazy initialization of FileSegmentManagedB...

2017-04-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17744 **[Test build #76131 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76131/testReport)** for PR 17744 at commit

[GitHub] spark issue #17702: [SPARK-20408][SQL] Get the glob path in parallel to redu...

2017-04-25 Thread xuanyuanking
Github user xuanyuanking commented on the issue: https://github.com/apache/spark/pull/17702 cc @zsxwing @tdas, can you review this? Founded the relative code of yours before. Thanks :) --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark issue #17737: [SPARK-20442][PYTHON][DOCS] Fill up documentations for f...

2017-04-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17737 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17737: [SPARK-20442][PYTHON][DOCS] Fill up documentations for f...

2017-04-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17737 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76130/ Test PASSed. ---

[GitHub] spark issue #17737: [SPARK-20442][PYTHON][DOCS] Fill up documentations for f...

2017-04-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17737 **[Test build #76130 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76130/testReport)** for PR 17737 at commit

[GitHub] spark issue #17744: [SPARK-20426] Lazy initialization of FileSegmentManagedB...

2017-04-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17744 **[Test build #76132 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76132/testReport)** for PR 17744 at commit

[GitHub] spark pull request #17754: [FollowUp][SPARK-18901][ML]: Require in LR Logist...

2017-04-25 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/17754 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #17744: [SPARK-20426] Lazy initialization of FileSegmentManagedB...

2017-04-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17744 **[Test build #76131 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76131/testReport)** for PR 17744 at commit

[GitHub] spark issue #17754: [FollowUp][SPARK-18901][ML]: Require in LR LogisticAggre...

2017-04-25 Thread yanboliang
Github user yanboliang commented on the issue: https://github.com/apache/spark/pull/17754 Merged into master and branch-2.2. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request #17686: [SPARK-20393][Webu UI] Strengthen Spark to preven...

2017-04-25 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/17686#discussion_r113133777 --- Diff: core/src/main/scala/org/apache/spark/ui/UIUtils.scala --- @@ -527,4 +530,24 @@ private[spark] object UIUtils extends Logging { origHref

[GitHub] spark pull request #17686: [SPARK-20393][Webu UI] Strengthen Spark to preven...

2017-04-25 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/17686#discussion_r113133450 --- Diff: core/src/main/scala/org/apache/spark/ui/UIUtils.scala --- @@ -27,13 +27,16 @@ import scala.xml.transform.{RewriteRule, RuleTransformer}

[GitHub] spark pull request #17686: [SPARK-20393][Webu UI] Strengthen Spark to preven...

2017-04-25 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/17686#discussion_r113133641 --- Diff: core/src/main/scala/org/apache/spark/ui/UIUtils.scala --- @@ -527,4 +530,24 @@ private[spark] object UIUtils extends Logging { origHref

[GitHub] spark pull request #17746: [SPARK-20449][ML] Upgrade breeze version to 0.13....

2017-04-25 Thread yanboliang
Github user yanboliang commented on a diff in the pull request: https://github.com/apache/spark/pull/17746#discussion_r113133446 --- Diff: R/pkg/inst/tests/testthat/test_mllib_classification.R --- @@ -288,18 +288,18 @@ test_that("spark.mlp", { c(0, 0, 0, 0, 0, 5, 5, 5, 5,

[GitHub] spark pull request #17740: [SPARK-20404][CORE] Using Option(name) instead of...

2017-04-25 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/17740 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

<    1   2   3   4   >