[GitHub] spark issue #13924: [WIP][SPARK-15643][DOC][ML] Add breaking changes to ML m...

2016-06-28 Thread jkbradley
Github user jkbradley commented on the issue: https://github.com/apache/spark/pull/13924 I just merged https://github.com/apache/spark/pull/13378 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not ha

[GitHub] spark issue #13948: [SPARK-16259] [PYSPARK] cleanup options in DataFrame rea...

2016-06-28 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/13948 looks good! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or i

[GitHub] spark issue #13949: [SPARK-16261][EXAMPLES][ML] Fixed incorrect appNames in ...

2016-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13949 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13949: [SPARK-16261][EXAMPLES][ML] Fixed incorrect appNames in ...

2016-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13949 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61395/ Test PASSed. ---

[GitHub] spark issue #13378: [SPARK-15643] [Doc] [ML] Update spark.ml and spark.mllib...

2016-06-28 Thread jkbradley
Github user jkbradley commented on the issue: https://github.com/apache/spark/pull/13378 LGTM Merging with master Thank you! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this featu

[GitHub] spark issue #13949: [SPARK-16261][EXAMPLES][ML] Fixed incorrect appNames in ...

2016-06-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13949 **[Test build #61395 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61395/consoleFull)** for PR 13949 at commit [`8f9c5cc`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #13603: [SPARK-15865][CORE] Blacklist should not result i...

2016-06-28 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/13603#discussion_r68819144 --- Diff: core/src/test/scala/org/apache/spark/scheduler/TaskSchedulerImplSuite.scala --- @@ -281,6 +281,96 @@ class TaskSchedulerImplSuite extends SparkFunSu

[GitHub] spark issue #13921: [SPARK-16140][MLlib][SparkR][Docs] Group k-means method ...

2016-06-28 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/13921 And to elaborate, the reason why it is complaining is because the line in generics.R is the only reference to @rdname write.ml. To fix, you could either change that to @rdname spark.kmeans (whic

[GitHub] spark issue #13921: [SPARK-16140][MLlib][SparkR][Docs] Group k-means method ...

2016-06-28 Thread keypointt
Github user keypointt commented on the issue: https://github.com/apache/spark/pull/13921 I vote for dis-coverability of "write.ml", "predict" --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark issue #13921: [SPARK-16140][MLlib][SparkR][Docs] Group k-means method ...

2016-06-28 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/13921 Actually don't do this? ``` #' This is a title for write.ml #' @rdname write.ml #' @export setGeneric("write.ml", function(object, path, ...) { standardGeneric("write.ml

[GitHub] spark pull request #13946: [MINOR][SparkR] update sparkR DataFrame.R comment

2016-06-28 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/13946#discussion_r68816901 --- Diff: R/pkg/R/DataFrame.R --- @@ -498,7 +498,7 @@ setMethod("registerTempTable", #' insertInto #' -#' Insert the contents of a Spa

[GitHub] spark issue #13946: [MINOR][SparkR] update sparkR DataFrame.R comment

2016-06-28 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/13946 LGTM @shivaram --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #13904: [SPARKR] add csv tests

2016-06-28 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/13904 @shivaram I think this will be good to have, just a small change. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #13765: [SPARK-16052][SQL] Improve `CollapseRepartition` optimiz...

2016-06-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13765 **[Test build #61398 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61398/consoleFull)** for PR 13765 at commit [`f1ee771`](https://github.com/apache/spark/commit/f

[GitHub] spark issue #13949: [SPARK-16261][EXAMPLES][ML] Fixed incorrect appNames in ...

2016-06-28 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/13949 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the featur

[GitHub] spark issue #13765: [SPARK-16052][SQL] Improve `CollapseRepartition` optimiz...

2016-06-28 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/13765 Retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishe

[GitHub] spark issue #13730: [SPARK-16006][SQL] Attemping to write empty DataFrame wi...

2016-06-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13730 **[Test build #61397 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61397/consoleFull)** for PR 13730 at commit [`7d38003`](https://github.com/apache/spark/commit/7

[GitHub] spark issue #13730: [SPARK-16006][SQL] Attemping to write empty DataFrame wi...

2016-06-28 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/13730 Retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishe

[GitHub] spark issue #13949: [SPARK-16261][EXAMPLES][ML] Fixed incorrect appNames in ...

2016-06-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13949 **[Test build #61395 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61395/consoleFull)** for PR 13949 at commit [`8f9c5cc`](https://github.com/apache/spark/commit/8

[GitHub] spark issue #13948: [SPARK-16259] [PYSPARK] cleanup options in DataFrame rea...

2016-06-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13948 **[Test build #61396 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61396/consoleFull)** for PR 13948 at commit [`2e7b6b9`](https://github.com/apache/spark/commit/2

[GitHub] spark issue #13949: [SPARK-16261][EXAMPLES][ML] Fixed incorrect appNames in ...

2016-06-28 Thread BryanCutler
Github user BryanCutler commented on the issue: https://github.com/apache/spark/pull/13949 Not sure if this is something worth squeezing into 2.0, but I thought I'd patch it now in case. cc @mengxr @jkbradley --- If your project is set up for it, you can reply to this email and

[GitHub] spark issue #13948: [SPARK-16259] [PYSPARK] cleanup options in DataFrame rea...

2016-06-28 Thread shaneknapp
Github user shaneknapp commented on the issue: https://github.com/apache/spark/pull/13948 jenkins, test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wi

[GitHub] spark pull request #13949: [SPARK-16261][EXAMPLES][ML] Fixed incorrect appNa...

2016-06-28 Thread BryanCutler
GitHub user BryanCutler opened a pull request: https://github.com/apache/spark/pull/13949 [SPARK-16261][EXAMPLES][ML] Fixed incorrect appNames in ML Examples ## What changes were proposed in this pull request? Some appNames in ML examples are incorrect, mostly in PySpark but

[GitHub] spark pull request #13945: [SPARK-16256][SQL][STREAMING] Added Structured St...

2016-06-28 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/13945#discussion_r68811215 --- Diff: docs/structured-streaming-programming-guide.md --- @@ -0,0 +1,888 @@ +--- +layout: global +displayTitle: Structured Streaming Programmin

[GitHub] spark pull request #13945: [SPARK-16256][SQL][STREAMING] Added Structured St...

2016-06-28 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/13945#discussion_r68811047 --- Diff: docs/structured-streaming-programming-guide.md --- @@ -0,0 +1,888 @@ +--- +layout: global +displayTitle: Structured Streaming Programmin

[GitHub] spark issue #13603: [SPARK-15865][CORE] Blacklist should not result in job h...

2016-06-28 Thread kayousterhout
Github user kayousterhout commented on the issue: https://github.com/apache/spark/pull/13603 This LGTM -- just a bunch of cosmetic suggestions --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request #13603: [SPARK-15865][CORE] Blacklist should not result i...

2016-06-28 Thread kayousterhout
Github user kayousterhout commented on a diff in the pull request: https://github.com/apache/spark/pull/13603#discussion_r68810277 --- Diff: core/src/test/scala/org/apache/spark/scheduler/TaskSchedulerImplSuite.scala --- @@ -281,6 +281,96 @@ class TaskSchedulerImplSuite extends Spa

[GitHub] spark pull request #13603: [SPARK-15865][CORE] Blacklist should not result i...

2016-06-28 Thread kayousterhout
Github user kayousterhout commented on a diff in the pull request: https://github.com/apache/spark/pull/13603#discussion_r68809604 --- Diff: core/src/test/scala/org/apache/spark/scheduler/TaskSchedulerImplSuite.scala --- @@ -281,6 +281,96 @@ class TaskSchedulerImplSuite extends Spa

[GitHub] spark pull request #13603: [SPARK-15865][CORE] Blacklist should not result i...

2016-06-28 Thread kayousterhout
Github user kayousterhout commented on a diff in the pull request: https://github.com/apache/spark/pull/13603#discussion_r68809060 --- Diff: core/src/test/scala/org/apache/spark/scheduler/BlacklistIntegrationSuite.scala --- @@ -91,6 +91,31 @@ class BlacklistIntegrationSuite extend

[GitHub] spark pull request #13603: [SPARK-15865][CORE] Blacklist should not result i...

2016-06-28 Thread kayousterhout
Github user kayousterhout commented on a diff in the pull request: https://github.com/apache/spark/pull/13603#discussion_r68808784 --- Diff: core/src/test/scala/org/apache/spark/scheduler/BlacklistIntegrationSuite.scala --- @@ -91,6 +91,31 @@ class BlacklistIntegrationSuite extend

[GitHub] spark pull request #13603: [SPARK-15865][CORE] Blacklist should not result i...

2016-06-28 Thread kayousterhout
Github user kayousterhout commented on a diff in the pull request: https://github.com/apache/spark/pull/13603#discussion_r68808597 --- Diff: core/src/test/scala/org/apache/spark/scheduler/BlacklistIntegrationSuite.scala --- @@ -91,6 +91,31 @@ class BlacklistIntegrationSuite extend

[GitHub] spark issue #13860: [SPARK-16157] [SQL] Add New Methods for comments in Stru...

2016-06-28 Thread yhuai
Github user yhuai commented on the issue: https://github.com/apache/spark/pull/13860 seems fine to have that method. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request #13603: [SPARK-15865][CORE] Blacklist should not result i...

2016-06-28 Thread kayousterhout
Github user kayousterhout commented on a diff in the pull request: https://github.com/apache/spark/pull/13603#discussion_r68808158 --- Diff: core/src/main/scala/org/apache/spark/scheduler/TaskSchedulerImpl.scala --- @@ -279,6 +279,9 @@ private[spark] class TaskSchedulerImpl(

[GitHub] spark pull request #13603: [SPARK-15865][CORE] Blacklist should not result i...

2016-06-28 Thread kayousterhout
Github user kayousterhout commented on a diff in the pull request: https://github.com/apache/spark/pull/13603#discussion_r68808263 --- Diff: core/src/main/scala/org/apache/spark/scheduler/TaskSetManager.scala --- @@ -576,6 +576,61 @@ private[spark] class TaskSetManager( }

[GitHub] spark issue #13915: [SPARK-16081][BUILD] Disallow using `l` as variable name

2016-06-28 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/13915 Hi, All. The decision points are the followings. 1. Choose one of lowercase `L` or uppercase `I` to disallow as a ScalaStyle. 2. Choose a scope of ScalaStyle excluded files:

[GitHub] spark pull request #13603: [SPARK-15865][CORE] Blacklist should not result i...

2016-06-28 Thread kayousterhout
Github user kayousterhout commented on a diff in the pull request: https://github.com/apache/spark/pull/13603#discussion_r68807958 --- Diff: core/src/main/scala/org/apache/spark/scheduler/TaskSetManager.scala --- @@ -576,6 +576,61 @@ private[spark] class TaskSetManager( }

[GitHub] spark issue #13947: [SPARK-16257] [Build] Update spark_ec2.py to support Spa...

2016-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13947 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13947: [SPARK-16257] [Build] Update spark_ec2.py to support Spa...

2016-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13947 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61393/ Test PASSed. ---

[GitHub] spark issue #13603: [SPARK-15865][CORE] Blacklist should not result in job h...

2016-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13603 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61385/ Test PASSed. ---

[GitHub] spark issue #13603: [SPARK-15865][CORE] Blacklist should not result in job h...

2016-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13603 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13947: [SPARK-16257] [Build] Update spark_ec2.py to support Spa...

2016-06-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13947 **[Test build #61393 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61393/consoleFull)** for PR 13947 at commit [`6b86b69`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13603: [SPARK-15865][CORE] Blacklist should not result in job h...

2016-06-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13603 **[Test build #61385 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61385/consoleFull)** for PR 13603 at commit [`60cd959`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13948: [SPARK-16259] [PYSPARK] cleanup options in DataFrame rea...

2016-06-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13948 **[Test build #61394 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61394/consoleFull)** for PR 13948 at commit [`2e7b6b9`](https://github.com/apache/spark/commit/2

[GitHub] spark issue #13775: [SPARK-16060][SQL] Vectorized Orc reader

2016-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13775 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61384/ Test PASSed. ---

[GitHub] spark pull request #13603: [SPARK-15865][CORE] Blacklist should not result i...

2016-06-28 Thread kayousterhout
Github user kayousterhout commented on a diff in the pull request: https://github.com/apache/spark/pull/13603#discussion_r68804577 --- Diff: core/src/main/scala/org/apache/spark/scheduler/TaskSchedulerImpl.scala --- @@ -35,7 +35,7 @@ import org.apache.spark.scheduler.SchedulingMod

[GitHub] spark issue #13775: [SPARK-16060][SQL] Vectorized Orc reader

2016-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13775 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13775: [SPARK-16060][SQL] Vectorized Orc reader

2016-06-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13775 **[Test build #61384 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61384/consoleFull)** for PR 13775 at commit [`4c14278`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13948: [SPARK-16259] [PYSPARK] cleanup options in DataFrame rea...

2016-06-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13948 **[Test build #61392 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61392/consoleFull)** for PR 13948 at commit [`c3142b1`](https://github.com/apache/spark/commit/c

[GitHub] spark issue #13947: [SPARK-16257] [Build] Update spark_ec2.py to support Spa...

2016-06-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13947 **[Test build #61393 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61393/consoleFull)** for PR 13947 at commit [`6b86b69`](https://github.com/apache/spark/commit/6

[GitHub] spark issue #13947: [SPARK-16257] [Build] Update spark_ec2.py to support Spa...

2016-06-28 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/13947 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the featur

[GitHub] spark issue #13947: [SPARK-16257] [Build] Update spark_ec2.py to support Spa...

2016-06-28 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/13947 Jenkins test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark pull request #13884: [SPARK-16181][SQL] outer join with isNull filter ...

2016-06-28 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/13884 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request #13948: [SPARK-16259] [PYSPARK] cleanup options in DataFr...

2016-06-28 Thread davies
GitHub user davies opened a pull request: https://github.com/apache/spark/pull/13948 [SPARK-16259] [PYSPARK] cleanup options in DataFrame read/write API ## What changes were proposed in this pull request? There are some duplicated code for options in DataFrame reader/writer

[GitHub] spark issue #13948: [SPARK-16259] [PYSPARK] cleanup options in DataFrame rea...

2016-06-28 Thread davies
Github user davies commented on the issue: https://github.com/apache/spark/pull/13948 cc @rxin --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the f

[GitHub] spark issue #13884: [SPARK-16181][SQL] outer join with isNull filter may ret...

2016-06-28 Thread yhuai
Github user yhuai commented on the issue: https://github.com/apache/spark/pull/13884 LGTM. Merging to master and branch 2.0. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabl

[GitHub] spark issue #13816: [SPARK-16114] [SQL] structured streaming network word co...

2016-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13816 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61389/ Test PASSed. ---

[GitHub] spark issue #13816: [SPARK-16114] [SQL] structured streaming network word co...

2016-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13816 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13816: [SPARK-16114] [SQL] structured streaming network word co...

2016-06-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13816 **[Test build #61389 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61389/consoleFull)** for PR 13816 at commit [`fb491c6`](https://github.com/apache/spark/commit/

[GitHub] spark issue #10943: [SPARK-12988][SQL] Can't drop columns that contain dots

2016-06-28 Thread yhuai
Github user yhuai commented on the issue: https://github.com/apache/spark/pull/10943 how about we close this pr since https://github.com/apache/spark/pull/13306 has been merged? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark issue #13921: [SPARK-16140][MLlib][SparkR][Docs] Group k-means method ...

2016-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13921 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13921: [SPARK-16140][MLlib][SparkR][Docs] Group k-means method ...

2016-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13921 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61388/ Test PASSed. ---

[GitHub] spark issue #13921: [SPARK-16140][MLlib][SparkR][Docs] Group k-means method ...

2016-06-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13921 **[Test build #61388 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61388/consoleFull)** for PR 13921 at commit [`6fa1b60`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13730: [SPARK-16006][SQL] Attemping to write empty DataFrame wi...

2016-06-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13730 **[Test build #61391 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61391/consoleFull)** for PR 13730 at commit [`7d38003`](https://github.com/apache/spark/commit/7

[GitHub] spark issue #13947: [SPARK-16257] [Build] Update spark_ec2.py to support Spa...

2016-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13947 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark issue #13876: [SPARK-16174][SQL] Improve OptimizeIn optimizer to remov...

2016-06-28 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/13876 Hi, @rxin . Could you review this `OptimizeIn` PR? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark issue #13765: [SPARK-16052][SQL] Improve `CollapseRepartition` optimiz...

2016-06-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13765 **[Test build #61390 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61390/consoleFull)** for PR 13765 at commit [`f1ee771`](https://github.com/apache/spark/commit/f

[GitHub] spark pull request #13947: [SPARK-16257] [Build] Update spark_ec2.py to supp...

2016-06-28 Thread briuri
GitHub user briuri opened a pull request: https://github.com/apache/spark/pull/13947 [SPARK-16257] [Build] Update spark_ec2.py to support Spark 1.6.2 and 1.6.3. ## What changes were proposed in this pull request? - Adds 1.6.2 and 1.6.3 as supported Spark versions within the

[GitHub] spark issue #13765: [SPARK-16052][SQL] Improve `CollapseRepartition` optimiz...

2016-06-28 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/13765 Hi, @cloud-fan and @yhuai . I added more description about the logic. I hope that makes the intention of this PR more clear. --- If your project is set up for it, you can reply to this em

[GitHub] spark issue #13939: [SPARK-16248][SQL] Whitelist the list of Hive fallback f...

2016-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13939 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13939: [SPARK-16248][SQL] Whitelist the list of Hive fallback f...

2016-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13939 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61386/ Test FAILed. ---

[GitHub] spark issue #13816: [SPARK-16114] [SQL] structured streaming network word co...

2016-06-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13816 **[Test build #61389 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61389/consoleFull)** for PR 13816 at commit [`fb491c6`](https://github.com/apache/spark/commit/f

[GitHub] spark issue #13939: [SPARK-16248][SQL] Whitelist the list of Hive fallback f...

2016-06-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13939 **[Test build #61386 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61386/consoleFull)** for PR 13939 at commit [`2639644`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13921: [SPARK-16140][MLlib][SparkR][Docs] Group k-means method ...

2016-06-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13921 **[Test build #61388 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61388/consoleFull)** for PR 13921 at commit [`6fa1b60`](https://github.com/apache/spark/commit/6

[GitHub] spark pull request #13765: [SPARK-16052][SQL] Improve `CollapseRepartition` ...

2016-06-28 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/13765#discussion_r68794253 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala --- @@ -537,12 +537,19 @@ object CollapseProject extends

[GitHub] spark issue #13921: [SPARK-16140][MLlib][SparkR][Docs] Group k-means method ...

2016-06-28 Thread keypointt
Github user keypointt commented on the issue: https://github.com/apache/spark/pull/13921 oh I see, thanks a lot --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #13778: [SPARK-16062][SPARK-15989][SQL] Fix two bugs of Python-o...

2016-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13778 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61383/ Test FAILed. ---

[GitHub] spark issue #13778: [SPARK-16062][SPARK-15989][SQL] Fix two bugs of Python-o...

2016-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13778 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13778: [SPARK-16062][SPARK-15989][SQL] Fix two bugs of Python-o...

2016-06-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13778 **[Test build #61383 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61383/consoleFull)** for PR 13778 at commit [`4c00bb1`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #13945: [SPARK-16256][SQL][STREAMING] Added Structured St...

2016-06-28 Thread anabranch
Github user anabranch commented on a diff in the pull request: https://github.com/apache/spark/pull/13945#discussion_r68792373 --- Diff: docs/structured-streaming-programming-guide.md --- @@ -0,0 +1,888 @@ +--- +layout: global +displayTitle: Structured Streaming Programm

[GitHub] spark pull request #13945: [SPARK-16256][SQL][STREAMING] Added Structured St...

2016-06-28 Thread anabranch
Github user anabranch commented on a diff in the pull request: https://github.com/apache/spark/pull/13945#discussion_r68792300 --- Diff: docs/structured-streaming-programming-guide.md --- @@ -0,0 +1,888 @@ +--- +layout: global +displayTitle: Structured Streaming Programm

[GitHub] spark pull request #13945: [SPARK-16256][SQL][STREAMING] Added Structured St...

2016-06-28 Thread anabranch
Github user anabranch commented on a diff in the pull request: https://github.com/apache/spark/pull/13945#discussion_r68792137 --- Diff: docs/structured-streaming-programming-guide.md --- @@ -0,0 +1,888 @@ +--- +layout: global +displayTitle: Structured Streaming Programm

[GitHub] spark pull request #13945: [SPARK-16256][SQL][STREAMING] Added Structured St...

2016-06-28 Thread anabranch
Github user anabranch commented on a diff in the pull request: https://github.com/apache/spark/pull/13945#discussion_r68789246 --- Diff: docs/structured-streaming-programming-guide.md --- @@ -0,0 +1,888 @@ +--- +layout: global +displayTitle: Structured Streaming Programm

[GitHub] spark pull request #13945: [SPARK-16256][SQL][STREAMING] Added Structured St...

2016-06-28 Thread anabranch
Github user anabranch commented on a diff in the pull request: https://github.com/apache/spark/pull/13945#discussion_r68791843 --- Diff: docs/structured-streaming-programming-guide.md --- @@ -0,0 +1,888 @@ +--- +layout: global +displayTitle: Structured Streaming Programm

[GitHub] spark pull request #13945: [SPARK-16256][SQL][STREAMING] Added Structured St...

2016-06-28 Thread anabranch
Github user anabranch commented on a diff in the pull request: https://github.com/apache/spark/pull/13945#discussion_r68790342 --- Diff: docs/structured-streaming-programming-guide.md --- @@ -0,0 +1,888 @@ +--- +layout: global +displayTitle: Structured Streaming Programm

[GitHub] spark issue #13670: [SPARK-15951] Change Executors Page to use datatables to...

2016-06-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13670 **[Test build #61387 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61387/consoleFull)** for PR 13670 at commit [`c73e905`](https://github.com/apache/spark/commit/c

[GitHub] spark pull request #13945: [SPARK-16256][SQL][STREAMING] Added Structured St...

2016-06-28 Thread anabranch
Github user anabranch commented on a diff in the pull request: https://github.com/apache/spark/pull/13945#discussion_r68790047 --- Diff: docs/structured-streaming-programming-guide.md --- @@ -0,0 +1,888 @@ +--- +layout: global +displayTitle: Structured Streaming Programm

[GitHub] spark pull request #13945: [SPARK-16256][SQL][STREAMING] Added Structured St...

2016-06-28 Thread anabranch
Github user anabranch commented on a diff in the pull request: https://github.com/apache/spark/pull/13945#discussion_r68790860 --- Diff: docs/structured-streaming-programming-guide.md --- @@ -0,0 +1,888 @@ +--- +layout: global +displayTitle: Structured Streaming Programm

[GitHub] spark pull request #13945: [SPARK-16256][SQL][STREAMING] Added Structured St...

2016-06-28 Thread anabranch
Github user anabranch commented on a diff in the pull request: https://github.com/apache/spark/pull/13945#discussion_r68790649 --- Diff: docs/structured-streaming-programming-guide.md --- @@ -0,0 +1,888 @@ +--- +layout: global +displayTitle: Structured Streaming Programm

[GitHub] spark pull request #13765: [SPARK-16052][SQL] Improve `CollapseRepartition` ...

2016-06-28 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/13765#discussion_r68790432 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala --- @@ -537,12 +537,19 @@ object CollapseProject extends

[GitHub] spark pull request #13778: [SPARK-16062][SPARK-15989][SQL] Fix two bugs of P...

2016-06-28 Thread vlad17
Github user vlad17 commented on a diff in the pull request: https://github.com/apache/spark/pull/13778#discussion_r68789054 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/objects/objects.scala --- @@ -349,11 +349,12 @@ object MapObjects { de

[GitHub] spark pull request #13945: [SPARK-16256][SQL][STREAMING] Added Structured St...

2016-06-28 Thread anabranch
Github user anabranch commented on a diff in the pull request: https://github.com/apache/spark/pull/13945#discussion_r68790090 --- Diff: docs/structured-streaming-programming-guide.md --- @@ -0,0 +1,888 @@ +--- +layout: global +displayTitle: Structured Streaming Programm

[GitHub] spark issue #12004: [SPARK-7481][build] [WIP] Add Hadoop 2.6+ spark-cloud mo...

2016-06-28 Thread steveloughran
Github user steveloughran commented on the issue: https://github.com/apache/spark/pull/12004 downgrading to a WIP as to work reliably it needs [HADOOP-12636](https://issues.apache.org/jira/browse/HADOOP-12636) on the hadoop code else the presence of `hadoop-aws.jar` on the CP without

[GitHub] spark pull request #13765: [SPARK-16052][SQL] Improve `CollapseRepartition` ...

2016-06-28 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/13765#discussion_r68788331 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala --- @@ -537,12 +537,19 @@ object CollapseProject extends

[GitHub] spark pull request #13765: [SPARK-16052][SQL] Improve `CollapseRepartition` ...

2016-06-28 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/13765#discussion_r68787810 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala --- @@ -537,12 +537,19 @@ object CollapseProject extends

[GitHub] spark issue #13939: [SPARK-16248][SQL] Whitelist the list of Hive fallback f...

2016-06-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13939 **[Test build #61386 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61386/consoleFull)** for PR 13939 at commit [`2639644`](https://github.com/apache/spark/commit/2

[GitHub] spark issue #13939: [SPARK-16248][SQL] Whitelist the list of Hive fallback f...

2016-06-28 Thread yhuai
Github user yhuai commented on the issue: https://github.com/apache/spark/pull/13939 test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark issue #13760: [SPARK-16012][SparkR] implement gapplyCollect which will...

2016-06-28 Thread NarineK
Github user NarineK commented on the issue: https://github.com/apache/spark/pull/13760 @felixcheung , I've addressed the comments or put a comment for the non-addressed ones. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as wel

[GitHub] spark issue #13603: [SPARK-15865][CORE] Blacklist should not result in job h...

2016-06-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13603 **[Test build #61385 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61385/consoleFull)** for PR 13603 at commit [`60cd959`](https://github.com/apache/spark/commit/6

[GitHub] spark issue #13891: [SPARK-6685][MLLIB]Use DSYRK to compute AtA in ALS

2016-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13891 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61381/ Test PASSed. ---

[GitHub] spark issue #13891: [SPARK-6685][MLLIB]Use DSYRK to compute AtA in ALS

2016-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13891 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

<    1   2   3   4   5   6   7   8   >