[GitHub] spark issue #15067: [SPARK-17513] [STREAMING] [SQL] Make StreamExecution gar...

2016-09-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15067 **[Test build #65525 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65525/consoleFull)** for PR 15067 at commit [`82f5b68`](https://github.com/apache/spark/commit/8

[GitHub] spark issue #15125: [SPARK-5484][GraphX] Periodically do checkpoint in Prege...

2016-09-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15125 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65523/ Test PASSed. ---

[GitHub] spark issue #15125: [SPARK-5484][GraphX] Periodically do checkpoint in Prege...

2016-09-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15125 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14971: [SPARK-17410] [SPARK-17284] Move Hive-generated Stats In...

2016-09-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14971 **[Test build #65526 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65526/consoleFull)** for PR 14971 at commit [`2e4d398`](https://github.com/apache/spark/commit/2

[GitHub] spark issue #15125: [SPARK-5484][GraphX] Periodically do checkpoint in Prege...

2016-09-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15125 **[Test build #65523 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65523/consoleFull)** for PR 15125 at commit [`70f826d`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15027: [SPARK-17475] [STREAMING] Delete CRC files if the filesy...

2016-09-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15027 **[Test build #3275 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3275/consoleFull)** for PR 15027 at commit [`9ff89c0`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15067: [SPARK-17513] [STREAMING] [SQL] Make StreamExecution gar...

2016-09-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15067 **[Test build #3276 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3276/consoleFull)** for PR 15067 at commit [`82f5b68`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15067: [SPARK-17513] [STREAMING] [SQL] Make StreamExecution gar...

2016-09-16 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/15067 Jenkins, test this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #15027: [SPARK-17475] [STREAMING] Delete CRC files if the filesy...

2016-09-16 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/15027 Jenkins, test this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #11105: [SPARK-12469][CORE] Data Property accumulators for Spark

2016-09-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/11105 **[Test build #65524 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65524/consoleFull)** for PR 11105 at commit [`f4488b7`](https://github.com/apache/spark/commit/f

[GitHub] spark issue #15090: [SPARK-17073] [SQL] generate column-level statistics

2016-09-16 Thread wzhfy
Github user wzhfy commented on the issue: https://github.com/apache/spark/pull/15090 @rxin Yeah, I think it's better to move histograms into ColumnStats than to maintain two members like BasicColStats and Histograms. Let me rename `BasicColStats` as `ColumnStats` so that all the colum

[GitHub] spark issue #15073: [SPARK-17518] [SQL] Block Users to Specify the Internal ...

2016-09-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15073 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15073: [SPARK-17518] [SQL] Block Users to Specify the Internal ...

2016-09-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15073 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65520/ Test PASSed. ---

[GitHub] spark issue #15073: [SPARK-17518] [SQL] Block Users to Specify the Internal ...

2016-09-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15073 **[Test build #65520 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65520/consoleFull)** for PR 15073 at commit [`da5bec6`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15090: [SPARK-17073] [SQL] generate column-level statistics

2016-09-16 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/15090 What's "basic" about? Are we going to have something that's not basic in the future (e.g. histogram)? If yes, should those go into a separate class or just in ColumnStats? --- If your project is set

[GitHub] spark issue #15047: [SPARK-17495] [SQL] Add Hash capability semantically equ...

2016-09-16 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/15047 hard coding output seems like a good idea. additionally, if you want to be super safe, you could also create a randomized test in sql/hive. --- If your project is set up for it, you can repl

[GitHub] spark issue #15125: [SPARK-5484][GraphX] Periodically do checkpoint in Prege...

2016-09-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15125 **[Test build #65523 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65523/consoleFull)** for PR 15125 at commit [`70f826d`](https://github.com/apache/spark/commit/7

[GitHub] spark issue #15125: [SPARK-5484][GraphX] Periodically do checkpoint in Prege...

2016-09-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15125 **[Test build #65522 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65522/consoleFull)** for PR 15125 at commit [`01523cb`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15125: [SPARK-5484][GraphX] Periodically do checkpoint in Prege...

2016-09-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15125 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65522/ Test FAILed. ---

[GitHub] spark issue #15125: [SPARK-5484][GraphX] Periodically do checkpoint in Prege...

2016-09-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15125 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15125: [SPARK-5484][GraphX] Periodically do checkpoint in Prege...

2016-09-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15125 **[Test build #65522 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65522/consoleFull)** for PR 15125 at commit [`01523cb`](https://github.com/apache/spark/commit/0

[GitHub] spark issue #15125: [SPARK-5484][GraphX] Periodically do checkpoint in Prege...

2016-09-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15125 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65521/ Test FAILed. ---

[GitHub] spark issue #15125: [SPARK-5484][GraphX] Periodically do checkpoint in Prege...

2016-09-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15125 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15125: [SPARK-5484][GraphX] Periodically do checkpoint in Prege...

2016-09-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15125 **[Test build #65521 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65521/consoleFull)** for PR 15125 at commit [`b06b22c`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #15054: [SPARK-17502] [SQL] Fix Multiple Bugs in DDL Stat...

2016-09-16 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/15054#discussion_r79275910 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/CheckAnalysis.scala --- @@ -360,6 +360,7 @@ trait CheckAnalysis extends Pred

[GitHub] spark issue #15125: [SPARK-5484][GraphX] Periodically do checkpoint in Prege...

2016-09-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15125 **[Test build #65521 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65521/consoleFull)** for PR 15125 at commit [`b06b22c`](https://github.com/apache/spark/commit/b

[GitHub] spark pull request #15073: [SPARK-17518] [SQL] Block Users to Specify the In...

2016-09-16 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/15073#discussion_r79275825 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/MetastoreDataSourcesSuite.scala --- @@ -1151,6 +1152,56 @@ class MetastoreDataSourcesSuite ex

[GitHub] spark issue #15073: [SPARK-17518] [SQL] Block Users to Specify the Internal ...

2016-09-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15073 **[Test build #65520 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65520/consoleFull)** for PR 15073 at commit [`da5bec6`](https://github.com/apache/spark/commit/d

[GitHub] spark pull request #15073: [SPARK-17518] [SQL] Block Users to Specify the In...

2016-09-16 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/15073#discussion_r79275783 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/MetastoreDataSourcesSuite.scala --- @@ -1151,6 +1152,56 @@ class MetastoreDataSourcesSuite ex

[GitHub] spark pull request #15090: [SPARK-17073] [SQL] generate column-level statist...

2016-09-16 Thread wzhfy
Github user wzhfy commented on a diff in the pull request: https://github.com/apache/spark/pull/15090#discussion_r79275019 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveExternalCatalog.scala --- @@ -401,7 +401,10 @@ private[spark] class HiveExternalCatalog(conf:

[GitHub] spark issue #15125: [SPARK-5484][GraphX] Periodically do checkpoint in Prege...

2016-09-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15125 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15125: [SPARK-5484][GraphX] Periodically do checkpoint in Prege...

2016-09-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15125 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65519/ Test FAILed. ---

[GitHub] spark issue #15125: [SPARK-5484][GraphX] Periodically do checkpoint in Prege...

2016-09-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15125 **[Test build #65519 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65519/consoleFull)** for PR 15125 at commit [`720a741`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15123: [SPARK-17551][SQL] Add DataFrame API for null ordering

2016-09-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15123 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65517/ Test PASSed. ---

[GitHub] spark issue #15123: [SPARK-17551][SQL] Add DataFrame API for null ordering

2016-09-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15123 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15123: [SPARK-17551][SQL] Add DataFrame API for null ordering

2016-09-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15123 **[Test build #65517 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65517/consoleFull)** for PR 15123 at commit [`02f5edf`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15125: [SPARK-5484][GraphX] Periodically do checkpoint in Prege...

2016-09-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15125 **[Test build #65519 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65519/consoleFull)** for PR 15125 at commit [`720a741`](https://github.com/apache/spark/commit/7

[GitHub] spark pull request #15125: [SPARK-5484][GraphX] Periodically do checkpoint i...

2016-09-16 Thread dding3
GitHub user dding3 opened a pull request: https://github.com/apache/spark/pull/15125 [SPARK-5484][GraphX] Periodically do checkpoint in Pregel ## What changes were proposed in this pull request? Pregel-based iterative algorithms with more than ~50 iterations begin to slow down

[GitHub] spark pull request #15123: [SPARK-17551][SQL] Add DataFrame API for null ord...

2016-09-16 Thread xwu0226
Github user xwu0226 commented on a diff in the pull request: https://github.com/apache/spark/pull/15123#discussion_r79274396 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/DataFrameSuite.scala --- @@ -325,6 +325,24 @@ class DataFrameSuite extends QueryTest with SharedSQLCo

[GitHub] spark issue #15120: [SPARK-4563][core] Allow driver to advertise a different...

2016-09-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15120 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15120: [SPARK-4563][core] Allow driver to advertise a different...

2016-09-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15120 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65516/ Test PASSed. ---

[GitHub] spark issue #15120: [SPARK-4563][core] Allow driver to advertise a different...

2016-09-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15120 **[Test build #65516 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65516/consoleFull)** for PR 15120 at commit [`0c1fe29`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15124: [SPARK-17559][MLLIB]persist edges if their storage level...

2016-09-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15124 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15124: [SPARK-17559][MLLIB]persist edges if their storage level...

2016-09-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15124 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65518/ Test PASSed. ---

[GitHub] spark issue #15124: [SPARK-17559][MLLIB]persist edges if their storage level...

2016-09-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15124 **[Test build #65518 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65518/consoleFull)** for PR 15124 at commit [`bf94b4d`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15124: [SPARK-17559][MLLIB]persist edges if their storage level...

2016-09-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15124 **[Test build #65518 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65518/consoleFull)** for PR 15124 at commit [`bf94b4d`](https://github.com/apache/spark/commit/b

[GitHub] spark issue #15121: [SPARK-17567][Docs] Use valid url to Spark RDD paper

2016-09-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15121 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65513/ Test PASSed. ---

[GitHub] spark issue #15121: [SPARK-17567][Docs] Use valid url to Spark RDD paper

2016-09-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15121 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark pull request #15124: [SPARK-17559][MLLIB]persist edges if their storag...

2016-09-16 Thread dding3
GitHub user dding3 opened a pull request: https://github.com/apache/spark/pull/15124 [SPARK-17559][MLLIB]persist edges if their storage level is non in PeriodicGraphCheckpointer ## What changes were proposed in this pull request? When use PeriodicGraphCheckpointer to persist gra

[GitHub] spark issue #15121: [SPARK-17567][Docs] Use valid url to Spark RDD paper

2016-09-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15121 **[Test build #65513 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65513/consoleFull)** for PR 15121 at commit [`88960ef`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15116: [SPARK-17559][MLLIB]persist edges if their storage level...

2016-09-16 Thread dding3
Github user dding3 commented on the issue: https://github.com/apache/spark/pull/15116 Close the pr since it mix with another unrelated commit --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have t

[GitHub] spark pull request #15116: [SPARK-17559][MLLIB]persist edges if their storag...

2016-09-16 Thread dding3
Github user dding3 closed the pull request at: https://github.com/apache/spark/pull/15116 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request #15090: [SPARK-17073] [SQL] generate column-level statist...

2016-09-16 Thread wzhfy
Github user wzhfy commented on a diff in the pull request: https://github.com/apache/spark/pull/15090#discussion_r79272492 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/AnalyzeColumnCommand.scala --- @@ -0,0 +1,159 @@ +/* + * Licensed to the Apac

[GitHub] spark issue #15121: [SPARK-17567][Docs] Use valid url to Spark RDD paper

2016-09-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15121 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15121: [SPARK-17567][Docs] Use valid url to Spark RDD paper

2016-09-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15121 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65511/ Test PASSed. ---

[GitHub] spark issue #15121: [SPARK-17567][Docs] Use valid url to Spark RDD paper

2016-09-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15121 **[Test build #65511 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65511/consoleFull)** for PR 15121 at commit [`e2d40bd`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15123: [SPARK-17551][SQL] Add DataFrame API for null ordering

2016-09-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15123 **[Test build #65517 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65517/consoleFull)** for PR 15123 at commit [`02f5edf`](https://github.com/apache/spark/commit/0

[GitHub] spark pull request #15123: [SPARK-17551][SQL] Add DataFrame API for null ord...

2016-09-16 Thread petermaxlee
Github user petermaxlee commented on a diff in the pull request: https://github.com/apache/spark/pull/15123#discussion_r79272091 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/DataFrameSuite.scala --- @@ -325,6 +325,24 @@ class DataFrameSuite extends QueryTest with SharedS

[GitHub] spark issue #15123: [SPARK-17551][SQL] Add DataFrame API for null ordering

2016-09-16 Thread petermaxlee
Github user petermaxlee commented on the issue: https://github.com/apache/spark/pull/15123 This is based on https://github.com/apache/spark/pull/15107 but cleaned up a little bit. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub

[GitHub] spark issue #15122: [SPARK-17569] Make StructuredStreaming FileStreamSource ...

2016-09-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15122 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65512/ Test PASSed. ---

[GitHub] spark pull request #15123: [SPARK-17551][SQL] Add DataFrame API for null ord...

2016-09-16 Thread petermaxlee
GitHub user petermaxlee opened a pull request: https://github.com/apache/spark/pull/15123 [SPARK-17551][SQL] Add DataFrame API for null ordering ## What changes were proposed in this pull request? This pull request adds Scala/Java DataFrame API for null ordering (NULLS FIRST | L

[GitHub] spark issue #15122: [SPARK-17569] Make StructuredStreaming FileStreamSource ...

2016-09-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15122 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15122: [SPARK-17569] Make StructuredStreaming FileStreamSource ...

2016-09-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15122 **[Test build #65512 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65512/consoleFull)** for PR 15122 at commit [`9b7e2de`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13822: [SPARK-16115][SQL] Improve error message on non-existent...

2016-09-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13822 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13822: [SPARK-16115][SQL] Improve error message on non-existent...

2016-09-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13822 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65510/ Test PASSed. ---

[GitHub] spark issue #13822: [SPARK-16115][SQL] Improve error message on non-existent...

2016-09-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13822 **[Test build #65510 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65510/consoleFull)** for PR 13822 at commit [`b36f0cf`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15120: [SPARK-4563][core] Allow driver to advertise a different...

2016-09-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15120 **[Test build #65516 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65516/consoleFull)** for PR 15120 at commit [`0c1fe29`](https://github.com/apache/spark/commit/0

[GitHub] spark issue #15119: [SPARK-17568][CORE][DEPLOY] Add spark-submit option to o...

2016-09-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15119 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15119: [SPARK-17568][CORE][DEPLOY] Add spark-submit option to o...

2016-09-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15119 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65506/ Test PASSed. ---

[GitHub] spark issue #15119: [SPARK-17568][CORE][DEPLOY] Add spark-submit option to o...

2016-09-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15119 **[Test build #65506 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65506/consoleFull)** for PR 15119 at commit [`1f472ff`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15120: [SPARK-4563][core] Allow driver to advertise a different...

2016-09-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15120 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65509/ Test FAILed. ---

[GitHub] spark issue #15120: [SPARK-4563][core] Allow driver to advertise a different...

2016-09-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15120 **[Test build #65509 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65509/consoleFull)** for PR 15120 at commit [`40f23a4`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15120: [SPARK-4563][core] Allow driver to advertise a different...

2016-09-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15120 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15116: [SPARK-17559][MLLIB]persist edges if their storage level...

2016-09-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15116 **[Test build #65515 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65515/consoleFull)** for PR 15116 at commit [`c2b6784`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15116: [SPARK-17559][MLLIB]persist edges if their storage level...

2016-09-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15116 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65515/ Test FAILed. ---

[GitHub] spark issue #15116: [SPARK-17559][MLLIB]persist edges if their storage level...

2016-09-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15116 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #11105: [SPARK-12469][CORE] Data Property accumulators for Spark

2016-09-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/11105 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65514/ Test FAILed. ---

[GitHub] spark issue #11105: [SPARK-12469][CORE] Data Property accumulators for Spark

2016-09-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/11105 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #11105: [SPARK-12469][CORE] Data Property accumulators for Spark

2016-09-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/11105 **[Test build #65514 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65514/consoleFull)** for PR 11105 at commit [`e47172c`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15116: [SPARK-17559][MLLIB]persist edges if their storage level...

2016-09-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15116 **[Test build #65515 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65515/consoleFull)** for PR 15116 at commit [`c2b6784`](https://github.com/apache/spark/commit/c

[GitHub] spark issue #15089: [SPARK-15621] [SQL] Support spilling for Python UDF

2016-09-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15089 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65505/ Test PASSed. ---

[GitHub] spark issue #15089: [SPARK-15621] [SQL] Support spilling for Python UDF

2016-09-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15089 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15089: [SPARK-15621] [SQL] Support spilling for Python UDF

2016-09-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15089 **[Test build #65505 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65505/consoleFull)** for PR 15089 at commit [`9a84870`](https://github.com/apache/spark/commit/

[GitHub] spark issue #11105: [SPARK-12469][CORE] Data Property accumulators for Spark

2016-09-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/11105 **[Test build #65514 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65514/consoleFull)** for PR 11105 at commit [`e47172c`](https://github.com/apache/spark/commit/e

[GitHub] spark issue #15121: [SPARK-17567] Use valid url to Spark RDD paper

2016-09-16 Thread keypointt
Github user keypointt commented on the issue: https://github.com/apache/spark/pull/15121 I just noticed, that at http://spark.apache.org/research.html > Spark offers an abstraction called resilient distributed datasets (RDDs) to support these applications efficiently.

[GitHub] spark issue #15121: [SPARK-17567] Use valid url to Spark RDD paper

2016-09-16 Thread keypointt
Github user keypointt commented on the issue: https://github.com/apache/spark/pull/15121 Just to be consistent with the url at http://spark.apache.org/research.html > Resilient Distributed Datasets: A Fault-Tolerant Abstraction for In-Memory Cluster Computing. Matei Zaharia, M

[GitHub] spark issue #15121: [SPARK-17567] Use valid url to Spark RDD paper

2016-09-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15121 **[Test build #65513 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65513/consoleFull)** for PR 15121 at commit [`88960ef`](https://github.com/apache/spark/commit/8

[GitHub] spark issue #15122: [SPARK-17569] Make StructuredStreaming FileStreamSource ...

2016-09-16 Thread yhuai
Github user yhuai commented on the issue: https://github.com/apache/spark/pull/15122 also cc @cloud-fan --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark issue #15122: [SPARK-17569] Make StructuredStreaming FileStreamSource ...

2016-09-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15122 **[Test build #65512 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65512/consoleFull)** for PR 15122 at commit [`9b7e2de`](https://github.com/apache/spark/commit/9

[GitHub] spark issue #15122: [SPARK-17569] Make StructuredStreaming FileStreamSource ...

2016-09-16 Thread brkyvz
Github user brkyvz commented on the issue: https://github.com/apache/spark/pull/15122 cc @zsxwing @yhuai --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, o

[GitHub] spark pull request #13822: [SPARK-16115][SQL] Change output schema to be par...

2016-09-16 Thread skambha
Github user skambha commented on a diff in the pull request: https://github.com/apache/spark/pull/13822#discussion_r79265065 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/tables.scala --- @@ -660,6 +662,10 @@ case class ShowPartitionsCommand( overr

[GitHub] spark pull request #15122: [SPARK-17569] Make StructuredStreaming FileStream...

2016-09-16 Thread brkyvz
GitHub user brkyvz opened a pull request: https://github.com/apache/spark/pull/15122 [SPARK-17569] Make StructuredStreaming FileStreamSource batch generation faster ## What changes were proposed in this pull request? While getting the batch for a `FileStreamSource` in Struc

[GitHub] spark pull request #13822: [SPARK-16115][SQL] Change output schema to be par...

2016-09-16 Thread skambha
Github user skambha commented on a diff in the pull request: https://github.com/apache/spark/pull/13822#discussion_r79265007 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveDDLSuite.scala --- @@ -595,6 +595,19 @@ class HiveDDLSuite } }

[GitHub] spark issue #15121: [SPARK-17567] Use valid url to Spark RDD paper

2016-09-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15121 **[Test build #65511 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65511/consoleFull)** for PR 15121 at commit [`e2d40bd`](https://github.com/apache/spark/commit/e

[GitHub] spark pull request #15121: [SPARK-17567] Use valid url to Spark RDD paper

2016-09-16 Thread keypointt
GitHub user keypointt opened a pull request: https://github.com/apache/spark/pull/15121 [SPARK-17567] Use valid url to Spark RDD paper https://issues.apache.org/jira/browse/SPARK-17567 ## What changes were proposed in this pull request? Documentation (http://spark.

[GitHub] spark issue #11119: [SPARK-10780][ML] Add an initial model to kmeans

2016-09-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/9 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65507/ Test PASSed. ---

[GitHub] spark issue #11119: [SPARK-10780][ML] Add an initial model to kmeans

2016-09-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/9 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark pull request #13822: [SPARK-16115][SQL] Change output schema to be par...

2016-09-16 Thread skambha
Github user skambha commented on a diff in the pull request: https://github.com/apache/spark/pull/13822#discussion_r79264648 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveDDLSuite.scala --- @@ -595,6 +595,19 @@ class HiveDDLSuite } }

[GitHub] spark issue #11119: [SPARK-10780][ML] Add an initial model to kmeans

2016-09-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/9 **[Test build #65507 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65507/consoleFull)** for PR 9 at commit [`f6e024a`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13822: [SPARK-16115][SQL] Change output schema to be partition ...

2016-09-16 Thread skambha
Github user skambha commented on the issue: https://github.com/apache/spark/pull/13822 Thank you so much Andrew for reviewing. I appreciate it. I have taken care of your comments and also rebased. Please take a look. Thanks. My changes were doing two things: 1) R

  1   2   3   4   >