spark git commit: [STREAMING][MINOR] Fix typo in function name of StateImpl

2015-12-15 Thread zsxwing
Repository: spark Updated Branches: refs/heads/master c59df8c51 -> bc1ff9f4a [STREAMING][MINOR] Fix typo in function name of StateImpl cc\ tdas zsxwing , please review. Thanks a lot. Author: jerryshao Closes #10305 from jerryshao/fix-typo-state-impl. Project:

spark git commit: [STREAMING][MINOR] Fix typo in function name of StateImpl

2015-12-15 Thread zsxwing
Repository: spark Updated Branches: refs/heads/branch-1.6 352a0c80f -> 23c884605 [STREAMING][MINOR] Fix typo in function name of StateImpl cc\ tdas zsxwing , please review. Thanks a lot. Author: jerryshao Closes #10305 from jerryshao/fix-typo-state-impl. (cherry

spark git commit: [SPARK-12332][TRIVIAL][TEST] Fix minor typo in ResetSystemProperties

2015-12-15 Thread srowen
Repository: spark Updated Branches: refs/heads/master 606f99b94 -> c59df8c51 [SPARK-12332][TRIVIAL][TEST] Fix minor typo in ResetSystemProperties Fix a minor typo (unbalanced bracket) in ResetSystemProperties. Author: Holden Karau Closes #10303 from

[1/2] spark git commit: Preparing Spark release v1.6.0-rc3

2015-12-15 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.6 80d261718 -> 08aa3b47e Preparing Spark release v1.6.0-rc3 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/00a39d9c Tree:

spark git commit: [MINOR][ML] Rename weights to coefficients for examples/DeveloperApiExample

2015-12-15 Thread jkbradley
Repository: spark Updated Branches: refs/heads/master bc1ff9f4a -> b24c12d73 [MINOR][ML] Rename weights to coefficients for examples/DeveloperApiExample Rename ```weights``` to ```coefficients``` for examples/DeveloperApiExample. cc mengxr jkbradley Author: Yanbo Liang

spark git commit: [SPARK-12271][SQL] Improve error message when Dataset.as[ ] has incompatible schemas.

2015-12-15 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master b24c12d73 -> 86ea64dd1 [SPARK-12271][SQL] Improve error message when Dataset.as[ ] has incompatible schemas. Author: Nong Li Closes #10260 from nongli/spark-11271. Project:

[3/3] spark git commit: Update branch-1.6 for 1.6.0 release

2015-12-15 Thread marmbrus
Update branch-1.6 for 1.6.0 release Author: Michael Armbrust Closes #10317 from marmbrus/versions. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/80d26171 Tree:

[spark] Git Push Summary

2015-12-15 Thread pwendell
Repository: spark Updated Tags: refs/tags/v1.6.0-rc3 [created] 00a39d9c0 - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

[2/2] spark git commit: Preparing development version 1.6.0-SNAPSHOT

2015-12-15 Thread pwendell
Preparing development version 1.6.0-SNAPSHOT Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/08aa3b47 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/08aa3b47 Diff:

[2/3] spark git commit: Update branch-1.6 for 1.6.0 release

2015-12-15 Thread marmbrus
http://git-wip-us.apache.org/repos/asf/spark/blob/80d26171/CHANGES.txt -- diff --git a/CHANGES.txt b/CHANGES.txt new file mode 100644 index 000..ff59371 --- /dev/null +++ b/CHANGES.txt @@ -0,0 +1,34172 @@ +Spark Change Log

[1/3] spark git commit: Update branch-1.6 for 1.6.0 release

2015-12-15 Thread marmbrus
Repository: spark Updated Branches: refs/heads/branch-1.6 23c884605 -> 80d261718 http://git-wip-us.apache.org/repos/asf/spark/blob/80d26171/core/src/main/scala/org/apache/spark/package.scala -- diff --git

spark git commit: [SPARK-12236][SQL] JDBC filter tests all pass if filters are not really pushed down

2015-12-15 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master 86ea64dd1 -> 28112657e [SPARK-12236][SQL] JDBC filter tests all pass if filters are not really pushed down https://issues.apache.org/jira/browse/SPARK-12236 Currently JDBC filters are not tested properly. All the tests pass even if the

spark git commit: [SPARK-12304][STREAMING] Make Spark Streaming web UI display more fri…

2015-12-15 Thread zsxwing
Repository: spark Updated Branches: refs/heads/master ca0690b5e -> d52bf47e1 [SPARK-12304][STREAMING] Make Spark Streaming web UI display more fri… …endly Receiver graphs Currently, the Spark Streaming web UI uses the same maxY when displays 'Input Rate Times& Histograms' and

spark git commit: [HOTFIX] Compile error from commit 31b3910

2015-12-15 Thread andrewor14
Repository: spark Updated Branches: refs/heads/master 31b391019 -> 840bd2e00 [HOTFIX] Compile error from commit 31b3910 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/840bd2e0 Tree:

spark git commit: [SPARK-12130] Replace shuffleManagerClass with shortShuffleMgrNames in ExternalShuffleBlockResolver

2015-12-15 Thread andrewor14
Repository: spark Updated Branches: refs/heads/master f725b2ec1 -> 369127f03 [SPARK-12130] Replace shuffleManagerClass with shortShuffleMgrNames in ExternalShuffleBlockResolver Replace shuffleManagerClassName with shortShuffleMgrName is to reduce time of string's comparison. and put sort's

spark git commit: [SPARK-4117][YARN] Spark on Yarn handle AM being told command from RM

2015-12-15 Thread andrewor14
Repository: spark Updated Branches: refs/heads/master a89e8b612 -> ca0690b5e [SPARK-4117][YARN] Spark on Yarn handle AM being told command from RM Spark on Yarn handle AM being told command from RM When RM throws ApplicationAttemptNotFoundException for allocate invocation, making the

spark git commit: [SPARK-12056][CORE] Part 2 Create a TaskAttemptContext only after calling setConf

2015-12-15 Thread andrewor14
Repository: spark Updated Branches: refs/heads/branch-1.6 08aa3b47e -> 9e4ac5645 [SPARK-12056][CORE] Part 2 Create a TaskAttemptContext only after calling setConf This is continuation of SPARK-12056 where change is applied to SqlNewHadoopRDD.scala andrewor14 FYI Author: tedyu

spark git commit: [SPARK-10477][SQL] using DSL in ColumnPruningSuite to improve readability

2015-12-15 Thread andrewor14
Repository: spark Updated Branches: refs/heads/master c5b6b398d -> a89e8b612 [SPARK-10477][SQL] using DSL in ColumnPruningSuite to improve readability Author: Wenchen Fan Closes #8645 from cloud-fan/test. Project: http://git-wip-us.apache.org/repos/asf/spark/repo

spark git commit: [SPARK-12062][CORE] Change Master to asyc rebuild UI when application completes

2015-12-15 Thread andrewor14
Repository: spark Updated Branches: refs/heads/branch-1.6 8e9a60031 -> 93095eb29 [SPARK-12062][CORE] Change Master to asyc rebuild UI when application completes This change builds the event history of completed apps asynchronously so the RPC thread will not be blocked and allow new workers

spark git commit: [SPARK-12062][CORE] Change Master to asyc rebuild UI when application completes

2015-12-15 Thread andrewor14
Repository: spark Updated Branches: refs/heads/master 8a215d233 -> c5b6b398d [SPARK-12062][CORE] Change Master to asyc rebuild UI when application completes This change builds the event history of completed apps asynchronously so the RPC thread will not be blocked and allow new workers to

spark git commit: [SPARK-12056][CORE] Part 2 Create a TaskAttemptContext only after calling setConf

2015-12-15 Thread andrewor14
Repository: spark Updated Branches: refs/heads/master 840bd2e00 -> f725b2ec1 [SPARK-12056][CORE] Part 2 Create a TaskAttemptContext only after calling setConf This is continuation of SPARK-12056 where change is applied to SqlNewHadoopRDD.scala andrewor14 FYI Author: tedyu

spark git commit: [SPARK-9516][UI] Improvement of Thread Dump Page

2015-12-15 Thread andrewor14
Repository: spark Updated Branches: refs/heads/master c2de99a7c -> a63d9edcf [SPARK-9516][UI] Improvement of Thread Dump Page https://issues.apache.org/jira/browse/SPARK-9516 - [x] new look of Thread Dump Page - [x] click column title to sort - [x] grep - [x] search as you type squito

spark git commit: [SPARK-12351][MESOS] Add documentation about submitting Spark with mesos cluster mode.

2015-12-15 Thread andrewor14
Repository: spark Updated Branches: refs/heads/branch-1.6 9e4ac5645 -> 2c324d35a [SPARK-12351][MESOS] Add documentation about submitting Spark with mesos cluster mode. Adding more documentation about submitting jobs with mesos cluster mode. Author: Timothy Chen Closes

spark git commit: [SPARK-12351][MESOS] Add documentation about submitting Spark with mesos cluster mode.

2015-12-15 Thread andrewor14
Repository: spark Updated Branches: refs/heads/master 369127f03 -> c2de99a7c [SPARK-12351][MESOS] Add documentation about submitting Spark with mesos cluster mode. Adding more documentation about submitting jobs with mesos cluster mode. Author: Timothy Chen Closes

spark git commit: [SPARK-9026][SPARK-4514] Modifications to JobWaiter, FutureAction, and AsyncRDDActions to support non-blocking operation

2015-12-15 Thread andrewor14
Repository: spark Updated Branches: refs/heads/master a63d9edcf -> 765a48849 [SPARK-9026][SPARK-4514] Modifications to JobWaiter, FutureAction, and AsyncRDDActions to support non-blocking operation These changes rework the implementations of `SimpleFutureAction`, `ComplexFutureAction`,

spark git commit: [SPARK-10477][SQL] using DSL in ColumnPruningSuite to improve readability

2015-12-15 Thread andrewor14
Repository: spark Updated Branches: refs/heads/branch-1.6 93095eb29 -> fb08f7b78 [SPARK-10477][SQL] using DSL in ColumnPruningSuite to improve readability Author: Wenchen Fan Closes #8645 from cloud-fan/test. (cherry picked from commit

spark git commit: [SPARK-12105] [SQL] add convenient show functions

2015-12-15 Thread andrewor14
Repository: spark Updated Branches: refs/heads/master 28112657e -> 31b391019 [SPARK-12105] [SQL] add convenient show functions Author: Jean-Baptiste Onofré Closes #10130 from jbonofre/SPARK-12105. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit:

spark git commit: [SPARK-10123][DEPLOY] Support specifying deploy mode from configuration

2015-12-15 Thread andrewor14
Repository: spark Updated Branches: refs/heads/master 765a48849 -> 63ccdef81 [SPARK-10123][DEPLOY] Support specifying deploy mode from configuration Please help to review, thanks a lot. Author: jerryshao Closes #10195 from jerryshao/SPARK-10123. Project:

spark git commit: [SPARK-9886][CORE] Fix to use ShutdownHookManager in

2015-12-15 Thread andrewor14
Repository: spark Updated Branches: refs/heads/master 63ccdef81 -> 8a215d233 [SPARK-9886][CORE] Fix to use ShutdownHookManager in ExternalBlockStore.scala Author: Naveen Closes #10313 from naveenminchu/branch-fix-SPARK-9886. Project:

spark git commit: [SPARK-9886][CORE] Fix to use ShutdownHookManager in

2015-12-15 Thread andrewor14
Repository: spark Updated Branches: refs/heads/branch-1.6 2c324d35a -> 8e9a60031 [SPARK-9886][CORE] Fix to use ShutdownHookManager in ExternalBlockStore.scala Author: Naveen Closes #10313 from naveenminchu/branch-fix-SPARK-9886. (cherry picked from commit

spark git commit: [SPARK-12249][SQL] JDBC non-equality comparison operator not pushed down.

2015-12-15 Thread rxin
Repository: spark Updated Branches: refs/heads/master d52bf47e1 -> 0f6936b5f [SPARK-12249][SQL] JDBC non-equality comparison operator not pushed down. https://issues.apache.org/jira/browse/SPARK-12249 Currently `!=` operator is not pushed down correctly. I simply added a case for this.

spark git commit: [SPARK-12315][SQL] isnotnull operator not pushed down for JDBC datasource.

2015-12-15 Thread rxin
Repository: spark Updated Branches: refs/heads/master 7f443a687 -> 2aad2d372 [SPARK-12315][SQL] isnotnull operator not pushed down for JDBC datasource. https://issues.apache.org/jira/browse/SPARK-12315 `IsNotNull` filter is not being pushed down for JDBC datasource. It looks it is SQL

spark git commit: Style fix for the previous 3 JDBC filter push down commits.

2015-12-15 Thread rxin
Repository: spark Updated Branches: refs/heads/master 2aad2d372 -> 554d840a9 Style fix for the previous 3 JDBC filter push down commits. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/554d840a Tree: