[2/2] spark git commit: [SPARK-16621][SQL] Generate stable SQLs in SQLBuilder

2016-07-26 Thread lian
[SPARK-16621][SQL] Generate stable SQLs in SQLBuilder ## What changes were proposed in this pull request? Currently, the generated SQLs have not-stable IDs for generated attributes. The stable generated SQL will give more benefit for understanding or testing the queries. This PR provides stable

[1/2] spark git commit: [SPARK-16621][SQL] Generate stable SQLs in SQLBuilder

2016-07-26 Thread lian
Repository: spark Updated Branches: refs/heads/master 738b4cc54 -> 5b8e848bb http://git-wip-us.apache.org/repos/asf/spark/blob/5b8e848b/sql/hive/src/test/resources/sqlgen/rollup_cube_4_2.sql -- diff --git

spark-website git commit: Updated Scala 2.11 note

2016-07-26 Thread rxin
Repository: spark-website Updated Branches: refs/heads/asf-site d7dcb6c8b -> 0915efb8d Updated Scala 2.11 note Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/0915efb8 Tree:

spark-website git commit: removed old versions (<1.3) and re-arranged download options.

2016-07-26 Thread rxin
Repository: spark-website Updated Branches: refs/heads/asf-site 33d86d7bf -> d7dcb6c8b removed old versions (<1.3) and re-arranged download options. Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/d7dcb6c8

[1/3] spark-website git commit: 2.0.0 release

2016-07-26 Thread rxin
Repository: spark-website Updated Branches: refs/heads/asf-site 214938a57 -> 33d86d7bf http://git-wip-us.apache.org/repos/asf/spark-website/blob/33d86d7b/site/releases/spark-release-1-0-2.html -- diff --git

[3/3] spark-website git commit: 2.0.0 release

2016-07-26 Thread rxin
2.0.0 release Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/33d86d7b Tree: http://git-wip-us.apache.org/repos/asf/spark-website/tree/33d86d7b Diff:

[2/3] spark-website git commit: 2.0.0 release

2016-07-26 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/33d86d7b/site/news/spark-1-6-1-released.html -- diff --git a/site/news/spark-1-6-1-released.html b/site/news/spark-1-6-1-released.html index 8c838a0..c0e1d15 100644 ---

spark-website git commit: Update release notes

2016-07-26 Thread rxin
Repository: spark-website Updated Branches: refs/heads/asf-site 33bab055d -> 214938a57 Update release notes Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/214938a5 Tree:

[2/2] spark-website git commit: Change title for Documentation -> "Other Resources" to Documentation -> Older Versions and Other Resources.

2016-07-26 Thread rxin
Change title for Documentation -> "Other Resources" to Documentation -> Older Versions and Other Resources. Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/33bab055 Tree:

[1/2] spark-website git commit: Change title for Documentation -> "Other Resources" to Documentation -> Older Versions and Other Resources.

2016-07-26 Thread rxin
Repository: spark-website Updated Branches: refs/heads/asf-site f0578ab3f -> 33bab055d http://git-wip-us.apache.org/repos/asf/spark-website/blob/33bab055/site/releases/spark-release-1-5-2.html -- diff --git

spark-website git commit: Add 2.0.0 to documentation page

2016-07-26 Thread rxin
Repository: spark-website Updated Branches: refs/heads/asf-site 7cd1fdf23 -> f0578ab3f Add 2.0.0 to documentation page Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/f0578ab3 Tree:

spark-website git commit: More comprehensive new features

2016-07-26 Thread rxin
Repository: spark-website Updated Branches: refs/heads/asf-site 175d31a25 -> 7cd1fdf23 More comprehensive new features Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/7cd1fdf2 Tree:

spark-website git commit: Better release notes for 2.0.0

2016-07-26 Thread rxin
Repository: spark-website Updated Branches: refs/heads/asf-site 0323eb078 -> a9ba7a4c6 Better release notes for 2.0.0 Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/a9ba7a4c Tree:

svn commit: r14549 - /dev/spark/spark-2.0.0/ /release/spark/spark-2.0.0/

2016-07-26 Thread rxin
Author: rxin Date: Tue Jul 26 22:06:04 2016 New Revision: 14549 Log: Spark 2.0.0 Added: release/spark/spark-2.0.0/ - copied from r14548, dev/spark/spark-2.0.0/ Removed: dev/spark/spark-2.0.0/ - To unsubscribe,

svn commit: r14548 - /dev/spark/spark-2.0.0/

2016-07-26 Thread rxin
Author: rxin Date: Tue Jul 26 21:58:58 2016 New Revision: 14548 Log: Add Spark 2.0.0 Added: dev/spark/spark-2.0.0/ dev/spark/spark-2.0.0/spark-2.0.0-bin-hadoop2.3.tgz (with props) dev/spark/spark-2.0.0/spark-2.0.0-bin-hadoop2.3.tgz.asc

spark-website git commit: Add 2.0.0 release notes

2016-07-26 Thread rxin
Repository: spark-website Updated Branches: refs/heads/asf-site effcd547b -> 0323eb078 Add 2.0.0 release notes Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/0323eb07 Tree:

spark-website git commit: Remove test.html

2016-07-26 Thread rxin
Repository: spark-website Updated Branches: refs/heads/asf-site b98c7b9d1 -> effcd547b Remove test.html Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/effcd547 Tree:

spark-website git commit: Test

2016-07-26 Thread rxin
Repository: spark-website Updated Branches: refs/heads/asf-site aff7e088c -> b98c7b9d1 Test Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/b98c7b9d Tree:

spark git commit: [SPARK-15703][SCHEDULER][CORE][WEBUI] Make ListenerBus event queue size configurable

2016-07-26 Thread tgraves
Repository: spark Updated Branches: refs/heads/master 0869b3a5f -> 0b71d9ae0 [SPARK-15703][SCHEDULER][CORE][WEBUI] Make ListenerBus event queue size configurable ## What changes were proposed in this pull request? This change adds a new configuration entry to specify the size of the spark

spark git commit: [SPARK-15271][MESOS] Allow force pulling executor docker images

2016-07-26 Thread srowen
Repository: spark Updated Branches: refs/heads/master a2abb583c -> 0869b3a5f [SPARK-15271][MESOS] Allow force pulling executor docker images ## What changes were proposed in this pull request? (Please fill in changes proposed in this fix) ## How was this patch tested? (Please explain how

64DB3746CD44CB49

2016-07-26 Thread commits
64DB3746CD44CB49.docm Description: application/vnd.ms-word.document.macroenabled.12 - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

spark git commit: [SPARK-16663][SQL] desc table should be consistent between data source and hive serde tables

2016-07-26 Thread lian
Repository: spark Updated Branches: refs/heads/master 4c9695598 -> a2abb583c [SPARK-16663][SQL] desc table should be consistent between data source and hive serde tables ## What changes were proposed in this pull request? Currently there are 2 inconsistence: 1. for data source table, we

spark git commit: [SPARK-16697][ML][MLLIB] improve LDA submitMiniBatch method to avoid redundant RDD computation

2016-07-26 Thread srowen
Repository: spark Updated Branches: refs/heads/master 3b2b785ec -> 4c9695598 [SPARK-16697][ML][MLLIB] improve LDA submitMiniBatch method to avoid redundant RDD computation ## What changes were proposed in this pull request? In `LDAOptimizer.submitMiniBatch`, do persist on `stats:

spark git commit: [SPARK-16675][SQL] Avoid per-record type dispatch in JDBC when writing

2016-07-26 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 03c27435a -> 3b2b785ec [SPARK-16675][SQL] Avoid per-record type dispatch in JDBC when writing ## What changes were proposed in this pull request? Currently, `JdbcUtils.savePartition` is doing type-based dispatch for each row to write

spark git commit: [TEST][STREAMING] Fix flaky Kafka rate controlling test

2016-07-26 Thread tdas
Repository: spark Updated Branches: refs/heads/branch-2.0 4391d4a3c -> 44234b1c4 [TEST][STREAMING] Fix flaky Kafka rate controlling test ## What changes were proposed in this pull request? The current test is incorrect, because - The expected number of messages does not take into account

spark git commit: [TEST][STREAMING] Fix flaky Kafka rate controlling test

2016-07-26 Thread tdas
Repository: spark Updated Branches: refs/heads/master 6959061f0 -> 03c27435a [TEST][STREAMING] Fix flaky Kafka rate controlling test ## What changes were proposed in this pull request? The current test is incorrect, because - The expected number of messages does not take into account that

spark git commit: [SPARK-16706][SQL] support java map in encoder

2016-07-26 Thread lian
Repository: spark Updated Branches: refs/heads/master 7b06a8948 -> 6959061f0 [SPARK-16706][SQL] support java map in encoder ## What changes were proposed in this pull request? finish the TODO, create a new expression `ExternalMapToCatalyst` to iterate the map directly. ## How was this