[3/3] spark-website git commit: Add CloudSort news entry.

2016-11-15 Thread rxin
Add CloudSort news entry. Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/8781cd3c Tree: http://git-wip-us.apache.org/repos/asf/spark-website/tree/8781cd3c Diff:

[2/3] spark-website git commit: Add CloudSort news entry.

2016-11-15 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/8781cd3c/site/news/spark-mailing-lists-moving-to-apache.html -- diff --git a/site/news/spark-mailing-lists-moving-to-apache.html

[1/3] spark-website git commit: Add CloudSort news entry.

2016-11-15 Thread rxin
Repository: spark-website Updated Branches: refs/heads/asf-site c693f2a7d -> 8781cd3c4 http://git-wip-us.apache.org/repos/asf/spark-website/blob/8781cd3c/site/releases/spark-release-1-2-1.html -- diff --git

spark git commit: [SPARK-18377][SQL] warehouse path should be a static conf

2016-11-15 Thread rxin
Repository: spark Updated Branches: refs/heads/master 4b35d13ba -> 4ac9759f8 [SPARK-18377][SQL] warehouse path should be a static conf ## What changes were proposed in this pull request? it's weird that every session can set its own warehouse path at runtime, we should forbid it and make it

spark git commit: [SPARK-18377][SQL] warehouse path should be a static conf

2016-11-15 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.1 175c47864 -> 436ae201f [SPARK-18377][SQL] warehouse path should be a static conf ## What changes were proposed in this pull request? it's weird that every session can set its own warehouse path at runtime, we should forbid it and

spark git commit: [SPARK-18300][SQL] Do not apply foldable propagation with expand as a child [BRANCH-2.0]

2016-11-15 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.0 e2452c632 -> 8d55886aa [SPARK-18300][SQL] Do not apply foldable propagation with expand as a child [BRANCH-2.0] ## What changes were proposed in this pull request? The `FoldablePropagation` optimizer rule, pulls foldable values out

spark git commit: [SPARK-18300][SQL] Fix scala 2.10 build for FoldablePropagation

2016-11-15 Thread zsxwing
Repository: spark Updated Branches: refs/heads/master 3ce057d00 -> 4b35d13ba [SPARK-18300][SQL] Fix scala 2.10 build for FoldablePropagation ## What changes were proposed in this pull request? Commit https://github.com/apache/spark/commit/f14ae4900ad0ed66ba36108b7792d56cd6767a69 broke the

spark git commit: [SPARK-18300][SQL] Fix scala 2.10 build for FoldablePropagation

2016-11-15 Thread zsxwing
Repository: spark Updated Branches: refs/heads/branch-2.1 1126c3194 -> 175c47864 [SPARK-18300][SQL] Fix scala 2.10 build for FoldablePropagation ## What changes were proposed in this pull request? Commit https://github.com/apache/spark/commit/f14ae4900ad0ed66ba36108b7792d56cd6767a69 broke

spark git commit: [SPARK-17732][SQL] ALTER TABLE DROP PARTITION should support comparators

2016-11-15 Thread hvanhovell
Repository: spark Updated Branches: refs/heads/branch-2.1 e469d3bad -> 1126c3194 [SPARK-17732][SQL] ALTER TABLE DROP PARTITION should support comparators ## What changes were proposed in this pull request? This PR aims to support `comparators`, e.g. '<', '<=', '>', '>=', again in Apache

spark git commit: [SPARK-17732][SQL] ALTER TABLE DROP PARTITION should support comparators

2016-11-15 Thread hvanhovell
Repository: spark Updated Branches: refs/heads/master 503378f10 -> 3ce057d00 [SPARK-17732][SQL] ALTER TABLE DROP PARTITION should support comparators ## What changes were proposed in this pull request? This PR aims to support `comparators`, e.g. '<', '<=', '>', '>=', again in Apache Spark

spark git commit: [SPARK-18423][STREAMING] ReceiverTracker should close checkpoint dir when stopped even if it was not started

2016-11-15 Thread zsxwing
Repository: spark Updated Branches: refs/heads/branch-2.1 b424dc947 -> e469d3bad [SPARK-18423][STREAMING] ReceiverTracker should close checkpoint dir when stopped even if it was not started ## What changes were proposed in this pull request? Several tests are being failed on Windows due to

spark git commit: [SPARK-18423][STREAMING] ReceiverTracker should close checkpoint dir when stopped even if it was not started

2016-11-15 Thread zsxwing
Repository: spark Updated Branches: refs/heads/master 1ae4652b7 -> 503378f10 [SPARK-18423][STREAMING] ReceiverTracker should close checkpoint dir when stopped even if it was not started ## What changes were proposed in this pull request? Several tests are being failed on Windows due to the

spark git commit: [SPARK-18440][STRUCTURED STREAMING] Pass correct query execution to FileFormatWriter

2016-11-15 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master 5bcb9a7ff -> 1ae4652b7 [SPARK-18440][STRUCTURED STREAMING] Pass correct query execution to FileFormatWriter ## What changes were proposed in this pull request? SPARK-18012 refactored the file write path in FileStreamSink using

spark git commit: [SPARK-18337] Complete mode memory sinks should be able to recover from checkpoints

2016-11-15 Thread tdas
Repository: spark Updated Branches: refs/heads/branch-2.0 de545e7c8 -> e2452c632 [SPARK-18337] Complete mode memory sinks should be able to recover from checkpoints ## What changes were proposed in this pull request? It would be nice if memory sinks can also recover from checkpoints. For

spark git commit: [SPARK-18337] Complete mode memory sinks should be able to recover from checkpoints

2016-11-15 Thread tdas
Repository: spark Updated Branches: refs/heads/branch-2.1 5f7a9af66 -> f13a33b47 [SPARK-18337] Complete mode memory sinks should be able to recover from checkpoints ## What changes were proposed in this pull request? It would be nice if memory sinks can also recover from checkpoints. For

spark git commit: [SPARK-13027][STREAMING] Added batch time as a parameter to updateStateByKey

2016-11-15 Thread zsxwing
Repository: spark Updated Branches: refs/heads/branch-2.1 0af94e772 -> 5f7a9af66 [SPARK-13027][STREAMING] Added batch time as a parameter to updateStateByKey Added RDD batch time as an input parameter to the update function in updateStateByKey. Author: Aaditya Ramesh

spark git commit: [SPARK-13027][STREAMING] Added batch time as a parameter to updateStateByKey

2016-11-15 Thread zsxwing
Repository: spark Updated Branches: refs/heads/master 745ab8bc5 -> 6f9e598cc [SPARK-13027][STREAMING] Added batch time as a parameter to updateStateByKey Added RDD batch time as an input parameter to the update function in updateStateByKey. Author: Aaditya Ramesh

spark git commit: [SPARK-18379][SQL] Make the parallelism of parallelPartitionDiscovery configurable.

2016-11-15 Thread yhuai
Repository: spark Updated Branches: refs/heads/master f14ae4900 -> 745ab8bc5 [SPARK-18379][SQL] Make the parallelism of parallelPartitionDiscovery configurable. ## What changes were proposed in this pull request? The largest parallelism in PartitioningAwareFileIndex

[1/2] spark-website git commit: Fix broken link to bootstrap JS

2016-11-15 Thread srowen
Repository: spark-website Updated Branches: refs/heads/asf-site d82e37220 -> c693f2a7d http://git-wip-us.apache.org/repos/asf/spark-website/blob/c693f2a7/site/releases/spark-release-1-5-2.html -- diff --git

[2/2] spark-website git commit: Fix broken link to bootstrap JS

2016-11-15 Thread srowen
Fix broken link to bootstrap JS Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/c693f2a7 Tree: http://git-wip-us.apache.org/repos/asf/spark-website/tree/c693f2a7 Diff:

[2/3] spark-website git commit: Use site.baseurl, not site.url, to work with Jekyll 3.3. Require Jekyll 3.3. Again commit HTML consistent with Jekyll 3.3 output. Fix date problem with news posts that

2016-11-15 Thread srowen
http://git-wip-us.apache.org/repos/asf/spark-website/blob/d82e3722/news/_posts/2015-10-02-spark-1-5-1-released.md -- diff --git a/news/_posts/2015-10-02-spark-1-5-1-released.md b/news/_posts/2015-10-02-spark-1-5-1-released.md

[3/3] spark-website git commit: Use site.baseurl, not site.url, to work with Jekyll 3.3. Require Jekyll 3.3. Again commit HTML consistent with Jekyll 3.3 output. Fix date problem with news posts that

2016-11-15 Thread srowen
Use site.baseurl, not site.url, to work with Jekyll 3.3. Require Jekyll 3.3. Again commit HTML consistent with Jekyll 3.3 output. Fix date problem with news posts that set date: by removing date:. Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit:

[1/3] spark-website git commit: Use site.baseurl, not site.url, to work with Jekyll 3.3. Require Jekyll 3.3. Again commit HTML consistent with Jekyll 3.3 output. Fix date problem with news posts that

2016-11-15 Thread srowen
Repository: spark-website Updated Branches: refs/heads/asf-site 4e10a1ac1 -> d82e37220 http://git-wip-us.apache.org/repos/asf/spark-website/blob/d82e3722/site/releases/spark-release-1-1-0.html -- diff --git

spark git commit: [SPARK-18300][SQL] Do not apply foldable propagation with expand as a child.

2016-11-15 Thread lixiao
Repository: spark Updated Branches: refs/heads/branch-2.1 0762c0ceb -> 0af94e772 [SPARK-18300][SQL] Do not apply foldable propagation with expand as a child. ## What changes were proposed in this pull request? The `FoldablePropagation` optimizer rule, pulls foldable values out from under an

spark git commit: [SPARK-18300][SQL] Do not apply foldable propagation with expand as a child.

2016-11-15 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 33be4da53 -> f14ae4900 [SPARK-18300][SQL] Do not apply foldable propagation with expand as a child. ## What changes were proposed in this pull request? The `FoldablePropagation` optimizer rule, pulls foldable values out from under an

spark git commit: [SPARK-18427][DOC] Update docs of mllib.KMeans

2016-11-15 Thread srowen
Repository: spark Updated Branches: refs/heads/master d89bfc923 -> 33be4da53 [SPARK-18427][DOC] Update docs of mllib.KMeans ## What changes were proposed in this pull request? 1,Remove `runs` from docs of mllib.KMeans 2,Add notes for `k` according to comments in sources ## How was this patch

spark git commit: [SPARK-18427][DOC] Update docs of mllib.KMeans

2016-11-15 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.1 a0125fd68 -> 0762c0ceb [SPARK-18427][DOC] Update docs of mllib.KMeans ## What changes were proposed in this pull request? 1,Remove `runs` from docs of mllib.KMeans 2,Add notes for `k` according to comments in sources ## How was this