spark git commit: [SPARK-9575] [MESOS] Add docuemntation around Mesos shuffle service.

2015-08-11 Thread andrewor14
Repository: spark Updated Branches: refs/heads/branch-1.5 a2f805729 -> 5dd0c5cd6 [SPARK-9575] [MESOS] Add docuemntation around Mesos shuffle service. andrewor14 Author: Timothy Chen Closes #7907 from tnachen/mesos_shuffle. (cherry picked from commit 741a29f98945538a475579ccc974cd42c1613be4

spark git commit: [SPARK-9575] [MESOS] Add docuemntation around Mesos shuffle service.

2015-08-11 Thread andrewor14
Repository: spark Updated Branches: refs/heads/master 5c99d8bf9 -> 741a29f98 [SPARK-9575] [MESOS] Add docuemntation around Mesos shuffle service. andrewor14 Author: Timothy Chen Closes #7907 from tnachen/mesos_shuffle. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: htt

spark git commit: [SPARK-8798] [MESOS] Allow additional uris to be fetched with mesos

2015-08-11 Thread andrewor14
Repository: spark Updated Branches: refs/heads/branch-1.5 93fc95934 -> a2f805729 [SPARK-8798] [MESOS] Allow additional uris to be fetched with mesos Some users like to download additional files in their sandbox that they can refer to from their spark program, or even later mount these files t

spark git commit: [SPARK-8798] [MESOS] Allow additional uris to be fetched with mesos

2015-08-11 Thread andrewor14
Repository: spark Updated Branches: refs/heads/master bab892328 -> 5c99d8bf9 [SPARK-8798] [MESOS] Allow additional uris to be fetched with mesos Some users like to download additional files in their sandbox that they can refer to from their spark program, or even later mount these files to an

spark git commit: [SPARK-9426] [WEBUI] Job page DAG visualization is not shown

2015-08-11 Thread andrewor14
Repository: spark Updated Branches: refs/heads/master 4e3f4b934 -> bab892328 [SPARK-9426] [WEBUI] Job page DAG visualization is not shown To reproduce the issue, go to the stage page and click DAG Visualization once, then go to the job page to show the job DAG visualization. You will only see

spark git commit: [SPARK-9426] [WEBUI] Job page DAG visualization is not shown

2015-08-11 Thread andrewor14
Repository: spark Updated Branches: refs/heads/branch-1.5 d9d4bdea2 -> 93fc95934 [SPARK-9426] [WEBUI] Job page DAG visualization is not shown To reproduce the issue, go to the stage page and click DAG Visualization once, then go to the job page to show the job DAG visualization. You will only

spark git commit: [SPARK-9829] [WEBUI] Display the update value for peak execution memory

2015-08-11 Thread andrewor14
Repository: spark Updated Branches: refs/heads/master a807fcbe5 -> 4e3f4b934 [SPARK-9829] [WEBUI] Display the update value for peak execution memory The peak execution memory is not correct because it shows the sum of finished tasks' values when a task finishes. This PR fixes it by using the

spark git commit: [SPARK-9829] [WEBUI] Display the update value for peak execution memory

2015-08-11 Thread andrewor14
Repository: spark Updated Branches: refs/heads/branch-1.5 402c0ca9a -> d9d4bdea2 [SPARK-9829] [WEBUI] Display the update value for peak execution memory The peak execution memory is not correct because it shows the sum of finished tasks' values when a task finishes. This PR fixes it by using

spark git commit: [SPARK-9806] [WEB UI] Don't share ReplayListenerBus between multiple applications

2015-08-11 Thread andrewor14
Repository: spark Updated Branches: refs/heads/branch-1.4 6dde38026 -> 89c8aea94 [SPARK-9806] [WEB UI] Don't share ReplayListenerBus between multiple applications Author: Rohit Agarwal Closes #8088 from mindprince/SPARK-9806. (cherry picked from commit a807fcbe50b2ce18751d80d39e9d21842f7da

spark git commit: [SPARK-9806] [WEB UI] Don't share ReplayListenerBus between multiple applications

2015-08-11 Thread andrewor14
Repository: spark Updated Branches: refs/heads/branch-1.5 2f909184e -> 402c0ca9a [SPARK-9806] [WEB UI] Don't share ReplayListenerBus between multiple applications Author: Rohit Agarwal Closes #8088 from mindprince/SPARK-9806. (cherry picked from commit a807fcbe50b2ce18751d80d39e9d21842f7da

spark git commit: [SPARK-9806] [WEB UI] Don't share ReplayListenerBus between multiple applications

2015-08-11 Thread andrewor14
Repository: spark Updated Branches: refs/heads/master b85f9a242 -> a807fcbe5 [SPARK-9806] [WEB UI] Don't share ReplayListenerBus between multiple applications Author: Rohit Agarwal Closes #8088 from mindprince/SPARK-9806. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit:

spark git commit: [SPARK-8366] maxNumExecutorsNeeded should properly handle failed tasks

2015-08-11 Thread andrewor14
Repository: spark Updated Branches: refs/heads/master b1581ac28 -> b85f9a242 [SPARK-8366] maxNumExecutorsNeeded should properly handle failed tasks Author: xutingjun Author: meiyoula <1039320...@qq.com> Closes #6817 from XuTingjun/SPARK-8366. Project: http://git-wip-us.apache.org/repos/asf

spark git commit: [SPARK-8366] maxNumExecutorsNeeded should properly handle failed tasks

2015-08-11 Thread andrewor14
Repository: spark Updated Branches: refs/heads/branch-1.5 b994f8928 -> 2f909184e [SPARK-8366] maxNumExecutorsNeeded should properly handle failed tasks Author: xutingjun Author: meiyoula <1039320...@qq.com> Closes #6817 from XuTingjun/SPARK-8366. (cherry picked from commit b85f9a242a12e8096

spark git commit: [SPARK-9854] [SQL] RuleExecutor.timeMap should be thread-safe

2015-08-11 Thread joshrosen
Repository: spark Updated Branches: refs/heads/branch-1.5 7024f3eac -> b994f8928 [SPARK-9854] [SQL] RuleExecutor.timeMap should be thread-safe `RuleExecutor.timeMap` is currently a non-thread-safe mutable HashMap; this can lead to infinite loops if multiple threads are concurrently modifying

spark git commit: [SPARK-9854] [SQL] RuleExecutor.timeMap should be thread-safe

2015-08-11 Thread joshrosen
Repository: spark Updated Branches: refs/heads/master c3e9a120e -> b1581ac28 [SPARK-9854] [SQL] RuleExecutor.timeMap should be thread-safe `RuleExecutor.timeMap` is currently a non-thread-safe mutable HashMap; this can lead to infinite loops if multiple threads are concurrently modifying the

spark git commit: [SPARK-9831] [SQL] fix serialization with empty broadcast

2015-08-11 Thread davies
Repository: spark Updated Branches: refs/heads/branch-1.5 890c75bc2 -> 7024f3eac [SPARK-9831] [SQL] fix serialization with empty broadcast Author: Davies Liu Closes #8117 from davies/fix_serialization and squashes the following commits: d21ac71 [Davies Liu] fix serialization with empty broa

spark git commit: [SPARK-9831] [SQL] fix serialization with empty broadcast

2015-08-11 Thread davies
Repository: spark Updated Branches: refs/heads/master 74a293f45 -> c3e9a120e [SPARK-9831] [SQL] fix serialization with empty broadcast Author: Davies Liu Closes #8117 from davies/fix_serialization and squashes the following commits: d21ac71 [Davies Liu] fix serialization with empty broadcas

spark git commit: [SPARK-9713] [ML] Document SparkR MLlib glm() integration in Spark 1.5

2015-08-11 Thread meng
Repository: spark Updated Branches: refs/heads/branch-1.5 6ea33f5bf -> 890c75bc2 [SPARK-9713] [ML] Document SparkR MLlib glm() integration in Spark 1.5 This documents the use of R model formulae in the SparkR guide. Also fixes some bugs in the R api doc. mengxr Author: Eric Liang Closes #

spark git commit: [SPARK-9713] [ML] Document SparkR MLlib glm() integration in Spark 1.5

2015-08-11 Thread meng
Repository: spark Updated Branches: refs/heads/master 3ef0f3292 -> 74a293f45 [SPARK-9713] [ML] Document SparkR MLlib glm() integration in Spark 1.5 This documents the use of R model formulae in the SparkR guide. Also fixes some bugs in the R api doc. mengxr Author: Eric Liang Closes #8085

spark git commit: [SPARK-1517] Refactor release scripts to facilitate nightly publishing

2015-08-11 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.5 0119edf52 -> 6ea33f5bf [SPARK-1517] Refactor release scripts to facilitate nightly publishing This update contains some code changes to the release scripts that allow easier nightly publishing. I've been using these new scripts on Jenk

spark git commit: [SPARK-1517] Refactor release scripts to facilitate nightly publishing

2015-08-11 Thread pwendell
Repository: spark Updated Branches: refs/heads/master ca8f70e9d -> 3ef0f3292 [SPARK-1517] Refactor release scripts to facilitate nightly publishing This update contains some code changes to the release scripts that allow easier nightly publishing. I've been using these new scripts on Jenkins

spark git commit: [SPARK-9649] Fix flaky test MasterSuite again - disable REST

2015-08-11 Thread joshrosen
Repository: spark Updated Branches: refs/heads/master afa757c98 -> ca8f70e9d [SPARK-9649] Fix flaky test MasterSuite again - disable REST The REST server is not actually used in most tests and so we can disable it. It is a source of flakiness because it tries to bind to a specific port in vai

spark git commit: [SPARK-9649] Fix flaky test MasterSuite again - disable REST

2015-08-11 Thread joshrosen
Repository: spark Updated Branches: refs/heads/branch-1.5 ec7a4b9b0 -> 0119edf52 [SPARK-9649] Fix flaky test MasterSuite again - disable REST The REST server is not actually used in most tests and so we can disable it. It is a source of flakiness because it tries to bind to a specific port in

spark git commit: [SPARK-9849] [SQL] DirectParquetOutputCommitter qualified name should be backward compatible

2015-08-11 Thread yhuai
Repository: spark Updated Branches: refs/heads/master 5a5bbc299 -> afa757c98 [SPARK-9849] [SQL] DirectParquetOutputCommitter qualified name should be backward compatible DirectParquetOutputCommitter was moved in SPARK-9763. However, users can explicitly set the class as a config option, so w

spark git commit: [SPARK-9849] [SQL] DirectParquetOutputCommitter qualified name should be backward compatible

2015-08-11 Thread yhuai
Repository: spark Updated Branches: refs/heads/branch-1.5 b7497e3a2 -> ec7a4b9b0 [SPARK-9849] [SQL] DirectParquetOutputCommitter qualified name should be backward compatible DirectParquetOutputCommitter was moved in SPARK-9763. However, users can explicitly set the class as a config option,

[2/2] spark git commit: Preparing development version 1.5.0-SNAPSHOT

2015-08-11 Thread pwendell
Preparing development version 1.5.0-SNAPSHOT Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/b7497e3a Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/b7497e3a Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/b74

[1/2] spark git commit: Preparing Spark release v1.5.0-snapshot-20150811

2015-08-11 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.5 18d78a823 -> b7497e3a2 Preparing Spark release v1.5.0-snapshot-20150811 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/158b2ea7 Tree: http://git-wip-us.apache.

Git Push Summary

2015-08-11 Thread pwendell
Repository: spark Updated Tags: refs/tags/v1.5.0-snapshot-20150811 [created] 158b2ea7a - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

Git Push Summary

2015-08-11 Thread pwendell
Repository: spark Updated Tags: refs/tags/v1.5.0-snapshot-20150811 [deleted] e9329ef6a - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

spark git commit: [SPARK-9074] [LAUNCHER] Allow arbitrary Spark args to be set.

2015-08-11 Thread vanzin
Repository: spark Updated Branches: refs/heads/branch-1.5 1067c7369 -> 18d78a823 [SPARK-9074] [LAUNCHER] Allow arbitrary Spark args to be set. This change allows any Spark argument to be added to the app to be started using SparkLauncher. Known arguments are properly validated, while unknown a

spark git commit: [SPARK-9074] [LAUNCHER] Allow arbitrary Spark args to be set.

2015-08-11 Thread vanzin
Repository: spark Updated Branches: refs/heads/master 736af95bd -> 5a5bbc299 [SPARK-9074] [LAUNCHER] Allow arbitrary Spark args to be set. This change allows any Spark argument to be added to the app to be started using SparkLauncher. Known arguments are properly validated, while unknown argum

spark git commit: [HOTFIX] Fix style error caused by ef961ed48a4f45447f0e0ad256b040c7ab2d78d9

2015-08-11 Thread andrewor14
Repository: spark Updated Branches: refs/heads/branch-1.5 725e5c7a4 -> 1067c7369 [HOTFIX] Fix style error caused by ef961ed48a4f45447f0e0ad256b040c7ab2d78d9 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/1067c736 Tree: ht

spark git commit: [HOTFIX] Fix style error caused by 017b5de

2015-08-11 Thread andrewor14
Repository: spark Updated Branches: refs/heads/master 017b5de07 -> 736af95bd [HOTFIX] Fix style error caused by 017b5de Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/736af95b Tree: http://git-wip-us.apache.org/repos/asf/

[2/2] spark git commit: Preparing development version 1.5.0-SNAPSHOT

2015-08-11 Thread pwendell
Preparing development version 1.5.0-SNAPSHOT Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/725e5c7a Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/725e5c7a Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/725

Git Push Summary

2015-08-11 Thread pwendell
Repository: spark Updated Tags: refs/tags/v1.5.0-snapshot-20150811 [created] e9329ef6a - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

[1/2] spark git commit: Preparing Spark release v1.5.0-snapshot-20150811

2015-08-11 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.5 ef961ed48 -> 725e5c7a4 Preparing Spark release v1.5.0-snapshot-20150811 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/e9329ef6 Tree: http://git-wip-us.apache.

spark git commit: [SPARK-8925] [MLLIB] Add @since tags to mllib.util

2015-08-11 Thread meng
Repository: spark Updated Branches: refs/heads/branch-1.5 2273e7432 -> ef961ed48 [SPARK-8925] [MLLIB] Add @since tags to mllib.util Went thru the history of changes the file MLUtils.scala and picked up the version that the change went in. Author: Sudhakar Thota Author: Sudhakar Thota Clos

spark git commit: [SPARK-8925] [MLLIB] Add @since tags to mllib.util

2015-08-11 Thread meng
Repository: spark Updated Branches: refs/heads/master be3e27164 -> 017b5de07 [SPARK-8925] [MLLIB] Add @since tags to mllib.util Went thru the history of changes the file MLUtils.scala and picked up the version that the change went in. Author: Sudhakar Thota Author: Sudhakar Thota Closes #

spark git commit: [SPARK-9788] [MLLIB] Fix LDA Binary Compatibility

2015-08-11 Thread jkbradley
Repository: spark Updated Branches: refs/heads/master 423cdfd83 -> be3e27164 [SPARK-9788] [MLLIB] Fix LDA Binary Compatibility 1. Add “asymmetricDocConcentration” and revert docConcentration changes. If the (internal) doc concentration vector is a single value, “getDocConcentration" re

spark git commit: [SPARK-9788] [MLLIB] Fix LDA Binary Compatibility

2015-08-11 Thread jkbradley
Repository: spark Updated Branches: refs/heads/branch-1.5 cdf781db6 -> 2273e7432 [SPARK-9788] [MLLIB] Fix LDA Binary Compatibility 1. Add “asymmetricDocConcentration” and revert docConcentration changes. If the (internal) doc concentration vector is a single value, “getDocConcentration

spark git commit: Closes #1290 Closes #4934

2015-08-11 Thread meng
Repository: spark Updated Branches: refs/heads/master f16bc68df -> 423cdfd83 Closes #1290 Closes #4934 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/423cdfd8 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/423cdf

spark git commit: [SPARK-9824] [CORE] Fix the issue that InternalAccumulator leaks WeakReference

2015-08-11 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-1.5 eead87ef2 -> cdf781db6 [SPARK-9824] [CORE] Fix the issue that InternalAccumulator leaks WeakReference `InternalAccumulator.create` doesn't call `registerAccumulatorForCleanup` to register itself with ContextCleaner, so `WeakReference`s

spark git commit: [SPARK-9824] [CORE] Fix the issue that InternalAccumulator leaks WeakReference

2015-08-11 Thread rxin
Repository: spark Updated Branches: refs/heads/master 00c02728a -> f16bc68df [SPARK-9824] [CORE] Fix the issue that InternalAccumulator leaks WeakReference `InternalAccumulator.create` doesn't call `registerAccumulatorForCleanup` to register itself with ContextCleaner, so `WeakReference`s for

spark git commit: [SPARK-9814] [SQL] EqualNotNull not passing to data sources

2015-08-11 Thread rxin
Repository: spark Updated Branches: refs/heads/master 2a3be4ddf -> 00c02728a [SPARK-9814] [SQL] EqualNotNull not passing to data sources Author: hyukjinkwon Author: 권혁진 Closes #8096 from HyukjinKwon/master. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://gi

spark git commit: [SPARK-9814] [SQL] EqualNotNull not passing to data sources

2015-08-11 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-1.5 e9d1eab92 -> eead87ef2 [SPARK-9814] [SQL] EqualNotNull not passing to data sources Author: hyukjinkwon Author: 권혁진 Closes #8096 from HyukjinKwon/master. (cherry picked from commit 00c02728a6c6c4282c389ca90641dd78dd5e3d32) Sign

spark git commit: [SPARK-7726] Add import so Scaladoc doesn't fail.

2015-08-11 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-1.5 811d23f1c -> e9d1eab92 [SPARK-7726] Add import so Scaladoc doesn't fail. This is another import needed so Scala 2.11 doc generation doesn't fail. See SPARK-7726 for more detail. I tested this locally and the 2.11 install goes from faili

spark git commit: [SPARK-7726] Add import so Scaladoc doesn't fail.

2015-08-11 Thread rxin
Repository: spark Updated Branches: refs/heads/master 520ad44b1 -> 2a3be4ddf [SPARK-7726] Add import so Scaladoc doesn't fail. This is another import needed so Scala 2.11 doc generation doesn't fail. See SPARK-7726 for more detail. I tested this locally and the 2.11 install goes from failing t

spark git commit: [SPARK-9750] [MLLIB] Improve equals on SparseMatrix and DenseMatrix

2015-08-11 Thread jkbradley
Repository: spark Updated Branches: refs/heads/branch-1.5 767ee1884 -> 811d23f1c [SPARK-9750] [MLLIB] Improve equals on SparseMatrix and DenseMatrix Adds unit test for `equals` on `mllib.linalg.Matrix` class and `equals` to both `SparseMatrix` and `DenseMatrix`. Supports equality testing betw

spark git commit: [SPARK-9750] [MLLIB] Improve equals on SparseMatrix and DenseMatrix

2015-08-11 Thread jkbradley
Repository: spark Updated Branches: refs/heads/master 5831294a7 -> 520ad44b1 [SPARK-9750] [MLLIB] Improve equals on SparseMatrix and DenseMatrix Adds unit test for `equals` on `mllib.linalg.Matrix` class and `equals` to both `SparseMatrix` and `DenseMatrix`. Supports equality testing between

[1/2] spark git commit: [SPARK-9646] [SQL] Add metrics for all join and aggregate operators

2015-08-11 Thread yhuai
Repository: spark Updated Branches: refs/heads/master 5b8bb1b21 -> 5831294a7 http://git-wip-us.apache.org/repos/asf/spark/blob/5831294a/sql/core/src/test/scala/org/apache/spark/sql/execution/metric/SQLMetricsSuite.scala -- diff

[2/2] spark git commit: [SPARK-9646] [SQL] Add metrics for all join and aggregate operators

2015-08-11 Thread yhuai
[SPARK-9646] [SQL] Add metrics for all join and aggregate operators This PR added metrics for all join and aggregate operators. However, I found the metrics may be confusing in the following two case: 1. The iterator is not totally consumed and the metric values will be less. 2. Recreating the it

[2/2] spark git commit: [SPARK-9646] [SQL] Add metrics for all join and aggregate operators

2015-08-11 Thread yhuai
[SPARK-9646] [SQL] Add metrics for all join and aggregate operators This PR added metrics for all join and aggregate operators. However, I found the metrics may be confusing in the following two case: 1. The iterator is not totally consumed and the metric values will be less. 2. Recreating the it

[1/2] spark git commit: [SPARK-9646] [SQL] Add metrics for all join and aggregate operators

2015-08-11 Thread yhuai
Repository: spark Updated Branches: refs/heads/branch-1.5 71460b889 -> 767ee1884 http://git-wip-us.apache.org/repos/asf/spark/blob/767ee188/sql/core/src/test/scala/org/apache/spark/sql/execution/metric/SQLMetricsSuite.scala --

spark git commit: [SPARK-9572] [STREAMING] [PYSPARK] Added StreamingContext.getActiveOrCreate() in Python

2015-08-11 Thread tdas
Repository: spark Updated Branches: refs/heads/branch-1.5 b077f36ea -> 71460b889 [SPARK-9572] [STREAMING] [PYSPARK] Added StreamingContext.getActiveOrCreate() in Python Author: Tathagata Das Closes #8080 from tdas/SPARK-9572 and squashes the following commits: 64a231d [Tathagata Das] Fix b

spark git commit: [SPARK-9572] [STREAMING] [PYSPARK] Added StreamingContext.getActiveOrCreate() in Python

2015-08-11 Thread tdas
Repository: spark Updated Branches: refs/heads/master dbd778d84 -> 5b8bb1b21 [SPARK-9572] [STREAMING] [PYSPARK] Added StreamingContext.getActiveOrCreate() in Python Author: Tathagata Das Closes #8080 from tdas/SPARK-9572 and squashes the following commits: 64a231d [Tathagata Das] Fix based

spark git commit: [SPARK-8764] [ML] string indexer should take option to handle unseen values

2015-08-11 Thread jkbradley
Repository: spark Updated Branches: refs/heads/master 8cad854ef -> dbd778d84 [SPARK-8764] [ML] string indexer should take option to handle unseen values As a precursor to adding a public constructor add an option to handle unseen values by skipping rather than throwing an exception (default r

spark git commit: [SPARK-8345] [ML] Add an SQL node as a feature transformer

2015-08-11 Thread meng
Repository: spark Updated Branches: refs/heads/master bce72797f -> 8cad854ef [SPARK-8345] [ML] Add an SQL node as a feature transformer Implements the transforms which are defined by SQL statement. Currently we only support SQL syntax like 'SELECT ... FROM __THIS__' where '__THIS__' represents

spark git commit: Fix comment error

2015-08-11 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-1.5 efcae3a70 -> b077f36ea Fix comment error API is updated but its doc comment is not updated. Author: Jeff Zhang Closes #8097 from zjffdu/dev. (cherry picked from commit bce72797f3499f14455722600b0d0898d4fd87c9) Signed-off-by: Reynold

spark git commit: Fix comment error

2015-08-11 Thread rxin
Repository: spark Updated Branches: refs/heads/master dfe347d2c -> bce72797f Fix comment error API is updated but its doc comment is not updated. Author: Jeff Zhang Closes #8097 from zjffdu/dev. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.or

spark git commit: [SPARK-9785] [SQL] HashPartitioning compatibility should consider expression ordering

2015-08-11 Thread yhuai
Repository: spark Updated Branches: refs/heads/branch-1.5 84ba990f2 -> efcae3a70 [SPARK-9785] [SQL] HashPartitioning compatibility should consider expression ordering HashPartitioning compatibility is currently defined w.r.t the _set_ of expressions, but the ordering of those expressions mat

spark git commit: [SPARK-9785] [SQL] HashPartitioning compatibility should consider expression ordering

2015-08-11 Thread yhuai
Repository: spark Updated Branches: refs/heads/master d378396f8 -> dfe347d2c [SPARK-9785] [SQL] HashPartitioning compatibility should consider expression ordering HashPartitioning compatibility is currently defined w.r.t the _set_ of expressions, but the ordering of those expressions matters

[1/2] spark git commit: [SPARK-9815] Rename PlatformDependent.UNSAFE -> Platform.

2015-08-11 Thread davies
Repository: spark Updated Branches: refs/heads/master 600031ebe -> d378396f8 http://git-wip-us.apache.org/repos/asf/spark/blob/d378396f/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/stringOperations.scala --

[1/2] spark git commit: [SPARK-9815] Rename PlatformDependent.UNSAFE -> Platform.

2015-08-11 Thread davies
Repository: spark Updated Branches: refs/heads/branch-1.5 ebbd3b616 -> 84ba990f2 http://git-wip-us.apache.org/repos/asf/spark/blob/84ba990f/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/stringOperations.scala --

[2/2] spark git commit: [SPARK-9815] Rename PlatformDependent.UNSAFE -> Platform.

2015-08-11 Thread davies
[SPARK-9815] Rename PlatformDependent.UNSAFE -> Platform. PlatformDependent.UNSAFE is way too verbose. Author: Reynold Xin Closes #8094 from rxin/SPARK-9815 and squashes the following commits: 229b603 [Reynold Xin] [SPARK-9815] Rename PlatformDependent.UNSAFE -> Platform. Project: http://git

[2/2] spark git commit: [SPARK-9815] Rename PlatformDependent.UNSAFE -> Platform.

2015-08-11 Thread davies
[SPARK-9815] Rename PlatformDependent.UNSAFE -> Platform. PlatformDependent.UNSAFE is way too verbose. Author: Reynold Xin Closes #8094 from rxin/SPARK-9815 and squashes the following commits: 229b603 [Reynold Xin] [SPARK-9815] Rename PlatformDependent.UNSAFE -> Platform. (cherry picked from

spark git commit: [SPARK-9727] [STREAMING] [BUILD] Updated streaming kinesis SBT project name to be more consistent

2015-08-11 Thread tdas
Repository: spark Updated Branches: refs/heads/branch-1.5 c7f009040 -> ebbd3b616 [SPARK-9727] [STREAMING] [BUILD] Updated streaming kinesis SBT project name to be more consistent Author: Tathagata Das Closes #8092 from tdas/SPARK-9727 and squashes the following commits: b1b01fd [Tathagata

spark git commit: [SPARK-9727] [STREAMING] [BUILD] Updated streaming kinesis SBT project name to be more consistent

2015-08-11 Thread tdas
Repository: spark Updated Branches: refs/heads/master 55752d883 -> 600031ebe [SPARK-9727] [STREAMING] [BUILD] Updated streaming kinesis SBT project name to be more consistent Author: Tathagata Das Closes #8092 from tdas/SPARK-9727 and squashes the following commits: b1b01fd [Tathagata Das]

spark git commit: [SPARK-9810] [BUILD] Remove individual commit messages from the squash commit message

2015-08-11 Thread rxin
Repository: spark Updated Branches: refs/heads/master 0f90d6055 -> 55752d883 [SPARK-9810] [BUILD] Remove individual commit messages from the squash commit message For more information, please see the JIRA ticket and the associated dev list discussion. https://issues.apache.org/jira/browse/S