spark git commit: [SPARK-12510][STREAMING] Refactor ActorReceiver to support Java

Repository: spark Updated Branches: refs/heads/master 34dbc8af2 -> c0c397509 [SPARK-12510][STREAMING] Refactor ActorReceiver to support Java This PR includes the following changes: 1. Rename `ActorReceiver` to `ActorReceiverSupervisor` 2. Remove `ActorHelper` 3. Add a new `ActorReceiver` for

spark git commit: [SPARK-12604][CORE] Addendum - use casting vs mapValues for countBy{Key, Value}

Repository: spark Updated Branches: refs/heads/master c0c397509 -> 5a4021998 [SPARK-12604][CORE] Addendum - use casting vs mapValues for countBy{Key,Value} Per rxin, let's use the casting for countByKey and countByValue as well. Let's see if this passes. Author: Sean Owen

spark git commit: [STREAMING][DOCS][EXAMPLES] Minor fixes

Repository: spark Updated Branches: refs/heads/master fd1dcfaf2 -> 8113dbda0 [STREAMING][DOCS][EXAMPLES] Minor fixes Author: Jacek Laskowski Closes #10603 from jaceklaskowski/streaming-actor-custom-receiver. Project: http://git-wip-us.apache.org/repos/asf/spark/repo

spark git commit: [SPARK-12507][STREAMING][DOCUMENT] Expose closeFileAfterWrite and allowBatching configurations for Streaming

Repository: spark Updated Branches: refs/heads/branch-1.6 6ef823544 -> a7c36362f [SPARK-12507][STREAMING][DOCUMENT] Expose closeFileAfterWrite and allowBatching configurations for Streaming /cc tdas brkyvz Author: Shixiong Zhu Closes #10453 from

spark git commit: [SPARK-12591][STREAMING] Register OpenHashMapBasedStateMap for Kryo

Repository: spark Updated Branches: refs/heads/master c94199e97 -> 28e0e500a [SPARK-12591][STREAMING] Register OpenHashMapBasedStateMap for Kryo The default serializer in Kryo is FieldSerializer and it ignores transient fields and never calls `writeObject` or `readObject`. So we should

spark git commit: [SPARK-12507][STREAMING][DOCUMENT] Expose closeFileAfterWrite and allowBatching configurations for Streaming

Repository: spark Updated Branches: refs/heads/master 5a4021998 -> c94199e97 [SPARK-12507][STREAMING][DOCUMENT] Expose closeFileAfterWrite and allowBatching configurations for Streaming /cc tdas brkyvz Author: Shixiong Zhu Closes #10453 from

spark git commit: [SPARK-12317][SQL] Support units (m, k, g) in SQLConf

Repository: spark Updated Branches: refs/heads/master 28e0e500a -> 5028a001d [SPARK-12317][SQL] Support units (m,k,g) in SQLConf This PR is continue from previous closed PR 10314. In this PR, SHUFFLE_TARGET_POSTSHUFFLE_INPUT_SIZE will be taken memory string conventions as input. For

spark git commit: Fix indentation for the previous patch.

Repository: spark Updated Branches: refs/heads/master 5028a001d -> 726bd3c4e Fix indentation for the previous patch. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/726bd3c4 Tree:

spark git commit: [SPARK-12006][ML][PYTHON] Fix GMM failure if initialModel is not None

Repository: spark Updated Branches: refs/heads/master 8113dbda0 -> 592f64985 [SPARK-12006][ML][PYTHON] Fix GMM failure if initialModel is not None If initial model passed to GMM is not empty it causes net.razorvine.pickle.PickleException. It can be fixed by converting initialModel.weights

spark git commit: [SPARK-12006][ML][PYTHON] Fix GMM failure if initialModel is not None

Repository: spark Updated Branches: refs/heads/branch-1.4 d4914647a -> 0832530e8 [SPARK-12006][ML][PYTHON] Fix GMM failure if initialModel is not None If initial model passed to GMM is not empty it causes net.razorvine.pickle.PickleException. It can be fixed by converting

spark git commit: [SPARK-12006][ML][PYTHON] Fix GMM failure if initialModel is not None

Repository: spark Updated Branches: refs/heads/branch-1.5 33ab236de -> 7b4fdf303 [SPARK-12006][ML][PYTHON] Fix GMM failure if initialModel is not None If initial model passed to GMM is not empty it causes net.razorvine.pickle.PickleException. It can be fixed by converting

spark git commit: [MINOR] Fix for BUILD FAILURE for Scala 2.11

Repository: spark Updated Branches: refs/heads/master f194d9911 -> 07b314a57 [MINOR] Fix for BUILD FAILURE for Scala 2.11 It was introduced in 917d3fc069fb9ea1c1487119c9c12b373f4f9b77 /cc cloud-fan rxin Author: Jacek Laskowski Closes #10636 from

spark git commit: [SPARK-12662][SQL] Fix DataFrame.randomSplit to avoid creating overlapping splits

Repository: spark Updated Branches: refs/heads/branch-1.6 69a885a71 -> 017b73e69 [SPARK-12662][SQL] Fix DataFrame.randomSplit to avoid creating overlapping splits https://issues.apache.org/jira/browse/SPARK-12662 cc yhuai Author: Sameer Agarwal Closes #10626 from

spark git commit: [SPARK-12580][SQL] Remove string concatenations from usage and extended in @ExpressionDescription

Repository: spark Updated Branches: refs/heads/master 834651835 -> 34dbc8af2 [SPARK-12580][SQL] Remove string concatenations from usage and extended in @ExpressionDescription Use multi-line string literals for ExpressionDescription with ``// scalastyle:off line.size.limit`` and ``//

spark git commit: [SPARK-12598][CORE] bug in setMinPartitions

Repository: spark Updated Branches: refs/heads/master 1b2c2162a -> 834651835 [SPARK-12598][CORE] bug in setMinPartitions There is a bug in the calculation of ```maxSplitSize```. The ```totalLen``` should be divided by ```minPartitions``` and not by ```files.size```. Author: Darek Blasiak

spark git commit: [SPARK-12598][CORE] bug in setMinPartitions

Repository: spark Updated Branches: refs/heads/branch-1.6 017b73e69 -> 6ef823544 [SPARK-12598][CORE] bug in setMinPartitions There is a bug in the calculation of ```maxSplitSize```. The ```totalLen``` should be divided by ```minPartitions``` and not by ```files.size```. Author: Darek

spark git commit: [STREAMING][MINOR] More contextual information in logs + minor code i…

Repository: spark Updated Branches: refs/heads/master 07b314a57 -> 1b2c2162a [STREAMING][MINOR] More contextual information in logs + minor code i… …mprovements Please review and merge at your convenience. Thanks! Author: Jacek Laskowski Closes #10595 from