spark git commit: [SPARK-9010] [DOCUMENTATION] Improve the Spark Configuration document about `spark.kryoserializer.buffer`

Repository: spark Updated Branches: refs/heads/master 20c1434a8 - c1feebd8f [SPARK-9010] [DOCUMENTATION] Improve the Spark Configuration document about `spark.kryoserializer.buffer` The meaning of spark.kryoserializer.buffer should be Initial size of Kryo's serialization buffer. Note that

spark git commit: [SPARK-9010] [DOCUMENTATION] Improve the Spark Configuration document about `spark.kryoserializer.buffer`

Repository: spark Updated Branches: refs/heads/branch-1.4 50607eca5 - dce68ad1a [SPARK-9010] [DOCUMENTATION] Improve the Spark Configuration document about `spark.kryoserializer.buffer` The meaning of spark.kryoserializer.buffer should be Initial size of Kryo's serialization buffer. Note

spark git commit: [SPARK-9001] Fixing errors in javadocs that lead to failed build/sbt doc

Repository: spark Updated Branches: refs/heads/master 408b384de - 20c1434a8 [SPARK-9001] Fixing errors in javadocs that lead to failed build/sbt doc These are minor corrections in the documentation of several classes that are preventing: ```bash build/sbt publish-local ``` I believe this

spark git commit: [SPARK-6851] [SQL] function least/greatest follow up

Repository: spark Updated Branches: refs/heads/master c1feebd8f - 257236c3e [SPARK-6851] [SQL] function least/greatest follow up This is a follow up of remaining comments from #6851 Author: Daoyuan Wang daoyuan.w...@intel.com Closes #7387 from adrian-wang/udflgfollow and squashes the

spark git commit: [SPARK-9029] [SQL] shortcut CaseKeyWhen if key is null

Repository: spark Updated Branches: refs/heads/master 257236c3e - 59d820aa8 [SPARK-9029] [SQL] shortcut CaseKeyWhen if key is null Author: Wenchen Fan cloud0...@outlook.com Closes #7389 from cloud-fan/case-when and squashes the following commits: ea4b6ba [Wenchen Fan] shortcut for case key

spark git commit: [SPARK-9027] [SQL] Generalize metastore predicate pushdown

Repository: spark Updated Branches: refs/heads/master 59d820aa8 - 37f2d9635 [SPARK-9027] [SQL] Generalize metastore predicate pushdown Add support for pushing down metastore filters that are in different orders and add some unit tests. Author: Michael Armbrust mich...@databricks.com Closes

spark git commit: [SPARK-8718] [GRAPHX] Improve EdgePartition2D for non perfect square number of partitions

Repository: spark Updated Branches: refs/heads/master d267c2834 - 0a4071eab [SPARK-8718] [GRAPHX] Improve EdgePartition2D for non perfect square number of partitions See https://github.com/aray/e2d/blob/master/EdgePartition2D.ipynb Author: Andrew Ray ray.and...@gmail.com Closes #7104 from

spark git commit: [SPARK-4072] [CORE] Display Streaming blocks in Streaming UI

Repository: spark Updated Branches: refs/heads/master 0a4071eab - fb1d06fc2 [SPARK-4072] [CORE] Display Streaming blocks in Streaming UI Replace #6634 This PR adds `SparkListenerBlockUpdated` to SparkListener so that it can monitor all block update infos that are sent to

spark git commit: [SPARK-4362] [MLLIB] Make prediction probability available in NaiveBayesModel

Repository: spark Updated Branches: refs/heads/master 4b5cfc988 - 740b034f1 [SPARK-4362] [MLLIB] Make prediction probability available in NaiveBayesModel Add predictProbabilities to Naive Bayes, return class probabilities. Continues https://github.com/apache/spark/pull/6761 Author: Sean

spark git commit: [SPARK-9031] Merge BlockObjectWriter and DiskBlockObject writer to remove abstract class

Repository: spark Updated Branches: refs/heads/master 8fb3a65cb - d267c2834 [SPARK-9031] Merge BlockObjectWriter and DiskBlockObject writer to remove abstract class BlockObjectWriter has only one concrete non-test class, DiskBlockObjectWriter. In order to simplify the code in preparation

spark git commit: [SPARK-8911] Fix local mode endless heartbeats

Repository: spark Updated Branches: refs/heads/master c4e98ff06 - 8fb3a65cb [SPARK-8911] Fix local mode endless heartbeats As of #7173 we expect executors to properly register with the driver before responding to their heartbeats. This behavior is not matched in local mode. This patch adds

spark git commit: [SPARK-8800] [SQL] Fix inaccurate precision/scale of Decimal division operation

Repository: spark Updated Branches: refs/heads/master fb1d06fc2 - 4b5cfc988 [SPARK-8800] [SQL] Fix inaccurate precision/scale of Decimal division operation JIRA: https://issues.apache.org/jira/browse/SPARK-8800 Previously, we turn to Java BigDecimal's divide with specified ROUNDING_MODE to

Git Push Summary

Repository: spark Updated Tags: refs/tags/v1.4.1 [created] dbaa5c294 - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

spark git commit: [SPARK-5523] [CORE] [STREAMING] Add a cache for hostname in TaskMetrics to decrease the memory usage and GC overhead

Repository: spark Updated Branches: refs/heads/master f957796c4 - bb870e72f [SPARK-5523] [CORE] [STREAMING] Add a cache for hostname in TaskMetrics to decrease the memory usage and GC overhead Hostname in TaskMetrics will be created through deserialization, mostly the number of hostname is

svn commit: r9826 - /dev/spark/spark-1.4.1-rc4-bin/ /release/spark/spark-1.4.1/

Author: pwendell Date: Wed Jul 15 03:29:55 2015 New Revision: 9826 Log: Spark release 1.4.1 Added: release/spark/spark-1.4.1/ - copied from r9825, dev/spark/spark-1.4.1-rc4-bin/ Removed: dev/spark/spark-1.4.1-rc4-bin/

svn commit: r9825 - in /dev/spark/spark-1.4.1-rc4-bin: spark-1.4.1-bin-hadoop2.4-without-hive.tgz spark-1.4.1-bin-hadoop2.4-without-hive.tgz.asc spark-1.4.1-bin-hadoop2.4-without-hive.tgz.md5 spark-1.

Author: pwendell Date: Wed Jul 15 03:28:40 2015 New Revision: 9825 Log: Removing hive developer build Removed: dev/spark/spark-1.4.1-rc4-bin/spark-1.4.1-bin-hadoop2.4-without-hive.tgz dev/spark/spark-1.4.1-rc4-bin/spark-1.4.1-bin-hadoop2.4-without-hive.tgz.asc

spark git commit: [SPARK-9045] Fix Scala 2.11 build break in UnsafeExternalRowSorter

Repository: spark Updated Branches: refs/heads/master 11e5c3728 - e965a798d [SPARK-9045] Fix Scala 2.11 build break in UnsafeExternalRowSorter This fixes a compilation break in under Scala 2.11: ``` [error]

svn commit: r9824 - /dev/spark/spark-1.4.1-rc4-bin/

Author: pwendell Date: Wed Jul 15 03:25:59 2015 New Revision: 9824 Log: Adding Spark 1.4.1 RC4 Added: dev/spark/spark-1.4.1-rc4-bin/ dev/spark/spark-1.4.1-rc4-bin/spark-1.4.1-bin-cdh4.tgz (with props) dev/spark/spark-1.4.1-rc4-bin/spark-1.4.1-bin-cdh4.tgz.asc (with props)

spark git commit: [SPARK-8962] Add Scalastyle rule to ban direct use of Class.forName; fix existing uses

Repository: spark Updated Branches: refs/heads/master 740b034f1 - 11e5c3728 [SPARK-8962] Add Scalastyle rule to ban direct use of Class.forName; fix existing uses This pull request adds a Scalastyle regex rule which fails the style check if `Class.forName` is used directly. `Class.forName`

spark git commit: [HOTFIX] Adding new names to known contributors

Repository: spark Updated Branches: refs/heads/master bb870e72f - 5572fd0c5 [HOTFIX] Adding new names to known contributors Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/5572fd0c Tree:

spark git commit: [SPARK-8808] [SPARKR] Fix assignments in SparkR.

Repository: spark Updated Branches: refs/heads/master 5572fd0c5 - f650a005e [SPARK-8808] [SPARKR] Fix assignments in SparkR. Author: Sun Rui rui@intel.com Closes #7395 from sun-rui/SPARK-8808 and squashes the following commits: ce603bc [Sun Rui] Use '-' instead of '='. 88590b1 [Sun Rui]

spark git commit: Revert SPARK-6910 and SPARK-9027

Repository: spark Updated Branches: refs/heads/master f23a721c1 - c6b1a9e74 Revert SPARK-6910 and SPARK-9027 Revert #7216 and #7386. These patch seems to be causing quite a few test failures: ``` Caused by: java.lang.reflect.InvocationTargetException at

svn commit: r1691124 - in /spark/site/docs/1.4.1: ./ api/ api/R/ api/java/ api/java/org/ api/java/org/apache/ api/java/org/apache/spark/ api/java/org/apache/spark/annotation/ api/java/org/apache/spark

Author: pwendell Date: Wed Jul 15 04:17:01 2015 New Revision: 1691124 URL: http://svn.apache.org/r1691124 Log: Spark 1.4.1 docs [This commit notification would consist of 734 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-8993][SQL] More comprehensive type checking in expressions.

Repository: spark Updated Branches: refs/heads/master f650a005e - f23a721c1 [SPARK-8993][SQL] More comprehensive type checking in expressions. This patch makes the following changes: 1. ExpectsInputTypes only defines expected input types, but does not perform any implicit type casting. 2.

spark git commit: [SPARK-9050] [SQL] Remove unused newOrdering argument from Exchange (cleanup after SPARK-8317)

Repository: spark Updated Branches: refs/heads/master e965a798d - cc57d705e [SPARK-9050] [SQL] Remove unused newOrdering argument from Exchange (cleanup after SPARK-8317) SPARK-8317 changed the SQL Exchange operator so that it no longer pushed sorting into Spark's shuffle layer, a change

spark git commit: [SPARK-8820] [STREAMING] Add a configuration to set checkpoint dir.

Repository: spark Updated Branches: refs/heads/master cc57d705e - f957796c4 [SPARK-8820] [STREAMING] Add a configuration to set checkpoint dir. Add a configuration to set checkpoint directory for convenience to user. [Jira Address](https://issues.apache.org/jira/browse/SPARK-8820) Author: