[2/2] spark git commit: Preparing development version 1.4.0-SNAPSHOT

Preparing development version 1.4.0-SNAPSHOT Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/6bf5a420 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/6bf5a420 Diff:

Git Push Summary

Repository: spark Updated Tags: refs/tags/v1.4.0-rc3 [created] f2796816b - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

[1/2] spark git commit: Preparing Spark release v1.4.0-rc3

Repository: spark Updated Branches: refs/heads/branch-1.4 55dc7a693 - 6bf5a4208 Preparing Spark release v1.4.0-rc3 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/f2796816 Tree:

spark git commit: [SPARK-7912] [SPARK-7921] [MLLIB] Update OneHotEncoder to handle ML attributes and change includeFirst to dropLast

Repository: spark Updated Branches: refs/heads/branch-1.4 6bf5a4208 - 509a7cafc [SPARK-7912] [SPARK-7921] [MLLIB] Update OneHotEncoder to handle ML attributes and change includeFirst to dropLast This PR contains two major changes to `OneHotEncoder`: 1. more robust handling of ML attributes.

spark git commit: [SPARK-7912] [SPARK-7921] [MLLIB] Update OneHotEncoder to handle ML attributes and change includeFirst to dropLast

Repository: spark Updated Branches: refs/heads/master 97a60cf75 - 23452be94 [SPARK-7912] [SPARK-7921] [MLLIB] Update OneHotEncoder to handle ML attributes and change includeFirst to dropLast This PR contains two major changes to `OneHotEncoder`: 1. more robust handling of ML attributes. If

spark git commit: [SPARK-7929] Turn whitespace checker on for more token types.

Repository: spark Updated Branches: refs/heads/branch-1.4 119c93af9 - 55dc7a693 [SPARK-7929] Turn whitespace checker on for more token types. This is the last batch of changes to complete SPARK-7929. Previous related PRs: https://github.com/apache/spark/pull/6480

spark git commit: [SPARK-7929] Turn whitespace checker on for more token types.

Repository: spark Updated Branches: refs/heads/master 36067ce39 - 97a60cf75 [SPARK-7929] Turn whitespace checker on for more token types. This is the last batch of changes to complete SPARK-7929. Previous related PRs: https://github.com/apache/spark/pull/6480

Git Push Summary

Repository: spark Updated Tags: refs/tags/v1.4.0-rc3 [deleted] 2d97d7a0a - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

spark git commit: [SPARK-7863] [CORE] Create SimpleDateFormat for every SimpleDateParam instance because it's not thread-safe

Repository: spark Updated Branches: refs/heads/master bf4658070 - 8db40f671 [SPARK-7863] [CORE] Create SimpleDateFormat for every SimpleDateParam instance because it's not thread-safe SimpleDateFormat is not thread-safe. This PR creates new `SimpleDateFormat` for each `SimpleDateParam`

spark git commit: [SPARK-7756] [CORE] Use testing cipher suites common to Oracle and IBM security providers

Repository: spark Updated Branches: refs/heads/master 23452be94 - bf4658070 [SPARK-7756] [CORE] Use testing cipher suites common to Oracle and IBM security providers Add alias names for supported cipher suites to the sample SSL configuration. The IBM JSSE provider reports its cipher suite

spark git commit: [SPARK-7756] [CORE] Use testing cipher suites common to Oracle and IBM security providers

Repository: spark Updated Branches: refs/heads/branch-1.4 509a7cafc - 459c3d22e [SPARK-7756] [CORE] Use testing cipher suites common to Oracle and IBM security providers Add alias names for supported cipher suites to the sample SSL configuration. The IBM JSSE provider reports its cipher

Git Push Summary

Repository: spark Updated Tags: refs/tags/v1.4.0-rc3 [deleted] f2796816b - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

spark git commit: [SPARK-7524] [SPARK-7846] add configs for keytab and principal, pass these two configs with different way in different modes

Repository: spark Updated Branches: refs/heads/master 8db40f671 - a51b133de [SPARK-7524] [SPARK-7846] add configs for keytab and principal, pass these two configs with different way in different modes * As spark now supports long running service by updating tokens for namenode, but only

spark git commit: HOTFIX: Scala style checker failure due to a missing space in TachyonBlockManager.scala.

Repository: spark Updated Branches: refs/heads/branch-1.4 459c3d22e - 23bd05fff HOTFIX: Scala style checker failure due to a missing space in TachyonBlockManager.scala. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit:

spark git commit: [SPARK-7946] [MLLIB] DecayFactor wrongly set in StreamingKMeans

Repository: spark Updated Branches: refs/heads/master 4782e1304 - 6181937f3 [SPARK-7946] [MLLIB] DecayFactor wrongly set in StreamingKMeans Author: MechCoder manojkumarsivaraj...@gmail.com Closes #6497 from MechCoder/spark-7946 and squashes the following commits: 2fdd0a3 [MechCoder] Add

spark git commit: [SPARK-7946] [MLLIB] DecayFactor wrongly set in StreamingKMeans

Repository: spark Updated Branches: refs/heads/branch-1.4 645e61164 - 4be701aa5 [SPARK-7946] [MLLIB] DecayFactor wrongly set in StreamingKMeans Author: MechCoder manojkumarsivaraj...@gmail.com Closes #6497 from MechCoder/spark-7946 and squashes the following commits: 2fdd0a3 [MechCoder] Add

spark git commit: [SPARK-7946] [MLLIB] DecayFactor wrongly set in StreamingKMeans

Repository: spark Updated Branches: refs/heads/branch-1.3 d09a053ec - ad5daa3a3 [SPARK-7946] [MLLIB] DecayFactor wrongly set in StreamingKMeans Author: MechCoder manojkumarsivaraj...@gmail.com Closes #6497 from MechCoder/spark-7946 and squashes the following commits: 2fdd0a3 [MechCoder] Add

spark git commit: [SPARK-7950] [SQL] Sets spark.sql.hive.version in HiveThriftServer2.startWithContext()

Repository: spark Updated Branches: refs/heads/master a51b133de - e7b617755 [SPARK-7950] [SQL] Sets spark.sql.hive.version in HiveThriftServer2.startWithContext() When starting `HiveThriftServer2` via `startWithContext`, property `spark.sql.hive.version` isn't set. This causes Simba ODBC

spark git commit: [SPARK-7950] [SQL] Sets spark.sql.hive.version in HiveThriftServer2.startWithContext()

Repository: spark Updated Branches: refs/heads/branch-1.4 23bd05fff - caea7a618 [SPARK-7950] [SQL] Sets spark.sql.hive.version in HiveThriftServer2.startWithContext() When starting `HiveThriftServer2` via `startWithContext`, property `spark.sql.hive.version` isn't set. This causes Simba

spark git commit: HOTFIX: Scala style checker for DataTypeSuite.scala.

Repository: spark Updated Branches: refs/heads/branch-1.4 caea7a618 - 62df047a3 HOTFIX: Scala style checker for DataTypeSuite.scala. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/62df047a Tree:

spark git commit: [SPARK-7946] [MLLIB] DecayFactor wrongly set in StreamingKMeans

Repository: spark Updated Branches: refs/heads/branch-1.2 c0a0eaacc - aefb113c8 [SPARK-7946] [MLLIB] DecayFactor wrongly set in StreamingKMeans Author: MechCoder manojkumarsivaraj...@gmail.com Closes #6497 from MechCoder/spark-7946 and squashes the following commits: 2fdd0a3 [MechCoder] Add

spark git commit: [SPARK-7954] [SPARKR] Create SparkContext in sparkRSQL init

Repository: spark Updated Branches: refs/heads/branch-1.4 cf4122e4d - 2bd446054 [SPARK-7954] [SPARKR] Create SparkContext in sparkRSQL init cc davies Author: Shivaram Venkataraman shiva...@cs.berkeley.edu Closes #6507 from shivaram/sparkr-init and squashes the following commits: 6fdd169

spark git commit: [SPARK-6013] [ML] Add more Python ML examples for spark.ml

Repository: spark Updated Branches: refs/heads/branch-1.4 2bd446054 - 9a88be183 [SPARK-6013] [ML] Add more Python ML examples for spark.ml Author: Ram Sriharsha rsriharsha@hw11853.local Closes #6443 from harsha2010/SPARK-6013 and squashes the following commits: 732506e [Ram Sriharsha] Code

spark git commit: [SPARK-6013] [ML] Add more Python ML examples for spark.ml

Repository: spark Updated Branches: refs/heads/master 5fb97dca9 - dbf8ff38d [SPARK-6013] [ML] Add more Python ML examples for spark.ml Author: Ram Sriharsha rsriharsha@hw11853.local Closes #6443 from harsha2010/SPARK-6013 and squashes the following commits: 732506e [Ram Sriharsha] Code

spark git commit: [HOT FIX] [BUILD] Fix maven build failures

Repository: spark Updated Branches: refs/heads/master 8c9979337 - a4f24123d [HOT FIX] [BUILD] Fix maven build failures This patch fixes a build break in maven caused by #6441. Note that this patch reverts the changes in flume-sink because this module does not currently depend on Spark core,

spark git commit: [SPARK-7910] [TINY] [JAVAAPI] expose partitioner information in javardd

Repository: spark Updated Branches: refs/heads/master 1c5b19827 - 82a396c2f [SPARK-7910] [TINY] [JAVAAPI] expose partitioner information in javardd Author: Holden Karau hol...@pigscanfly.ca Closes #6464 from holdenk/SPARK-7910-expose-partitioner-information-in-javardd and squashes the

spark git commit: [SPARK-7954] [SPARKR] Create SparkContext in sparkRSQL init

Repository: spark Updated Branches: refs/heads/master 82a396c2f - 5fb97dca9 [SPARK-7954] [SPARKR] Create SparkContext in sparkRSQL init cc davies Author: Shivaram Venkataraman shiva...@cs.berkeley.edu Closes #6507 from shivaram/sparkr-init and squashes the following commits: 6fdd169

spark git commit: [HOTFIX] [SQL] Maven test compilation issue

Repository: spark Updated Branches: refs/heads/master dbf8ff38d - 8c9979337 [HOTFIX] [SQL] Maven test compilation issue Tests compile in SBT but not Maven. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/8c997933 Tree:

spark git commit: [SPARK-7558] Guard against direct uses of FunSuite / FunSuiteLike

Repository: spark Updated Branches: refs/heads/master 7ed06c399 - 609c4923f [SPARK-7558] Guard against direct uses of FunSuite / FunSuiteLike This is a follow-up patch to #6441. Author: Andrew Or and...@databricks.com Closes #6510 from andrewor14/extends-funsuite-check and squashes the

spark git commit: [DOCS][Tiny] Added a missing dash(-) in docs/configuration.md

Repository: spark Updated Branches: refs/heads/master a4f24123d - 3792d2583 [DOCS][Tiny] Added a missing dash(-) in docs/configuration.md The first line had only two dashes (--) instead of three(---). Because of this missing dash(-), 'jekyll build' command was not converting configuration.md

spark git commit: [SPARK-7957] Preserve partitioning when using randomSplit

Repository: spark Updated Branches: refs/heads/master 3792d2583 - 7ed06c399 [SPARK-7957] Preserve partitioning when using randomSplit cc JoshRosen Thanks for noticing this! Author: Burak Yavuz brk...@gmail.com Closes #6509 from brkyvz/sample-perf-reg and squashes the following commits:

spark git commit: [SPARK-7957] Preserve partitioning when using randomSplit

Repository: spark Updated Branches: refs/heads/branch-1.4 400e6dbce - 1513cffa3 [SPARK-7957] Preserve partitioning when using randomSplit cc JoshRosen Thanks for noticing this! Author: Burak Yavuz brk...@gmail.com Closes #6509 from brkyvz/sample-perf-reg and squashes the following commits:

spark git commit: [DOCS][Tiny] Added a missing dash(-) in docs/configuration.md

Repository: spark Updated Branches: refs/heads/branch-1.4 9a88be183 - 400e6dbce [DOCS][Tiny] Added a missing dash(-) in docs/configuration.md The first line had only two dashes (--) instead of three(---). Because of this missing dash(-), 'jekyll build' command was not converting

Git Push Summary

Repository: spark Updated Tags: refs/tags/v1.4.0-rc3 [created] fb60503ff - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

[6/6] spark git commit: [SPARK-7558] Demarcate tests in unit-tests.log

[SPARK-7558] Demarcate tests in unit-tests.log Right now `unit-tests.log` are not of much value because we can't tell where the test boundaries are easily. This patch adds log statements before and after each test to outline the test boundaries, e.g.: ``` = TEST OUTPUT FOR

[4/6] spark git commit: [SPARK-7558] Demarcate tests in unit-tests.log

http://git-wip-us.apache.org/repos/asf/spark/blob/9eb222c1/core/src/test/scala/org/apache/spark/util/collection/AppendOnlyMapSuite.scala -- diff --git

[1/6] spark git commit: [SPARK-7558] Demarcate tests in unit-tests.log

Repository: spark Updated Branches: refs/heads/master 94f62a497 - 9eb222c13 http://git-wip-us.apache.org/repos/asf/spark/blob/9eb222c1/yarn/src/test/scala/org/apache/spark/deploy/yarn/YarnAllocatorSuite.scala -- diff --git

[2/6] spark git commit: [SPARK-7558] Demarcate tests in unit-tests.log

http://git-wip-us.apache.org/repos/asf/spark/blob/9eb222c1/repl/scala-2.11/src/test/scala/org/apache/spark/repl/ReplSuite.scala -- diff --git a/repl/scala-2.11/src/test/scala/org/apache/spark/repl/ReplSuite.scala

[5/6] spark git commit: [SPARK-7558] Demarcate tests in unit-tests.log

http://git-wip-us.apache.org/repos/asf/spark/blob/9eb222c1/core/src/test/scala/org/apache/spark/network/netty/NettyBlockTransferSecuritySuite.scala -- diff --git

[3/6] spark git commit: [SPARK-7558] Demarcate tests in unit-tests.log

http://git-wip-us.apache.org/repos/asf/spark/blob/9eb222c1/mllib/src/test/scala/org/apache/spark/ml/regression/RandomForestRegressorSuite.scala -- diff --git

spark git commit: Revert [SQL] [TEST] [MINOR] Uses a temporary log4j.properties in HiveThriftServer2Test to ensure expected logging behavior

Repository: spark Updated Branches: refs/heads/branch-1.4 c68abaa34 - 18811ca20 Revert [SQL] [TEST] [MINOR] Uses a temporary log4j.properties in HiveThriftServer2Test to ensure expected logging behavior This reverts commit 645e611644be3f62ef07e4ca7628bf298349d9a6. Project:

Git Push Summary

Repository: spark Updated Tags: refs/tags/v1.4.0-rc3 [deleted] fb60503ff - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

Git Push Summary

Repository: spark Updated Tags: refs/tags/v1.4.0-rc3 [created] dd109a874 - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

[2/2] spark git commit: Preparing development version 1.4.0-SNAPSHOT

Preparing development version 1.4.0-SNAPSHOT Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/e549874c Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/e549874c Diff:

spark git commit: [SPARK-7940] Enforce whitespace checking for DO, TRY, CATCH, FINALLY, MATCH, LARROW, RARROW in style checker.

Repository: spark Updated Branches: refs/heads/branch-1.4 e549874c3 - f40605f06 [SPARK-7940] Enforce whitespace checking for DO, TRY, CATCH, FINALLY, MATCH, LARROW, RARROW in style checker. … Author: Reynold Xin r...@databricks.com Closes #6491 from rxin/more-whitespace and squashes the

spark git commit: [SPARK-7940] Enforce whitespace checking for DO, TRY, CATCH, FINALLY, MATCH, LARROW, RARROW in style checker.

Repository: spark Updated Branches: refs/heads/master 6181937f3 - 94f62a497 [SPARK-7940] Enforce whitespace checking for DO, TRY, CATCH, FINALLY, MATCH, LARROW, RARROW in style checker. … Author: Reynold Xin r...@databricks.com Closes #6491 from rxin/more-whitespace and squashes the

[2/2] spark git commit: Preparing development version 1.4.0-SNAPSHOT

Preparing development version 1.4.0-SNAPSHOT Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/c68abaa3 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/c68abaa3 Diff:

[1/2] spark git commit: Preparing Spark release v1.4.0-rc3

Repository: spark Updated Branches: refs/heads/branch-1.4 18811ca20 - e549874c3 Preparing Spark release v1.4.0-rc3 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/dd109a87 Tree:

spark git commit: [SQL] [TEST] [MINOR] Uses a temporary log4j.properties in HiveThriftServer2Test to ensure expected logging behavior

Repository: spark Updated Branches: refs/heads/branch-1.4 62df047a3 - 645e61164 [SQL] [TEST] [MINOR] Uses a temporary log4j.properties in HiveThriftServer2Test to ensure expected logging behavior The `HiveThriftServer2Test` relies on proper logging behavior to assert whether the Thrift

spark git commit: [SQL] [TEST] [MINOR] Uses a temporary log4j.properties in HiveThriftServer2Test to ensure expected logging behavior

Repository: spark Updated Branches: refs/heads/master e7b617755 - 4782e1304 [SQL] [TEST] [MINOR] Uses a temporary log4j.properties in HiveThriftServer2Test to ensure expected logging behavior The `HiveThriftServer2Test` relies on proper logging behavior to assert whether the Thrift server

[1/2] spark git commit: Preparing Spark release v1.4.0-rc3

Repository: spark Updated Branches: refs/heads/branch-1.4 4be701aa5 - c68abaa34 Preparing Spark release v1.4.0-rc3 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/fb60503f Tree:

spark git commit: [SPARK-6806] [SPARKR] [DOCS] Add a new SparkR programming guide

Repository: spark Updated Branches: refs/heads/master 9eb222c13 - 5f48e5c33 [SPARK-6806] [SPARKR] [DOCS] Add a new SparkR programming guide This PR adds a new SparkR programming guide at the top-level. This will be useful for R users as our APIs don't directly match the Scala/Python APIs and

spark git commit: [SPARK-6806] [SPARKR] [DOCS] Add a new SparkR programming guide

Repository: spark Updated Branches: refs/heads/branch-1.4 f40605f06 - cf4122e4d [SPARK-6806] [SPARKR] [DOCS] Add a new SparkR programming guide This PR adds a new SparkR programming guide at the top-level. This will be useful for R users as our APIs don't directly match the Scala/Python APIs

[2/2] spark git commit: [SPARK-7899] [PYSPARK] Fix Python 3 pyspark/sql/types module conflict

[SPARK-7899] [PYSPARK] Fix Python 3 pyspark/sql/types module conflict This PR makes the types module in `pyspark/sql/types` work with pylint static analysis by removing the dynamic naming of the `pyspark/sql/_types` module to `pyspark/sql/types`. Tests are now loaded using

[1/2] spark git commit: [SPARK-7899] [PYSPARK] Fix Python 3 pyspark/sql/types module conflict

Repository: spark Updated Branches: refs/heads/master 5f48e5c33 - 1c5b19827 http://git-wip-us.apache.org/repos/asf/spark/blob/1c5b1982/python/pyspark/sql/types.py -- diff --git a/python/pyspark/sql/types.py