spark git commit: [SPARK-7962] [MESOS] Fix master url parsing in rest submission client.

Repository: spark Updated Branches: refs/heads/master da2112aef -> 78657d53d [SPARK-7962] [MESOS] Fix master url parsing in rest submission client. Only parse standalone master url when master url starts with spark:// Author: Timothy Chen Closes #6517 from tnachen/fix_mesos_client and squas

spark git commit: [SPARK-7962] [MESOS] Fix master url parsing in rest submission client.

Repository: spark Updated Branches: refs/heads/branch-1.4 11a4b30d1 -> 8938a7489 [SPARK-7962] [MESOS] Fix master url parsing in rest submission client. Only parse standalone master url when master url starts with spark:// Author: Timothy Chen Closes #6517 from tnachen/fix_mesos_client and s

spark git commit: [SPARK-7576] [MLLIB] Add spark.ml user guide doc/example for ElementwiseProduct

Repository: spark Updated Branches: refs/heads/master 193dba01c -> da2112aef [SPARK-7576] [MLLIB] Add spark.ml user guide doc/example for ElementwiseProduct Author: Octavian Geagla Closes #6501 from ogeagla/ml-guide-elemwiseprod and squashes the following commits: 4ad93d5 [Octavian Geagla]

spark git commit: [SPARK-7576] [MLLIB] Add spark.ml user guide doc/example for ElementwiseProduct

Repository: spark Updated Branches: refs/heads/branch-1.4 1513cffa3 -> 11a4b30d1 [SPARK-7576] [MLLIB] Add spark.ml user guide doc/example for ElementwiseProduct Author: Octavian Geagla Closes #6501 from ogeagla/ml-guide-elemwiseprod and squashes the following commits: 4ad93d5 [Octavian Gea

spark git commit: [TRIVIAL] Typo fix for last commit

Repository: spark Updated Branches: refs/heads/master 609c4923f -> 193dba01c [TRIVIAL] Typo fix for last commit Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/193dba01 Tree: http://git-wip-us.apache.org/repos/asf/spark/tr

spark git commit: [SPARK-7558] Guard against direct uses of FunSuite / FunSuiteLike

Repository: spark Updated Branches: refs/heads/master 7ed06c399 -> 609c4923f [SPARK-7558] Guard against direct uses of FunSuite / FunSuiteLike This is a follow-up patch to #6441. Author: Andrew Or Closes #6510 from andrewor14/extends-funsuite-check and squashes the following commits: 6618

spark git commit: [SPARK-7957] Preserve partitioning when using randomSplit

Repository: spark Updated Branches: refs/heads/master 3792d2583 -> 7ed06c399 [SPARK-7957] Preserve partitioning when using randomSplit cc JoshRosen Thanks for noticing this! Author: Burak Yavuz Closes #6509 from brkyvz/sample-perf-reg and squashes the following commits: 497465d [Burak Yavu

spark git commit: [SPARK-7957] Preserve partitioning when using randomSplit

Repository: spark Updated Branches: refs/heads/branch-1.4 400e6dbce -> 1513cffa3 [SPARK-7957] Preserve partitioning when using randomSplit cc JoshRosen Thanks for noticing this! Author: Burak Yavuz Closes #6509 from brkyvz/sample-perf-reg and squashes the following commits: 497465d [Burak

spark git commit: [DOCS][Tiny] Added a missing dash(-) in docs/configuration.md

Repository: spark Updated Branches: refs/heads/master a4f24123d -> 3792d2583 [DOCS][Tiny] Added a missing dash(-) in docs/configuration.md The first line had only two dashes (--) instead of three(---). Because of this missing dash(-), 'jekyll build' command was not converting configuration.md

spark git commit: [DOCS][Tiny] Added a missing dash(-) in docs/configuration.md

Repository: spark Updated Branches: refs/heads/branch-1.4 9a88be183 -> 400e6dbce [DOCS][Tiny] Added a missing dash(-) in docs/configuration.md The first line had only two dashes (--) instead of three(---). Because of this missing dash(-), 'jekyll build' command was not converting configuratio

spark git commit: [HOT FIX] [BUILD] Fix maven build failures

Repository: spark Updated Branches: refs/heads/master 8c9979337 -> a4f24123d [HOT FIX] [BUILD] Fix maven build failures This patch fixes a build break in maven caused by #6441. Note that this patch reverts the changes in flume-sink because this module does not currently depend on Spark core,

spark git commit: [HOTFIX] [SQL] Maven test compilation issue

Repository: spark Updated Branches: refs/heads/master dbf8ff38d -> 8c9979337 [HOTFIX] [SQL] Maven test compilation issue Tests compile in SBT but not Maven. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/8c997933 Tree: h

spark git commit: [SPARK-6013] [ML] Add more Python ML examples for spark.ml

Repository: spark Updated Branches: refs/heads/branch-1.4 2bd446054 -> 9a88be183 [SPARK-6013] [ML] Add more Python ML examples for spark.ml Author: Ram Sriharsha Closes #6443 from harsha2010/SPARK-6013 and squashes the following commits: 732506e [Ram Sriharsha] Code Review Feedback 121c211

spark git commit: [SPARK-6013] [ML] Add more Python ML examples for spark.ml

Repository: spark Updated Branches: refs/heads/master 5fb97dca9 -> dbf8ff38d [SPARK-6013] [ML] Add more Python ML examples for spark.ml Author: Ram Sriharsha Closes #6443 from harsha2010/SPARK-6013 and squashes the following commits: 732506e [Ram Sriharsha] Code Review Feedback 121c211 [Ram

spark git commit: [SPARK-7954] [SPARKR] Create SparkContext in sparkRSQL init

Repository: spark Updated Branches: refs/heads/master 82a396c2f -> 5fb97dca9 [SPARK-7954] [SPARKR] Create SparkContext in sparkRSQL init cc davies Author: Shivaram Venkataraman Closes #6507 from shivaram/sparkr-init and squashes the following commits: 6fdd169 [Shivaram Venkataraman] Create

spark git commit: [SPARK-7954] [SPARKR] Create SparkContext in sparkRSQL init

Repository: spark Updated Branches: refs/heads/branch-1.4 cf4122e4d -> 2bd446054 [SPARK-7954] [SPARKR] Create SparkContext in sparkRSQL init cc davies Author: Shivaram Venkataraman Closes #6507 from shivaram/sparkr-init and squashes the following commits: 6fdd169 [Shivaram Venkataraman] Cr

spark git commit: [SPARK-7910] [TINY] [JAVAAPI] expose partitioner information in javardd

Repository: spark Updated Branches: refs/heads/master 1c5b19827 -> 82a396c2f [SPARK-7910] [TINY] [JAVAAPI] expose partitioner information in javardd Author: Holden Karau Closes #6464 from holdenk/SPARK-7910-expose-partitioner-information-in-javardd and squashes the following commits: de1e6

[2/2] spark git commit: [SPARK-7899] [PYSPARK] Fix Python 3 pyspark/sql/types module conflict

[SPARK-7899] [PYSPARK] Fix Python 3 pyspark/sql/types module conflict This PR makes the types module in `pyspark/sql/types` work with pylint static analysis by removing the dynamic naming of the `pyspark/sql/_types` module to `pyspark/sql/types`. Tests are now loaded using `$PYSPARK_DRIVER_PYTH

[1/2] spark git commit: [SPARK-7899] [PYSPARK] Fix Python 3 pyspark/sql/types module conflict

Repository: spark Updated Branches: refs/heads/master 5f48e5c33 -> 1c5b19827 http://git-wip-us.apache.org/repos/asf/spark/blob/1c5b1982/python/pyspark/sql/types.py -- diff --git a/python/pyspark/sql/types.py b/python/pyspark/sq

spark git commit: [SPARK-6806] [SPARKR] [DOCS] Add a new SparkR programming guide

Repository: spark Updated Branches: refs/heads/branch-1.4 f40605f06 -> cf4122e4d [SPARK-6806] [SPARKR] [DOCS] Add a new SparkR programming guide This PR adds a new SparkR programming guide at the top-level. This will be useful for R users as our APIs don't directly match the Scala/Python APIs

spark git commit: [SPARK-6806] [SPARKR] [DOCS] Add a new SparkR programming guide

Repository: spark Updated Branches: refs/heads/master 9eb222c13 -> 5f48e5c33 [SPARK-6806] [SPARKR] [DOCS] Add a new SparkR programming guide This PR adds a new SparkR programming guide at the top-level. This will be useful for R users as our APIs don't directly match the Scala/Python APIs and

[5/6] spark git commit: [SPARK-7558] Demarcate tests in unit-tests.log

http://git-wip-us.apache.org/repos/asf/spark/blob/9eb222c1/core/src/test/scala/org/apache/spark/network/netty/NettyBlockTransferSecuritySuite.scala -- diff --git a/core/src/test/scala/org/apache/spark/network/netty/NettyBlockTrans

[3/6] spark git commit: [SPARK-7558] Demarcate tests in unit-tests.log

http://git-wip-us.apache.org/repos/asf/spark/blob/9eb222c1/mllib/src/test/scala/org/apache/spark/ml/regression/RandomForestRegressorSuite.scala -- diff --git a/mllib/src/test/scala/org/apache/spark/ml/regression/RandomForestRegres

[2/6] spark git commit: [SPARK-7558] Demarcate tests in unit-tests.log

http://git-wip-us.apache.org/repos/asf/spark/blob/9eb222c1/repl/scala-2.11/src/test/scala/org/apache/spark/repl/ReplSuite.scala -- diff --git a/repl/scala-2.11/src/test/scala/org/apache/spark/repl/ReplSuite.scala b/repl/scala-2.1

[6/6] spark git commit: [SPARK-7558] Demarcate tests in unit-tests.log

[SPARK-7558] Demarcate tests in unit-tests.log Right now `unit-tests.log` are not of much value because we can't tell where the test boundaries are easily. This patch adds log statements before and after each test to outline the test boundaries, e.g.: ``` = TEST OUTPUT FOR o.a.s.serializer.

[4/6] spark git commit: [SPARK-7558] Demarcate tests in unit-tests.log

http://git-wip-us.apache.org/repos/asf/spark/blob/9eb222c1/core/src/test/scala/org/apache/spark/util/collection/AppendOnlyMapSuite.scala -- diff --git a/core/src/test/scala/org/apache/spark/util/collection/AppendOnlyMapSuite.scala

[1/6] spark git commit: [SPARK-7558] Demarcate tests in unit-tests.log

Repository: spark Updated Branches: refs/heads/master 94f62a497 -> 9eb222c13 http://git-wip-us.apache.org/repos/asf/spark/blob/9eb222c1/yarn/src/test/scala/org/apache/spark/deploy/yarn/YarnAllocatorSuite.scala -- diff --git a/

spark git commit: [SPARK-7940] Enforce whitespace checking for DO, TRY, CATCH, FINALLY, MATCH, LARROW, RARROW in style checker.

Repository: spark Updated Branches: refs/heads/branch-1.4 e549874c3 -> f40605f06 [SPARK-7940] Enforce whitespace checking for DO, TRY, CATCH, FINALLY, MATCH, LARROW, RARROW in style checker. … Author: Reynold Xin Closes #6491 from rxin/more-whitespace and squashes the following commits:

spark git commit: [SPARK-7940] Enforce whitespace checking for DO, TRY, CATCH, FINALLY, MATCH, LARROW, RARROW in style checker.

Repository: spark Updated Branches: refs/heads/master 6181937f3 -> 94f62a497 [SPARK-7940] Enforce whitespace checking for DO, TRY, CATCH, FINALLY, MATCH, LARROW, RARROW in style checker. … Author: Reynold Xin Closes #6491 from rxin/more-whitespace and squashes the following commits: f6e

[1/2] spark git commit: Preparing Spark release v1.4.0-rc3

Repository: spark Updated Branches: refs/heads/branch-1.4 18811ca20 -> e549874c3 Preparing Spark release v1.4.0-rc3 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/dd109a87 Tree: http://git-wip-us.apache.org/repos/asf/spar

[2/2] spark git commit: Preparing development version 1.4.0-SNAPSHOT

Preparing development version 1.4.0-SNAPSHOT Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/e549874c Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/e549874c Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/e54

Git Push Summary

Repository: spark Updated Tags: refs/tags/v1.4.0-rc3 [created] dd109a874 - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

Git Push Summary

Repository: spark Updated Tags: refs/tags/v1.4.0-rc3 [deleted] fb60503ff - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

spark git commit: Revert "[SQL] [TEST] [MINOR] Uses a temporary log4j.properties in HiveThriftServer2Test to ensure expected logging behavior"

Repository: spark Updated Branches: refs/heads/branch-1.4 c68abaa34 -> 18811ca20 Revert "[SQL] [TEST] [MINOR] Uses a temporary log4j.properties in HiveThriftServer2Test to ensure expected logging behavior" This reverts commit 645e611644be3f62ef07e4ca7628bf298349d9a6. Project: http://git-wip

[2/2] spark git commit: Preparing development version 1.4.0-SNAPSHOT

Preparing development version 1.4.0-SNAPSHOT Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/c68abaa3 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/c68abaa3 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/c68

[1/2] spark git commit: Preparing Spark release v1.4.0-rc3

Repository: spark Updated Branches: refs/heads/branch-1.4 4be701aa5 -> c68abaa34 Preparing Spark release v1.4.0-rc3 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/fb60503f Tree: http://git-wip-us.apache.org/repos/asf/spar

Git Push Summary

Repository: spark Updated Tags: refs/tags/v1.4.0-rc3 [created] fb60503ff - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

spark git commit: [SPARK-7946] [MLLIB] DecayFactor wrongly set in StreamingKMeans

Repository: spark Updated Branches: refs/heads/branch-1.2 c0a0eaacc -> aefb113c8 [SPARK-7946] [MLLIB] DecayFactor wrongly set in StreamingKMeans Author: MechCoder Closes #6497 from MechCoder/spark-7946 and squashes the following commits: 2fdd0a3 [MechCoder] Add non-regression test 8c988c6 [

spark git commit: [SPARK-7946] [MLLIB] DecayFactor wrongly set in StreamingKMeans

Repository: spark Updated Branches: refs/heads/branch-1.4 645e61164 -> 4be701aa5 [SPARK-7946] [MLLIB] DecayFactor wrongly set in StreamingKMeans Author: MechCoder Closes #6497 from MechCoder/spark-7946 and squashes the following commits: 2fdd0a3 [MechCoder] Add non-regression test 8c988c6 [

spark git commit: [SPARK-7946] [MLLIB] DecayFactor wrongly set in StreamingKMeans

Repository: spark Updated Branches: refs/heads/branch-1.3 d09a053ec -> ad5daa3a3 [SPARK-7946] [MLLIB] DecayFactor wrongly set in StreamingKMeans Author: MechCoder Closes #6497 from MechCoder/spark-7946 and squashes the following commits: 2fdd0a3 [MechCoder] Add non-regression test 8c988c6 [

spark git commit: [SPARK-7946] [MLLIB] DecayFactor wrongly set in StreamingKMeans

Repository: spark Updated Branches: refs/heads/master 4782e1304 -> 6181937f3 [SPARK-7946] [MLLIB] DecayFactor wrongly set in StreamingKMeans Author: MechCoder Closes #6497 from MechCoder/spark-7946 and squashes the following commits: 2fdd0a3 [MechCoder] Add non-regression test 8c988c6 [Mech

spark git commit: [SQL] [TEST] [MINOR] Uses a temporary log4j.properties in HiveThriftServer2Test to ensure expected logging behavior

Repository: spark Updated Branches: refs/heads/master e7b617755 -> 4782e1304 [SQL] [TEST] [MINOR] Uses a temporary log4j.properties in HiveThriftServer2Test to ensure expected logging behavior The `HiveThriftServer2Test` relies on proper logging behavior to assert whether the Thrift server d

spark git commit: [SQL] [TEST] [MINOR] Uses a temporary log4j.properties in HiveThriftServer2Test to ensure expected logging behavior

Repository: spark Updated Branches: refs/heads/branch-1.4 62df047a3 -> 645e61164 [SQL] [TEST] [MINOR] Uses a temporary log4j.properties in HiveThriftServer2Test to ensure expected logging behavior The `HiveThriftServer2Test` relies on proper logging behavior to assert whether the Thrift serv

spark git commit: HOTFIX: Scala style checker for DataTypeSuite.scala.

Repository: spark Updated Branches: refs/heads/branch-1.4 caea7a618 -> 62df047a3 HOTFIX: Scala style checker for DataTypeSuite.scala. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/62df047a Tree: http://git-wip-us.apache.

spark git commit: [SPARK-7950] [SQL] Sets spark.sql.hive.version in HiveThriftServer2.startWithContext()

Repository: spark Updated Branches: refs/heads/branch-1.4 23bd05fff -> caea7a618 [SPARK-7950] [SQL] Sets spark.sql.hive.version in HiveThriftServer2.startWithContext() When starting `HiveThriftServer2` via `startWithContext`, property `spark.sql.hive.version` isn't set. This causes Simba ODB

spark git commit: [SPARK-7950] [SQL] Sets spark.sql.hive.version in HiveThriftServer2.startWithContext()

Repository: spark Updated Branches: refs/heads/master a51b133de -> e7b617755 [SPARK-7950] [SQL] Sets spark.sql.hive.version in HiveThriftServer2.startWithContext() When starting `HiveThriftServer2` via `startWithContext`, property `spark.sql.hive.version` isn't set. This causes Simba ODBC dr

Git Push Summary

Repository: spark Updated Tags: refs/tags/v1.4.0-rc3 [deleted] f2796816b - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

spark git commit: HOTFIX: Scala style checker failure due to a missing space in TachyonBlockManager.scala.

Repository: spark Updated Branches: refs/heads/branch-1.4 459c3d22e -> 23bd05fff HOTFIX: Scala style checker failure due to a missing space in TachyonBlockManager.scala. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/23b

spark git commit: [SPARK-7524] [SPARK-7846] add configs for keytab and principal, pass these two configs with different way in different modes

Repository: spark Updated Branches: refs/heads/master 8db40f671 -> a51b133de [SPARK-7524] [SPARK-7846] add configs for keytab and principal, pass these two configs with different way in different modes * As spark now supports long running service by updating tokens for namenode, but only acc

spark git commit: [SPARK-7863] [CORE] Create SimpleDateFormat for every SimpleDateParam instance because it's not thread-safe

Repository: spark Updated Branches: refs/heads/master bf4658070 -> 8db40f671 [SPARK-7863] [CORE] Create SimpleDateFormat for every SimpleDateParam instance because it's not thread-safe SimpleDateFormat is not thread-safe. This PR creates new `SimpleDateFormat` for each `SimpleDateParam` inst

spark git commit: [SPARK-7756] [CORE] Use testing cipher suites common to Oracle and IBM security providers

Repository: spark Updated Branches: refs/heads/branch-1.4 509a7cafc -> 459c3d22e [SPARK-7756] [CORE] Use testing cipher suites common to Oracle and IBM security providers Add alias names for supported cipher suites to the sample SSL configuration. The IBM JSSE provider reports its cipher sui

spark git commit: [SPARK-7756] [CORE] Use testing cipher suites common to Oracle and IBM security providers

Repository: spark Updated Branches: refs/heads/master 23452be94 -> bf4658070 [SPARK-7756] [CORE] Use testing cipher suites common to Oracle and IBM security providers Add alias names for supported cipher suites to the sample SSL configuration. The IBM JSSE provider reports its cipher suite w

spark git commit: [SPARK-7912] [SPARK-7921] [MLLIB] Update OneHotEncoder to handle ML attributes and change includeFirst to dropLast

Repository: spark Updated Branches: refs/heads/master 97a60cf75 -> 23452be94 [SPARK-7912] [SPARK-7921] [MLLIB] Update OneHotEncoder to handle ML attributes and change includeFirst to dropLast This PR contains two major changes to `OneHotEncoder`: 1. more robust handling of ML attributes. If

spark git commit: [SPARK-7912] [SPARK-7921] [MLLIB] Update OneHotEncoder to handle ML attributes and change includeFirst to dropLast

Repository: spark Updated Branches: refs/heads/branch-1.4 6bf5a4208 -> 509a7cafc [SPARK-7912] [SPARK-7921] [MLLIB] Update OneHotEncoder to handle ML attributes and change includeFirst to dropLast This PR contains two major changes to `OneHotEncoder`: 1. more robust handling of ML attributes.