spark git commit: [SPARK-8023][SQL] Add deterministic attribute to Expression to avoid collapsing nondeterministic projects.

2015-06-02 Thread rxin
Repository: spark Updated Branches: refs/heads/master 7b7f7b6c6 - 0f80990bf [SPARK-8023][SQL] Add deterministic attribute to Expression to avoid collapsing nondeterministic projects. This closes #6570. Author: Yin Huai yh...@databricks.com Author: Reynold Xin r...@databricks.com Closes

spark git commit: [SPARK-8020] [SQL] Spark SQL conf in spark-defaults.conf make metadataHive get constructed too early

2015-06-02 Thread yhuai
Repository: spark Updated Branches: refs/heads/master bcb47ad77 - 7b7f7b6c6 [SPARK-8020] [SQL] Spark SQL conf in spark-defaults.conf make metadataHive get constructed too early https://issues.apache.org/jira/browse/SPARK-8020 Author: Yin Huai yh...@databricks.com Closes #6571 from

spark git commit: [SPARK-8020] [SQL] Spark SQL conf in spark-defaults.conf make metadataHive get constructed too early

2015-06-02 Thread yhuai
Repository: spark Updated Branches: refs/heads/branch-1.4 9d6475b93 - 4940630f5 [SPARK-8020] [SQL] Spark SQL conf in spark-defaults.conf make metadataHive get constructed too early https://issues.apache.org/jira/browse/SPARK-8020 Author: Yin Huai yh...@databricks.com Closes #6571 from

spark git commit: [MINOR] Enable PySpark SQL readerwriter and window tests

2015-06-02 Thread davies
Repository: spark Updated Branches: refs/heads/branch-1.4 fa292dc3d - 139c8240f [MINOR] Enable PySpark SQL readerwriter and window tests PySpark SQL's `readerwriter` and `window` doctests weren't being run by our test runner script; this patch re-enables them. Author: Josh Rosen

Git Push Summary

2015-06-02 Thread pwendell
Repository: spark Updated Tags: refs/tags/v1.4.0-rc4 [deleted] 48c506724 - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

spark git commit: [SPARK-8015] [FLUME] Remove Guava dependency from flume-sink.

2015-06-02 Thread tdas
Repository: spark Updated Branches: refs/heads/master 1bb5d716c - 0071bd8d3 [SPARK-8015] [FLUME] Remove Guava dependency from flume-sink. The minimal change would be to disable shading of Guava in the module, and rely on the transitive dependency from other libraries instead. But since

spark git commit: [MINOR] [UI] Improve error message on log page

2015-06-02 Thread andrewor14
Repository: spark Updated Branches: refs/heads/branch-1.3 ad5daa3a3 - 476b87d31 [MINOR] [UI] Improve error message on log page Currently if a bad log type if specified, then we get blank. We should provide a more informative error message. Project:

spark git commit: [SPARK-7985] [ML] [MLlib] [Docs] Remove fittingParamMap references. Updating ML Doc Estimator, Transformer, and Param examples.

2015-06-02 Thread jkbradley
Repository: spark Updated Branches: refs/heads/branch-1.4 139c8240f - 815e05654 [SPARK-7985] [ML] [MLlib] [Docs] Remove fittingParamMap references. Updating ML Doc Estimator, Transformer, and Param examples. Updating ML Doc's *Estimator, Transformer, and Param* example to use

spark git commit: [SPARK-8014] [SQL] Avoid premature metadata discovery when writing a HadoopFsRelation with a save mode other than Append

2015-06-02 Thread yhuai
Repository: spark Updated Branches: refs/heads/branch-1.4 815e05654 - cbaf59544 [SPARK-8014] [SQL] Avoid premature metadata discovery when writing a HadoopFsRelation with a save mode other than Append The current code references the schema of the DataFrame to be written before checking save

spark git commit: [SPARK-8038] [SQL] [PYSPARK] fix Column.when() and otherwise()

2015-06-02 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-1.4 cbaf59544 - 6b0f61563 [SPARK-8038] [SQL] [PYSPARK] fix Column.when() and otherwise() Thanks ogirardot, closes #6580 cc rxin JoshRosen Author: Davies Liu dav...@databricks.com Closes #6590 from davies/when and squashes the following

[2/2] spark git commit: Preparing development version 1.4.0-SNAPSHOT

2015-06-02 Thread pwendell
Preparing development version 1.4.0-SNAPSHOT Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/92ccc5ba Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/92ccc5ba Diff:

Git Push Summary

2015-06-02 Thread pwendell
Repository: spark Updated Tags: refs/tags/v1.4.0-rc4 [deleted] a14fad11e - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

spark git commit: [SPARK-8049] [MLLIB] drop tmp col from OneVsRest output

2015-06-02 Thread meng
Repository: spark Updated Branches: refs/heads/master 605ddbb27 - 89f21f66b [SPARK-8049] [MLLIB] drop tmp col from OneVsRest output The temporary column should be dropped after we get the prediction column. harsha2010 Author: Xiangrui Meng m...@databricks.com Closes #6592 from

Git Push Summary

2015-06-02 Thread pwendell
Repository: spark Updated Tags: refs/tags/v1.4.0-rc4 [deleted] d630f4d69 - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

spark git commit: [SQL] [TEST] [MINOR] Uses a temporary log4j.properties in HiveThriftServer2Test to ensure expected logging behavior

2015-06-02 Thread andrewor14
Repository: spark Updated Branches: refs/heads/branch-1.4 e3c35b217 - daeaa0c5a [SQL] [TEST] [MINOR] Uses a temporary log4j.properties in HiveThriftServer2Test to ensure expected logging behavior The `HiveThriftServer2Test` relies on proper logging behavior to assert whether the Thrift

spark git commit: [SQL] [TEST] [MINOR] Follow-up of PR #6493, use Guava API to ensure Java 6 friendliness

2015-06-02 Thread andrewor14
Repository: spark Updated Branches: refs/heads/master 89f21f66b - 5cd6a63d9 [SQL] [TEST] [MINOR] Follow-up of PR #6493, use Guava API to ensure Java 6 friendliness This is a follow-up of PR #6493, which has been reverted in branch-1.4 because it uses Java 7 specific APIs and breaks Java 6

spark git commit: [SQL] [TEST] [MINOR] Follow-up of PR #6493, use Guava API to ensure Java 6 friendliness

2015-06-02 Thread andrewor14
Repository: spark Updated Branches: refs/heads/branch-1.4 daeaa0c5a - 0d8372099 [SQL] [TEST] [MINOR] Follow-up of PR #6493, use Guava API to ensure Java 6 friendliness This is a follow-up of PR #6493, which has been reverted in branch-1.4 because it uses Java 7 specific APIs and breaks Java

spark git commit: [SPARK-8049] [MLLIB] drop tmp col from OneVsRest output

2015-06-02 Thread meng
Repository: spark Updated Branches: refs/heads/branch-1.4 92ccc5ba3 - 97d4cd074 [SPARK-8049] [MLLIB] drop tmp col from OneVsRest output The temporary column should be dropped after we get the prediction column. harsha2010 Author: Xiangrui Meng m...@databricks.com Closes #6592 from

[2/2] spark git commit: Preparing development version 1.4.0-SNAPSHOT

2015-06-02 Thread pwendell
Preparing development version 1.4.0-SNAPSHOT Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/e3c35b21 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/e3c35b21 Diff:

[1/2] spark git commit: Preparing Spark release v1.4.0-rc4

2015-06-02 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.4 97d4cd074 - e3c35b217 Preparing Spark release v1.4.0-rc4 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/a14fad11 Tree:

Git Push Summary

2015-06-02 Thread pwendell
Repository: spark Updated Tags: refs/tags/v1.4.0-rc4 [created] a14fad11e - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

[2/2] spark git commit: Preparing development version 1.4.0-SNAPSHOT

2015-06-02 Thread pwendell
Preparing development version 1.4.0-SNAPSHOT Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/ab713af5 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/ab713af5 Diff:

Git Push Summary

2015-06-02 Thread pwendell
Repository: spark Updated Tags: refs/tags/v1.4.0-rc4 [created] 22596c534 - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

[1/2] spark git commit: Preparing Spark release v1.4.0-rc4

2015-06-02 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.4 0d8372099 - ab713af56 Preparing Spark release v1.4.0-rc4 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/22596c53 Tree:

spark git commit: [SPARK-7387] [ML] [DOC] CrossValidator example code in Python

2015-06-02 Thread jkbradley
Repository: spark Updated Branches: refs/heads/master 5cd6a63d9 - c3f4c3257 [SPARK-7387] [ML] [DOC] CrossValidator example code in Python Author: Ram Sriharsha rsriharsha@hw11853.local Closes #6358 from harsha2010/SPARK-7387 and squashes the following commits: 63efda2 [Ram Sriharsha] more

spark git commit: [SPARK-7547] [ML] Scala Example code for ElasticNet

2015-06-02 Thread jkbradley
Repository: spark Updated Branches: refs/heads/branch-1.4 6a3e32ad1 - 6391be872 [SPARK-7547] [ML] Scala Example code for ElasticNet This is scala example code for both linear and logistic regression. Python and Java versions are to be added. Author: DB Tsai d...@netflix.com Closes #6576

spark git commit: [SPARK-7691] [SQL] Refactor CatalystTypeConverter to use type-specific row accessors

2015-06-02 Thread rxin
Repository: spark Updated Branches: refs/heads/master a86b3e9b9 - cafd5056e [SPARK-7691] [SQL] Refactor CatalystTypeConverter to use type-specific row accessors This patch significantly refactors CatalystTypeConverters to both clean up the code and enable these conversions to work with

svn commit: r1683233 - in /spark: downloads.md site/downloads.html

2015-06-02 Thread pwendell
Author: pwendell Date: Wed Jun 3 05:21:50 2015 New Revision: 1683233 URL: http://svn.apache.org/r1683233 Log: Adding information about nightly builds Modified: spark/downloads.md spark/site/downloads.html Modified: spark/downloads.md URL:

spark git commit: [SPARK-8053] [MLLIB] renamed scalingVector to scalingVec

2015-06-02 Thread meng
Repository: spark Updated Branches: refs/heads/master cafd5056e - 07c16cb5b [SPARK-8053] [MLLIB] renamed scalingVector to scalingVec I searched the Spark codebase for all occurrences of scalingVector CC: mengxr Author: Joseph K. Bradley jos...@databricks.com Closes #6596 from

spark git commit: [SPARK-8053] [MLLIB] renamed scalingVector to scalingVec

2015-06-02 Thread meng
Repository: spark Updated Branches: refs/heads/branch-1.4 6391be872 - 88399c34b [SPARK-8053] [MLLIB] renamed scalingVector to scalingVec I searched the Spark codebase for all occurrences of scalingVector CC: mengxr Author: Joseph K. Bradley jos...@databricks.com Closes #6596 from

spark git commit: [SPARK-8021] [SQL] [PYSPARK] make Python read/write API consistent with Scala

2015-06-02 Thread pwendell
Repository: spark Updated Branches: refs/heads/master 0f80990bf - 445647a1a [SPARK-8021] [SQL] [PYSPARK] make Python read/write API consistent with Scala add schema()/format()/options() for reader, add mode()/format()/options()/partitionBy() for writer cc rxin yhuai pwendell Author:

spark git commit: [SPARK-8021] [SQL] [PYSPARK] make Python read/write API consistent with Scala

2015-06-02 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.4 87941ff8c - 292ee1a99 [SPARK-8021] [SQL] [PYSPARK] make Python read/write API consistent with Scala add schema()/format()/options() for reader, add mode()/format()/options()/partitionBy() for writer cc rxin yhuai pwendell Author:

[1/2] spark git commit: Preparing Spark release v1.4.0-rc4

2015-06-02 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.4 292ee1a99 - 92a677891 Preparing Spark release v1.4.0-rc4 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/48c50672 Tree:

Git Push Summary

2015-06-02 Thread pwendell
Repository: spark Updated Tags: refs/tags/v1.4.0-rc4 [created] 48c506724 - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

spark git commit: [SPARK-7432] [MLLIB] fix flaky CrossValidator doctest

2015-06-02 Thread meng
Repository: spark Updated Branches: refs/heads/branch-1.4 92a677891 - 97fedf1a0 [SPARK-7432] [MLLIB] fix flaky CrossValidator doctest The new test uses CV to compare `maxIter=0` and `maxIter=1`, and validate on the evaluation result. jkbradley Author: Xiangrui Meng m...@databricks.com

spark git commit: [SPARK-7432] [MLLIB] fix flaky CrossValidator doctest

2015-06-02 Thread meng
Repository: spark Updated Branches: refs/heads/master 445647a1a - bd97840d5 [SPARK-7432] [MLLIB] fix flaky CrossValidator doctest The new test uses CV to compare `maxIter=0` and `maxIter=1`, and validate on the evaluation result. jkbradley Author: Xiangrui Meng m...@databricks.com Closes

spark git commit: [SPARK-8037] [SQL] Ignores files whose name starts with dot in HadoopFsRelation

2015-06-02 Thread lian
Repository: spark Updated Branches: refs/heads/master bd97840d5 - 1bb5d716c [SPARK-8037] [SQL] Ignores files whose name starts with dot in HadoopFsRelation Author: Cheng Lian l...@databricks.com Closes #6581 from liancheng/spark-8037 and squashes the following commits: d08e97b [Cheng Lian]

spark git commit: [HOT-FIX] Add EvaluatedType back to RDG

2015-06-02 Thread yhuai
Repository: spark Updated Branches: refs/heads/branch-1.4 97fedf1a0 - 8c3fc3a6c [HOT-FIX] Add EvaluatedType back to RDG https://github.com/apache/spark/commit/87941ff8c49a6661f22c31aa7b84ac1fce768135 accidentally removed the EvaluatedType. Author: Yin Huai yh...@databricks.com Closes #6589

spark git commit: [SPARK-6917] [SQL] DecimalType is not read back when non-native type exists

2015-06-02 Thread rxin
Repository: spark Updated Branches: refs/heads/master 0221c7f0e - bcb47ad77 [SPARK-6917] [SQL] DecimalType is not read back when non-native type exists cc yhuai Author: Davies Liu dav...@databricks.com Closes #6558 from davies/decimalType and squashes the following commits: c877ca8 [Davies

spark git commit: [SPARK-6917] [SQL] DecimalType is not read back when non-native type exists

2015-06-02 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-1.4 011b07e23 - 9d6475b93 [SPARK-6917] [SQL] DecimalType is not read back when non-native type exists cc yhuai Author: Davies Liu dav...@databricks.com Closes #6558 from davies/decimalType and squashes the following commits: c877ca8