spark git commit: [SPARK-13518][SQL] Enable vectorized parquet scanner by default

2016-02-26 Thread rxin
Repository: spark Updated Branches: refs/heads/master 59e3e10be -> 7a0cb4e58 [SPARK-13518][SQL] Enable vectorized parquet scanner by default ## What changes were proposed in this pull request? Change the default of the flag to enable this feature now that the implementation is complete. ##

spark git commit: [SPARK-13521][BUILD] Remove reference to Tachyon in cluster & release scripts

2016-02-26 Thread rxin
Repository: spark Updated Branches: refs/heads/master f77dc4e1e -> 59e3e10be [SPARK-13521][BUILD] Remove reference to Tachyon in cluster & release scripts ## What changes were proposed in this pull request? We provide a very limited set of cluster management script in Spark for Tachyon,

[2/2] spark git commit: Preparing development version 1.6.2-SNAPSHOT

2016-02-26 Thread pwendell
Preparing development version 1.6.2-SNAPSHOT Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/dcf60d79 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/dcf60d79 Diff:

[1/2] spark git commit: Preparing Spark release v1.6.1-rc1

2016-02-26 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.6 eb6f6da48 -> dcf60d79e Preparing Spark release v1.6.1-rc1 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/15de51c2 Tree:

[spark] Git Push Summary

2016-02-26 Thread pwendell
Repository: spark Updated Tags: refs/tags/v1.6.1-rc1 [created] 15de51c23 - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

spark git commit: Update CHANGES.txt and spark-ec2 and R package versions for 1.6.1

2016-02-26 Thread joshrosen
Repository: spark Updated Branches: refs/heads/branch-1.6 8a43c3bfb -> eb6f6da48 Update CHANGES.txt and spark-ec2 and R package versions for 1.6.1 This patch updates a few more 1.6.0 version numbers for the 1.6.1 release candidate. Verified this by running ``` git grep "1\.6\.0" | grep -v

spark git commit: [SPARK-13474][PROJECT INFRA] Update packaging scripts to push artifacts to home.apache.org

2016-02-26 Thread joshrosen
Repository: spark Updated Branches: refs/heads/master ad615291f -> f77dc4e1e [SPARK-13474][PROJECT INFRA] Update packaging scripts to push artifacts to home.apache.org Due to the people.apache.org -> home.apache.org migration, we need to update our packaging scripts to publish artifacts to

spark git commit: [SPARK-13474][PROJECT INFRA] Update packaging scripts to push artifacts to home.apache.org

2016-02-26 Thread joshrosen
Repository: spark Updated Branches: refs/heads/branch-1.6 a57f87ee4 -> 8a43c3bfb [SPARK-13474][PROJECT INFRA] Update packaging scripts to push artifacts to home.apache.org Due to the people.apache.org -> home.apache.org migration, we need to update our packaging scripts to publish artifacts

spark git commit: [SPARK-13519][CORE] Driver should tell Executor to stop itself when cleaning executor's state

2016-02-26 Thread andrewor14
Repository: spark Updated Branches: refs/heads/master 1e5fcdf96 -> ad615291f [SPARK-13519][CORE] Driver should tell Executor to stop itself when cleaning executor's state ## What changes were proposed in this pull request? When the driver removes an executor's state, the connection between

spark git commit: [SPARK-13505][ML] add python api for MaxAbsScaler

2016-02-26 Thread meng
Repository: spark Updated Branches: refs/heads/master 391755dc6 -> 1e5fcdf96 [SPARK-13505][ML] add python api for MaxAbsScaler ## What changes were proposed in this pull request? After SPARK-13028, we should add Python API for MaxAbsScaler. ## How was this patch tested? unit test Author:

[spark] Git Push Summary

2016-02-26 Thread marmbrus
Repository: spark Updated Tags: refs/tags/v1.6.1-rc1 [deleted] 152252f15 - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

spark git commit: [SPARK-13465] Add a task failure listener to TaskContext

2016-02-26 Thread davies
Repository: spark Updated Branches: refs/heads/master 0598a2b81 -> 391755dc6 [SPARK-13465] Add a task failure listener to TaskContext ## What changes were proposed in this pull request? TaskContext supports task completion callback, which gets called regardless of task failures. However,

spark git commit: [SPARK-13499] [SQL] Performance improvements for parquet reader.

2016-02-26 Thread davies
Repository: spark Updated Branches: refs/heads/master 6df1e55a6 -> 0598a2b81 [SPARK-13499] [SQL] Performance improvements for parquet reader. ## What changes were proposed in this pull request? This patch includes these performance fixes: - Remove unnecessary setNotNull() calls. The NULL

spark git commit: [SPARK-13454][SQL] Allow users to drop a table with a name starting with an underscore.

2016-02-26 Thread yhuai
Repository: spark Updated Branches: refs/heads/branch-1.6 abe8f991a -> a57f87ee4 [SPARK-13454][SQL] Allow users to drop a table with a name starting with an underscore. ## What changes were proposed in this pull request? This change adds a workaround to allow users to drop a table with a

spark git commit: [MINOR][SQL] Fix modifier order.

2016-02-26 Thread srowen
Repository: spark Updated Branches: refs/heads/master 7af0de076 -> 727e78014 [MINOR][SQL] Fix modifier order. ## What changes were proposed in this pull request? This PR fixes the order of modifier from `abstract public` into `public abstract`. Currently, when we run `./dev/lint-java`, it

spark git commit: [SPARK-11381][DOCS] Replace example code in mllib-linear-methods.md using include_example

2016-02-26 Thread meng
Repository: spark Updated Branches: refs/heads/master b33261f91 -> 7af0de076 [SPARK-11381][DOCS] Replace example code in mllib-linear-methods.md using include_example ## What changes were proposed in this pull request? This PR replaces example codes in `mllib-linear-methods.md` using

spark git commit: [SPARK-12634][PYSPARK][DOC] PySpark tree parameter desc to consistent format

2016-02-26 Thread meng
Repository: spark Updated Branches: refs/heads/master 99dfcedbf -> b33261f91 [SPARK-12634][PYSPARK][DOC] PySpark tree parameter desc to consistent format Part of task for [SPARK-11219](https://issues.apache.org/jira/browse/SPARK-11219) to make PySpark MLlib parameter description formatting

spark git commit: [SPARK-13457][SQL] Removes DataFrame RDD operations

2016-02-26 Thread lian
Repository: spark Updated Branches: refs/heads/master 5c3912e5c -> 99dfcedbf [SPARK-13457][SQL] Removes DataFrame RDD operations ## What changes were proposed in this pull request? This is another try of PR #11323. This PR removes DataFrame RDD operations except for `foreach` and

spark git commit: [SPARK-12523][YARN] Support long-running of the Spark On HBase and hive meta store.

2016-02-26 Thread tgraves
Repository: spark Updated Branches: refs/heads/master 318bf4115 -> 5c3912e5c [SPARK-12523][YARN] Support long-running of the Spark On HBase and hive meta store. Obtain the hive metastore and hbase token as well as hdfs token in DelegationToeknRenewer to supoort long-running application of

spark git commit: [MINOR][STREAMING] Fix a minor naming issue in JavaDStreamLike

2016-02-26 Thread rxin
Repository: spark Updated Branches: refs/heads/master 9812a24aa -> 318bf4115 [MINOR][STREAMING] Fix a minor naming issue in JavaDStreamLike Author: Liwei Lin Closes #11385 from proflin/Fix-minor-naming. Project: http://git-wip-us.apache.org/repos/asf/spark/repo