spark git commit: [SPARK-8406] [SQL] Backports SPARK-8406 and PR #6864 to branch-1.4

2015-06-22 Thread yhuai
Repository: spark Updated Branches: refs/heads/branch-1.4 b836bac3f - 451c8722a [SPARK-8406] [SQL] Backports SPARK-8406 and PR #6864 to branch-1.4 Author: Cheng Lian l...@databricks.com Closes #6932 from liancheng/spark-8406-for-1.4 and squashes the following commits: a0168fe [Cheng Lian]

spark git commit: [SPARK-8406] [SQL] Adding UUID to output file name to avoid accidental overwriting

2015-06-22 Thread yhuai
Repository: spark Updated Branches: refs/heads/master 47c1d5629 - 0818fdec3 [SPARK-8406] [SQL] Adding UUID to output file name to avoid accidental overwriting This PR fixes a Parquet output file name collision bug which may cause data loss. Changes made: 1. Identify each write job issued

spark git commit: [SPARK-8511] [PYSPARK] Modify a test to remove a saved model in `regression.py`

2015-06-22 Thread jkbradley
Repository: spark Updated Branches: refs/heads/master ba8a4537f - 5d89d9f00 [SPARK-8511] [PYSPARK] Modify a test to remove a saved model in `regression.py` [[SPARK-8511] Modify a test to remove a saved model in `regression.py` - ASF JIRA](https://issues.apache.org/jira/browse/SPARK-8511)

spark git commit: [SPARK-8420] [SQL] Fix comparision of timestamps/dates with strings (branch-1.4)

2015-06-22 Thread yhuai
Repository: spark Updated Branches: refs/heads/branch-1.4 451c8722a - 65981619b [SPARK-8420] [SQL] Fix comparision of timestamps/dates with strings (branch-1.4) This is branch 1.4 backport of https://github.com/apache/spark/pull/6888. Below is the original description. In earlier versions

spark git commit: [SPARK-8482] Added M4 instances to the list.

2015-06-22 Thread shivaram
Repository: spark Updated Branches: refs/heads/master 42a1f716f - ba8a4537f [SPARK-8482] Added M4 instances to the list. AWS recently added M4 instances (https://aws.amazon.com/blogs/aws/the-new-m4-instance-type-bonus-price-reduction-on-m3-c4/). Author: Pradeep Chhetri

spark git commit: [SPARK-8095][BACKPORT] Resolve dependencies of --packages in local ivy cache

2015-06-22 Thread andrewor14
Repository: spark Updated Branches: refs/heads/branch-1.3 0b8dce0c0 - 45b4527e3 [SPARK-8095][BACKPORT] Resolve dependencies of --packages in local ivy cache Backported PR #6788 cc andrewor14 Author: Burak Yavuz brk...@gmail.com Closes #6923 from brkyvz/backport-local-ivy and squashes the

spark git commit: [SPARK-8455] [ML] Implement n-gram feature transformer

2015-06-22 Thread jkbradley
Repository: spark Updated Branches: refs/heads/master 5ab9fcfb0 - afe35f051 [SPARK-8455] [ML] Implement n-gram feature transformer Implementation of n-gram feature transformer for ML. Author: Feynman Liang fli...@databricks.com Closes #6887 from feynmanliang/ngram-featurizer and squashes

spark git commit: [SPARK-8532] [SQL] In Python's DataFrameWriter, save/saveAsTable/json/parquet/jdbc always override mode

2015-06-22 Thread yhuai
Repository: spark Updated Branches: refs/heads/branch-1.4 507381d39 - 994abbaeb [SPARK-8532] [SQL] In Python's DataFrameWriter, save/saveAsTable/json/parquet/jdbc always override mode https://issues.apache.org/jira/browse/SPARK-8532 This PR has two changes. First, it fixes the bug that save

spark git commit: [SPARK-8532] [SQL] In Python's DataFrameWriter, save/saveAsTable/json/parquet/jdbc always override mode

2015-06-22 Thread yhuai
Repository: spark Updated Branches: refs/heads/master da7bbb943 - 5ab9fcfb0 [SPARK-8532] [SQL] In Python's DataFrameWriter, save/saveAsTable/json/parquet/jdbc always override mode https://issues.apache.org/jira/browse/SPARK-8532 This PR has two changes. First, it fixes the bug that save

spark git commit: [SPARK-8537] [SPARKR] Add a validation rule about the curly braces in SparkR to `.lintr`

2015-06-22 Thread shivaram
Repository: spark Updated Branches: refs/heads/master afe35f051 - b1f3a489e [SPARK-8537] [SPARKR] Add a validation rule about the curly braces in SparkR to `.lintr` [[SPARK-8537] Add a validation rule about the curly braces in SparkR to `.lintr` - ASF

spark git commit: [SPARK-8356] [SQL] Reconcile callUDF and callUdf

2015-06-22 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master b1f3a489e - 50d3242d6 [SPARK-8356] [SQL] Reconcile callUDF and callUdf Deprecates ```callUdf``` in favor of ```callUDF```. Author: BenFradet benjamin.fra...@gmail.com Closes #6902 from BenFradet/SPARK-8356 and squashes the following

spark git commit: [SPARK-8492] [SQL] support binaryType in UnsafeRow

2015-06-22 Thread davies
Repository: spark Updated Branches: refs/heads/master 50d3242d6 - 96aa01378 [SPARK-8492] [SQL] support binaryType in UnsafeRow Support BinaryType in UnsafeRow, just like StringType. Also change the layout of StringType and BinaryType in UnsafeRow, by combining offset and size together as

spark git commit: [HOTFIX] [TESTS] Typo mqqt - mqtt

2015-06-22 Thread andrewor14
Repository: spark Updated Branches: refs/heads/master 96aa01378 - 1dfb0f7b2 [HOTFIX] [TESTS] Typo mqqt - mqtt This was introduced in #6866. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/1dfb0f7b Tree:

spark git commit: [SPARK-7153] [SQL] support all integral type ordinal in GetArrayItem

2015-06-22 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master 1dfb0f7b2 - 860a49ef2 [SPARK-7153] [SQL] support all integral type ordinal in GetArrayItem first convert `ordinal` to `Number`, then convert to int type. Author: Wenchen Fan cloud0...@outlook.com Closes #5706 from cloud-fan/7153 and

spark git commit: [SPARK-8511] [PYSPARK] Modify a test to remove a saved model in `regression.py`

2015-06-22 Thread jkbradley
Repository: spark Updated Branches: refs/heads/branch-1.4 65981619b - 507381d39 [SPARK-8511] [PYSPARK] Modify a test to remove a saved model in `regression.py` [[SPARK-8511] Modify a test to remove a saved model in `regression.py` - ASF JIRA](https://issues.apache.org/jira/browse/SPARK-8511)

spark git commit: [SPARK-8429] [EC2] Add ability to set additional tags

2015-06-22 Thread shivaram
Repository: spark Updated Branches: refs/heads/master 0818fdec3 - 42a1f716f [SPARK-8429] [EC2] Add ability to set additional tags Add the `--additional-tags` parameter that allows to set additional tags to all the created instances (masters and slaves). The user can specify multiple tags by

spark git commit: [SPARK-8104] [SQL] auto alias expressions in analyzer

2015-06-22 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master 5d89d9f00 - da7bbb943 [SPARK-8104] [SQL] auto alias expressions in analyzer Currently we auto alias expression in parser. However, during parser phase we don't have enough information to do the right alias. For example, Generator that

spark git commit: [SPARK-7859] [SQL] Collect_set() behavior differences which fails the unit test under jdk8

2015-06-22 Thread yhuai
Repository: spark Updated Branches: refs/heads/branch-1.4 994abbaeb - d73900a90 [SPARK-7859] [SQL] Collect_set() behavior differences which fails the unit test under jdk8 To reproduce that: ``` JAVA_HOME=/home/hcheng/Java/jdk1.8.0_45 | build/sbt -Phadoop-2.3 -Phive 'test-only

spark git commit: [SPARK-8548] [SPARKR] Remove the trailing whitespaces from the SparkR files

2015-06-22 Thread shivaram
Repository: spark Updated Branches: refs/heads/branch-1.4 d73900a90 - 250179485 [SPARK-8548] [SPARKR] Remove the trailing whitespaces from the SparkR files [[SPARK-8548] Remove the trailing whitespaces from the SparkR files - ASF JIRA](https://issues.apache.org/jira/browse/SPARK-8548) -

spark git commit: [SPARK-8548] [SPARKR] Remove the trailing whitespaces from the SparkR files

2015-06-22 Thread shivaram
Repository: spark Updated Branches: refs/heads/master c4d234396 - 44fa7df64 [SPARK-8548] [SPARKR] Remove the trailing whitespaces from the SparkR files [[SPARK-8548] Remove the trailing whitespaces from the SparkR files - ASF JIRA](https://issues.apache.org/jira/browse/SPARK-8548) - This is

spark git commit: MAINTENANCE: Automated closing of pull requests.

2015-06-22 Thread pwendell
Repository: spark Updated Branches: refs/heads/master 13321e655 - c4d234396 MAINTENANCE: Automated closing of pull requests. This commit exists to close the following pull requests on Github: Closes #2849 (close requested by 'srowen') Closes #2786 (close requested by 'andrewor14') Closes

spark git commit: [BUILD] Preparing Spark release 1.4.1

2015-06-22 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.4 250179485 - 48d683014 [BUILD] Preparing Spark release 1.4.1 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/48d68301 Tree:

Git Push Summary

2015-06-22 Thread pwendell
Repository: spark Updated Tags: refs/tags/v1.4.1-rc1 [created] d0a5560ce - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

spark git commit: [SPARK-7781] [MLLIB] gradient boosted trees.train regressor missing max bins

2015-06-22 Thread jkbradley
Repository: spark Updated Branches: refs/heads/branch-1.4 1cfa7302e - 22cc1ab66 [SPARK-7781] [MLLIB] gradient boosted trees.train regressor missing max bins Author: Holden Karau hol...@pigscanfly.ca Closes #6331 from holdenk/SPARK-7781-GradientBoostedTrees.trainRegressor-missing-max-bins

spark git commit: [SPARK-7781] [MLLIB] gradient boosted trees.train regressor missing max bins

2015-06-22 Thread jkbradley
Repository: spark Updated Branches: refs/heads/master 44fa7df64 - 164fe2aa4 [SPARK-7781] [MLLIB] gradient boosted trees.train regressor missing max bins Author: Holden Karau hol...@pigscanfly.ca Closes #6331 from holdenk/SPARK-7781-GradientBoostedTrees.trainRegressor-missing-max-bins and

[1/2] spark git commit: Preparing Spark release v1.4.1-rc1

2015-06-22 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.4 48d683014 - 1cfa7302e Preparing Spark release v1.4.1-rc1 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/d0a5560c Tree:

[2/2] spark git commit: Preparing development version 1.4.2-SNAPSHOT

2015-06-22 Thread pwendell
Preparing development version 1.4.2-SNAPSHOT Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/1cfa7302 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/1cfa7302 Diff: