spark git commit: [SPARK-7656] [SQL] use CatalystConf in FunctionRegistry

2015-05-19 Thread marmbrus
Repository: spark Updated Branches: refs/heads/branch-1.4 2ef04a162 -> 86893390c [SPARK-7656] [SQL] use CatalystConf in FunctionRegistry follow up for #5806 Author: scwf Closes #6164 from scwf/FunctionRegistry and squashes the following commits: 15e6697 [scwf] use catalogconf in FunctionRe

spark git commit: [SPARK-7656] [SQL] use CatalystConf in FunctionRegistry

2015-05-19 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master 386052063 -> 60336e3bc [SPARK-7656] [SQL] use CatalystConf in FunctionRegistry follow up for #5806 Author: scwf Closes #6164 from scwf/FunctionRegistry and squashes the following commits: 15e6697 [scwf] use catalogconf in FunctionRegist

spark git commit: [SPARK-7744] [DOCS] [MLLIB] Distributed matrix" section in MLlib "Data Types" documentation should be reordered.

2015-05-19 Thread meng
Repository: spark Updated Branches: refs/heads/branch-1.3 fc1b4a414 -> a64e097f1 [SPARK-7744] [DOCS] [MLLIB] Distributed matrix" section in MLlib "Data Types" documentation should be reordered. The documentation for BlockMatrix should come after RowMatrix, IndexedRowMatrix, and CoordinateMat

spark git commit: [SPARK-7744] [DOCS] [MLLIB] Distributed matrix" section in MLlib "Data Types" documentation should be reordered.

2015-05-19 Thread meng
Repository: spark Updated Branches: refs/heads/branch-1.4 62b4c7392 -> 2ef04a162 [SPARK-7744] [DOCS] [MLLIB] Distributed matrix" section in MLlib "Data Types" documentation should be reordered. The documentation for BlockMatrix should come after RowMatrix, IndexedRowMatrix, and CoordinateMat

spark git commit: [SPARK-7744] [DOCS] [MLLIB] Distributed matrix" section in MLlib "Data Types" documentation should be reordered.

2015-05-19 Thread meng
Repository: spark Updated Branches: refs/heads/master 2bc5e0616 -> 386052063 [SPARK-7744] [DOCS] [MLLIB] Distributed matrix" section in MLlib "Data Types" documentation should be reordered. The documentation for BlockMatrix should come after RowMatrix, IndexedRowMatrix, and CoordinateMatrix,

spark git commit: [SPARK-6246] [EC2] fixed support for more than 100 nodes

2015-05-19 Thread shivaram
Repository: spark Updated Branches: refs/heads/master bcb1ff814 -> 2bc5e0616 [SPARK-6246] [EC2] fixed support for more than 100 nodes This is a small fix. But it is important for amazon users because as the ticket states, "spark-ec2 can't handle clusters with > 100 nodes" now. Author: alyaxe

spark git commit: [SPARK-7662] [SQL] Resolve correct names for generator in projection

2015-05-19 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master 4de74d260 -> bcb1ff814 [SPARK-7662] [SQL] Resolve correct names for generator in projection ``` select explode(map(value, key)) from src; ``` Throws exception ``` org.apache.spark.sql.AnalysisException: The number of aliases supplied in the

spark git commit: [SPARK-7662] [SQL] Resolve correct names for generator in projection

2015-05-19 Thread marmbrus
Repository: spark Updated Branches: refs/heads/branch-1.4 87fa8ccd2 -> 62b4c7392 [SPARK-7662] [SQL] Resolve correct names for generator in projection ``` select explode(map(value, key)) from src; ``` Throws exception ``` org.apache.spark.sql.AnalysisException: The number of aliases supplied in

spark git commit: [SPARK-7738] [SQL] [PySpark] add reader and writer API in Python

2015-05-19 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-1.4 5643499d2 -> 87fa8ccd2 [SPARK-7738] [SQL] [PySpark] add reader and writer API in Python cc rxin, please take a quick look, I'm working on tests. Author: Davies Liu Closes #6238 from davies/readwrite and squashes the following commits

spark git commit: [SPARK-7738] [SQL] [PySpark] add reader and writer API in Python

2015-05-19 Thread rxin
Repository: spark Updated Branches: refs/heads/master c12dff9b8 -> 4de74d260 [SPARK-7738] [SQL] [PySpark] add reader and writer API in Python cc rxin, please take a quick look, I'm working on tests. Author: Davies Liu Closes #6238 from davies/readwrite and squashes the following commits: c

spark git commit: [SPARK-7652] [MLLIB] Update the implementation of naive Bayes prediction with BLAS

2015-05-19 Thread meng
Repository: spark Updated Branches: refs/heads/branch-1.4 c3871eeb2 -> 5643499d2 [SPARK-7652] [MLLIB] Update the implementation of naive Bayes prediction with BLAS JIRA: https://issues.apache.org/jira/browse/SPARK-7652 Author: Liang-Chi Hsieh Closes #6189 from viirya/naive_bayes_blas_predi

spark git commit: [SPARK-7652] [MLLIB] Update the implementation of naive Bayes prediction with BLAS

2015-05-19 Thread meng
Repository: spark Updated Branches: refs/heads/master 68fb2a46e -> c12dff9b8 [SPARK-7652] [MLLIB] Update the implementation of naive Bayes prediction with BLAS JIRA: https://issues.apache.org/jira/browse/SPARK-7652 Author: Liang-Chi Hsieh Closes #6189 from viirya/naive_bayes_blas_predictio

spark git commit: [SPARK-7586] [ML] [DOC] Add docs of Word2Vec in ml package

2015-05-19 Thread jkbradley
Repository: spark Updated Branches: refs/heads/branch-1.4 ee012e0ed -> c3871eeb2 [SPARK-7586] [ML] [DOC] Add docs of Word2Vec in ml package CC jkbradley. JIRA [issue](https://issues.apache.org/jira/browse/SPARK-7586). Author: Xusen Yin Closes #6181 from yinxusen/SPARK-7586 and squashes the

spark git commit: [SPARK-7586] [ML] [DOC] Add docs of Word2Vec in ml package

2015-05-19 Thread jkbradley
Repository: spark Updated Branches: refs/heads/master 3c4c1f964 -> 68fb2a46e [SPARK-7586] [ML] [DOC] Add docs of Word2Vec in ml package CC jkbradley. JIRA [issue](https://issues.apache.org/jira/browse/SPARK-7586). Author: Xusen Yin Closes #6181 from yinxusen/SPARK-7586 and squashes the fol

spark git commit: [SPARK-7726] Fix Scaladoc false errors

2015-05-19 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.4 cd3093e70 -> ee012e0ed [SPARK-7726] Fix Scaladoc false errors Visibility rules for static members are different in Scala and Java, and this case requires an explicit static import. Even though these are Java files, they are run throug

spark git commit: [SPARK-7726] Fix Scaladoc false errors

2015-05-19 Thread pwendell
Repository: spark Updated Branches: refs/heads/master 7b16e9f21 -> 3c4c1f964 [SPARK-7726] Fix Scaladoc false errors Visibility rules for static members are different in Scala and Java, and this case requires an explicit static import. Even though these are Java files, they are run through sc

spark git commit: [SPARK-7678] [ML] Fix default random seed in HasSeed

2015-05-19 Thread meng
Repository: spark Updated Branches: refs/heads/branch-1.4 24cb323e7 -> cd3093e70 [SPARK-7678] [ML] Fix default random seed in HasSeed Changed shared param HasSeed to have default based on hashCode of class name, instead of random number. Also, removed fixed random seeds from Word2Vec and ALS.

spark git commit: [SPARK-7678] [ML] Fix default random seed in HasSeed

2015-05-19 Thread meng
Repository: spark Updated Branches: refs/heads/master fb9027321 -> 7b16e9f21 [SPARK-7678] [ML] Fix default random seed in HasSeed Changed shared param HasSeed to have default based on hashCode of class name, instead of random number. Also, removed fixed random seeds from Word2Vec and ALS. CC

spark git commit: [SPARK-7047] [ML] ml.Model optional parent support

2015-05-19 Thread meng
Repository: spark Updated Branches: refs/heads/branch-1.4 8567d29ef -> 24cb323e7 [SPARK-7047] [ML] ml.Model optional parent support Made Model.parent transient. Added Model.hasParent to test for null parent CC: mengxr Author: Joseph K. Bradley Closes #5914 from jkbradley/parent-optional a

spark git commit: [SPARK-7047] [ML] ml.Model optional parent support

2015-05-19 Thread meng
Repository: spark Updated Branches: refs/heads/master 32fa611b1 -> fb9027321 [SPARK-7047] [ML] ml.Model optional parent support Made Model.parent transient. Added Model.hasParent to test for null parent CC: mengxr Author: Joseph K. Bradley Closes #5914 from jkbradley/parent-optional and s

spark git commit: [SPARK-7704] Updating Programming Guides per SPARK-4397

2015-05-19 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-1.4 2cce6bfea -> 8567d29ef [SPARK-7704] Updating Programming Guides per SPARK-4397 The change per SPARK-4397 makes implicit objects in SparkContext to be found by the compiler automatically. So that we don't need to import the o.a.s.Spark

spark git commit: [SPARK-7704] Updating Programming Guides per SPARK-4397

2015-05-19 Thread srowen
Repository: spark Updated Branches: refs/heads/master 6845cb2ff -> 32fa611b1 [SPARK-7704] Updating Programming Guides per SPARK-4397 The change per SPARK-4397 makes implicit objects in SparkContext to be found by the compiler automatically. So that we don't need to import the o.a.s.SparkCont

spark git commit: [SPARK-7681] [MLLIB] remove mima excludes for 1.3

2015-05-19 Thread meng
Repository: spark Updated Branches: refs/heads/master df34793ad -> 6845cb2ff [SPARK-7681] [MLLIB] remove mima excludes for 1.3 There excludes are unnecessary for 1.3 because the changes were made in 1.4.x. Author: Xiangrui Meng Closes #6254 from mengxr/SPARK-7681-mima and squashes the follo

spark git commit: [SPARK-7681] [MLLIB] remove mima excludes for 1.3

2015-05-19 Thread meng
Repository: spark Updated Branches: refs/heads/branch-1.4 ac3197e1b -> 2cce6bfea [SPARK-7681] [MLLIB] remove mima excludes for 1.3 There excludes are unnecessary for 1.3 because the changes were made in 1.4.x. Author: Xiangrui Meng Closes #6254 from mengxr/SPARK-7681-mima and squashes the f

Git Push Summary

2015-05-19 Thread pwendell
Repository: spark Updated Tags: refs/tags/v1.4.0-rc1 [created] 777a08166 - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

[1/2] spark git commit: Preparing development version 1.4.1-SNAPSHOT

2015-05-19 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.4 f9f2aafbf -> ac3197e1b Preparing development version 1.4.1-SNAPSHOT Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/ac3197e1 Tree: http://git-wip-us.apache.org/repo

[2/2] spark git commit: Preparing Spark release v1.4.0-rc1

2015-05-19 Thread pwendell
Preparing Spark release v1.4.0-rc1 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/777a0816 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/777a0816 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/777a0816 Bra

spark git commit: CHANGES.txt updates

2015-05-19 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.4 6834d1af4 -> f9f2aafbf CHANGES.txt updates Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/f9f2aafb Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/f9f2aafb

spark git commit: [SPARK-7723] Fix string interpolation in pipeline examples

2015-05-19 Thread srowen
Repository: spark Updated Branches: refs/heads/master 27fa88b9b -> df34793ad [SPARK-7723] Fix string interpolation in pipeline examples https://issues.apache.org/jira/browse/SPARK-7723 Author: Saleem Ansari Closes #6258 from tuxdna/master and squashes the following commits: 2bb5a42 [Saleem

spark git commit: [SPARK-7723] Fix string interpolation in pipeline examples

2015-05-19 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-1.4 31f5d53e9 -> 6834d1af4 [SPARK-7723] Fix string interpolation in pipeline examples https://issues.apache.org/jira/browse/SPARK-7723 Author: Saleem Ansari Closes #6258 from tuxdna/master and squashes the following commits: 2bb5a42 [Sa

spark git commit: [HOTFIX] Revert "[SPARK-7092] Update spark scala version to 2.11.6"

2015-05-19 Thread pwendell
Repository: spark Updated Branches: refs/heads/master 61f164d3f -> 27fa88b9b [HOTFIX] Revert "[SPARK-7092] Update spark scala version to 2.11.6" This reverts commit a11c8683c76c67f45749a1b50a0912a731fd2487. For more information see: https://issues.apache.org/jira/browse/SPARK-7726 Project:

spark git commit: [HOTFIX] Revert "[SPARK-7092] Update spark scala version to 2.11.6"

2015-05-19 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.4 586ede6b3 -> 31f5d53e9 [HOTFIX] Revert "[SPARK-7092] Update spark scala version to 2.11.6" This reverts commit a11c8683c76c67f45749a1b50a0912a731fd2487. For more information see: https://issues.apache.org/jira/browse/SPARK-7726 Proje

[2/2] spark git commit: Revert "Preparing Spark release v1.4.0-rc1"

2015-05-19 Thread pwendell
Revert "Preparing Spark release v1.4.0-rc1" This reverts commit 79fb01a3be07b5086134a6fe103248e9a33a9500. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/586ede6b Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/586ede

[1/2] spark git commit: Revert "Preparing development version 1.4.1-SNAPSHOT"

2015-05-19 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.4 0748263a2 -> 586ede6b3 Revert "Preparing development version 1.4.1-SNAPSHOT" This reverts commit a1d896b85bd3fb88284f8b6758d7e5f0a1bb9eb3. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org

Git Push Summary

2015-05-19 Thread pwendell
Repository: spark Updated Tags: refs/tags/v1.4.0-rc1 [deleted] 79fb01a3b - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

spark git commit: Fixing a few basic typos in the Programming Guide.

2015-05-19 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-1.4 a1d896b85 -> 0748263a2 Fixing a few basic typos in the Programming Guide. Just a few minor fixes in the guide, so a new JIRA issue was not created per the guidelines. Author: Mike Dusenberry Closes #6240 from dusenberrymw/Fix_Progra

spark git commit: Fixing a few basic typos in the Programming Guide.

2015-05-19 Thread srowen
Repository: spark Updated Branches: refs/heads/master 6008ec14e -> 61f164d3f Fixing a few basic typos in the Programming Guide. Just a few minor fixes in the guide, so a new JIRA issue was not created per the guidelines. Author: Mike Dusenberry Closes #6240 from dusenberrymw/Fix_Programmin

[1/2] spark git commit: Preparing development version 1.4.1-SNAPSHOT

2015-05-19 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.4 30bf33359 -> a1d896b85 Preparing development version 1.4.1-SNAPSHOT Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/a1d896b8 Tree: http://git-wip-us.apache.org/repo

Git Push Summary

2015-05-19 Thread pwendell
Repository: spark Updated Tags: refs/tags/v1.4.0-rc1 [created] 79fb01a3b - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

[2/2] spark git commit: Preparing Spark release v1.4.0-rc1

2015-05-19 Thread pwendell
Preparing Spark release v1.4.0-rc1 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/79fb01a3 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/79fb01a3 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/79fb01a3 Bra

Git Push Summary

2015-05-19 Thread pwendell
Repository: spark Updated Tags: refs/tags/v1.4.0-rc1 [deleted] 38ccef36c - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

[1/3] spark git commit: Revert "Preparing development version 1.4.1-SNAPSHOT"

2015-05-19 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.4 38a3fc848 -> 30bf33359 Revert "Preparing development version 1.4.1-SNAPSHOT" This reverts commit 40190ce22622cadd41f740a763fba061281c2966. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org

[2/3] spark git commit: Revert "Preparing Spark release v1.4.0-rc1"

2015-05-19 Thread pwendell
Revert "Preparing Spark release v1.4.0-rc1" This reverts commit 38ccef36c1551dc36d9444f47df11ae34c1e139e. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/b0c63d24 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/b0c63d

[3/3] spark git commit: Updating CHANGES.txt for Spark 1.4

2015-05-19 Thread pwendell
Updating CHANGES.txt for Spark 1.4 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/30bf3335 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/30bf3335 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/30bf3335 Bra

spark git commit: [SPARK-7581] [ML] [DOC] User guide for spark.ml PolynomialExpansion

2015-05-19 Thread jkbradley
Repository: spark Updated Branches: refs/heads/branch-1.4 de60c2e73 -> 38a3fc848 [SPARK-7581] [ML] [DOC] User guide for spark.ml PolynomialExpansion JIRA [here](https://issues.apache.org/jira/browse/SPARK-7581). CC jkbradley Author: Xusen Yin Closes #6113 from yinxusen/SPARK-7581 and squas

spark git commit: [SPARK-7581] [ML] [DOC] User guide for spark.ml PolynomialExpansion

2015-05-19 Thread jkbradley
Repository: spark Updated Branches: refs/heads/master 23cf89711 -> 6008ec14e [SPARK-7581] [ML] [DOC] User guide for spark.ml PolynomialExpansion JIRA [here](https://issues.apache.org/jira/browse/SPARK-7581). CC jkbradley Author: Xusen Yin Closes #6113 from yinxusen/SPARK-7581 and squashes

spark git commit: [HOTFIX] Fixing style failures in Kinesis source

2015-05-19 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.4 40190ce22 -> de60c2e73 [HOTFIX] Fixing style failures in Kinesis source Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/de60c2e7 Tree: http://git-wip-us.apache.org/

spark git commit: [HOTFIX] Fixing style failures in Kinesis source

2015-05-19 Thread pwendell
Repository: spark Updated Branches: refs/heads/master 9ebb44f8a -> 23cf89711 [HOTFIX] Fixing style failures in Kinesis source Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/23cf8971 Tree: http://git-wip-us.apache.org/repo