spark git commit: [SPARK-5966][WIP] Spark-submit deploy-mode cluster is not compatible with master local>

2015-10-26 Thread srowen
Repository: spark Updated Branches: refs/heads/master 05c4bdb57 -> 616be29c7 [SPARK-5966][WIP] Spark-submit deploy-mode cluster is not compatible with master local> … master local> Author: Kevin Yu Closes #9220 from kevinyu98/working_on_spark-5966. Project:

spark git commit: [SPARK-5966][WIP] Spark-submit deploy-mode cluster is not compatible with master local>

2015-10-26 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-1.5 74921c219 -> a355d0d0d [SPARK-5966][WIP] Spark-submit deploy-mode cluster is not compatible with master local> … master local> Author: Kevin Yu Closes #9220 from kevinyu98/working_on_spark-5966. (cherry picked

spark git commit: [SPARK-11279][PYSPARK] Add DataFrame#toDF in PySpark

2015-10-26 Thread rxin
Repository: spark Updated Branches: refs/heads/master 07ced4342 -> 05c4bdb57 [SPARK-11279][PYSPARK] Add DataFrame#toDF in PySpark Author: Jeff Zhang Closes #9248 from zjffdu/SPARK-11279. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit:

spark git commit: [SPARK-11325] [SQL] Alias 'alias' in Scala's DataFrame API

2015-10-26 Thread yhuai
Repository: spark Updated Branches: refs/heads/master 4bb2b3698 -> d4c397a64 [SPARK-11325] [SQL] Alias 'alias' in Scala's DataFrame API Author: Nong Li Closes #9286 from nongli/spark-11325. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit:

spark git commit: [SPARK-10979][SPARKR] Sparkrmerge: Add merge to DataFrame with R signature

2015-10-26 Thread shivaram
Repository: spark Updated Branches: refs/heads/master 616be29c7 -> 3689beb98 [SPARK-10979][SPARKR] Sparkrmerge: Add merge to DataFrame with R signature Add merge function to DataFrame, which supports R signature. https://stat.ethz.ch/R-manual/R-devel/library/base/html/merge.html Author:

spark git commit: [SQL][DOC] Minor document fixes in interfaces.scala

2015-10-26 Thread rxin
Repository: spark Updated Branches: refs/heads/master b60aab8a9 -> 4bb2b3698 [SQL][DOC] Minor document fixes in interfaces.scala rxin just noticed this while reading the code. Author: Alexander Slesarenko Closes #9284 from aslesarenko/doc-typos. Project:

spark git commit: [SPARK-11258] Converting a Spark DataFrame into an R data.frame is slow / requires a lot of memory

2015-10-26 Thread shivaram
Repository: spark Updated Branches: refs/heads/master 3689beb98 -> b60aab8a9 [SPARK-11258] Converting a Spark DataFrame into an R data.frame is slow / requires a lot of memory https://issues.apache.org/jira/browse/SPARK-11258 I was not able to locate an existing unit test for this function

spark git commit: [SQL][DOC] Minor document fixes in interfaces.scala

2015-10-26 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-1.5 a355d0d0d -> 8a6e63c78 [SQL][DOC] Minor document fixes in interfaces.scala rxin just noticed this while reading the code. Author: Alexander Slesarenko Closes #9284 from aslesarenko/doc-typos. (cherry picked

spark git commit: [SPARK-10271][PYSPARK][MLLIB] Added @since tags to pyspark.mllib.clustering

2015-10-26 Thread meng
Repository: spark Updated Branches: refs/heads/master 943d4fa20 -> 5d4f6abec [SPARK-10271][PYSPARK][MLLIB] Added @since tags to pyspark.mllib.clustering Duplicated the since decorator from pyspark.sql into pyspark (also tweaked to handle functions without docstrings). Added since to methods

spark git commit: [SPARK-10562] [SQL] support mixed case partitionBy column names for tables stored in metastore

2015-10-26 Thread yhuai
Repository: spark Updated Branches: refs/heads/master dc3220ce1 -> a150e6c1b [SPARK-10562] [SQL] support mixed case partitionBy column names for tables stored in metastore https://issues.apache.org/jira/browse/SPARK-10562 Author: Wenchen Fan Closes #9226 from

spark git commit: [SPARK-10654][MLLIB] Add columnSimilarities to IndexedRowMatrix

2015-10-26 Thread meng
Repository: spark Updated Branches: refs/heads/master 3cac6614a -> 8b292b19c [SPARK-10654][MLLIB] Add columnSimilarities to IndexedRowMatrix Add columnSimilarities to IndexedRowMatrix by delegating to functionality already in RowMatrix. With a test. Author: Reza Zadeh

spark git commit: [SPARK-11184][MLLIB] Declare most of .mllib code not-Experimental

2015-10-26 Thread meng
Repository: spark Updated Branches: refs/heads/master 5d4f6abec -> 3cac6614a [SPARK-11184][MLLIB] Declare most of .mllib code not-Experimental Remove "Experimental" from .mllib code that has been around since 1.4.0 or earlier Author: Sean Owen Closes #9169 from

spark git commit: [SPARK-10947] [SQL] With schema inference from JSON into a Dataframe, add option to infer all primitive object types as strings

2015-10-26 Thread yhuai
Repository: spark Updated Branches: refs/heads/master d4c397a64 -> 82464fb2e [SPARK-10947] [SQL] With schema inference from JSON into a Dataframe, add option to infer all primitive object types as strings Currently, when a schema is inferred from a JSON file using sqlContext.read.json, the

spark git commit: [SPARK-11209][SPARKR] Add window functions into SparkR [step 1].

2015-10-26 Thread shivaram
Repository: spark Updated Branches: refs/heads/master 82464fb2e -> dc3220ce1 [SPARK-11209][SPARKR] Add window functions into SparkR [step 1]. Author: Sun Rui Closes #9193 from sun-rui/SPARK-11209. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit:

spark git commit: [SPARK-11289][DOC] Substitute code examples in ML features extractors with include_example

2015-10-26 Thread meng
Repository: spark Updated Branches: refs/heads/master a150e6c1b -> 943d4fa20 [SPARK-11289][DOC] Substitute code examples in ML features extractors with include_example mengxr https://issues.apache.org/jira/browse/SPARK-11289 I make some changes in ML feature extractors. I.e. TF-IDF,