spark git commit: [SPARK-16829][SPARKR] sparkR sc.setLogLevel doesn't work

2016-09-03 Thread shivaram
Repository: spark Updated Branches: refs/heads/master abb2f9210 -> e9b58e9ef [SPARK-16829][SPARKR] sparkR sc.setLogLevel doesn't work (Please fill in changes proposed in this fix) ./bin/sparkR Launching java with spark-submit command /Users/mwang/spark_ws_0904/bin/spark-submit

spark git commit: [SPARK-17315][SPARKR] Kolmogorov-Smirnov test SparkR wrapper

2016-09-03 Thread felixcheung
Repository: spark Updated Branches: refs/heads/master c2a1576c2 -> abb2f9210 [SPARK-17315][SPARKR] Kolmogorov-Smirnov test SparkR wrapper ## What changes were proposed in this pull request? This PR tries to add Kolmogorov-Smirnov Test wrapper to SparkR. This wrapper implementation only

spark git commit: [SPARK-17335][SQL] Fix ArrayType and MapType CatalogString.

2016-09-03 Thread hvanhovell
Repository: spark Updated Branches: refs/heads/branch-2.0 3500dbc9b -> 704215d30 [SPARK-17335][SQL] Fix ArrayType and MapType CatalogString. ## What changes were proposed in this pull request? the `catalogString` for `ArrayType` and `MapType` currently calls the `simpleString` method on its

spark git commit: [SPARK-17335][SQL] Fix ArrayType and MapType CatalogString.

2016-09-03 Thread hvanhovell
Repository: spark Updated Branches: refs/heads/master a8a35b39b -> c2a1576c2 [SPARK-17335][SQL] Fix ArrayType and MapType CatalogString. ## What changes were proposed in this pull request? the `catalogString` for `ArrayType` and `MapType` currently calls the `simpleString` method on its

spark git commit: [SPARK-16663][SQL] desc table should be consistent between data source and hive serde tables

2016-09-03 Thread wenchen
Repository: spark Updated Branches: refs/heads/branch-2.0 a7f5e7066 -> 3500dbc9b [SPARK-16663][SQL] desc table should be consistent between data source and hive serde tables Currently there are 2 inconsistence: 1. for data source table, we only print partition names, for hive table, we

spark git commit: [SPARK-16959][SQL] Rebuild Table Comment when Retrieving Metadata from Hive Metastore

2016-09-03 Thread wenchen
Repository: spark Updated Branches: refs/heads/branch-2.0 196d62eae -> a7f5e7066 [SPARK-16959][SQL] Rebuild Table Comment when Retrieving Metadata from Hive Metastore ### What changes were proposed in this pull request? The `comment` in `CatalogTable` returned from Hive is always empty. We

spark git commit: [MINOR][SQL] Not dropping all necessary tables

2016-09-03 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.0 949544d01 -> 196d62eae [MINOR][SQL] Not dropping all necessary tables ## What changes were proposed in this pull request? was not dropping table `parquet_t3` ## How was this patch tested? tested `LogicalPlanToSQLSuite` locally

spark git commit: [MINOR][SQL] Not dropping all necessary tables

2016-09-03 Thread srowen
Repository: spark Updated Branches: refs/heads/master 97da41039 -> a8a35b39b [MINOR][SQL] Not dropping all necessary tables ## What changes were proposed in this pull request? was not dropping table `parquet_t3` ## How was this patch tested? tested `LogicalPlanToSQLSuite` locally Author:

spark git commit: [SPARK-17347][SQL][EXAMPLES] Encoder in Dataset example has incorrect type

2016-09-03 Thread srowen
Repository: spark Updated Branches: refs/heads/master 7a8a81d79 -> 97da41039 [SPARK-17347][SQL][EXAMPLES] Encoder in Dataset example has incorrect type ## What changes were proposed in this pull request? We propose to fix the Encoder type in the Dataset example ## How was this patch tested?

spark git commit: [SPARK-17347][SQL][EXAMPLES] Encoder in Dataset example has incorrect type

2016-09-03 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.0 12a2e2a5a -> 949544d01 [SPARK-17347][SQL][EXAMPLES] Encoder in Dataset example has incorrect type ## What changes were proposed in this pull request? We propose to fix the Encoder type in the Dataset example ## How was this patch

spark git commit: [SPARK-17363][ML][MLLIB] fix MultivariantOnlineSummerizer.numNonZeros

2016-09-03 Thread srowen
Repository: spark Updated Branches: refs/heads/master d2fde6b72 -> 7a8a81d79 [SPARK-17363][ML][MLLIB] fix MultivariantOnlineSummerizer.numNonZeros ## What changes were proposed in this pull request? fix `MultivariantOnlineSummerizer.numNonZeros` method, return `nnz` array, instead of