[spark] Git Push Summary

2016-11-01 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.1 [created] 1bbf9ff63 - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

spark git commit: [SPARK-17992][SQL] Return all partitions from HiveShim when Hive throws a metastore exception when attempting to fetch partitions by filter

2016-11-01 Thread rxin
Repository: spark Updated Branches: refs/heads/master 1ecfafa08 -> 1bbf9ff63 [SPARK-17992][SQL] Return all partitions from HiveShim when Hive throws a metastore exception when attempting to fetch partitions by filter (Link to Jira issue: https://issues.apache.org/jira/browse/SPARK-17992) ##

spark git commit: [SPARK-17838][SPARKR] Check named arguments for options and use formatted R friendly message from JVM exception message

2016-11-01 Thread felixcheung
Repository: spark Updated Branches: refs/heads/master ad4832a9f -> 1ecfafa08 [SPARK-17838][SPARKR] Check named arguments for options and use formatted R friendly message from JVM exception message ## What changes were proposed in this pull request? This PR proposes to - improve the

spark git commit: [SPARK-18216][SQL] Make Column.expr public

2016-11-01 Thread rxin
Repository: spark Updated Branches: refs/heads/master 77a98162d -> ad4832a9f [SPARK-18216][SQL] Make Column.expr public ## What changes were proposed in this pull request? Column.expr is private[sql], but it's an actually really useful field to have for debugging. We should open it up,

spark git commit: [SPARK-18088][ML] Various ChiSqSelector cleanups

2016-11-01 Thread jkbradley
Repository: spark Updated Branches: refs/heads/master b929537b6 -> 91c33a0ca [SPARK-18088][ML] Various ChiSqSelector cleanups ## What changes were proposed in this pull request? - Renamed kbest to numTopFeatures - Renamed alpha to fpr - Added missing Since annotations - Doc cleanups ## How

spark git commit: [SPARK-18182] Expose ReplayListenerBus.read() overload which takes string iterator

2016-11-01 Thread rxin
Repository: spark Updated Branches: refs/heads/master 6e6298154 -> b929537b6 [SPARK-18182] Expose ReplayListenerBus.read() overload which takes string iterator The `ReplayListenerBus.read()` method is used when implementing a custom `ApplicationHistoryProvider`. The current interface only

spark git commit: [SPARK-17350][SQL] Disable default use of KryoSerializer in Thrift Server

2016-11-01 Thread rxin
Repository: spark Updated Branches: refs/heads/master 01dd00830 -> 6e6298154 [SPARK-17350][SQL] Disable default use of KryoSerializer in Thrift Server In SPARK-4761 / #3621 (December 2014) we enabled Kryo serialization by default in the Spark Thrift Server. However, I don't think that the

[1/2] spark git commit: Preparing Spark release v2.0.2-rc2

2016-11-01 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-2.0 a01b95060 -> d401a74d4 Preparing Spark release v2.0.2-rc2 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/a6abe1ee Tree:

spark git commit: [SPARK-17764][SQL] Add `to_json` supporting to convert nested struct column to JSON string

2016-11-01 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master cfac17ee1 -> 01dd00830 [SPARK-17764][SQL] Add `to_json` supporting to convert nested struct column to JSON string ## What changes were proposed in this pull request? This PR proposes to add `to_json` function in contrast with `from_json`

[spark] Git Push Summary

2016-11-01 Thread pwendell
Repository: spark Updated Tags: refs/tags/v2.0.2-rc2 [created] a6abe1ee2 - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

spark git commit: [SPARK-18114][HOTFIX] Fix line-too-long style error from backport of SPARK-18114

2016-11-01 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.0 4176da8be -> a01b95060 [SPARK-18114][HOTFIX] Fix line-too-long style error from backport of SPARK-18114 ## What changes were proposed in this pull request? Fix style error introduced in cherry-pick of

spark git commit: [SPARK-18167] Disable flaky SQLQuerySuite test

2016-11-01 Thread rxin
Repository: spark Updated Branches: refs/heads/master d0272b436 -> cfac17ee1 [SPARK-18167] Disable flaky SQLQuerySuite test We now know it's a persistent environmental issue that is causing this test to sometimes fail. One hypothesis is that some configuration is leaked from another suite,

spark git commit: [SPARK-18148][SQL] Misleading Error Message for Aggregation Without Window/GroupBy

2016-11-01 Thread rxin
Repository: spark Updated Branches: refs/heads/master 8a538c97b -> d0272b436 [SPARK-18148][SQL] Misleading Error Message for Aggregation Without Window/GroupBy ## What changes were proposed in this pull request? Aggregation Without Window/GroupBy expressions will fail in `checkAnalysis`,

spark git commit: [SPARK-18189][SQL] Fix serialization issue in KeyValueGroupedDataset

2016-11-01 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.0 4d2672a40 -> 58655f51f [SPARK-18189][SQL] Fix serialization issue in KeyValueGroupedDataset ## What changes were proposed in this pull request? Likewise

spark git commit: [SPARK-18189][SQL] Fix serialization issue in KeyValueGroupedDataset

2016-11-01 Thread rxin
Repository: spark Updated Branches: refs/heads/master 8cdf143f4 -> 8a538c97b [SPARK-18189][SQL] Fix serialization issue in KeyValueGroupedDataset ## What changes were proposed in this pull request? Likewise

spark git commit: [SPARK-18103][FOLLOW-UP][SQL][MINOR] Rename `MetadataLogFileCatalog` to `MetadataLogFileIndex`

2016-11-01 Thread rxin
Repository: spark Updated Branches: refs/heads/master 8ac09108f -> 8cdf143f4 [SPARK-18103][FOLLOW-UP][SQL][MINOR] Rename `MetadataLogFileCatalog` to `MetadataLogFileIndex` ## What changes were proposed in this pull request? This is a follow-up to https://github.com/apache/spark/pull/15634.

spark git commit: [SPARK-17848][ML] Move LabelCol datatype cast into Predictor.fit

2016-11-01 Thread jkbradley
Repository: spark Updated Branches: refs/heads/master 0cba535af -> 8ac09108f [SPARK-17848][ML] Move LabelCol datatype cast into Predictor.fit ## What changes were proposed in this pull request? 1, move cast to `Predictor` 2, and then, remove unnecessary cast ## How was this patch tested?

spark git commit: Revert "[SPARK-16839][SQL] redundant aliases after cleanupAliases"

2016-11-01 Thread hvanhovell
Repository: spark Updated Branches: refs/heads/master 5441a6269 -> 0cba535af Revert "[SPARK-16839][SQL] redundant aliases after cleanupAliases" This reverts commit 5441a6269e00e3903ae6c1ea8deb4ddf3d2e9975. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit:

spark git commit: [SPARK-17996][SQL] Fix unqualified catalog.getFunction(...)

2016-11-01 Thread hvanhovell
Repository: spark Updated Branches: refs/heads/master 9b377aa49 -> f7c145d8c [SPARK-17996][SQL] Fix unqualified catalog.getFunction(...) ## What changes were proposed in this pull request? Currently an unqualified `getFunction(..)`call returns a wrong result; the returned function is shown

spark git commit: [SPARK-18114][MESOS] Fix mesos cluster scheduler generage command option error

2016-11-01 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.0 e06f43e33 -> 4d2672a40 [SPARK-18114][MESOS] Fix mesos cluster scheduler generage command option error Enclose --conf option value with "" to support multi value configs like spark.driver.extraJavaOptions, without "", driver will fail

spark git commit: [SPARK-18114][MESOS] Fix mesos cluster scheduler generage command option error

2016-11-01 Thread srowen
Repository: spark Updated Branches: refs/heads/master ec6f479bb -> 9b377aa49 [SPARK-18114][MESOS] Fix mesos cluster scheduler generage command option error ## What changes were proposed in this pull request? Enclose --conf option value with "" to support multi value configs like

spark git commit: [SPARK-16881][MESOS] Migrate Mesos configs to use ConfigEntry

2016-11-01 Thread srowen
Repository: spark Updated Branches: refs/heads/master e34b4e126 -> ec6f479bb [SPARK-16881][MESOS] Migrate Mesos configs to use ConfigEntry ## What changes were proposed in this pull request? Migrate Mesos configs to use ConfigEntry ## How was this patch tested? Jenkins Tests Author:

spark git commit: [SPARK-15994][MESOS] Allow enabling Mesos fetch cache in coarse executor backend

2016-11-01 Thread srowen
Repository: spark Updated Branches: refs/heads/master cb80edc26 -> e34b4e126 [SPARK-15994][MESOS] Allow enabling Mesos fetch cache in coarse executor backend Mesos 0.23.0 introduces a Fetch Cache feature http://mesos.apache.org/documentation/latest/fetcher/ which allows caching of resources

spark git commit: [SPARK-18111][SQL] Wrong ApproximatePercentile answer when multiple records have the minimum value

2016-11-01 Thread srowen
Repository: spark Updated Branches: refs/heads/master 623fc7fc6 -> cb80edc26 [SPARK-18111][SQL] Wrong ApproximatePercentile answer when multiple records have the minimum value ## What changes were proposed in this pull request? When multiple records have the minimum value, the answer of

spark git commit: [MINOR][DOC] Remove spaces following slashs

2016-11-01 Thread srowen
Repository: spark Updated Branches: refs/heads/master dd85eb544 -> 623fc7fc6 [MINOR][DOC] Remove spaces following slashs ## What changes were proposed in this pull request? This PR merges multiple lines enumerating items in order to remove the redundant spaces following slashes in

spark git commit: [SPARK-18107][SQL] Insert overwrite statement runs much slower in spark-sql than it does in hive-client

2016-11-01 Thread rxin
Repository: spark Updated Branches: refs/heads/master d9d146500 -> dd85eb544 [SPARK-18107][SQL] Insert overwrite statement runs much slower in spark-sql than it does in hive-client ## What changes were proposed in this pull request? As reported on the jira, insert overwrite statement runs