spark git commit: [SPARK-19916][SQL] simplify bad file handling

2017-03-12 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 945668854 -> 05887fc3d [SPARK-19916][SQL] simplify bad file handling ## What changes were proposed in this pull request? We should only have one centre place to try catch the exception for corrupted files. ## How was this patch tested?

spark git commit: [SPARK-17495][SQL] Support date, timestamp and interval types in Hive hash

2017-03-12 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 0a4d06a7c -> 945668854 [SPARK-17495][SQL] Support date, timestamp and interval types in Hive hash ## What changes were proposed in this pull request? - Timestamp hashing is done as per [TimestampWritable.hashCode()](https://github.com/apa

spark git commit: [SPARK-19853][SS] uppercase kafka topics fail when startingOffsets are SpecificOffsets

2017-03-12 Thread zsxwing
Repository: spark Updated Branches: refs/heads/branch-2.1 f9833c66a -> 8c4608046 [SPARK-19853][SS] uppercase kafka topics fail when startingOffsets are SpecificOffsets When using the KafkaSource with Structured Streaming, consumer assignments are not what the user expects if startingOffsets

spark git commit: [SPARK-19853][SS] uppercase kafka topics fail when startingOffsets are SpecificOffsets

2017-03-12 Thread zsxwing
Repository: spark Updated Branches: refs/heads/master 9f8ce4825 -> 0a4d06a7c [SPARK-19853][SS] uppercase kafka topics fail when startingOffsets are SpecificOffsets When using the KafkaSource with Structured Streaming, consumer assignments are not what the user expects if startingOffsets is s

spark git commit: [SPARK-19282][ML][SPARKR] RandomForest Wrapper and GBT Wrapper return param "maxDepth" to R models

2017-03-12 Thread felixcheung
Repository: spark Updated Branches: refs/heads/master 2f5187bde -> 9f8ce4825 [SPARK-19282][ML][SPARKR] RandomForest Wrapper and GBT Wrapper return param "maxDepth" to R models ## What changes were proposed in this pull request? RandomForest R Wrapper and GBT R Wrapper return param `maxDepth`

spark git commit: [SPARK-19831][CORE] Reuse the existing cleanupThreadExecutor to clean up the directories of finished applications to avoid the block

2017-03-12 Thread zsxwing
Repository: spark Updated Branches: refs/heads/master e29a74d5b -> 2f5187bde [SPARK-19831][CORE] Reuse the existing cleanupThreadExecutor to clean up the directories of finished applications to avoid the block Cleaning the application may cost much time at worker, then it will block that the

[1/2] spark-website git commit: add Spark Project Improvement Proposals doc

2017-03-12 Thread srowen
Repository: spark-website Updated Branches: refs/heads/asf-site c1b9ad3cb -> 39838046c http://git-wip-us.apache.org/repos/asf/spark-website/blob/39838046/site/news/spark-summit-east-2016-cfp-closing.html -- diff --git a/site/ne

[2/2] spark-website git commit: add Spark Project Improvement Proposals doc

2017-03-12 Thread srowen
add Spark Project Improvement Proposals doc Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/39838046 Tree: http://git-wip-us.apache.org/repos/asf/spark-website/tree/39838046 Diff: http://git-wip-us.apache.org/r

spark git commit: [DOCS][SS] fix structured streaming python example

2017-03-12 Thread srowen
Repository: spark Updated Branches: refs/heads/master f6fdf92d0 -> e29a74d5b [DOCS][SS] fix structured streaming python example ## What changes were proposed in this pull request? - SS python example: `TypeError: 'xxx' object is not callable` - some other doc issue. ## How was this patch tes

spark git commit: [DOCS][SS] fix structured streaming python example

2017-03-12 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.1 e481a7381 -> f9833c66a [DOCS][SS] fix structured streaming python example ## What changes were proposed in this pull request? - SS python example: `TypeError: 'xxx' object is not callable` - some other doc issue. ## How was this patch