spark git commit: [SPARK-16818] Exchange reuse incorrectly reuses scans over different sets of partitions

2016-08-01 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.0 1813bbd9b -> 5fbf5f93e [SPARK-16818] Exchange reuse incorrectly reuses scans over different sets of partitions https://github.com/apache/spark/pull/14425 rebased for branch-2.0 Author: Eric Liang Closes #14427

spark git commit: [SPARK-16828][SQL] remove MaxOf and MinOf

2016-08-01 Thread yhuai
Repository: spark Updated Branches: refs/heads/master 03d46aafe -> 2eedc00b0 [SPARK-16828][SQL] remove MaxOf and MinOf ## What changes were proposed in this pull request? These 2 expressions are not needed anymore after we have `Greatest` and `Least`. This PR removes them and related tests.

spark git commit: [SPARK-15869][STREAMING] Fix a potential NPE in StreamingJobProgressListener.getBatchUIData

2016-08-01 Thread zsxwing
Repository: spark Updated Branches: refs/heads/branch-2.0 4e73cb8eb -> 1813bbd9b [SPARK-15869][STREAMING] Fix a potential NPE in StreamingJobProgressListener.getBatchUIData ## What changes were proposed in this pull request? Moved `asScala` to a `map` to avoid NPE. ## How was this patch

spark git commit: [SPARK-15869][STREAMING] Fix a potential NPE in StreamingJobProgressListener.getBatchUIData

2016-08-01 Thread zsxwing
Repository: spark Updated Branches: refs/heads/master ab1e761f9 -> 03d46aafe [SPARK-15869][STREAMING] Fix a potential NPE in StreamingJobProgressListener.getBatchUIData ## What changes were proposed in this pull request? Moved `asScala` to a `map` to avoid NPE. ## How was this patch

spark git commit: [SPARK-16774][SQL] Fix use of deprecated timestamp constructor & improve timezone handling

2016-08-01 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.0 1523bf69a -> 4e73cb8eb [SPARK-16774][SQL] Fix use of deprecated timestamp constructor & improve timezone handling ## What changes were proposed in this pull request? Removes the deprecated timestamp constructor and incidentally fixes

spark git commit: [SPARK-16774][SQL] Fix use of deprecated timestamp constructor & improve timezone handling

2016-08-01 Thread srowen
Repository: spark Updated Branches: refs/heads/master 338a98d65 -> ab1e761f9 [SPARK-16774][SQL] Fix use of deprecated timestamp constructor & improve timezone handling ## What changes were proposed in this pull request? Removes the deprecated timestamp constructor and incidentally fixes the

spark-website git commit: Fix main links to streaming examples

2016-08-01 Thread srowen
Repository: spark-website Updated Branches: refs/heads/asf-site 5e869909e -> 612383440 Fix main links to streaming examples Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/61238344 Tree:

spark git commit: [SPARK-16791][SQL] cast struct with timestamp field fails

2016-08-01 Thread wenchen
Repository: spark Updated Branches: refs/heads/branch-2.0 b49091e10 -> 1523bf69a [SPARK-16791][SQL] cast struct with timestamp field fails ## What changes were proposed in this pull request? a failing test case + fix to SPARK-16791 (https://issues.apache.org/jira/browse/SPARK-16791) ## How

spark git commit: [SPARK-16791][SQL] cast struct with timestamp field fails

2016-08-01 Thread wenchen
Repository: spark Updated Branches: refs/heads/master f93ad4fe7 -> 338a98d65 [SPARK-16791][SQL] cast struct with timestamp field fails ## What changes were proposed in this pull request? a failing test case + fix to SPARK-16791 (https://issues.apache.org/jira/browse/SPARK-16791) ## How was

spark git commit: [SPARK-16776][STREAMING] Replace deprecated API in KafkaTestUtils for 0.10.0.

2016-08-01 Thread srowen
Repository: spark Updated Branches: refs/heads/master 1e9b59b73 -> f93ad4fe7 [SPARK-16776][STREAMING] Replace deprecated API in KafkaTestUtils for 0.10.0. ## What changes were proposed in this pull request? This PR replaces the old Kafka API to 0.10.0 ones in `KafkaTestUtils`. The change

spark git commit: [SPARK-16776][STREAMING] Replace deprecated API in KafkaTestUtils for 0.10.0.

2016-08-01 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.0 4bdc55898 -> b49091e10 [SPARK-16776][STREAMING] Replace deprecated API in KafkaTestUtils for 0.10.0. ## What changes were proposed in this pull request? This PR replaces the old Kafka API to 0.10.0 ones in `KafkaTestUtils`. The

spark git commit: [SPARK-16778][SQL][TRIVIAL] Fix deprecation warning with SQLContext

2016-08-01 Thread srowen
Repository: spark Updated Branches: refs/heads/master 2a0de7dc9 -> 1e9b59b73 [SPARK-16778][SQL][TRIVIAL] Fix deprecation warning with SQLContext ## What changes were proposed in this pull request? Change to non-deprecated constructor for SQLContext. ## How was this patch tested? Existing

spark git commit: [SPARK-16778][SQL][TRIVIAL] Fix deprecation warning with SQLContext

2016-08-01 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.0 c651ff53a -> 4bdc55898 [SPARK-16778][SQL][TRIVIAL] Fix deprecation warning with SQLContext ## What changes were proposed in this pull request? Change to non-deprecated constructor for SQLContext. ## How was this patch tested?

spark git commit: [SPARK-16485][DOC][ML] Remove useless latex in a log messge.

2016-08-01 Thread srowen
Repository: spark Updated Branches: refs/heads/master 64d8f37c7 -> 2a0de7dc9 [SPARK-16485][DOC][ML] Remove useless latex in a log messge. ## What changes were proposed in this pull request? Removed useless latex in a log messge. ## How was this patch tested? Check generated scaladoc.

spark git commit: [SPARK-16726][SQL] Improve `Union/Intersect/Except` error messages on incompatible types

2016-08-01 Thread hvanhovell
Repository: spark Updated Branches: refs/heads/master 579fbcf3b -> 64d8f37c7 [SPARK-16726][SQL] Improve `Union/Intersect/Except` error messages on incompatible types ## What changes were proposed in this pull request? Currently, `UNION` queries on incompatible types show misleading error