spark git commit: [SPARK-20375][R] R wrappers for array and map

2017-04-19 Thread felixcheung
Repository: spark Updated Branches: refs/heads/master bdc605691 -> 46c574976 [SPARK-20375][R] R wrappers for array and map ## What changes were proposed in this pull request? Adds wrappers for `o.a.s.sql.functions.array` and `o.a.s.sql.functions.map` ## How was this patch tested? Unit

spark git commit: Fixed typos in docs

2017-04-19 Thread rxin
Repository: spark Updated Branches: refs/heads/master dd6d55d5d -> bdc605691 Fixed typos in docs ## What changes were proposed in this pull request? Typos at a couple of place in the docs. ## How was this patch tested? build including docs Please review

spark git commit: Fixed typos in docs

2017-04-19 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.2 e6bbdb0c5 -> 8d658b90b Fixed typos in docs ## What changes were proposed in this pull request? Typos at a couple of place in the docs. ## How was this patch tested? build including docs Please review

spark git commit: [SPARK-20398][SQL] range() operator should include cancellation reason when killed

2017-04-19 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.2 af9f18c31 -> e6bbdb0c5 [SPARK-20398][SQL] range() operator should include cancellation reason when killed ## What changes were proposed in this pull request? https://issues.apache.org/jira/browse/SPARK-19820 adds a reason field for

spark git commit: [SPARK-20398][SQL] range() operator should include cancellation reason when killed

2017-04-19 Thread rxin
Repository: spark Updated Branches: refs/heads/master 39e303a8b -> dd6d55d5d [SPARK-20398][SQL] range() operator should include cancellation reason when killed ## What changes were proposed in this pull request? https://issues.apache.org/jira/browse/SPARK-19820 adds a reason field for why

spark git commit: [MINOR][SS] Fix a missing space in UnsupportedOperationChecker error message

2017-04-19 Thread zsxwing
Repository: spark Updated Branches: refs/heads/branch-2.2 371af9623 -> af9f18c31 [MINOR][SS] Fix a missing space in UnsupportedOperationChecker error message ## What changes were proposed in this pull request? Also went through the same file to ensure other string concatenation are correct.

spark git commit: [MINOR][SS] Fix a missing space in UnsupportedOperationChecker error message

2017-04-19 Thread zsxwing
Repository: spark Updated Branches: refs/heads/branch-2.1 171bf656f -> 9e5dc82a1 [MINOR][SS] Fix a missing space in UnsupportedOperationChecker error message ## What changes were proposed in this pull request? Also went through the same file to ensure other string concatenation are correct.

spark git commit: [MINOR][SS] Fix a missing space in UnsupportedOperationChecker error message

2017-04-19 Thread zsxwing
Repository: spark Updated Branches: refs/heads/master 63824b2c8 -> 39e303a8b [MINOR][SS] Fix a missing space in UnsupportedOperationChecker error message ## What changes were proposed in this pull request? Also went through the same file to ensure other string concatenation are correct. ##

spark git commit: [SPARK-20350] Add optimization rules to apply Complementation Laws.

2017-04-19 Thread wenchen
Repository: spark Updated Branches: refs/heads/branch-2.2 d649787ee -> 371af9623 [SPARK-20350] Add optimization rules to apply Complementation Laws. ## What changes were proposed in this pull request? Apply Complementation Laws during boolean expression simplification. ## How was this patch

spark git commit: [SPARK-20350] Add optimization rules to apply Complementation Laws.

2017-04-19 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 4fea7848c -> 63824b2c8 [SPARK-20350] Add optimization rules to apply Complementation Laws. ## What changes were proposed in this pull request? Apply Complementation Laws during boolean expression simplification. ## How was this patch

spark git commit: [SPARK-20397][SPARKR][SS] Fix flaky test: test_streaming.R.Terminated by error

2017-04-19 Thread zsxwing
Repository: spark Updated Branches: refs/heads/branch-2.2 80a60da8f -> d649787ee [SPARK-20397][SPARKR][SS] Fix flaky test: test_streaming.R.Terminated by error ## What changes were proposed in this pull request? Checking a source parameter is asynchronous. When the query is created, it's

spark git commit: [SPARK-20397][SPARKR][SS] Fix flaky test: test_streaming.R.Terminated by error

2017-04-19 Thread zsxwing
Repository: spark Updated Branches: refs/heads/master 71a8e9df1 -> 4fea7848c [SPARK-20397][SPARKR][SS] Fix flaky test: test_streaming.R.Terminated by error ## What changes were proposed in this pull request? Checking a source parameter is asynchronous. When the query is created, it's not

spark git commit: [SPARK-20036][DOC] Note incompatible dependencies on org.apache.kafka artifacts

2017-04-19 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.2 8baa970bc -> 80a60da8f [SPARK-20036][DOC] Note incompatible dependencies on org.apache.kafka artifacts ## What changes were proposed in this pull request? Note that you shouldn't manually add dependencies on org.apache.kafka artifacts

spark git commit: [SPARK-20036][DOC] Note incompatible dependencies on org.apache.kafka artifacts

2017-04-19 Thread srowen
Repository: spark Updated Branches: refs/heads/master 35378766a -> 71a8e9df1 [SPARK-20036][DOC] Note incompatible dependencies on org.apache.kafka artifacts ## What changes were proposed in this pull request? Note that you shouldn't manually add dependencies on org.apache.kafka artifacts ##

spark git commit: [SPARK-20343][BUILD] Avoid Unidoc build only if Hadoop 2.6 is explicitly set in SBT build

2017-04-19 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.2 a87e21dd2 -> 8baa970bc [SPARK-20343][BUILD] Avoid Unidoc build only if Hadoop 2.6 is explicitly set in SBT build ## What changes were proposed in this pull request? This PR proposes two things as below: - Avoid Unidoc build only if

spark git commit: [SPARK-20343][BUILD] Avoid Unidoc build only if Hadoop 2.6 is explicitly set in SBT build

2017-04-19 Thread srowen
Repository: spark Updated Branches: refs/heads/master 773754b6c -> 35378766a [SPARK-20343][BUILD] Avoid Unidoc build only if Hadoop 2.6 is explicitly set in SBT build ## What changes were proposed in this pull request? This PR proposes two things as below: - Avoid Unidoc build only if

spark git commit: [SPARK-20356][SQL] Pruned InMemoryTableScanExec should have correct output partitioning and ordering

2017-04-19 Thread wenchen
Repository: spark Updated Branches: refs/heads/branch-2.2 274a3e294 -> a87e21dd2 [SPARK-20356][SQL] Pruned InMemoryTableScanExec should have correct output partitioning and ordering ## What changes were proposed in this pull request? The output of `InMemoryTableScanExec` can be pruned and

spark git commit: [SPARK-20356][SQL] Pruned InMemoryTableScanExec should have correct output partitioning and ordering

2017-04-19 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 608bf30f0 -> 773754b6c [SPARK-20356][SQL] Pruned InMemoryTableScanExec should have correct output partitioning and ordering ## What changes were proposed in this pull request? The output of `InMemoryTableScanExec` can be pruned and

spark git commit: [SPARK-20359][SQL] Avoid unnecessary execution in EliminateOuterJoin optimization that can lead to NPE

2017-04-19 Thread wenchen
Repository: spark Updated Branches: refs/heads/branch-2.1 a4c1ebc1d -> 171bf656f [SPARK-20359][SQL] Avoid unnecessary execution in EliminateOuterJoin optimization that can lead to NPE Avoid necessary execution that can lead to NPE in EliminateOuterJoin and add test in DataFrameSuite to

spark git commit: [SPARK-20359][SQL] Avoid unnecessary execution in EliminateOuterJoin optimization that can lead to NPE

2017-04-19 Thread wenchen
Repository: spark Updated Branches: refs/heads/branch-2.2 ef6923f7e -> 274a3e294 [SPARK-20359][SQL] Avoid unnecessary execution in EliminateOuterJoin optimization that can lead to NPE Avoid necessary execution that can lead to NPE in EliminateOuterJoin and add test in DataFrameSuite to

spark git commit: [SPARK-20359][SQL] Avoid unnecessary execution in EliminateOuterJoin optimization that can lead to NPE

2017-04-19 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 702d85af2 -> 608bf30f0 [SPARK-20359][SQL] Avoid unnecessary execution in EliminateOuterJoin optimization that can lead to NPE Avoid necessary execution that can lead to NPE in EliminateOuterJoin and add test in DataFrameSuite to confirm