[GitHub] [spark] SparkQA commented on issue #25271: [SPARK-28536][SQL][PYTHON][TESTS] Reduce shuffle partitions in Python UDF tests in SQLQueryTestSuite

SparkQA commented on issue #25271: [SPARK-28536][SQL][PYTHON][TESTS] Reduce shuffle partitions in Python UDF tests in SQLQueryTestSuite URL: https://github.com/apache/spark/pull/25271#issuecomment-515658591 **[Test build #108245 has started](https://amplab.cs.berkeley.edu/jenkins/job/Spark

[GitHub] [spark] HyukjinKwon commented on issue #25272: [SPARK-28441][SQL][TESTS][FOLLOW-UP] Skip Python tests if python executable and pyspark library are unavailable

HyukjinKwon commented on issue #25272: [SPARK-28441][SQL][TESTS][FOLLOW-UP] Skip Python tests if python executable and pyspark library are unavailable URL: https://github.com/apache/spark/pull/25272#issuecomment-515658470 Related tests passed. Merged to master. -

[GitHub] [spark] AmplabJenkins removed a comment on issue #25271: [SPARK-28536][SQL][PYTHON][TESTS] Reduce shuffle partitions in Python UDF tests in SQLQueryTestSuite

AmplabJenkins removed a comment on issue #25271: [SPARK-28536][SQL][PYTHON][TESTS] Reduce shuffle partitions in Python UDF tests in SQLQueryTestSuite URL: https://github.com/apache/spark/pull/25271#issuecomment-515658439 Test PASSed. Refer to this link for build results (access rights t

[GitHub] [spark] AmplabJenkins removed a comment on issue #25271: [SPARK-28536][SQL][PYTHON][TESTS] Reduce shuffle partitions in Python UDF tests in SQLQueryTestSuite

AmplabJenkins removed a comment on issue #25271: [SPARK-28536][SQL][PYTHON][TESTS] Reduce shuffle partitions in Python UDF tests in SQLQueryTestSuite URL: https://github.com/apache/spark/pull/25271#issuecomment-515658437 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25271: [SPARK-28536][SQL][PYTHON][TESTS] Reduce shuffle partitions in Python UDF tests in SQLQueryTestSuite

AmplabJenkins commented on issue #25271: [SPARK-28536][SQL][PYTHON][TESTS] Reduce shuffle partitions in Python UDF tests in SQLQueryTestSuite URL: https://github.com/apache/spark/pull/25271#issuecomment-515658437 Merged build finished. Test PASSed. -

[GitHub] [spark] AmplabJenkins commented on issue #25271: [SPARK-28536][SQL][PYTHON][TESTS] Reduce shuffle partitions in Python UDF tests in SQLQueryTestSuite

AmplabJenkins commented on issue #25271: [SPARK-28536][SQL][PYTHON][TESTS] Reduce shuffle partitions in Python UDF tests in SQLQueryTestSuite URL: https://github.com/apache/spark/pull/25271#issuecomment-515658439 Test PASSed. Refer to this link for build results (access rights to CI serv

[GitHub] [spark] HyukjinKwon commented on issue #25271: [SPARK-28536][SQL][PYTHON][TESTS] Reduce shuffle partitions in Python UDF tests in SQLQueryTestSuite

HyukjinKwon commented on issue #25271: [SPARK-28536][SQL][PYTHON][TESTS] Reduce shuffle partitions in Python UDF tests in SQLQueryTestSuite URL: https://github.com/apache/spark/pull/25271#issuecomment-515658080 ![Screen Shot 2019-07-27 at 3 48 46 PM](https://user-images.githubusercontent.c

[GitHub] [spark] AmplabJenkins removed a comment on issue #25271: [SPARK-28536][SQL][PYTHON][TESTS] Reduce shuffle partitions in Python UDF tests in SQLQueryTestSuite

AmplabJenkins removed a comment on issue #25271: [SPARK-28536][SQL][PYTHON][TESTS] Reduce shuffle partitions in Python UDF tests in SQLQueryTestSuite URL: https://github.com/apache/spark/pull/25271#issuecomment-515657988 Test PASSed. Refer to this link for build results (access rights t

[GitHub] [spark] AmplabJenkins removed a comment on issue #25271: [SPARK-28536][SQL][PYTHON][TESTS] Reduce shuffle partitions in Python UDF tests in SQLQueryTestSuite

AmplabJenkins removed a comment on issue #25271: [SPARK-28536][SQL][PYTHON][TESTS] Reduce shuffle partitions in Python UDF tests in SQLQueryTestSuite URL: https://github.com/apache/spark/pull/25271#issuecomment-515657987 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25271: [SPARK-28536][SQL][PYTHON][TESTS] Reduce shuffle partitions in Python UDF tests in SQLQueryTestSuite

AmplabJenkins commented on issue #25271: [SPARK-28536][SQL][PYTHON][TESTS] Reduce shuffle partitions in Python UDF tests in SQLQueryTestSuite URL: https://github.com/apache/spark/pull/25271#issuecomment-515657988 Test PASSed. Refer to this link for build results (access rights to CI serv

[GitHub] [spark] AmplabJenkins commented on issue #25271: [SPARK-28536][SQL][PYTHON][TESTS] Reduce shuffle partitions in Python UDF tests in SQLQueryTestSuite

AmplabJenkins commented on issue #25271: [SPARK-28536][SQL][PYTHON][TESTS] Reduce shuffle partitions in Python UDF tests in SQLQueryTestSuite URL: https://github.com/apache/spark/pull/25271#issuecomment-515657987 Merged build finished. Test PASSed. -

[GitHub] [spark] SparkQA removed a comment on issue #25271: [SPARK-28536][SQL][PYTHON][TESTS] Reduce shuffle partitions in Python UDF tests in SQLQueryTestSuite

SparkQA removed a comment on issue #25271: [SPARK-28536][SQL][PYTHON][TESTS] Reduce shuffle partitions in Python UDF tests in SQLQueryTestSuite URL: https://github.com/apache/spark/pull/25271#issuecomment-515648081 **[Test build #108243 has started](https://amplab.cs.berkeley.edu/jenkins/j

[GitHub] [spark] SparkQA commented on issue #25271: [SPARK-28536][SQL][PYTHON][TESTS] Reduce shuffle partitions in Python UDF tests in SQLQueryTestSuite

SparkQA commented on issue #25271: [SPARK-28536][SQL][PYTHON][TESTS] Reduce shuffle partitions in Python UDF tests in SQLQueryTestSuite URL: https://github.com/apache/spark/pull/25271#issuecomment-515657899 **[Test build #108243 has finished](https://amplab.cs.berkeley.edu/jenkins/job/Spar

[GitHub] [spark] maropu commented on issue #25268: [SPARK-28375][SQL] Make pullupCorrelatedPredicate idempotent

maropu commented on issue #25268: [SPARK-28375][SQL] Make pullupCorrelatedPredicate idempotent URL: https://github.com/apache/spark/pull/25268#issuecomment-515656650 WIP? This is an automated message from the Apache Git Servi

[GitHub] [spark] AmplabJenkins removed a comment on issue #25266: [SPARK-28530][SQL] Cost-based join reorder optimizer batch should be FixedPoint(1)

AmplabJenkins removed a comment on issue #25266: [SPARK-28530][SQL] Cost-based join reorder optimizer batch should be FixedPoint(1) URL: https://github.com/apache/spark/pull/25266#issuecomment-515655534 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins commented on issue #25266: [SPARK-28530][SQL] Cost-based join reorder optimizer batch should be FixedPoint(1)

AmplabJenkins commented on issue #25266: [SPARK-28530][SQL] Cost-based join reorder optimizer batch should be FixedPoint(1) URL: https://github.com/apache/spark/pull/25266#issuecomment-515655534 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins removed a comment on issue #25266: [SPARK-28530][SQL] Cost-based join reorder optimizer batch should be FixedPoint(1)

AmplabJenkins removed a comment on issue #25266: [SPARK-28530][SQL] Cost-based join reorder optimizer batch should be FixedPoint(1) URL: https://github.com/apache/spark/pull/25266#issuecomment-515655535 Test PASSed. Refer to this link for build results (access rights to CI server needed)

[GitHub] [spark] AmplabJenkins commented on issue #25266: [SPARK-28530][SQL] Cost-based join reorder optimizer batch should be FixedPoint(1)

AmplabJenkins commented on issue #25266: [SPARK-28530][SQL] Cost-based join reorder optimizer batch should be FixedPoint(1) URL: https://github.com/apache/spark/pull/25266#issuecomment-515655535 Test PASSed. Refer to this link for build results (access rights to CI server needed): h

[GitHub] [spark] gatorsmile closed pull request #25266: [SPARK-28530][SQL] Cost-based join reorder optimizer batch should be FixedPoint(1)

gatorsmile closed pull request #25266: [SPARK-28530][SQL] Cost-based join reorder optimizer batch should be FixedPoint(1) URL: https://github.com/apache/spark/pull/25266 This is an automated message from the Apache Git Servi

[GitHub] [spark] AmplabJenkins commented on issue #22646: [SPARK-25654][SQL] Support for nested JavaBean arrays, lists and maps in createDataFrame

AmplabJenkins commented on issue #22646: [SPARK-25654][SQL] Support for nested JavaBean arrays, lists and maps in createDataFrame URL: https://github.com/apache/spark/pull/22646#issuecomment-515655523 Can one of the admins verify this patch?

[GitHub] [spark] HyukjinKwon commented on issue #25215: [SPARK-28445][SQL][Python] Fix error when PythonUDF is used in both group by and aggregate expression

HyukjinKwon commented on issue #25215: [SPARK-28445][SQL][Python] Fix error when PythonUDF is used in both group by and aggregate expression URL: https://github.com/apache/spark/pull/25215#issuecomment-515655414 cc @cloud-fan and @mgaido91 too --

[GitHub] [spark] HyukjinKwon commented on issue #25204: [SPARK-28441][SQL][Python] Fix error when non-foldable expression is used in correlated scalar subquery

HyukjinKwon commented on issue #25204: [SPARK-28441][SQL][Python] Fix error when non-foldable expression is used in correlated scalar subquery URL: https://github.com/apache/spark/pull/25204#issuecomment-515655379 LGTM too Th

[GitHub] [spark] imback82 commented on a change in pull request #25040: [SPARK-28238][SQL] Implement DESCRIBE TABLE for Data Source V2 Tables.

imback82 commented on a change in pull request #25040: [SPARK-28238][SQL] Implement DESCRIBE TABLE for Data Source V2 Tables. URL: https://github.com/apache/spark/pull/25040#discussion_r307954474 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/Describe

[GitHub] [spark] gatorsmile closed pull request #25267: [SPARK-28532][SQL] Make optimizer batch "subquery" FixedPoint(1)

gatorsmile closed pull request #25267: [SPARK-28532][SQL] Make optimizer batch "subquery" FixedPoint(1) URL: https://github.com/apache/spark/pull/25267 This is an automated message from the Apache Git Service. To respond to

[GitHub] [spark] imback82 commented on a change in pull request #25040: [SPARK-28238][SQL] Implement DESCRIBE TABLE for Data Source V2 Tables.

imback82 commented on a change in pull request #25040: [SPARK-28238][SQL] Implement DESCRIBE TABLE for Data Source V2 Tables. URL: https://github.com/apache/spark/pull/25040#discussion_r307954309 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analy

[GitHub] [spark] HyukjinKwon commented on issue #25204: [SPARK-28441][SQL][Python] Fix error when non-foldable expression is used in correlated scalar subquery

HyukjinKwon commented on issue #25204: [SPARK-28441][SQL][Python] Fix error when non-foldable expression is used in correlated scalar subquery URL: https://github.com/apache/spark/pull/25204#issuecomment-515654566 @huaxingao, can you make a followup of SPARK-28277 to re-enable? http

[GitHub] [spark] gatorsmile commented on issue #25262: [SPARK-28486][CORE][PYTHON] Map PythonBroadcast's data file to a BroadcastBlock to avoid delete by GC

gatorsmile commented on issue #25262: [SPARK-28486][CORE][PYTHON] Map PythonBroadcast's data file to a BroadcastBlock to avoid delete by GC URL: https://github.com/apache/spark/pull/25262#issuecomment-515654502 cc @jiangxb1987 --

[GitHub] [spark] viirya commented on issue #25272: [SPARK-28441][SQL][TESTS][FOLLOW-UP] Skip Python tests if python executable and pyspark library are unavailable

viirya commented on issue #25272: [SPARK-28441][SQL][TESTS][FOLLOW-UP] Skip Python tests if python executable and pyspark library are unavailable URL: https://github.com/apache/spark/pull/25272#issuecomment-515650194 Thanks for adding that. -

[GitHub] [spark] gatorsmile commented on issue #25264: [SPARK-28213][SQL][followup] code cleanup and bug fix for columnar execution framework

gatorsmile commented on issue #25264: [SPARK-28213][SQL][followup] code cleanup and bug fix for columnar execution framework URL: https://github.com/apache/spark/pull/25264#issuecomment-515649764 cc @rednaxelafx Please post your comment about the changes. Thanks! --

[GitHub] [spark] AmplabJenkins removed a comment on issue #25272: [SPARK-28441][SQL][TESTS][FOLLOW-UP] Skip Python tests if python executable and pyspark library are unavailable

AmplabJenkins removed a comment on issue #25272: [SPARK-28441][SQL][TESTS][FOLLOW-UP] Skip Python tests if python executable and pyspark library are unavailable URL: https://github.com/apache/spark/pull/25272#issuecomment-515648726 Merged build finished. Test PASSed. -

[GitHub] [spark] AmplabJenkins removed a comment on issue #25272: [SPARK-28441][SQL][TESTS][FOLLOW-UP] Skip Python tests if python executable and pyspark library are unavailable

AmplabJenkins removed a comment on issue #25272: [SPARK-28441][SQL][TESTS][FOLLOW-UP] Skip Python tests if python executable and pyspark library are unavailable URL: https://github.com/apache/spark/pull/25272#issuecomment-515648729 Test PASSed. Refer to this link for build results (acce

[GitHub] [spark] SparkQA commented on issue #25272: [SPARK-28441][SQL][TESTS][FOLLOW-UP] Skip Python tests if python executable and pyspark library are unavailable

SparkQA commented on issue #25272: [SPARK-28441][SQL][TESTS][FOLLOW-UP] Skip Python tests if python executable and pyspark library are unavailable URL: https://github.com/apache/spark/pull/25272#issuecomment-515648866 **[Test build #108244 has started](https://amplab.cs.berkeley.edu/jenkin

[GitHub] [spark] HyukjinKwon commented on issue #25272: [SPARK-28441][SQL][TESTS][FOLLOW-UP] Skip Python tests if python executable and pyspark library are unavailable

HyukjinKwon commented on issue #25272: [SPARK-28441][SQL][TESTS][FOLLOW-UP] Skip Python tests if python executable and pyspark library are unavailable URL: https://github.com/apache/spark/pull/25272#issuecomment-515648778 cc @viirya and @cloud-fan --

[GitHub] [spark] AmplabJenkins commented on issue #25272: [SPARK-28441][SQL][TESTS][FOLLOW-UP] Skip Python tests if python executable and pyspark library are unavailable

AmplabJenkins commented on issue #25272: [SPARK-28441][SQL][TESTS][FOLLOW-UP] Skip Python tests if python executable and pyspark library are unavailable URL: https://github.com/apache/spark/pull/25272#issuecomment-515648729 Test PASSed. Refer to this link for build results (access rights

[GitHub] [spark] AmplabJenkins commented on issue #25272: [SPARK-28441][SQL][TESTS][FOLLOW-UP] Skip Python tests if python executable and pyspark library are unavailable

AmplabJenkins commented on issue #25272: [SPARK-28441][SQL][TESTS][FOLLOW-UP] Skip Python tests if python executable and pyspark library are unavailable URL: https://github.com/apache/spark/pull/25272#issuecomment-515648726 Merged build finished. Test PASSed. --

[GitHub] [spark] HyukjinKwon opened a new pull request #25272: [SPARK-28441][SQL][TESTS] Skip Python tests if python executable and pyspark library are unavailable

HyukjinKwon opened a new pull request #25272: [SPARK-28441][SQL][TESTS] Skip Python tests if python executable and pyspark library are unavailable URL: https://github.com/apache/spark/pull/25272 #25052 What changes were proposed in this pull request? We should add `assume(shouldTest

[GitHub] [spark] AmplabJenkins commented on issue #25270: [SPARK-28535][CORE][TEST] Slow down tasks to de-flake JobCancellationSuite

AmplabJenkins commented on issue #25270: [SPARK-28535][CORE][TEST] Slow down tasks to de-flake JobCancellationSuite URL: https://github.com/apache/spark/pull/25270#issuecomment-515648442 Merged build finished. Test PASSed. Th

[GitHub] [spark] AmplabJenkins removed a comment on issue #25270: [SPARK-28535][CORE][TEST] Slow down tasks to de-flake JobCancellationSuite

AmplabJenkins removed a comment on issue #25270: [SPARK-28535][CORE][TEST] Slow down tasks to de-flake JobCancellationSuite URL: https://github.com/apache/spark/pull/25270#issuecomment-515648442 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins commented on issue #25270: [SPARK-28535][CORE][TEST] Slow down tasks to de-flake JobCancellationSuite

AmplabJenkins commented on issue #25270: [SPARK-28535][CORE][TEST] Slow down tasks to de-flake JobCancellationSuite URL: https://github.com/apache/spark/pull/25270#issuecomment-515648444 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://am

[GitHub] [spark] AmplabJenkins removed a comment on issue #25270: [SPARK-28535][CORE][TEST] Slow down tasks to de-flake JobCancellationSuite

AmplabJenkins removed a comment on issue #25270: [SPARK-28535][CORE][TEST] Slow down tasks to de-flake JobCancellationSuite URL: https://github.com/apache/spark/pull/25270#issuecomment-515648444 Test PASSed. Refer to this link for build results (access rights to CI server needed): ht

[GitHub] [spark] HyukjinKwon commented on a change in pull request #25271: [SPARK-28536][SQL][PYTHON][TESTS] Reduce shuffle partitions in Python UDF tests in SQLQueryTestSuite

HyukjinKwon commented on a change in pull request #25271: [SPARK-28536][SQL][PYTHON][TESTS] Reduce shuffle partitions in Python UDF tests in SQLQueryTestSuite URL: https://github.com/apache/spark/pull/25271#discussion_r307951512 ## File path: sql/core/src/test/scala/org/apache/spar

[GitHub] [spark] SparkQA commented on issue #25270: [SPARK-28535][CORE][TEST] Slow down tasks to de-flake JobCancellationSuite

SparkQA commented on issue #25270: [SPARK-28535][CORE][TEST] Slow down tasks to de-flake JobCancellationSuite URL: https://github.com/apache/spark/pull/25270#issuecomment-515648327 **[Test build #108241 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/108241

[GitHub] [spark] SparkQA removed a comment on issue #25270: [SPARK-28535][CORE][TEST] Slow down tasks to de-flake JobCancellationSuite

SparkQA removed a comment on issue #25270: [SPARK-28535][CORE][TEST] Slow down tasks to de-flake JobCancellationSuite URL: https://github.com/apache/spark/pull/25270#issuecomment-515633937 **[Test build #108241 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder

[GitHub] [spark] HyukjinKwon commented on a change in pull request #25204: [SPARK-28441][SQL][Python] Fix error when non-foldable expression is used in correlated scalar subquery

HyukjinKwon commented on a change in pull request #25204: [SPARK-28441][SQL][Python] Fix error when non-foldable expression is used in correlated scalar subquery URL: https://github.com/apache/spark/pull/25204#discussion_r307951390 ## File path: sql/core/src/test/scala/org/apache/s

[GitHub] [spark] AmplabJenkins removed a comment on issue #25271: [SPARK-28536][SQL][PYTHON][TESTS] Reduce shuffle partitions in Python UDF tests in SQLQueryTestSuite

AmplabJenkins removed a comment on issue #25271: [SPARK-28536][SQL][PYTHON][TESTS] Reduce shuffle partitions in Python UDF tests in SQLQueryTestSuite URL: https://github.com/apache/spark/pull/25271#issuecomment-515647964 Test PASSed. Refer to this link for build results (access rights t

[GitHub] [spark] AmplabJenkins removed a comment on issue #25271: [SPARK-28536][SQL][PYTHON][TESTS] Reduce shuffle partitions in Python UDF tests in SQLQueryTestSuite

AmplabJenkins removed a comment on issue #25271: [SPARK-28536][SQL][PYTHON][TESTS] Reduce shuffle partitions in Python UDF tests in SQLQueryTestSuite URL: https://github.com/apache/spark/pull/25271#issuecomment-515647963 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #25271: [SPARK-28536][SQL][PYTHON][TESTS] Reduce shuffle partitions in Python UDF tests in SQLQueryTestSuite

SparkQA commented on issue #25271: [SPARK-28536][SQL][PYTHON][TESTS] Reduce shuffle partitions in Python UDF tests in SQLQueryTestSuite URL: https://github.com/apache/spark/pull/25271#issuecomment-515648081 **[Test build #108243 has started](https://amplab.cs.berkeley.edu/jenkins/job/Spark

[GitHub] [spark] AmplabJenkins commented on issue #25271: [SPARK-28536][SQL][PYTHON][TESTS] Reduce shuffle partitions in Python UDF tests in SQLQueryTestSuite

AmplabJenkins commented on issue #25271: [SPARK-28536][SQL][PYTHON][TESTS] Reduce shuffle partitions in Python UDF tests in SQLQueryTestSuite URL: https://github.com/apache/spark/pull/25271#issuecomment-515647963 Merged build finished. Test PASSed. -

[GitHub] [spark] AmplabJenkins commented on issue #25271: [SPARK-28536][SQL][PYTHON][TESTS] Reduce shuffle partitions in Python UDF tests in SQLQueryTestSuite

AmplabJenkins commented on issue #25271: [SPARK-28536][SQL][PYTHON][TESTS] Reduce shuffle partitions in Python UDF tests in SQLQueryTestSuite URL: https://github.com/apache/spark/pull/25271#issuecomment-515647964 Test PASSed. Refer to this link for build results (access rights to CI serv

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #25271: [SPARK-28536][SQL][PYTHON][TESTS] Reduce shuffle partitions in Python UDF tests in SQLQueryTestSuite

dongjoon-hyun commented on a change in pull request #25271: [SPARK-28536][SQL][PYTHON][TESTS] Reduce shuffle partitions in Python UDF tests in SQLQueryTestSuite URL: https://github.com/apache/spark/pull/25271#discussion_r307951248 ## File path: sql/core/src/test/scala/org/apache/sp

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #25271: [SPARK-28536][SQL][PYTHON][TESTS] Reduce shuffle partitions in Python UDF tests in SQLQueryTestSuite

dongjoon-hyun commented on a change in pull request #25271: [SPARK-28536][SQL][PYTHON][TESTS] Reduce shuffle partitions in Python UDF tests in SQLQueryTestSuite URL: https://github.com/apache/spark/pull/25271#discussion_r307951248 ## File path: sql/core/src/test/scala/org/apache/sp

[GitHub] [spark] HyukjinKwon opened a new pull request #25271: [SPARK-28536][SQL][PYTHON][TESTS] Reduce shuffle partitions in Python UDF tests in SQLQueryTestSuite

HyukjinKwon opened a new pull request #25271: [SPARK-28536][SQL][PYTHON][TESTS] Reduce shuffle partitions in Python UDF tests in SQLQueryTestSuite URL: https://github.com/apache/spark/pull/25271 ## What changes were proposed in this pull request? In Python UDF tests, the number of sh

[GitHub] [spark] AmplabJenkins removed a comment on issue #25268: [SPARK-28375][SQL] Make pullupCorrelatedPredicate idempotent

AmplabJenkins removed a comment on issue #25268: [SPARK-28375][SQL] Make pullupCorrelatedPredicate idempotent URL: https://github.com/apache/spark/pull/25268#issuecomment-515646390 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.c

[GitHub] [spark] AmplabJenkins commented on issue #25268: [SPARK-28375][SQL] Make pullupCorrelatedPredicate idempotent

AmplabJenkins commented on issue #25268: [SPARK-28375][SQL] Make pullupCorrelatedPredicate idempotent URL: https://github.com/apache/spark/pull/25268#issuecomment-515646390 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkel

[GitHub] [spark] AmplabJenkins removed a comment on issue #25268: [SPARK-28375][SQL] Make pullupCorrelatedPredicate idempotent

AmplabJenkins removed a comment on issue #25268: [SPARK-28375][SQL] Make pullupCorrelatedPredicate idempotent URL: https://github.com/apache/spark/pull/25268#issuecomment-515646388 Merged build finished. Test PASSed. This is

[GitHub] [spark] AmplabJenkins commented on issue #25268: [SPARK-28375][SQL] Make pullupCorrelatedPredicate idempotent

AmplabJenkins commented on issue #25268: [SPARK-28375][SQL] Make pullupCorrelatedPredicate idempotent URL: https://github.com/apache/spark/pull/25268#issuecomment-515646388 Merged build finished. Test PASSed. This is an autom

[GitHub] [spark] SparkQA removed a comment on issue #25268: [SPARK-28375][SQL] Make pullupCorrelatedPredicate idempotent

SparkQA removed a comment on issue #25268: [SPARK-28375][SQL] Make pullupCorrelatedPredicate idempotent URL: https://github.com/apache/spark/pull/25268#issuecomment-515616231 **[Test build #108239 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/108239/testRe

[GitHub] [spark] SparkQA commented on issue #25268: [SPARK-28375][SQL] Make pullupCorrelatedPredicate idempotent

SparkQA commented on issue #25268: [SPARK-28375][SQL] Make pullupCorrelatedPredicate idempotent URL: https://github.com/apache/spark/pull/25268#issuecomment-515646279 **[Test build #108239 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/108239/testReport)**

[GitHub] [spark] viirya commented on issue #25204: [SPARK-28441][SQL][Python] Fix error when non-foldable expression is used in correlated scalar subquery

viirya commented on issue #25204: [SPARK-28441][SQL][Python] Fix error when non-foldable expression is used in correlated scalar subquery URL: https://github.com/apache/spark/pull/25204#issuecomment-515645947 thanks @cloud-fan @HyukjinKwon @mgaido91 ---

[GitHub] [spark] cloud-fan closed pull request #25204: [SPARK-28441][SQL][Python] Fix error when non-foldable expression is used in correlated scalar subquery

cloud-fan closed pull request #25204: [SPARK-28441][SQL][Python] Fix error when non-foldable expression is used in correlated scalar subquery URL: https://github.com/apache/spark/pull/25204 This is an automated message from

[GitHub] [spark] cloud-fan commented on issue #25204: [SPARK-28441][SQL][Python] Fix error when non-foldable expression is used in correlated scalar subquery

cloud-fan commented on issue #25204: [SPARK-28441][SQL][Python] Fix error when non-foldable expression is used in correlated scalar subquery URL: https://github.com/apache/spark/pull/25204#issuecomment-515645348 thanks, merging to master! ---

[GitHub] [spark] SparkQA commented on issue #25264: [SPARK-28213][SQL][followup] code cleanup and bug fix for columnar execution framework

SparkQA commented on issue #25264: [SPARK-28213][SQL][followup] code cleanup and bug fix for columnar execution framework URL: https://github.com/apache/spark/pull/25264#issuecomment-515645203 **[Test build #108242 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBui

[GitHub] [spark] WeichenXu123 edited a comment on issue #25235: [SPARK-28483][Core] Fix canceling a spark job using barrier mode but barrier tasks blocking on BarrierTaskContext.barrier()

WeichenXu123 edited a comment on issue #25235: [SPARK-28483][Core] Fix canceling a spark job using barrier mode but barrier tasks blocking on BarrierTaskContext.barrier() URL: https://github.com/apache/spark/pull/25235#issuecomment-515644786 @jiangxb1987 This approach is very similar with

[GitHub] [spark] AmplabJenkins removed a comment on issue #25264: [SPARK-28213][SQL][followup] code cleanup and bug fix for columnar execution framework

AmplabJenkins removed a comment on issue #25264: [SPARK-28213][SQL][followup] code cleanup and bug fix for columnar execution framework URL: https://github.com/apache/spark/pull/25264#issuecomment-515645056 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins removed a comment on issue #25264: [SPARK-28213][SQL][followup] code cleanup and bug fix for columnar execution framework

AmplabJenkins removed a comment on issue #25264: [SPARK-28213][SQL][followup] code cleanup and bug fix for columnar execution framework URL: https://github.com/apache/spark/pull/25264#issuecomment-515645059 Test PASSed. Refer to this link for build results (access rights to CI server nee

[GitHub] [spark] AmplabJenkins commented on issue #25264: [SPARK-28213][SQL][followup] code cleanup and bug fix for columnar execution framework

AmplabJenkins commented on issue #25264: [SPARK-28213][SQL][followup] code cleanup and bug fix for columnar execution framework URL: https://github.com/apache/spark/pull/25264#issuecomment-515645059 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] WeichenXu123 edited a comment on issue #25235: [SPARK-28483][Core] Fix canceling a spark job using barrier mode but barrier tasks blocking on BarrierTaskContext.barrier()

WeichenXu123 edited a comment on issue #25235: [SPARK-28483][Core] Fix canceling a spark job using barrier mode but barrier tasks blocking on BarrierTaskContext.barrier() URL: https://github.com/apache/spark/pull/25235#issuecomment-515644786 @jiangxb1987 This approach is very similar with

[GitHub] [spark] AmplabJenkins commented on issue #25264: [SPARK-28213][SQL][followup] code cleanup and bug fix for columnar execution framework

AmplabJenkins commented on issue #25264: [SPARK-28213][SQL][followup] code cleanup and bug fix for columnar execution framework URL: https://github.com/apache/spark/pull/25264#issuecomment-515645056 Merged build finished. Test PASSed. ---

[GitHub] [spark] WeichenXu123 commented on issue #25235: [SPARK-28483][Core] Fix canceling a spark job using barrier mode but barrier tasks blocking on BarrierTaskContext.barrier()

WeichenXu123 commented on issue #25235: [SPARK-28483][Core] Fix canceling a spark job using barrier mode but barrier tasks blocking on BarrierTaskContext.barrier() URL: https://github.com/apache/spark/pull/25235#issuecomment-515644786 @jiangxb1987 This approach is the same with my first ve

[GitHub] [spark] cloud-fan commented on a change in pull request #25264: [SPARK-28213][SQL][followup] code cleanup and bug fix for columnar execution framework

cloud-fan commented on a change in pull request #25264: [SPARK-28213][SQL][followup] code cleanup and bug fix for columnar execution framework URL: https://github.com/apache/spark/pull/25264#discussion_r307949797 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution

[GitHub] [spark] maropu commented on a change in pull request #23531: [SPARK-24497][SQL] Support recursive SQL query

maropu commented on a change in pull request #23531: [SPARK-24497][SQL] Support recursive SQL query URL: https://github.com/apache/spark/pull/23531#discussion_r307949407 ## File path: sql/core/src/test/resources/sql-tests/results/cte.sql.out ## @@ -328,16 +328,891 @@ struc

[GitHub] [spark] xuanyuanking commented on issue #25256: [SPARK-28514][ML] Remove the redundant transformImpl method in RF & GBT

xuanyuanking commented on issue #25256: [SPARK-28514][ML] Remove the redundant transformImpl method in RF & GBT URL: https://github.com/apache/spark/pull/25256#issuecomment-515637162 Seem like a partial revert of #6300, cc @BryanCutler for a further review.

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #25270: [SPARK-28535][core] Slow down tasks to de-flake JobCancellationSuite.

dongjoon-hyun commented on a change in pull request #25270: [SPARK-28535][core] Slow down tasks to de-flake JobCancellationSuite. URL: https://github.com/apache/spark/pull/25270#discussion_r307944399 ## File path: core/src/test/scala/org/apache/spark/JobCancellationSuite.scala

[GitHub] [spark] AmplabJenkins removed a comment on issue #25270: [SPARK-28535][core] Slow down tasks to de-flake JobCancellationSuite.

AmplabJenkins removed a comment on issue #25270: [SPARK-28535][core] Slow down tasks to de-flake JobCancellationSuite. URL: https://github.com/apache/spark/pull/25270#issuecomment-515633679 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25270: [SPARK-28535][core] Slow down tasks to de-flake JobCancellationSuite.

AmplabJenkins removed a comment on issue #25270: [SPARK-28535][core] Slow down tasks to de-flake JobCancellationSuite. URL: https://github.com/apache/spark/pull/25270#issuecomment-515633681 Test PASSed. Refer to this link for build results (access rights to CI server needed): https:

[GitHub] [spark] SparkQA commented on issue #25270: [SPARK-28535][core] Slow down tasks to de-flake JobCancellationSuite.

SparkQA commented on issue #25270: [SPARK-28535][core] Slow down tasks to de-flake JobCancellationSuite. URL: https://github.com/apache/spark/pull/25270#issuecomment-515633937 **[Test build #108241 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/108241/testR

[GitHub] [spark] AmplabJenkins commented on issue #25270: [SPARK-28535][core] Slow down tasks to de-flake JobCancellationSuite.

AmplabJenkins commented on issue #25270: [SPARK-28535][core] Slow down tasks to de-flake JobCancellationSuite. URL: https://github.com/apache/spark/pull/25270#issuecomment-515633679 Merged build finished. Test PASSed. This is

[GitHub] [spark] AmplabJenkins commented on issue #25270: [SPARK-28535][core] Slow down tasks to de-flake JobCancellationSuite.

AmplabJenkins commented on issue #25270: [SPARK-28535][core] Slow down tasks to de-flake JobCancellationSuite. URL: https://github.com/apache/spark/pull/25270#issuecomment-515633681 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab

[GitHub] [spark] vanzin opened a new pull request #25270: [SPARK-28535][core] Slow down tasks to de-flake JobCancellationSuite.

vanzin opened a new pull request #25270: [SPARK-28535][core] Slow down tasks to de-flake JobCancellationSuite. URL: https://github.com/apache/spark/pull/25270 This test tries to detect correct behavior in racy code, where the event thread is racing with the executor thread that's trying

[GitHub] [spark] gatorsmile commented on issue #25228: [SPARK-28472][SQL][TEST][test-hadoop3.2] Add test for thriftserver protocol versions

gatorsmile commented on issue #25228: [SPARK-28472][SQL][TEST][test-hadoop3.2] Add test for thriftserver protocol versions URL: https://github.com/apache/spark/pull/25228#issuecomment-515629597 cc @juliuszsompolski @bogdanrdc ---

[GitHub] [spark] AmplabJenkins removed a comment on issue #25267: [SPARK-28532][SQL] Make optimizer batch "subquery" FixedPoint(1)

AmplabJenkins removed a comment on issue #25267: [SPARK-28532][SQL] Make optimizer batch "subquery" FixedPoint(1) URL: https://github.com/apache/spark/pull/25267#issuecomment-515628214 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins removed a comment on issue #25267: [SPARK-28532][SQL] Make optimizer batch "subquery" FixedPoint(1)

AmplabJenkins removed a comment on issue #25267: [SPARK-28532][SQL] Make optimizer batch "subquery" FixedPoint(1) URL: https://github.com/apache/spark/pull/25267#issuecomment-515628218 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://ampl

[GitHub] [spark] AmplabJenkins commented on issue #25267: [SPARK-28532][SQL] Make optimizer batch "subquery" FixedPoint(1)

AmplabJenkins commented on issue #25267: [SPARK-28532][SQL] Make optimizer batch "subquery" FixedPoint(1) URL: https://github.com/apache/spark/pull/25267#issuecomment-515628214 Merged build finished. Test PASSed. This is an a

[GitHub] [spark] AmplabJenkins commented on issue #25267: [SPARK-28532][SQL] Make optimizer batch "subquery" FixedPoint(1)

AmplabJenkins commented on issue #25267: [SPARK-28532][SQL] Make optimizer batch "subquery" FixedPoint(1) URL: https://github.com/apache/spark/pull/25267#issuecomment-515628218 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.be

[GitHub] [spark] SparkQA removed a comment on issue #25267: [SPARK-28532][SQL] Make optimizer batch "subquery" FixedPoint(1)

SparkQA removed a comment on issue #25267: [SPARK-28532][SQL] Make optimizer batch "subquery" FixedPoint(1) URL: https://github.com/apache/spark/pull/25267#issuecomment-515553178 **[Test build #108237 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/108237/te

[GitHub] [spark] SparkQA commented on issue #25267: [SPARK-28532][SQL] Make optimizer batch "subquery" FixedPoint(1)

SparkQA commented on issue #25267: [SPARK-28532][SQL] Make optimizer batch "subquery" FixedPoint(1) URL: https://github.com/apache/spark/pull/25267#issuecomment-515627896 **[Test build #108237 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/108237/testRepor

[GitHub] [spark] SparkQA commented on issue #25269: [SPARK-28534][K8S][TEST] Update node affinity for DockerForDesktop backend in PVTestsSuite

SparkQA commented on issue #25269: [SPARK-28534][K8S][TEST] Update node affinity for DockerForDesktop backend in PVTestsSuite URL: https://github.com/apache/spark/pull/25269#issuecomment-515627528 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job

[GitHub] [spark] AmplabJenkins commented on issue #25269: [SPARK-28534][K8S][TEST] Update node affinity for DockerForDesktop backend in PVTestsSuite

AmplabJenkins commented on issue #25269: [SPARK-28534][K8S][TEST] Update node affinity for DockerForDesktop backend in PVTestsSuite URL: https://github.com/apache/spark/pull/25269#issuecomment-515627540 Test PASSed. Refer to this link for build results (access rights to CI server needed)

[GitHub] [spark] AmplabJenkins commented on issue #25269: [SPARK-28534][K8S][TEST] Update node affinity for DockerForDesktop backend in PVTestsSuite

AmplabJenkins commented on issue #25269: [SPARK-28534][K8S][TEST] Update node affinity for DockerForDesktop backend in PVTestsSuite URL: https://github.com/apache/spark/pull/25269#issuecomment-515627537 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins removed a comment on issue #25266: [SPARK-28530][SQL] Cost-based join reorder optimizer batch should be FixedPoint(1)

AmplabJenkins removed a comment on issue #25266: [SPARK-28530][SQL] Cost-based join reorder optimizer batch should be FixedPoint(1) URL: https://github.com/apache/spark/pull/25266#issuecomment-515627446 Test PASSed. Refer to this link for build results (access rights to CI server needed)

[GitHub] [spark] AmplabJenkins removed a comment on issue #25269: [SPARK-28534][K8S][TEST] Update node affinity for DockerForDesktop backend in PVTestsSuite

AmplabJenkins removed a comment on issue #25269: [SPARK-28534][K8S][TEST] Update node affinity for DockerForDesktop backend in PVTestsSuite URL: https://github.com/apache/spark/pull/25269#issuecomment-515627537 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins removed a comment on issue #25269: [SPARK-28534][K8S][TEST] Update node affinity for DockerForDesktop backend in PVTestsSuite

AmplabJenkins removed a comment on issue #25269: [SPARK-28534][K8S][TEST] Update node affinity for DockerForDesktop backend in PVTestsSuite URL: https://github.com/apache/spark/pull/25269#issuecomment-515627540 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins removed a comment on issue #25266: [SPARK-28530][SQL] Cost-based join reorder optimizer batch should be FixedPoint(1)

AmplabJenkins removed a comment on issue #25266: [SPARK-28530][SQL] Cost-based join reorder optimizer batch should be FixedPoint(1) URL: https://github.com/apache/spark/pull/25266#issuecomment-515627443 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins commented on issue #25266: [SPARK-28530][SQL] Cost-based join reorder optimizer batch should be FixedPoint(1)

AmplabJenkins commented on issue #25266: [SPARK-28530][SQL] Cost-based join reorder optimizer batch should be FixedPoint(1) URL: https://github.com/apache/spark/pull/25266#issuecomment-515627443 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins commented on issue #25266: [SPARK-28530][SQL] Cost-based join reorder optimizer batch should be FixedPoint(1)

AmplabJenkins commented on issue #25266: [SPARK-28530][SQL] Cost-based join reorder optimizer batch should be FixedPoint(1) URL: https://github.com/apache/spark/pull/25266#issuecomment-515627446 Test PASSed. Refer to this link for build results (access rights to CI server needed): ht

[GitHub] [spark] SparkQA removed a comment on issue #25266: [SPARK-28530][SQL] Cost-based join reorder optimizer batch should be FixedPoint(1)

SparkQA removed a comment on issue #25266: [SPARK-28530][SQL] Cost-based join reorder optimizer batch should be FixedPoint(1) URL: https://github.com/apache/spark/pull/25266#issuecomment-515550735 **[Test build #108236 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullReques

[GitHub] [spark] SparkQA commented on issue #25266: [SPARK-28530][SQL] Cost-based join reorder optimizer batch should be FixedPoint(1)

SparkQA commented on issue #25266: [SPARK-28530][SQL] Cost-based join reorder optimizer batch should be FixedPoint(1) URL: https://github.com/apache/spark/pull/25266#issuecomment-515627163 **[Test build #108236 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilde

[GitHub] [spark] AmplabJenkins commented on issue #25269: [SPARK-28534][K8S][TEST] Update node affinity for DockerForDesktop backend in PVTestsSuite

AmplabJenkins commented on issue #25269: [SPARK-28534][K8S][TEST] Update node affinity for DockerForDesktop backend in PVTestsSuite URL: https://github.com/apache/spark/pull/25269#issuecomment-515625441 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins commented on issue #25269: [SPARK-28534][K8S][TEST] Update node affinity for DockerForDesktop backend in PVTestsSuite

AmplabJenkins commented on issue #25269: [SPARK-28534][K8S][TEST] Update node affinity for DockerForDesktop backend in PVTestsSuite URL: https://github.com/apache/spark/pull/25269#issuecomment-515625445 Test PASSed. Refer to this link for build results (access rights to CI server needed)

[GitHub] [spark] SparkQA removed a comment on issue #25269: [SPARK-28534][K8S][TEST] Update node affinity for DockerForDesktop backend in PVTestsSuite

SparkQA removed a comment on issue #25269: [SPARK-28534][K8S][TEST] Update node affinity for DockerForDesktop backend in PVTestsSuite URL: https://github.com/apache/spark/pull/25269#issuecomment-515623461 **[Test build #108240 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPu

  1   2   3   4   5   6   7   8   >