[GitHub] [spark] AmplabJenkins commented on pull request #30480: [SPARK-32921][SHUFFLE] MapOutputTracker extensions to support push-based shuffle

AmplabJenkins commented on pull request #30480: URL: https://github.com/apache/spark/pull/30480#issuecomment-803659538 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136316/ -- This

[GitHub] [spark] SparkQA removed a comment on pull request #30480: [SPARK-32921][SHUFFLE] MapOutputTracker extensions to support push-based shuffle

SparkQA removed a comment on pull request #30480: URL: https://github.com/apache/spark/pull/30480#issuecomment-803642884 **[Test build #136316 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136316/testReport)** for PR 30480 at commit

[GitHub] [spark] SparkQA commented on pull request #30480: [SPARK-32921][SHUFFLE] MapOutputTracker extensions to support push-based shuffle

SparkQA commented on pull request #30480: URL: https://github.com/apache/spark/pull/30480#issuecomment-803658230 **[Test build #136316 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136316/testReport)** for PR 30480 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30480: [SPARK-32921][SHUFFLE] MapOutputTracker extensions to support push-based shuffle

AmplabJenkins removed a comment on pull request #30480: URL: https://github.com/apache/spark/pull/30480#issuecomment-803650839 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/40898/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31901: [SPARK-34802][SQL] Move simplify expression rules before operator push down

AmplabJenkins removed a comment on pull request #31901: URL: https://github.com/apache/spark/pull/31901#issuecomment-803650838 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136314/

[GitHub] [spark] AmplabJenkins commented on pull request #31901: [SPARK-34802][SQL] Move simplify expression rules before operator push down

AmplabJenkins commented on pull request #31901: URL: https://github.com/apache/spark/pull/31901#issuecomment-803650838 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136314/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #30480: [SPARK-32921][SHUFFLE] MapOutputTracker extensions to support push-based shuffle

AmplabJenkins commented on pull request #30480: URL: https://github.com/apache/spark/pull/30480#issuecomment-803650839 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/40898/ --

[GitHub] [spark] SparkQA commented on pull request #30480: [SPARK-32921][SHUFFLE] MapOutputTracker extensions to support push-based shuffle

SparkQA commented on pull request #30480: URL: https://github.com/apache/spark/pull/30480#issuecomment-803649501 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/40898/ -- This is an automated message from the

[GitHub] [spark] SparkQA removed a comment on pull request #31901: [SPARK-34802][SQL] Move simplify expression rules before operator push down

SparkQA removed a comment on pull request #31901: URL: https://github.com/apache/spark/pull/31901#issuecomment-803601337 **[Test build #136314 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136314/testReport)** for PR 31901 at commit

[GitHub] [spark] SparkQA commented on pull request #31901: [SPARK-34802][SQL] Move simplify expression rules before operator push down

SparkQA commented on pull request #31901: URL: https://github.com/apache/spark/pull/31901#issuecomment-803648480 **[Test build #136314 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136314/testReport)** for PR 31901 at commit

[GitHub] [spark] SparkQA commented on pull request #30480: [SPARK-32921][SHUFFLE] MapOutputTracker extensions to support push-based shuffle

SparkQA commented on pull request #30480: URL: https://github.com/apache/spark/pull/30480#issuecomment-803648419 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/40898/ -- This is an automated message from the Apache

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29726: [SPARK-32855][SQL] Improve the cost model in pruningHasBenefit for filtering side can not build broadcast by join type

AmplabJenkins removed a comment on pull request #29726: URL: https://github.com/apache/spark/pull/29726#issuecomment-803644398 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136313/

[GitHub] [spark] AmplabJenkins commented on pull request #29726: [SPARK-32855][SQL] Improve the cost model in pruningHasBenefit for filtering side can not build broadcast by join type

AmplabJenkins commented on pull request #29726: URL: https://github.com/apache/spark/pull/29726#issuecomment-803644398 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136313/ -- This

[GitHub] [spark] SparkQA removed a comment on pull request #29726: [SPARK-32855][SQL] Improve the cost model in pruningHasBenefit for filtering side can not build broadcast by join type

SparkQA removed a comment on pull request #29726: URL: https://github.com/apache/spark/pull/29726#issuecomment-803599521 **[Test build #136313 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136313/testReport)** for PR 29726 at commit

[GitHub] [spark] SparkQA commented on pull request #29726: [SPARK-32855][SQL] Improve the cost model in pruningHasBenefit for filtering side can not build broadcast by join type

SparkQA commented on pull request #29726: URL: https://github.com/apache/spark/pull/29726#issuecomment-803644066 **[Test build #136313 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136313/testReport)** for PR 29726 at commit

[GitHub] [spark] SparkQA commented on pull request #30480: [SPARK-32921][SHUFFLE] MapOutputTracker extensions to support push-based shuffle

SparkQA commented on pull request #30480: URL: https://github.com/apache/spark/pull/30480#issuecomment-803642884 **[Test build #136316 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136316/testReport)** for PR 30480 at commit

[GitHub] [spark] romainx commented on pull request #27356: [SPARK-29924][DOCS] Document Apache Arrow JDK11 requirement

romainx commented on pull request #27356: URL: https://github.com/apache/spark/pull/27356#issuecomment-803642584 Hello. For information we observed that this setting seems to not be required anymore with new versions of the libraries. See

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31908: [SPARK-34808][SQL] Removes outer join if it only has DISTINCT on streamed side

AmplabJenkins removed a comment on pull request #31908: URL: https://github.com/apache/spark/pull/31908#issuecomment-803642404 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136312/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31913: [SPARK-34581][SQL] Don't optimize out grouping expressions from aggregate expressions without aggregate function

AmplabJenkins removed a comment on pull request #31913: URL: https://github.com/apache/spark/pull/31913#issuecomment-803642405 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136310/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30480: [SPARK-32921][SHUFFLE] MapOutputTracker extensions to support push-based shuffle

AmplabJenkins removed a comment on pull request #30480: URL: https://github.com/apache/spark/pull/30480#issuecomment-803634727 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] AmplabJenkins commented on pull request #31908: [SPARK-34808][SQL] Removes outer join if it only has DISTINCT on streamed side

AmplabJenkins commented on pull request #31908: URL: https://github.com/apache/spark/pull/31908#issuecomment-803642404 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136312/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #30480: [SPARK-32921][SHUFFLE] MapOutputTracker extensions to support push-based shuffle

AmplabJenkins commented on pull request #30480: URL: https://github.com/apache/spark/pull/30480#issuecomment-803642406 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/40897/ --

[GitHub] [spark] AmplabJenkins commented on pull request #31913: [SPARK-34581][SQL] Don't optimize out grouping expressions from aggregate expressions without aggregate function

AmplabJenkins commented on pull request #31913: URL: https://github.com/apache/spark/pull/31913#issuecomment-803642405 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136310/ -- This

[GitHub] [spark] SparkQA commented on pull request #30480: [SPARK-32921][SHUFFLE] MapOutputTracker extensions to support push-based shuffle

SparkQA commented on pull request #30480: URL: https://github.com/apache/spark/pull/30480#issuecomment-803642140 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/40897/ -- This is an automated message from the

[GitHub] [spark] SparkQA commented on pull request #30480: [SPARK-32921][SHUFFLE] MapOutputTracker extensions to support push-based shuffle

SparkQA commented on pull request #30480: URL: https://github.com/apache/spark/pull/30480#issuecomment-803640854 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/40897/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA removed a comment on pull request #31908: [SPARK-34808][SQL] Removes outer join if it only has DISTINCT on streamed side

SparkQA removed a comment on pull request #31908: URL: https://github.com/apache/spark/pull/31908#issuecomment-803588325 **[Test build #136312 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136312/testReport)** for PR 31908 at commit

[GitHub] [spark] SparkQA commented on pull request #31908: [SPARK-34808][SQL] Removes outer join if it only has DISTINCT on streamed side

SparkQA commented on pull request #31908: URL: https://github.com/apache/spark/pull/31908#issuecomment-803640495 **[Test build #136312 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136312/testReport)** for PR 31908 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #31913: [SPARK-34581][SQL] Don't optimize out grouping expressions from aggregate expressions without aggregate function

SparkQA removed a comment on pull request #31913: URL: https://github.com/apache/spark/pull/31913#issuecomment-803586691 **[Test build #136310 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136310/testReport)** for PR 31913 at commit

[GitHub] [spark] SparkQA commented on pull request #31913: [SPARK-34581][SQL] Don't optimize out grouping expressions from aggregate expressions without aggregate function

SparkQA commented on pull request #31913: URL: https://github.com/apache/spark/pull/31913#issuecomment-803636428 **[Test build #136310 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136310/testReport)** for PR 31913 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #30480: [SPARK-32921][SHUFFLE] MapOutputTracker extensions to support push-based shuffle

SparkQA removed a comment on pull request #30480: URL: https://github.com/apache/spark/pull/30480#issuecomment-803634362 **[Test build #136315 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136315/testReport)** for PR 30480 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #30480: [SPARK-32921][SHUFFLE] MapOutputTracker extensions to support push-based shuffle

AmplabJenkins commented on pull request #30480: URL: https://github.com/apache/spark/pull/30480#issuecomment-803634727 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136315/ -- This

[GitHub] [spark] SparkQA commented on pull request #30480: [SPARK-32921][SHUFFLE] MapOutputTracker extensions to support push-based shuffle

SparkQA commented on pull request #30480: URL: https://github.com/apache/spark/pull/30480#issuecomment-803634719 **[Test build #136315 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136315/testReport)** for PR 30480 at commit

[GitHub] [spark] SparkQA commented on pull request #30480: [SPARK-32921][SHUFFLE] MapOutputTracker extensions to support push-based shuffle

SparkQA commented on pull request #30480: URL: https://github.com/apache/spark/pull/30480#issuecomment-803634362 **[Test build #136315 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136315/testReport)** for PR 30480 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29810: [SPARK-32940][SQL] Collect, first and last should be deterministic aggregate functions

AmplabJenkins removed a comment on pull request #29810: URL: https://github.com/apache/spark/pull/29810#issuecomment-803633175 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136309/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31914: [SPARK-33122][SQL][FOLLOWUP] Remove redundant aggregates in the Optimzier

AmplabJenkins removed a comment on pull request #31914: URL: https://github.com/apache/spark/pull/31914#issuecomment-803633176 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136308/

[GitHub] [spark] AmplabJenkins commented on pull request #29810: [SPARK-32940][SQL] Collect, first and last should be deterministic aggregate functions

AmplabJenkins commented on pull request #29810: URL: https://github.com/apache/spark/pull/29810#issuecomment-803633175 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136309/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #31914: [SPARK-33122][SQL][FOLLOWUP] Remove redundant aggregates in the Optimzier

AmplabJenkins commented on pull request #31914: URL: https://github.com/apache/spark/pull/31914#issuecomment-803633176 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136308/ -- This

[GitHub] [spark] Victsm commented on pull request #30480: [SPARK-32921][SHUFFLE] MapOutputTracker extensions to support push-based shuffle

Victsm commented on pull request #30480: URL: https://github.com/apache/spark/pull/30480#issuecomment-803631962 Just to provide an update here on this PR. The group at LinkedIn has been focusing on improving the internal version of push-based shuffle in order to roll it out to 100% of

[GitHub] [spark] Victsm commented on a change in pull request #30480: [SPARK-32921][SHUFFLE] MapOutputTracker extensions to support push-based shuffle

Victsm commented on a change in pull request #30480: URL: https://github.com/apache/spark/pull/30480#discussion_r598314382 ## File path: core/src/main/scala/org/apache/spark/MapOutputTracker.scala ## @@ -987,18 +1277,51 @@ private[spark] object MapOutputTracker extends Logging

[GitHub] [spark] Victsm commented on a change in pull request #30480: [SPARK-32921][SHUFFLE] MapOutputTracker extensions to support push-based shuffle

Victsm commented on a change in pull request #30480: URL: https://github.com/apache/spark/pull/30480#discussion_r598313753 ## File path: core/src/main/scala/org/apache/spark/MapOutputTracker.scala ## @@ -833,33 +1106,44 @@ private[spark] class MapOutputTrackerWorker(conf:

[GitHub] [spark] SparkQA removed a comment on pull request #31914: [SPARK-33122][SQL][FOLLOWUP] Remove redundant aggregates in the Optimzier

SparkQA removed a comment on pull request #31914: URL: https://github.com/apache/spark/pull/31914#issuecomment-803575576 **[Test build #136308 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136308/testReport)** for PR 31914 at commit

[GitHub] [spark] SparkQA commented on pull request #31914: [SPARK-33122][SQL][FOLLOWUP] Remove redundant aggregates in the Optimzier

SparkQA commented on pull request #31914: URL: https://github.com/apache/spark/pull/31914#issuecomment-80363 **[Test build #136308 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136308/testReport)** for PR 31914 at commit

[GitHub] [spark] Victsm commented on a change in pull request #30480: [SPARK-32921][SHUFFLE] MapOutputTracker extensions to support push-based shuffle

Victsm commented on a change in pull request #30480: URL: https://github.com/apache/spark/pull/30480#discussion_r598312463 ## File path: core/src/main/scala/org/apache/spark/MapOutputTracker.scala ## @@ -633,23 +810,50 @@ private[spark] class MapOutputTrackerMaster( /**

[GitHub] [spark] Victsm commented on a change in pull request #30480: [SPARK-32921][SHUFFLE] MapOutputTracker extensions to support push-based shuffle

Victsm commented on a change in pull request #30480: URL: https://github.com/apache/spark/pull/30480#discussion_r598311960 ## File path: core/src/main/scala/org/apache/spark/MapOutputTracker.scala ## @@ -524,10 +669,37 @@ private[spark] class MapOutputTrackerMaster( }

[GitHub] [spark] SparkQA removed a comment on pull request #29810: [SPARK-32940][SQL] Collect, first and last should be deterministic aggregate functions

SparkQA removed a comment on pull request #29810: URL: https://github.com/apache/spark/pull/29810#issuecomment-803575782 **[Test build #136309 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136309/testReport)** for PR 29810 at commit

[GitHub] [spark] SparkQA commented on pull request #29810: [SPARK-32940][SQL] Collect, first and last should be deterministic aggregate functions

SparkQA commented on pull request #29810: URL: https://github.com/apache/spark/pull/29810#issuecomment-803628236 **[Test build #136309 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136309/testReport)** for PR 29810 at commit

[GitHub] [spark] c21 commented on pull request #31911: [SPARK-34796][SQL][3.1] Initialize counter variable for LIMIT code-gen in doProduce()

c21 commented on pull request #31911: URL: https://github.com/apache/spark/pull/31911#issuecomment-803627621 Thank you @maropu for review! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31886: [WIP][SPARK-34795][SQL][TEST] Adds a new job in GitHub Actions to check the output of TPC-DS queries

AmplabJenkins removed a comment on pull request #31886: URL: https://github.com/apache/spark/pull/31886#issuecomment-803623075 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136307/

[GitHub] [spark] AmplabJenkins commented on pull request #31886: [WIP][SPARK-34795][SQL][TEST] Adds a new job in GitHub Actions to check the output of TPC-DS queries

AmplabJenkins commented on pull request #31886: URL: https://github.com/apache/spark/pull/31886#issuecomment-803623075 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136307/ -- This

[GitHub] [spark] SparkQA removed a comment on pull request #31886: [WIP][SPARK-34795][SQL][TEST] Adds a new job in GitHub Actions to check the output of TPC-DS queries

SparkQA removed a comment on pull request #31886: URL: https://github.com/apache/spark/pull/31886#issuecomment-803565414 **[Test build #136307 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136307/testReport)** for PR 31886 at commit

[GitHub] [spark] SparkQA commented on pull request #31886: [WIP][SPARK-34795][SQL][TEST] Adds a new job in GitHub Actions to check the output of TPC-DS queries

SparkQA commented on pull request #31886: URL: https://github.com/apache/spark/pull/31886#issuecomment-803614109 **[Test build #136307 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136307/testReport)** for PR 31886 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31901: [SPARK-34802][SQL] Move simplify expression rules before operator push down

AmplabJenkins removed a comment on pull request #31901: URL: https://github.com/apache/spark/pull/31901#issuecomment-803613136 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/40896/

[GitHub] [spark] AmplabJenkins commented on pull request #31901: [SPARK-34802][SQL] Move simplify expression rules before operator push down

AmplabJenkins commented on pull request #31901: URL: https://github.com/apache/spark/pull/31901#issuecomment-803613136 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/40896/ --

[GitHub] [spark] SparkQA commented on pull request #31901: [SPARK-34802][SQL] Move simplify expression rules before operator push down

SparkQA commented on pull request #31901: URL: https://github.com/apache/spark/pull/31901#issuecomment-803613126 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/40896/ -- This is an automated message from the

[GitHub] [spark] SparkQA commented on pull request #31901: [SPARK-34802][SQL] Move simplify expression rules before operator push down

SparkQA commented on pull request #31901: URL: https://github.com/apache/spark/pull/31901#issuecomment-803611243 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/40896/ -- This is an automated message from the Apache

[GitHub] [spark] hezuojiao commented on a change in pull request #31898: [SPARK-34790][CORE] Disable fetching shuffle blocks in batch when io encryption is enabled

hezuojiao commented on a change in pull request #31898: URL: https://github.com/apache/spark/pull/31898#discussion_r598300042 ## File path: core/src/main/scala/org/apache/spark/shuffle/BlockStoreShuffleReader.scala ## @@ -51,15 +51,17 @@ private[spark] class

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29726: [SPARK-32855][SQL] Improve the cost model in pruningHasBenefit for filtering side can not build broadcast by join type

AmplabJenkins removed a comment on pull request #29726: URL: https://github.com/apache/spark/pull/29726#issuecomment-803610725 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/40895/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31901: [SPARK-34802][SQL] Move simplify expression rules before operator push down

AmplabJenkins removed a comment on pull request #31901: URL: https://github.com/apache/spark/pull/31901#issuecomment-803610724 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136311/

[GitHub] [spark] AmplabJenkins commented on pull request #31901: [SPARK-34802][SQL] Move simplify expression rules before operator push down

AmplabJenkins commented on pull request #31901: URL: https://github.com/apache/spark/pull/31901#issuecomment-803610724 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136311/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #29726: [SPARK-32855][SQL] Improve the cost model in pruningHasBenefit for filtering side can not build broadcast by join type

AmplabJenkins commented on pull request #29726: URL: https://github.com/apache/spark/pull/29726#issuecomment-803610725 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/40895/ --

[GitHub] [spark] SparkQA commented on pull request #29726: [SPARK-32855][SQL] Improve the cost model in pruningHasBenefit for filtering side can not build broadcast by join type

SparkQA commented on pull request #29726: URL: https://github.com/apache/spark/pull/29726#issuecomment-803610238 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/40895/ -- This is an automated message from the

[GitHub] [spark] hezuojiao commented on a change in pull request #31898: [SPARK-34790][CORE] Disable fetching shuffle blocks in batch when io encryption is enabled

hezuojiao commented on a change in pull request #31898: URL: https://github.com/apache/spark/pull/31898#discussion_r598300042 ## File path: core/src/main/scala/org/apache/spark/shuffle/BlockStoreShuffleReader.scala ## @@ -51,15 +51,17 @@ private[spark] class

[GitHub] [spark] SparkQA commented on pull request #29726: [SPARK-32855][SQL] Improve the cost model in pruningHasBenefit for filtering side can not build broadcast by join type

SparkQA commented on pull request #29726: URL: https://github.com/apache/spark/pull/29726#issuecomment-803609317 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/40895/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA removed a comment on pull request #31901: [SPARK-34802][SQL] Move simplify expression rules before operator push down

SparkQA removed a comment on pull request #31901: URL: https://github.com/apache/spark/pull/31901#issuecomment-803586704 **[Test build #136311 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136311/testReport)** for PR 31901 at commit

[GitHub] [spark] SparkQA commented on pull request #31901: [SPARK-34802][SQL] Move simplify expression rules before operator push down

SparkQA commented on pull request #31901: URL: https://github.com/apache/spark/pull/31901#issuecomment-803607027 **[Test build #136311 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136311/testReport)** for PR 31901 at commit

[GitHub] [spark] hezuojiao commented on a change in pull request #31898: [SPARK-34790][CORE] Disable fetching shuffle blocks in batch when io encryption is enabled

hezuojiao commented on a change in pull request #31898: URL: https://github.com/apache/spark/pull/31898#discussion_r598297714 ## File path: core/src/main/scala/org/apache/spark/shuffle/BlockStoreShuffleReader.scala ## @@ -51,15 +51,17 @@ private[spark] class

[GitHub] [spark] hezuojiao commented on a change in pull request #31898: [SPARK-34790][CORE] Disable fetching shuffle blocks in batch when io encryption is enabled

hezuojiao commented on a change in pull request #31898: URL: https://github.com/apache/spark/pull/31898#discussion_r598297612 ## File path: core/src/main/scala/org/apache/spark/shuffle/BlockStoreShuffleReader.scala ## @@ -51,15 +51,17 @@ private[spark] class

[GitHub] [spark] SparkQA commented on pull request #31901: [SPARK-34802][SQL] Move simplify expression rules before operator push down

SparkQA commented on pull request #31901: URL: https://github.com/apache/spark/pull/31901#issuecomment-803601337 **[Test build #136314 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136314/testReport)** for PR 31901 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31908: [SPARK-34808][SQL] Removes outer join if it only has DISTINCT on streamed side

AmplabJenkins removed a comment on pull request #31908: URL: https://github.com/apache/spark/pull/31908#issuecomment-803600452 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/40894/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31901: [SPARK-34802][SQL] Move simplify expression rules before operator push down

AmplabJenkins removed a comment on pull request #31901: URL: https://github.com/apache/spark/pull/31901#issuecomment-803600458 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/40893/

[GitHub] [spark] AmplabJenkins commented on pull request #31901: [SPARK-34802][SQL] Move simplify expression rules before operator push down

AmplabJenkins commented on pull request #31901: URL: https://github.com/apache/spark/pull/31901#issuecomment-803600458 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/40893/ --

[GitHub] [spark] SparkQA commented on pull request #31908: [SPARK-34808][SQL] Removes outer join if it only has DISTINCT on streamed side

SparkQA commented on pull request #31908: URL: https://github.com/apache/spark/pull/31908#issuecomment-803600440 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/40894/ -- This is an automated message from the

[GitHub] [spark] SparkQA commented on pull request #31901: [SPARK-34802][SQL] Move simplify expression rules before operator push down

SparkQA commented on pull request #31901: URL: https://github.com/apache/spark/pull/31901#issuecomment-803600449 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/40893/ -- This is an automated message from the

[GitHub] [spark] AmplabJenkins commented on pull request #31908: [SPARK-34808][SQL] Removes outer join if it only has DISTINCT on streamed side

AmplabJenkins commented on pull request #31908: URL: https://github.com/apache/spark/pull/31908#issuecomment-803600452 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/40894/ --

[GitHub] [spark] SparkQA commented on pull request #29726: [SPARK-32855][SQL] Improve the cost model in pruningHasBenefit for filtering side can not build broadcast by join type

SparkQA commented on pull request #29726: URL: https://github.com/apache/spark/pull/29726#issuecomment-803599521 **[Test build #136313 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136313/testReport)** for PR 29726 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31913: [SPARK-34581][SQL] Don't optimize out grouping expressions from aggregate expressions without aggregate function

AmplabJenkins removed a comment on pull request #31913: URL: https://github.com/apache/spark/pull/31913#issuecomment-803598651 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] SparkQA commented on pull request #31901: [SPARK-34802][SQL] Move simplify expression rules before operator push down

SparkQA commented on pull request #31901: URL: https://github.com/apache/spark/pull/31901#issuecomment-803598693 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/40893/ -- This is an automated message from the Apache

[GitHub] [spark] AmplabJenkins commented on pull request #31913: [SPARK-34581][SQL] Don't optimize out grouping expressions from aggregate expressions without aggregate function

AmplabJenkins commented on pull request #31913: URL: https://github.com/apache/spark/pull/31913#issuecomment-803598652 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For

[GitHub] [spark] SparkQA commented on pull request #31908: [SPARK-34808][SQL] Removes outer join if it only has DISTINCT on streamed side

SparkQA commented on pull request #31908: URL: https://github.com/apache/spark/pull/31908#issuecomment-803598557 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/40894/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #31913: [SPARK-34581][SQL] Don't optimize out grouping expressions from aggregate expressions without aggregate function

SparkQA commented on pull request #31913: URL: https://github.com/apache/spark/pull/31913#issuecomment-803597025 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/40892/ -- This is an automated message from the

[GitHub] [spark] SparkQA commented on pull request #31913: [SPARK-34581][SQL] Don't optimize out grouping expressions from aggregate expressions without aggregate function

SparkQA commented on pull request #31913: URL: https://github.com/apache/spark/pull/31913#issuecomment-803596183 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/40892/ -- This is an automated message from the Apache

[GitHub] [spark] yaooqinn commented on pull request #31895: [SPARK-34128][SQL] Suppress undesirable TTransportException warnings involved in THRIFT-4805

yaooqinn commented on pull request #31895: URL: https://github.com/apache/spark/pull/31895#issuecomment-803594259 Thanks for merging @dongjoon-hyun, I will send a backport PR tomorrow~ -- This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] wangyum commented on a change in pull request #29726: [SPARK-32855][SQL] Improve the cost model in pruningHasBenefit for filtering side can not build broadcast by join type

wangyum commented on a change in pull request #29726: URL: https://github.com/apache/spark/pull/29726#discussion_r598289449 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/dynamicpruning/PartitionPruning.scala ## @@ -147,10 +151,15 @@ object

[GitHub] [spark] SparkQA removed a comment on pull request #31913: [SPARK-34581][SQL] Don't optimize out grouping expressions from aggregate expressions without aggregate function

SparkQA removed a comment on pull request #31913: URL: https://github.com/apache/spark/pull/31913#issuecomment-803546837 **[Test build #136306 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136306/testReport)** for PR 31913 at commit

[GitHub] [spark] SparkQA commented on pull request #31913: [SPARK-34581][SQL] Don't optimize out grouping expressions from aggregate expressions without aggregate function

SparkQA commented on pull request #31913: URL: https://github.com/apache/spark/pull/31913#issuecomment-803590604 **[Test build #136306 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136306/testReport)** for PR 31913 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29810: [SPARK-32940][SQL] Collect, first and last should be deterministic aggregate functions

AmplabJenkins removed a comment on pull request #29810: URL: https://github.com/apache/spark/pull/29810#issuecomment-803586558 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/40891/

[GitHub] [spark] SparkQA commented on pull request #31908: [SPARK-34808][SQL] Removes outer join if it only has DISTINCT on streamed side

SparkQA commented on pull request #31908: URL: https://github.com/apache/spark/pull/31908#issuecomment-803588325 **[Test build #136312 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136312/testReport)** for PR 31908 at commit

[GitHub] [spark] MaxGekk commented on pull request #30678: [MINOR][SQL] Spelling: filters - PushedFilers

MaxGekk commented on pull request #30678: URL: https://github.com/apache/spark/pull/30678#issuecomment-803587703 @jsoref Could you update PR's description, for instance fill in `What changes were proposed in this pull request?`. -- This is an automated message from the Apache Git

[GitHub] [spark] wangyum commented on a change in pull request #31908: [SPARK-34808][SQL] Removes outer join if it only has DISTINCT on streamed side

wangyum commented on a change in pull request #31908: URL: https://github.com/apache/spark/pull/31908#discussion_r598285144 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/basicLogicalOperators.scala ## @@ -659,6 +659,12 @@ case class

[GitHub] [spark] wangyum commented on a change in pull request #31908: [SPARK-34808][SQL] Removes outer join if it only has DISTINCT on streamed side

wangyum commented on a change in pull request #31908: URL: https://github.com/apache/spark/pull/31908#discussion_r598285144 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/basicLogicalOperators.scala ## @@ -659,6 +659,12 @@ case class

[GitHub] [spark] SparkQA commented on pull request #31901: [SPARK-34802][SQL] Move simplify expression rules before operator push down

SparkQA commented on pull request #31901: URL: https://github.com/apache/spark/pull/31901#issuecomment-803586704 **[Test build #136311 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136311/testReport)** for PR 31901 at commit

[GitHub] [spark] SparkQA commented on pull request #31913: [SPARK-34581][SQL] Don't optimize out grouping expressions from aggregate expressions without aggregate function

SparkQA commented on pull request #31913: URL: https://github.com/apache/spark/pull/31913#issuecomment-803586691 **[Test build #136310 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136310/testReport)** for PR 31913 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #29810: [SPARK-32940][SQL] Collect, first and last should be deterministic aggregate functions

AmplabJenkins commented on pull request #29810: URL: https://github.com/apache/spark/pull/29810#issuecomment-803586558 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/40891/ --

[GitHub] [spark] SparkQA commented on pull request #29810: [SPARK-32940][SQL] Collect, first and last should be deterministic aggregate functions

SparkQA commented on pull request #29810: URL: https://github.com/apache/spark/pull/29810#issuecomment-803586542 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/40891/ -- This is an automated message from the

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31901: [SPARK-34802][SQL] Move simplify expression rules before operator push down

AmplabJenkins removed a comment on pull request #31901: URL: https://github.com/apache/spark/pull/31901#issuecomment-803586167 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136305/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31914: [SPARK-33122][SQL][FOLLOWUP] Remove redundant aggregates in the Optimzier

AmplabJenkins removed a comment on pull request #31914: URL: https://github.com/apache/spark/pull/31914#issuecomment-803586168 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/40890/

[GitHub] [spark] AmplabJenkins commented on pull request #31901: [SPARK-34802][SQL] Move simplify expression rules before operator push down

AmplabJenkins commented on pull request #31901: URL: https://github.com/apache/spark/pull/31901#issuecomment-803586167 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136305/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #31914: [SPARK-33122][SQL][FOLLOWUP] Remove redundant aggregates in the Optimzier

AmplabJenkins commented on pull request #31914: URL: https://github.com/apache/spark/pull/31914#issuecomment-803586168 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/40890/ --

[GitHub] [spark] SparkQA commented on pull request #31914: [SPARK-33122][SQL][FOLLOWUP] Remove redundant aggregates in the Optimzier

SparkQA commented on pull request #31914: URL: https://github.com/apache/spark/pull/31914#issuecomment-803585081 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/40890/ -- This is an automated message from the

[GitHub] [spark] SparkQA commented on pull request #29810: [SPARK-32940][SQL] Collect, first and last should be deterministic aggregate functions

SparkQA commented on pull request #29810: URL: https://github.com/apache/spark/pull/29810#issuecomment-803584634 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/40891/ -- This is an automated message from the Apache

<    1   2   3   4   5   >