[GitHub] [spark] yaooqinn commented on a change in pull request #33172: [SPARK-35968][SQL] Make sure partitions are not too small in AQE partition coalescing

2021-07-01 Thread GitBox
yaooqinn commented on a change in pull request #33172: URL: https://github.com/apache/spark/pull/33172#discussion_r662334188 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ## @@ -525,8 +525,20 @@ object SQLConf { .booleanConf

[GitHub] [spark] yaooqinn commented on a change in pull request #33172: [SPARK-35968][SQL] Make sure partitions are not too small in AQE partition coalescing

2021-07-01 Thread GitBox
yaooqinn commented on a change in pull request #33172: URL: https://github.com/apache/spark/pull/33172#discussion_r662140639 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/ShufflePartitionsUtil.scala ## @@ -61,7 +63,9 @@ object

[GitHub] [spark] yaooqinn commented on a change in pull request #33172: [SPARK-35968][SQL] Make sure partitions are not too small in AQE partition coalescing

2021-07-01 Thread GitBox
yaooqinn commented on a change in pull request #33172: URL: https://github.com/apache/spark/pull/33172#discussion_r662142804 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ## @@ -525,18 +525,34 @@ object SQLConf { .booleanConf

[GitHub] [spark] yaooqinn commented on a change in pull request #33172: [SPARK-35968][SQL] Make sure partitions are not too small in AQE partition coalescing

2021-07-01 Thread GitBox
yaooqinn commented on a change in pull request #33172: URL: https://github.com/apache/spark/pull/33172#discussion_r662140767 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/ShufflePartitionsUtil.scala ## @@ -61,7 +63,9 @@ object

[GitHub] [spark] yaooqinn commented on a change in pull request #33172: [SPARK-35968][SQL] Make sure partitions are not too small in AQE partition coalescing

2021-07-01 Thread GitBox
yaooqinn commented on a change in pull request #33172: URL: https://github.com/apache/spark/pull/33172#discussion_r662141208 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/ShufflePartitionsUtil.scala ## @@ -61,7 +63,9 @@ object

[GitHub] [spark] yaooqinn commented on a change in pull request #33172: [SPARK-35968][SQL] Make sure partitions are not too small in AQE partition coalescing

2021-07-01 Thread GitBox
yaooqinn commented on a change in pull request #33172: URL: https://github.com/apache/spark/pull/33172#discussion_r662140767 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/ShufflePartitionsUtil.scala ## @@ -61,7 +63,9 @@ object

[GitHub] [spark] yaooqinn commented on a change in pull request #33172: [SPARK-35968][SQL] Make sure partitions are not too small in AQE partition coalescing

2021-07-01 Thread GitBox
yaooqinn commented on a change in pull request #33172: URL: https://github.com/apache/spark/pull/33172#discussion_r662140639 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/ShufflePartitionsUtil.scala ## @@ -61,7 +63,9 @@ object

[GitHub] [spark] yaooqinn commented on a change in pull request #33172: [SPARK-35968][SQL] Make sure partitions are not too small in AQE partition coalescing

2021-07-01 Thread GitBox
yaooqinn commented on a change in pull request #33172: URL: https://github.com/apache/spark/pull/33172#discussion_r662138631 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ## @@ -525,18 +525,34 @@ object SQLConf { .booleanConf