[GitHub] [spark] maropu commented on a change in pull request #29094: [SPARK-24983][SQL] limit number of leaf expressions in a single project when collapse project to prevent driver oom

maropu commented on a change in pull request #29094: URL: https://github.com/apache/spark/pull/29094#discussion_r458201704 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/optimizer/CollapseProjectSuite.scala ## @@ -121,6 +121,17 @@ class CollapseProject

[GitHub] [spark] maropu commented on a change in pull request #29094: [SPARK-24983][SQL] limit number of leaf expressions in a single project when collapse project to prevent driver oom

maropu commented on a change in pull request #29094: URL: https://github.com/apache/spark/pull/29094#discussion_r458201704 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/optimizer/CollapseProjectSuite.scala ## @@ -121,6 +121,17 @@ class CollapseProject

[GitHub] [spark] maropu commented on a change in pull request #29094: [SPARK-24983][SQL] limit number of leaf expressions in a single project when collapse project to prevent driver oom

maropu commented on a change in pull request #29094: URL: https://github.com/apache/spark/pull/29094#discussion_r458575888 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala ## @@ -697,16 +697,21 @@ object ColumnPruning extends Ru