Re: [PR] [SPARK-37932][SQL]Wait to resolve missing attributes before applying DeduplicateRelations [spark]

2024-03-07 Thread via GitHub
peter-toth commented on PR #35684: URL: https://github.com/apache/spark/pull/35684#issuecomment-1984107426 @martinf-moodys, [SPARK-47319](https://issues.apache.org/jira/browse/SPARK-47319) / https://github.com/apache/spark/pull/45424 might help, especially if you have many `Union` nodes

Re: [PR] [SPARK-37932][SQL]Wait to resolve missing attributes before applying DeduplicateRelations [spark]

2024-02-29 Thread via GitHub
martinf-moodys commented on PR #35684: URL: https://github.com/apache/spark/pull/35684#issuecomment-1970792026 Hi @cloud-fan, @chenzhx, Checking for missing references is very costly on my workflow, due to the call to `missingInput`. Do you think it could be optimized, either by doing