Re: [PR] [SPARK-47037] ] Fix AliasAwareOutputExpression outputPartitioning [spark]

2024-05-29 Thread via GitHub
github-actions[bot] closed pull request #45093: [SPARK-47037] ] Fix AliasAwareOutputExpression outputPartitioning URL: https://github.com/apache/spark/pull/45093 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [PR] [SPARK-47037] ] Fix AliasAwareOutputExpression outputPartitioning [spark]

2024-05-28 Thread via GitHub
github-actions[bot] commented on PR #45093: URL: https://github.com/apache/spark/pull/45093#issuecomment-2136304814 We're closing this PR because it hasn't been updated in a while. This isn't a judgement on the merit of the PR in any way. It's just a way of keeping the PR queue manageable.

[PR] [SPARK-47037] ] Fix AliasAwareOutputExpression outputPartitioning [spark]

2024-02-13 Thread via GitHub
liorregev opened a new pull request, #45093: URL: https://github.com/apache/spark/pull/45093 AliasAwareOutputExpression does not detect that `select(F.struct($"my_field"))` retains partitioning in case the dataset was partitioning by `$"my_field"` before the select. This causes an