[
https://issues.apache.org/jira/browse/SPARK-46367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18075341#comment-18075341
]
Naveen Kumar Kumar Puppala commented on SPARK-46367:
----------------------------------------------------
Confirmed this issue persists on current master (4.2.0) following the
KeyGroupedPartitioning → KeyedPartitioning refactor in SPARK-55535 (PR #54330).
ProjectExec still extends PartitioningPreservingUnaryExecNode without
overriding outputPartitioning to remap KeyedPartitioning expressions through
column aliases. Added a failing reproduction test in
KeyGroupedPartitioningSuite.
> PartitioningPreservingUnaryExecNode breaks KeyGroupedPartitioning
> -----------------------------------------------------------------
>
> Key: SPARK-46367
> URL: https://issues.apache.org/jira/browse/SPARK-46367
> Project: Spark
> Issue Type: Bug
> Components: Spark Core
> Affects Versions: 3.5.0
> Reporter: Nikita Sokolov
> Priority: Major
>
> When aliasing columns with Project, the KeyGroupedPartitioning from
> outputPartitioning still points to the old column names and etc.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
