[
https://issues.apache.org/jira/browse/SPARK-37800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-37800.
---------------------------------
Fix Version/s: 3.3.0
3.2.1
Resolution: Fixed
Issue resolved by pull request 35084
[https://github.com/apache/spark/pull/35084]
> TreeNode.argString incorrectly formats arguments of type Set[_]
> ---------------------------------------------------------------
>
> Key: SPARK-37800
> URL: https://issues.apache.org/jira/browse/SPARK-37800
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Affects Versions: 3.2.0
> Reporter: Simeon Simeonov
> Assignee: Simeon Simeonov
> Priority: Minor
> Fix For: 3.3.0, 3.2.1
>
>
> The implementation of {{argString}} uses the following pattern for sets:
>
> {code:java}
> case set: Set[_] =>
> // Sort elements for deterministic behaviours
> val sortedSeq = set.toSeq.map(formatArg(_, maxFields).sorted)
>
> truncatedString(sortedSeq, "{", ", ", "}", maxFields) :: Nil {code}
> Instead of sorting the elements of the set, the implementation sorts the
> characters of the strings that {{formatArg}} returns.
> The fix is simply to move the closing parenthesis to the correct location:
> {code:java}
> val sortedSeq = set.toSeq.map(formatArg(_, maxFields)).sorted
> {code}
>
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
