[ https://issues.apache.org/jira/browse/SPARK-46349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17795922#comment-17795922 ]
Majid Hajiheidari edited comment on SPARK-46349 at 12/12/23 8:21 PM: --------------------------------------------------------------------- The PR was not working because it failed a bunch of of test cases. Deleted the PR from the issue. was (Author: JIRAUSER303450): The PR was not working because it failed lots of test cases. Deleted the PR from the issue. > Prevent Multiple SortOrders for an Expression > --------------------------------------------- > > Key: SPARK-46349 > URL: https://issues.apache.org/jira/browse/SPARK-46349 > Project: Spark > Issue Type: Bug > Components: PySpark, SQL > Affects Versions: 4.0.0 > Reporter: Majid Hajiheidari > Priority: Minor > > Hello everyone, > This is my first contribution to the project. I welcome any feedback and > edits to improve this pull request.Currently, it's possible to create > redundant sort expressions in both Scala and Python APIs, leading to > potentially incorrect and confusing SQL statements. For example: > Scala: > {code:java} > spark.range(10).orderBy($"id".desc.asc).show(){code} > Python: > {code:java} > spark.range(10).orderBy(f.desc('id'), ascending=False).show(){code} > > Such usage generates SQL like order by id DESC NULLS LAST DESC NULLS LAST, > causing non-descriptive error messages. > > I look forward to your feedback and thank you for considering this > contribution. -- This message was sent by Atlassian Jira (v8.20.10#820010) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org