[GitHub] [spark] allisonwang-db commented on a diff in pull request #42595: [SPARK-44901][SQL] Add API in Python UDTF 'analyze' method to return partitioning/ordering expressions

2023-08-30 Thread via GitHub
allisonwang-db commented on code in PR #42595: URL: https://github.com/apache/spark/pull/42595#discussion_r1310650141 ## sql/core/src/test/scala/org/apache/spark/sql/IntegratedUDFTestUtils.scala: ## @@ -441,6 +443,255 @@ object IntegratedUDFTestUtils extends SQLHelper { val

[GitHub] [spark] allisonwang-db commented on a diff in pull request #42595: [SPARK-44901][SQL] Add API in Python UDTF 'analyze' method to return partitioning/ordering expressions

2023-08-30 Thread via GitHub
allisonwang-db commented on code in PR #42595: URL: https://github.com/apache/spark/pull/42595#discussion_r1310644050 ## sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/PythonUDF.scala: ## @@ -207,6 +208,19 @@ case class UnresolvedPolymorphicPythonUDTF(

[GitHub] [spark] allisonwang-db commented on a diff in pull request #42595: [SPARK-44901][SQL] Add API in Python UDTF 'analyze' method to return partitioning/ordering expressions

2023-08-30 Thread via GitHub
allisonwang-db commented on code in PR #42595: URL: https://github.com/apache/spark/pull/42595#discussion_r1310679860 ## python/pyspark/sql/udtf.py: ## @@ -61,6 +61,26 @@ class AnalyzeArgument: is_table: bool +@dataclass(frozen=True) +class PartitioningColumn: +"""