[ https://issues.apache.org/jira/browse/SPARK-45662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17779370#comment-17779370 ]
Yi Zhu commented on SPARK-45662: -------------------------------- ping [~gurwls223] Could you take a look? I have checked that the env is correct and python is 3.6 > Pyspark union method throw 'pyspark.sql.utils.IllegalArgumentException: > requirement failed' > -------------------------------------------------------------------------------------------- > > Key: SPARK-45662 > URL: https://issues.apache.org/jira/browse/SPARK-45662 > Project: Spark > Issue Type: Bug > Components: PySpark > Affects Versions: 3.2.1 > Reporter: Yi Zhu > Priority: Major > Attachments: image-2023-10-25-15-01-28-896.png > > > !image-2023-10-25-15-01-28-896.png|width=1795,height=194! > > > The code is > {code:java} > output_df = spark.createDataFrame([], output_schema()) > output_df.printSchema() > print(output_df.count()) {code} > I have checked that the schema is same, `final` is from a sql query. > -- This message was sent by Atlassian Jira (v8.20.10#820010) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org