[ https://issues.apache.org/jira/browse/SPARK-38800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17519331#comment-17519331 ]
Apache Spark commented on SPARK-38800: -------------------------------------- User 'itholic' has created a pull request for this issue: https://github.com/apache/spark/pull/36114 > Explicitly document the supported pandas version. > ------------------------------------------------- > > Key: SPARK-38800 > URL: https://issues.apache.org/jira/browse/SPARK-38800 > Project: Spark > Issue Type: Test > Components: Documentation, PySpark > Affects Versions: 3.3.0 > Reporter: Haejoon Lee > Assignee: Haejoon Lee > Priority: Major > Fix For: 3.4.0 > > > pandas has different behavior per each version for some APIs. > So, we should explicitly follow one pandas version for one pandas-on-Spark > version and document it. > For example, if some APIs follow the behavior of pandas 1.3 whereas some APIs > follow the behavior of pandas 1.4, users may be confused. -- This message was sent by Atlassian Jira (v8.20.1#820001) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org