[ https://issues.apache.org/jira/browse/SPARK-38800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17517830#comment-17517830 ]
Haejoon Lee commented on SPARK-38800: ------------------------------------- I'm working on this > Explicitly document the supported pandas version. > ------------------------------------------------- > > Key: SPARK-38800 > URL: https://issues.apache.org/jira/browse/SPARK-38800 > Project: Spark > Issue Type: Test > Components: PySpark > Affects Versions: 3.3.0 > Reporter: Haejoon Lee > Priority: Major > > pandas has different behavior per each version for some APIs. > So, we should explicitly follow one pandas version for one pandas-on-Spark > version and document it. > For example, if some APIs follow the behavior of pandas 1.3 whereas some APIs > follow the behavior of pandas 1.4, users may be confused. -- This message was sent by Atlassian Jira (v8.20.1#820001) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org