[
https://issues.apache.org/jira/browse/SPARK-35614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xinrong Meng updated SPARK-35614:
---------------------------------
Description:
The conversion from/to pandas includes logic for checking ExtensionDtypes data
types and behaving accordingly.
That makes code hard to change or maintain.
We want to introduce the Ops class per ExtensionDtypes data type, and then make
the conversion from/to pandas data-type-based for .
> Make the conversion from/to pandas data-type-based for ExtensionDtypes
> ----------------------------------------------------------------------
>
> Key: SPARK-35614
> URL: https://issues.apache.org/jira/browse/SPARK-35614
> Project: Spark
> Issue Type: Sub-task
> Components: PySpark
> Affects Versions: 3.2.0
> Reporter: Xinrong Meng
> Priority: Major
>
> The conversion from/to pandas includes logic for checking ExtensionDtypes
> data types and behaving accordingly.
> That makes code hard to change or maintain.
> We want to introduce the Ops class per ExtensionDtypes data type, and then
> make the conversion from/to pandas data-type-based for .
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
