[
https://issues.apache.org/jira/browse/SPARK-35341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xinrong Meng updated SPARK-35341:
---------------------------------
Description:
{{Now ___and____, __or____,_ ___rand____, and __ror___ are not data type
based.}}
So we would like to introduce these operators to the DataTypeOps class.
extension_dtypes process these operators differently from the rest of the types.
So we would also introduce ExtentionDtypeOps.
ExtentionDtypeOps would be helpful for other data-type-based operations, for
example, to/from pandas conversion as well.
was:
Now __and__, __or__,_ _rand__, and __ror__ are not data type based.
So we would like to introduce __and__, __or__,_ _rand__, and __ror__ to each
DataTypeOps subclass.
extension_dtypes process __and__, __or__,_ _rand__, and __ror__ differently
from the rest of types.
So we would also introduce ExtentionDtypeOps.
> Introduce ExtentionDtypeOps
> ---------------------------
>
> Key: SPARK-35341
> URL: https://issues.apache.org/jira/browse/SPARK-35341
> Project: Spark
> Issue Type: Sub-task
> Components: PySpark
> Affects Versions: 3.2.0
> Reporter: Xinrong Meng
> Priority: Major
>
> {{Now ___and____, __or____,_ ___rand____, and __ror___ are not data type
> based.}}
> So we would like to introduce these operators to the DataTypeOps class.
> extension_dtypes process these operators differently from the rest of the
> types.
> So we would also introduce ExtentionDtypeOps.
> ExtentionDtypeOps would be helpful for other data-type-based operations, for
> example, to/from pandas conversion as well.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
