[jira] [Updated] (SPARK-37011) Upgrade flake8 to 3.9.0 or above in Jenkins

[ https://issues.apache.org/jira/browse/SPARK-37011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin updated SPARK-37011: -- Description: In flake8 < 3.9.0, F401 error occurs for imports when the imported identities

[jira] [Updated] (SPARK-37011) Upgrade flake8 to 3.9.0 or above in Jenkins

[ https://issues.apache.org/jira/browse/SPARK-37011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin updated SPARK-37011: -- Description: In flake8 < 3.9.0, F401 error occurs for imports when the impo Since this

[jira] [Updated] (SPARK-37011) Upgrade flake8 to 3.9.0 or above in Jenkins

[ https://issues.apache.org/jira/browse/SPARK-37011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin updated SPARK-37011: -- Fix Version/s: (was: 3.3.0) > Upgrade flake8 to 3.9.0 or above in Jenkins >

[jira] [Updated] (SPARK-37011) Upgrade flake8 to 3.9.0 or above in Jenkins

[ https://issues.apache.org/jira/browse/SPARK-37011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin updated SPARK-37011: -- Affects Version/s: (was: 3.2.0) 3.3.0 > Upgrade flake8 to 3.9.0 or

[jira] [Updated] (SPARK-37011) Upgrade flake8 to 3.9.0 or above in Jenkins

[ https://issues.apache.org/jira/browse/SPARK-37011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin updated SPARK-37011: -- Description: In flake8 < 3.8.0, F401 error occurs for imports in *if* statements when

[jira] [Updated] (SPARK-37011) Upgrade flake8 to 3.9.0 or above in Jenkins

[ https://issues.apache.org/jira/browse/SPARK-37011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin updated SPARK-37011: -- Reporter: Takuya Ueshin (was: Haejoon Lee) > Upgrade flake8 to 3.9.0 or above in Jenkins >

[jira] [Assigned] (SPARK-37011) Upgrade flake8 to 3.9.0 or above in Jenkins

[ https://issues.apache.org/jira/browse/SPARK-37011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin reassigned SPARK-37011: - Assignee: (was: Shane Knapp) > Upgrade flake8 to 3.9.0 or above in Jenkins >

[jira] [Created] (SPARK-37011) Upgrade flake8 to 3.9.0 or above in Jenkins

Takuya Ueshin created SPARK-37011: - Summary: Upgrade flake8 to 3.9.0 or above in Jenkins Key: SPARK-37011 URL: https://issues.apache.org/jira/browse/SPARK-37011 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-36942) Inline type hints for python/pyspark/sql/readwriter.py

[ https://issues.apache.org/jira/browse/SPARK-36942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-36942. --- Fix Version/s: 3.3.0 Assignee: Xinrong Meng Resolution: Fixed Issue

[jira] [Created] (SPARK-37010) Remove unnecessary "noqa: F401" comments in pandas-on-Spark

Takuya Ueshin created SPARK-37010: - Summary: Remove unnecessary "noqa: F401" comments in pandas-on-Spark Key: SPARK-37010 URL: https://issues.apache.org/jira/browse/SPARK-37010 Project: Spark

[jira] [Resolved] (SPARK-37000) Add type hints to python/pyspark/sql/util.py

[ https://issues.apache.org/jira/browse/SPARK-37000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-37000. --- Fix Version/s: 3.3.0 Assignee: Takuya Ueshin (was: Apache Spark)

[jira] [Resolved] (SPARK-36938) Inline type hints for group.py in python/pyspark/sql

[ https://issues.apache.org/jira/browse/SPARK-36938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-36938. --- Fix Version/s: 3.3.0 Assignee: dch nguyen Resolution: Fixed Issue resolved

[jira] [Updated] (SPARK-37000) Add type hints to python/pyspark/sql/util.py

[ https://issues.apache.org/jira/browse/SPARK-37000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin updated SPARK-37000: -- Description: Add type hints for python/pyspark/sql/utils.py. > Add type hints to

[jira] [Created] (SPARK-37000) Add type hints to python/pyspark/sql/util.py

Takuya Ueshin created SPARK-37000: - Summary: Add type hints to python/pyspark/sql/util.py Key: SPARK-37000 URL: https://issues.apache.org/jira/browse/SPARK-37000 Project: Spark Issue Type:

[jira] [Commented] (SPARK-37000) Add type hints to python/pyspark/sql/util.py

[ https://issues.apache.org/jira/browse/SPARK-37000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17428475#comment-17428475 ] Takuya Ueshin commented on SPARK-37000: --- I'm working on this. > Add type hints to

[jira] [Resolved] (SPARK-36951) Inline type hints for python/pyspark/sql/column.py

[ https://issues.apache.org/jira/browse/SPARK-36951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-36951. --- Fix Version/s: 3.3.0 Assignee: Xinrong Meng Resolution: Fixed Issue

[jira] [Updated] (SPARK-36961) Use PEP526 style variable type hints

[ https://issues.apache.org/jira/browse/SPARK-36961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin updated SPARK-36961: -- Summary: Use PEP526 style variable type hints (was: Use PEP526 style variable type hints in

[jira] [Updated] (SPARK-36961) Use PEP526 style variable type hints

[ https://issues.apache.org/jira/browse/SPARK-36961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin updated SPARK-36961: -- Description: Now that we have started using newer Python syntax in the code base. We should

[jira] [Updated] (SPARK-36961) Use PEP526 style variable type hints in pandas-on-Spark

[ https://issues.apache.org/jira/browse/SPARK-36961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin updated SPARK-36961: -- Description: Now that we have started using newer Python syntax in the code base. We should

[jira] [Created] (SPARK-36961) Use PEP526 style variable type hints in pandas-on-Spark

Takuya Ueshin created SPARK-36961: - Summary: Use PEP526 style variable type hints in pandas-on-Spark Key: SPARK-36961 URL: https://issues.apache.org/jira/browse/SPARK-36961 Project: Spark

[jira] [Resolved] (SPARK-36940) Inline type hints for python/pyspark/sql/avro/functions.py

[ https://issues.apache.org/jira/browse/SPARK-36940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-36940. --- Fix Version/s: 3.3.0 Assignee: Xinrong Meng Resolution: Fixed Issue

[jira] [Resolved] (SPARK-36906) Inline type hints for conf.py and observation.py in python/pyspark/sql

[ https://issues.apache.org/jira/browse/SPARK-36906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-36906. --- Fix Version/s: 3.3.0 Assignee: Xinrong Meng Resolution: Fixed Issue

[jira] [Created] (SPARK-36907) pandas API on Spark: DataFrameGroupBy.apply raises an exception when it returns Series.

Takuya Ueshin created SPARK-36907: - Summary: pandas API on Spark: DataFrameGroupBy.apply raises an exception when it returns Series. Key: SPARK-36907 URL: https://issues.apache.org/jira/browse/SPARK-36907

[jira] [Commented] (SPARK-36845) Inline type hint files

[ https://issues.apache.org/jira/browse/SPARK-36845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17422935#comment-17422935 ] Takuya Ueshin commented on SPARK-36845: --- Is the {{typing-extensions}} always available in runtime

[jira] [Commented] (SPARK-36845) Inline type hint files

[ https://issues.apache.org/jira/browse/SPARK-36845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17422487#comment-17422487 ] Takuya Ueshin commented on SPARK-36845: --- For the {{_typing.pyi}}, it uses {{Protocol}} that is

[jira] [Comment Edited] (SPARK-36845) Inline type hint files

[ https://issues.apache.org/jira/browse/SPARK-36845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17422486#comment-17422486 ] Takuya Ueshin edited comment on SPARK-36845 at 9/30/21, 1:36 AM: - It

[jira] [Commented] (SPARK-36845) Inline type hint files

[ https://issues.apache.org/jira/browse/SPARK-36845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17422486#comment-17422486 ] Takuya Ueshin commented on SPARK-36845: --- It would be great if we could use the "annotation" future

[jira] [Created] (SPARK-36885) Inline type hints for python/pyspark/sql/dataframe.py

Takuya Ueshin created SPARK-36885: - Summary: Inline type hints for python/pyspark/sql/dataframe.py Key: SPARK-36885 URL: https://issues.apache.org/jira/browse/SPARK-36885 Project: Spark

[jira] [Commented] (SPARK-36885) Inline type hints for python/pyspark/sql/dataframe.py

[ https://issues.apache.org/jira/browse/SPARK-36885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17421863#comment-17421863 ] Takuya Ueshin commented on SPARK-36885: --- I'm working on this. > Inline type hints for

[jira] [Commented] (SPARK-36884) Inline type hints for python/pyspark/sql/session.py

[ https://issues.apache.org/jira/browse/SPARK-36884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17421861#comment-17421861 ] Takuya Ueshin commented on SPARK-36884: --- I'm working on this. > Inline type hints for

[jira] [Created] (SPARK-36884) Inline type hints for python/pyspark/sql/session.py

Takuya Ueshin created SPARK-36884: - Summary: Inline type hints for python/pyspark/sql/session.py Key: SPARK-36884 URL: https://issues.apache.org/jira/browse/SPARK-36884 Project: Spark Issue

[jira] [Resolved] (SPARK-36847) Explicitly specify error codes when ignoring type hint errors

[ https://issues.apache.org/jira/browse/SPARK-36847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-36847. --- Fix Version/s: 3.3.0 Assignee: Takuya Ueshin Resolution: Fixed Issue

[jira] [Created] (SPARK-36847) Explicitly specify error codes when ignoring type hint errors

Takuya Ueshin created SPARK-36847: - Summary: Explicitly specify error codes when ignoring type hint errors Key: SPARK-36847 URL: https://issues.apache.org/jira/browse/SPARK-36847 Project: Spark

[jira] [Updated] (SPARK-36846) Inline most of type hint files under pyspark/sql/pandas folder

[ https://issues.apache.org/jira/browse/SPARK-36846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin updated SPARK-36846: -- Description: Inline type hint files under {{pyspark/sql/pandas}} folder, except for

[jira] [Updated] (SPARK-36846) Inline most of type hint files under pyspark/sql/pandas folder

[ https://issues.apache.org/jira/browse/SPARK-36846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin updated SPARK-36846: -- Description: Inline type hint files under {{pyspark/sql/pandas}} folder, except for

[jira] [Created] (SPARK-36846) Inline most of type hint files under pyspark/sql/pandas folder

Takuya Ueshin created SPARK-36846: - Summary: Inline most of type hint files under pyspark/sql/pandas folder Key: SPARK-36846 URL: https://issues.apache.org/jira/browse/SPARK-36846 Project: Spark

[jira] [Created] (SPARK-36845) Inline type hint files

Takuya Ueshin created SPARK-36845: - Summary: Inline type hint files Key: SPARK-36845 URL: https://issues.apache.org/jira/browse/SPARK-36845 Project: Spark Issue Type: Umbrella

[jira] [Resolved] (SPARK-36818) Fix filtering a Series by a boolean Series

[ https://issues.apache.org/jira/browse/SPARK-36818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-36818. --- Fix Version/s: 3.3.0 3.2.0 Assignee: Xinrong Meng

[jira] [Updated] (SPARK-36771) Fix `pop` of Categorical Series

[ https://issues.apache.org/jira/browse/SPARK-36771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin updated SPARK-36771: -- Fix Version/s: 3.2.0 > Fix `pop` of Categorical Series > >

[jira] [Resolved] (SPARK-36771) Fix `pop` of Categorical Series

[ https://issues.apache.org/jira/browse/SPARK-36771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-36771. --- Fix Version/s: 3.3.0 Assignee: Xinrong Meng Resolution: Fixed Issue

[jira] [Resolved] (SPARK-36769) Improve `filter` of single-indexed DataFrame

[ https://issues.apache.org/jira/browse/SPARK-36769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-36769. --- Fix Version/s: 3.3.0 Assignee: Xinrong Meng Resolution: Fixed Issue

[jira] [Updated] (SPARK-36785) Fix ps.DataFrame.isin

[ https://issues.apache.org/jira/browse/SPARK-36785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin updated SPARK-36785: -- Fix Version/s: 3.3.0 > Fix ps.DataFrame.isin > - > > Key:

[jira] [Resolved] (SPARK-36785) Fix ps.DataFrame.isin

[ https://issues.apache.org/jira/browse/SPARK-36785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-36785. --- Fix Version/s: 3.2.1 Assignee: dgd_contributor Resolution: Fixed Issue

[jira] [Commented] (SPARK-36813) Implement ps.merge_asof

[ https://issues.apache.org/jira/browse/SPARK-36813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17417858#comment-17417858 ] Takuya Ueshin commented on SPARK-36813: --- I'm working on this. > Implement ps.merge_asof >

[jira] [Created] (SPARK-36813) Implement ps.merge_asof

Takuya Ueshin created SPARK-36813: - Summary: Implement ps.merge_asof Key: SPARK-36813 URL: https://issues.apache.org/jira/browse/SPARK-36813 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-36746) Refactor _select_rows_by_iterable in iLocIndexer to use Column.isin

[ https://issues.apache.org/jira/browse/SPARK-36746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-36746. --- Fix Version/s: 3.3.0 Assignee: Xinrong Meng Resolution: Fixed Issue

[jira] [Resolved] (SPARK-36618) Support dropping rows of a single-indexed DataFrame

[ https://issues.apache.org/jira/browse/SPARK-36618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-36618. --- Fix Version/s: 3.3.0 Assignee: Xinrong Meng Resolution: Fixed Issue

[jira] [Resolved] (SPARK-36762) Fix Series.isin when Series has NaN values

[ https://issues.apache.org/jira/browse/SPARK-36762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-36762. --- Fix Version/s: 3.2.0 Assignee: dgd_contributor Resolution: Fixed Issue

[jira] [Commented] (SPARK-34276) Check the unreleased/unresolved JIRAs/PRs of Parquet 1.11 and 1.12

[ https://issues.apache.org/jira/browse/SPARK-34276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17415725#comment-17415725 ] Takuya Ueshin commented on SPARK-34276: --- SPARK-36696 was fixed by upgrading parquet to 1.12.1.

[jira] [Resolved] (SPARK-36696) spark.read.parquet loads empty dataset

[ https://issues.apache.org/jira/browse/SPARK-36696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-36696. --- Fix Version/s: 3.2.0 Resolution: Fixed I confirmed the example file can be read

[jira] [Resolved] (SPARK-36722) Problems with update function in koalas - pyspark pandas.

[ https://issues.apache.org/jira/browse/SPARK-36722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-36722. --- Fix Version/s: 3.2.0 Assignee: dgd_contributor Resolution: Fixed Issue

[jira] [Resolved] (SPARK-36653) Implement Series.__xor__

[ https://issues.apache.org/jira/browse/SPARK-36653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-36653. --- Fix Version/s: 3.3.0 Assignee: dgd_contributor Resolution: Fixed Issue

[jira] [Commented] (SPARK-34276) Check the unreleased/unresolved JIRAs/PRs of Parquet 1.11 and 1.12

[ https://issues.apache.org/jira/browse/SPARK-34276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17412183#comment-17412183 ] Takuya Ueshin commented on SPARK-34276: --- SPARK-36696 seems to be the actual issue caused by 

[jira] [Updated] (SPARK-36696) spark.read.parquet loads empty dataset

[ https://issues.apache.org/jira/browse/SPARK-36696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin updated SPARK-36696: -- Attachment: example.parquet > spark.read.parquet loads empty dataset >

[jira] [Created] (SPARK-36696) spark.read.parquet loads empty dataset

Takuya Ueshin created SPARK-36696: - Summary: spark.read.parquet loads empty dataset Key: SPARK-36696 URL: https://issues.apache.org/jira/browse/SPARK-36696 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-36655) Add `versionadded` for API added in Spark 3.3.0

[ https://issues.apache.org/jira/browse/SPARK-36655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-36655. --- Fix Version/s: 3.3.0 Assignee: Xinrong Meng Resolution: Fixed Issue

[jira] [Resolved] (SPARK-36401) Implement Series.cov

[ https://issues.apache.org/jira/browse/SPARK-36401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-36401. --- Fix Version/s: 3.3.0 Assignee: dgd_contributor Resolution: Fixed Issue

[jira] [Created] (SPARK-36653) Implement Series.__xor__

Takuya Ueshin created SPARK-36653: - Summary: Implement Series.__xor__ Key: SPARK-36653 URL: https://issues.apache.org/jira/browse/SPARK-36653 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-36399) Implement DataFrame.combine_first

[ https://issues.apache.org/jira/browse/SPARK-36399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-36399. --- Fix Version/s: 3.3.0 Assignee: Xinrong Meng Resolution: Fixed Issue

[jira] [Resolved] (SPARK-36368) Fix CategoricalOps.astype to follow pandas 1.3

[ https://issues.apache.org/jira/browse/SPARK-36368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-36368. --- Fix Version/s: 3.3.0 Assignee: Haejoon Lee Resolution: Fixed Issue resolved

[jira] [Updated] (SPARK-36537) Take care of other tests disabled related to inplace updates with CategoricalDtype.

[ https://issues.apache.org/jira/browse/SPARK-36537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin updated SPARK-36537: -- Description: There are some more tests disabled related to inplace updates with

[jira] [Updated] (SPARK-36537) Take care of other tests disabled related to inplace updates with CategoricalDtype.

[ https://issues.apache.org/jira/browse/SPARK-36537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin updated SPARK-36537: -- Summary: Take care of other tests disabled related to inplace updates with CategoricalDtype.

[jira] [Created] (SPARK-36537) Take care of other tests disabled.

Takuya Ueshin created SPARK-36537: - Summary: Take care of other tests disabled. Key: SPARK-36537 URL: https://issues.apache.org/jira/browse/SPARK-36537 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-36387) Fix Series.astype from datetime to nullable string

[ https://issues.apache.org/jira/browse/SPARK-36387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-36387. --- Fix Version/s: 3.3.0 Assignee: Haejoon Lee Resolution: Fixed Issue resolved

[jira] [Resolved] (SPARK-36469) Implement Index.map

[ https://issues.apache.org/jira/browse/SPARK-36469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-36469. --- Fix Version/s: 3.2.0 Assignee: Xinrong Meng (was: Apache Spark) Resolution:

[jira] [Resolved] (SPARK-36370) Avoid using SelectionMixin._builtin_table which is removed in pandas 1.3

[ https://issues.apache.org/jira/browse/SPARK-36370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-36370. --- Fix Version/s: 3.2.0 Assignee: Takuya Ueshin Resolution: Fixed This was

[jira] [Created] (SPARK-36388) Fix DataFrame groupby-rolling to follow pandas 1.3

Takuya Ueshin created SPARK-36388: - Summary: Fix DataFrame groupby-rolling to follow pandas 1.3 Key: SPARK-36388 URL: https://issues.apache.org/jira/browse/SPARK-36388 Project: Spark Issue

[jira] [Updated] (SPARK-36386) Fix DataFrame groupby-expanding to follow pandas 1.3

[ https://issues.apache.org/jira/browse/SPARK-36386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin updated SPARK-36386: -- Summary: Fix DataFrame groupby-expanding to follow pandas 1.3 (was: Fix groupby-expanding to

[jira] [Created] (SPARK-36387) Fix Series.astype from datetime to nullable string

Takuya Ueshin created SPARK-36387: - Summary: Fix Series.astype from datetime to nullable string Key: SPARK-36387 URL: https://issues.apache.org/jira/browse/SPARK-36387 Project: Spark Issue

[jira] [Updated] (SPARK-36386) Fix groupby-expanding to follow pandas 1.3

[ https://issues.apache.org/jira/browse/SPARK-36386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin updated SPARK-36386: -- Summary: Fix groupby-expanding to follow pandas 1.3 (was: Fix expanding to follow pandas

[jira] [Created] (SPARK-36386) Fix expanding to follow pandas 1.3

Takuya Ueshin created SPARK-36386: - Summary: Fix expanding to follow pandas 1.3 Key: SPARK-36386 URL: https://issues.apache.org/jira/browse/SPARK-36386 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-36370) Avoid using SelectionMixin._builtin_table which is removed in pandas 1.3

Takuya Ueshin created SPARK-36370: - Summary: Avoid using SelectionMixin._builtin_table which is removed in pandas 1.3 Key: SPARK-36370 URL: https://issues.apache.org/jira/browse/SPARK-36370 Project:

[jira] [Created] (SPARK-36369) Fix Index.union to follow pandas 1.3

Takuya Ueshin created SPARK-36369: - Summary: Fix Index.union to follow pandas 1.3 Key: SPARK-36369 URL: https://issues.apache.org/jira/browse/SPARK-36369 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-36368) Fix CategoricalOps.astype to follow pandas 1.3

Takuya Ueshin created SPARK-36368: - Summary: Fix CategoricalOps.astype to follow pandas 1.3 Key: SPARK-36368 URL: https://issues.apache.org/jira/browse/SPARK-36368 Project: Spark Issue Type:

[jira] [Updated] (SPARK-36367) Fix the behavior to follow pandas >= 1.3

[ https://issues.apache.org/jira/browse/SPARK-36367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin updated SPARK-36367: -- Issue Type: Umbrella (was: Improvement) > Fix the behavior to follow pandas >= 1.3 >

[jira] [Created] (SPARK-36367) Fix the behavior to follow pandas >= 1.3

Takuya Ueshin created SPARK-36367: - Summary: Fix the behavior to follow pandas >= 1.3 Key: SPARK-36367 URL: https://issues.apache.org/jira/browse/SPARK-36367 Project: Spark Issue Type:

[jira] [Updated] (SPARK-36365) Remove old workarounds related to null ordering.

[ https://issues.apache.org/jira/browse/SPARK-36365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin updated SPARK-36365: -- Summary: Remove old workarounds related to null ordering. (was: Remove old workarounds

[jira] [Created] (SPARK-36365) Remove old workarounds related to ordering.

Takuya Ueshin created SPARK-36365: - Summary: Remove old workarounds related to ordering. Key: SPARK-36365 URL: https://issues.apache.org/jira/browse/SPARK-36365 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-36350) Make nanvl work with DataTypeOps

[ https://issues.apache.org/jira/browse/SPARK-36350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-36350. --- Fix Version/s: 3.2.0 Assignee: Takuya Ueshin Resolution: Fixed Issue

[jira] [Resolved] (SPARK-36333) Reuse isnull where the null check is needed.

[ https://issues.apache.org/jira/browse/SPARK-36333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-36333. --- Fix Version/s: 3.2.0 Assignee: Takuya Ueshin Resolution: Fixed Issue

[jira] [Created] (SPARK-36350) Make nanvl work with DataTypeOps

Takuya Ueshin created SPARK-36350: - Summary: Make nanvl work with DataTypeOps Key: SPARK-36350 URL: https://issues.apache.org/jira/browse/SPARK-36350 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-36333) Reuse isnull where the null check is needed.

[ https://issues.apache.org/jira/browse/SPARK-36333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin updated SPARK-36333: -- Summary: Reuse isnull where the null check is needed. (was: Reuse isnull where the

[jira] [Created] (SPARK-36333) Reuse isnull where the nullability check is needed.

Takuya Ueshin created SPARK-36333: - Summary: Reuse isnull where the nullability check is needed. Key: SPARK-36333 URL: https://issues.apache.org/jira/browse/SPARK-36333 Project: Spark Issue

[jira] [Resolved] (SPARK-36190) Improve the rest of DataTypeOps tests by avoiding joins

[ https://issues.apache.org/jira/browse/SPARK-36190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-36190. --- Fix Version/s: 3.2.0 Assignee: Xinrong Meng Resolution: Fixed Issue

[jira] [Resolved] (SPARK-36143) Adjust `astype` of fractional Series with missing values to follow pandas

[ https://issues.apache.org/jira/browse/SPARK-36143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-36143. --- Fix Version/s: 3.2.0 Assignee: Xinrong Meng Resolution: Fixed Issue

[jira] [Created] (SPARK-36320) Fix Series/Index.copy() to drop extra columns.

Takuya Ueshin created SPARK-36320: - Summary: Fix Series/Index.copy() to drop extra columns. Key: SPARK-36320 URL: https://issues.apache.org/jira/browse/SPARK-36320 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-36185) Implement functions in CategoricalAccessor/CategoricalIndex

[ https://issues.apache.org/jira/browse/SPARK-36185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-36185. --- Fix Version/s: 3.2.0 Resolution: Done I'd close this since we've done the tasks we

[jira] [Resolved] (SPARK-36260) Add set_categories to CategoricalAccessor and CategoricalIndex

[ https://issues.apache.org/jira/browse/SPARK-36260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-36260. --- Fix Version/s: 3.2.0 Assignee: Xinrong Meng Resolution: Fixed Issue

[jira] [Resolved] (SPARK-36274) Fix equality comparison of unordered Categoricals

[ https://issues.apache.org/jira/browse/SPARK-36274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-36274. --- Fix Version/s: 3.2.0 Assignee: Xinrong Meng Resolution: Fixed Issue

[jira] [Resolved] (SPARK-36264) Add reorder_categories to CategoricalAccessor and CategoricalIndex.

[ https://issues.apache.org/jira/browse/SPARK-36264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-36264. --- Fix Version/s: 3.2.0 Assignee: Takuya Ueshin Resolution: Fixed Issue

[jira] [Created] (SPARK-36279) Fix lint-python to work with Python 3.9

Takuya Ueshin created SPARK-36279: - Summary: Fix lint-python to work with Python 3.9 Key: SPARK-36279 URL: https://issues.apache.org/jira/browse/SPARK-36279 Project: Spark Issue Type:

[jira] [Commented] (SPARK-36267) Clean up CategoricalAccessor and CategoricalIndex.

[ https://issues.apache.org/jira/browse/SPARK-36267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17386534#comment-17386534 ] Takuya Ueshin commented on SPARK-36267: --- I'll work on this. > Clean up CategoricalAccessor and

[jira] [Updated] (SPARK-36267) Clean up CategoricalAccessor and CategoricalIndex.

[ https://issues.apache.org/jira/browse/SPARK-36267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin updated SPARK-36267: -- Description: - Clean up the classes - Add deprecation warnings > Clean up

[jira] [Created] (SPARK-36267) Clean up CategoricalAccessor and CategoricalIndex.

Takuya Ueshin created SPARK-36267: - Summary: Clean up CategoricalAccessor and CategoricalIndex. Key: SPARK-36267 URL: https://issues.apache.org/jira/browse/SPARK-36267 Project: Spark Issue

[jira] [Created] (SPARK-36265) Use __getitem__ instead of getItem to suppress warnings.

Takuya Ueshin created SPARK-36265: - Summary: Use __getitem__ instead of getItem to suppress warnings. Key: SPARK-36265 URL: https://issues.apache.org/jira/browse/SPARK-36265 Project: Spark

[jira] [Commented] (SPARK-36264) Add reorder_categories to CategoricalAccessor and CategoricalIndex.

[ https://issues.apache.org/jira/browse/SPARK-36264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17385785#comment-17385785 ] Takuya Ueshin commented on SPARK-36264: --- I'm working on this. > Add reorder_categories to

[jira] [Created] (SPARK-36264) Add reorder_categories to CategoricalAccessor and CategoricalIndex.

Takuya Ueshin created SPARK-36264: - Summary: Add reorder_categories to CategoricalAccessor and CategoricalIndex. Key: SPARK-36264 URL: https://issues.apache.org/jira/browse/SPARK-36264 Project: Spark

[jira] [Commented] (SPARK-36261) Add remove_unused_categories to CategoricalAccessor and CategoricalIndex.

[ https://issues.apache.org/jira/browse/SPARK-36261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17385690#comment-17385690 ] Takuya Ueshin commented on SPARK-36261: --- I'm working on this. > Add remove_unused_categories to

[jira] [Created] (SPARK-36261) Add remove_unused_categories to CategoricalAccessor and CategoricalIndex.

Takuya Ueshin created SPARK-36261: - Summary: Add remove_unused_categories to CategoricalAccessor and CategoricalIndex. Key: SPARK-36261 URL: https://issues.apache.org/jira/browse/SPARK-36261 Project:

[jira] [Resolved] (SPARK-36214) Add add_categories to CategoricalAccessor and CategoricalIndex.

[ https://issues.apache.org/jira/browse/SPARK-36214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-36214. --- Fix Version/s: 3.2.0 Assignee: Takuya Ueshin Resolution: Fixed Issue

<    1   2   3   4   5   6   7   8   9   >