Re: [PR] [SPARK-45718][PS] Remove remaining deprecated Pandas features from Spark 3.4.0 [spark]

2023-11-02 Thread via GitHub
dongjoon-hyun commented on PR #43581: URL: https://github.com/apache/spark/pull/43581#issuecomment-1791556755 Right. Finally, it's fixed and passed. Merged to master. Thank you, @itholic and @HyukjinKwon . -- This is an automated message from the Apache Git Service. To respond to the mess

Re: [PR] [SPARK-45718][PS] Remove remaining deprecated Pandas features from Spark 3.4.0 [spark]

2023-11-02 Thread via GitHub
dongjoon-hyun closed pull request #43581: [SPARK-45718][PS] Remove remaining deprecated Pandas features from Spark 3.4.0 URL: https://github.com/apache/spark/pull/43581 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

Re: [PR] [SPARK-45718][PS] Remove remaining deprecated Pandas features from Spark 3.4.0 [spark]

2023-11-01 Thread via GitHub
HyukjinKwon commented on PR #43581: URL: https://github.com/apache/spark/pull/43581#issuecomment-1790035094 Seems actually like it's a real error: ``` Warning, treated as error: [autosummary] failed to import 'pyspark.pandas.Index.is_all_dates': no module named pyspark.pandas.In

Re: [PR] [SPARK-45718][PS] Remove remaining deprecated Pandas features from Spark 3.4.0 [spark]

2023-11-01 Thread via GitHub
dongjoon-hyun commented on PR #43581: URL: https://github.com/apache/spark/pull/43581#issuecomment-1790034093 It seems to be fixed. Could you re-run `linter` pipeline? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use th

Re: [PR] [SPARK-45718][PS] Remove remaining deprecated Pandas features from Spark 3.4.0 [spark]

2023-10-31 Thread via GitHub
itholic commented on PR #43581: URL: https://github.com/apache/spark/pull/43581#issuecomment-1788315425 Oh, just realized that there was actual failure. Thanks for the notice! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub an

Re: [PR] [SPARK-45718][PS] Remove remaining deprecated Pandas features from Spark 3.4.0 [spark]

2023-10-31 Thread via GitHub
dongjoon-hyun commented on PR #43581: URL: https://github.com/apache/spark/pull/43581#issuecomment-1787577153 It seems that three PySpark test pipelines fails still unfortunately. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

Re: [PR] [SPARK-45718][PS] Remove remaining deprecated Pandas features from Spark 3.4.0 [spark]

2023-10-30 Thread via GitHub
dongjoon-hyun commented on PR #43581: URL: https://github.com/apache/spark/pull/43581#issuecomment-1785814391 Please re-trigger the CI, @itholic . -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[PR] [SPARK-45718][PS] Remove remaining deprecated Pandas features from Spark 3.4.0 [spark]

2023-10-30 Thread via GitHub
itholic opened a new pull request, #43581: URL: https://github.com/apache/spark/pull/43581 ### What changes were proposed in this pull request? This PR proposes to remove remaining deprecated Pandas features from Spark 3.4.0 ### Why are the changes needed? To match the b