[GitHub] [spark] zhengruifeng commented on pull request #42942: [SPARK-45168][PYTHON][FOLLOWUP] `test_missing_data.py` Code Cleanup

2023-09-15 Thread via GitHub
zhengruifeng commented on PR #42942: URL: https://github.com/apache/spark/pull/42942#issuecomment-1720943164 thanks @dongjoon-hyun , merged to master -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [spark] zhengruifeng commented on pull request #42942: [SPARK-45168][PYTHON][FOLLOWUP] `test_missing_data.py` Code Cleanup

2023-09-14 Thread via GitHub
zhengruifeng commented on PR #42942: URL: https://github.com/apache/spark/pull/42942#issuecomment-1720747786 thanks @dongjoon-hyun the CI link is https://github.com/zhengruifeng/spark/actions/runs/6194672684 -- This is an automated message from the Apache Git Service. To respond to

[GitHub] [spark] zhengruifeng commented on pull request #42942: [SPARK-45168][PYTHON][FOLLOWUP] `test_missing_data.py` Code Cleanup

2023-09-14 Thread via GitHub
zhengruifeng commented on PR #42942: URL: https://github.com/apache/spark/pull/42942#issuecomment-1720745593 after this PR, ``` (spark_dev_310) ➜ spark git:(inc_pd_clean_up) ag --py 'pandas\.__version' python python/pyspark/sql/pandas/utils.py 37:if LooseVersion(pandas._