Re: [PR] [WIP][SPARK-46858][PYTHON][PS][BUILD] Upgrade Pandas to 2.2.0 [spark]

2024-02-13 Thread via GitHub
itholic commented on code in PR #44881: URL: https://github.com/apache/spark/pull/44881#discussion_r1487597019 ## python/pyspark/pandas/frame.py: ## @@ -10607,7 +10607,9 @@ def melt( name_like_string(name) if name is not None else "variable_{}".format(i)

Re: [PR] [WIP][SPARK-46858][PYTHON][PS][BUILD] Upgrade Pandas to 2.2.0 [spark]

2024-01-29 Thread via GitHub
dongjoon-hyun commented on code in PR #44881: URL: https://github.com/apache/spark/pull/44881#discussion_r1470668096 ## python/pyspark/pandas/namespace.py: ## @@ -2554,7 +2553,7 @@ def resolve_func(psdf, this_column_labels, that_column_labels): if isinstance(obj, Serie

Re: [PR] [WIP][SPARK-46858][PYTHON][PS][BUILD] Upgrade Pandas to 2.2.0 [spark]

2024-01-29 Thread via GitHub
itholic commented on code in PR #44881: URL: https://github.com/apache/spark/pull/44881#discussion_r1470651441 ## python/pyspark/pandas/namespace.py: ## @@ -2554,7 +2553,7 @@ def resolve_func(psdf, this_column_labels, that_column_labels): if isinstance(obj, Series):

Re: [PR] [WIP][SPARK-46858][PYTHON][PS][BUILD] Upgrade Pandas to 2.2.0 [spark]

2024-01-29 Thread via GitHub
dongjoon-hyun commented on code in PR #44881: URL: https://github.com/apache/spark/pull/44881#discussion_r1470641012 ## python/pyspark/pandas/namespace.py: ## @@ -2554,7 +2553,7 @@ def resolve_func(psdf, this_column_labels, that_column_labels): if isinstance(obj, Serie

Re: [PR] [WIP][SPARK-46858][PYTHON][PS][BUILD] Upgrade Pandas to 2.2.0 [spark]

2024-01-29 Thread via GitHub
itholic commented on code in PR #44881: URL: https://github.com/apache/spark/pull/44881#discussion_r1470461086 ## dev/infra/Dockerfile: ## @@ -91,10 +91,10 @@ RUN mkdir -p /usr/local/pypy/pypy3.8 && \ ln -sf /usr/local/pypy/pypy3.8/bin/pypy /usr/local/bin/pypy3.8 && \

Re: [PR] [WIP][SPARK-46858][PYTHON][PS][BUILD] Upgrade Pandas to 2.2.0 [spark]

2024-01-28 Thread via GitHub
itholic commented on code in PR #44881: URL: https://github.com/apache/spark/pull/44881#discussion_r1469178246 ## dev/infra/Dockerfile: ## @@ -91,10 +91,10 @@ RUN mkdir -p /usr/local/pypy/pypy3.8 && \ ln -sf /usr/local/pypy/pypy3.8/bin/pypy /usr/local/bin/pypy3.8 && \