This is an automated email from the ASF dual-hosted git repository.
gurwls223 pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new 28a201a [SPARK-35873][PYTHON] Cleanup the version logic from the
pandas API on Spark
28a201a is described below
commit 28a201a442812a1d4b35887ef0e89e4e470ae969
Author: itholic <haejoon....@databricks.com>
AuthorDate: Wed Jun 30 10:01:51 2021 +0900
[SPARK-35873][PYTHON] Cleanup the version logic from the pandas API on Spark
### What changes were proposed in this pull request?
This PR proposes removing the legacy Koalas version from pandas API on
Spark package.
And also remove the Python version check logic since now pandas-on-Spark
should follow the PySpark's Python version.
### Why are the changes needed?
Since Koalas is ported into PySpark, we don't need to keep the version
logic for Koalas.
### Does this PR introduce _any_ user-facing change?
Now the legacy Koalas user should follow the version from PySpark.
### How was this patch tested?
Manually built the package and see it's successfully done.
Closes #33128 from itholic/SPARK-35873.
Authored-by: itholic <haejoon....@databricks.com>
Signed-off-by: Hyukjin Kwon <gurwls...@apache.org>
---
python/pyspark/pandas/__init__.py | 25 -------------------------
python/pyspark/pandas/version.py | 18 ------------------
2 files changed, 43 deletions(-)
diff --git a/python/pyspark/pandas/__init__.py
b/python/pyspark/pandas/__init__.py
index eed9872..cf078ed 100644
--- a/python/pyspark/pandas/__init__.py
+++ b/python/pyspark/pandas/__init__.py
@@ -31,31 +31,6 @@ except ImportError as e:
else:
raise
-from pyspark.pandas.version import __version__ # noqa: F401
-
-
-def assert_python_version() -> None:
- major = 3
- minor = 5
- deprecated_version = (major, minor)
- min_supported_version = (major, minor + 1)
-
- if sys.version_info[:2] <= deprecated_version:
- warnings.warn(
- "pandas-on-Spark support for Python {dep_ver} is deprecated and
will be dropped in "
- "the future release. At that point, existing Python {dep_ver}
workflows "
- "that use pandas-on-Spark will continue to work without
modification, but "
- "Python {dep_ver} users will no longer get access to the latest
pandas-on-Spark "
- "features and bugfixes. We recommend that you upgrade to Python
{min_ver} or "
- "newer.".format(
- dep_ver=".".join(map(str, deprecated_version)),
- min_ver=".".join(map(str, min_supported_version)),
- ),
- FutureWarning,
- )
-
-
-assert_python_version()
import pyarrow
diff --git a/python/pyspark/pandas/version.py b/python/pyspark/pandas/version.py
deleted file mode 100644
index 449df1d..0000000
--- a/python/pyspark/pandas/version.py
+++ /dev/null
@@ -1,18 +0,0 @@
-#
-# Licensed to the Apache Software Foundation (ASF) under one or more
-# contributor license agreements. See the NOTICE file distributed with
-# this work for additional information regarding copyright ownership.
-# The ASF licenses this file to You under the Apache License, Version 2.0
-# (the "License"); you may not use this file except in compliance with
-# the License. You may obtain a copy of the License at
-#
-# http://www.apache.org/licenses/LICENSE-2.0
-#
-# Unless required by applicable law or agreed to in writing, software
-# distributed under the License is distributed on an "AS IS" BASIS,
-# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-# See the License for the specific language governing permissions and
-# limitations under the License.
-#
-
-__version__ = "1.7.0"
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
