(spark) branch branch-3.5 updated: [SPARK-52721][PYTHON] Fix message parameter for CANNOT_PARSE_DATATYPE

[yao]

This is an automated email from the ASF dual-hosted git repository.

yao pushed a commit to branch branch-3.5
in repository https://gitbox.apache.org/repos/asf/spark.git


The following commit(s) were added to refs/heads/branch-3.5 by this push:
     new fb9cd1026209 [SPARK-52721][PYTHON] Fix message parameter for 
CANNOT_PARSE_DATATYPE
fb9cd1026209 is described below

commit fb9cd102620991c53390e1dc62cff320132e385c
Author: Kent Yao <y...@apache.org>
AuthorDate: Wed Jul 9 17:39:42 2025 +0800

    [SPARK-52721][PYTHON] Fix message parameter for CANNOT_PARSE_DATATYPE
    
    Fix message parameter for CANNOT_PARSE_DATATYPE
    
    bugfix
    
    No
    
    - Before
    AssertionError: Undefined error message parameter for error class: 
CANNOT_PARSE_DATATYPE. Parameters: {'error':
    
    - After
    pyspark.errors.exceptions.base.PySparkValueError: [CANNOT_PARSE_DATATYPE] 
Unable to parse datatype.
    
    no
    
    Closes #51414 from yaooqinn/SPARK-52721.
    
    Authored-by: Kent Yao <y...@apache.org>
    Signed-off-by: Kent Yao <y...@apache.org>
    (cherry picked from commit c6e864538e2d8e3c816ba0f0a7bb9e212adc0a9d)
    Signed-off-by: Kent Yao <y...@apache.org>
---
 python/pyspark/sql/classic/dataframe.py | 0
 python/pyspark/sql/dataframe.py         | 2 +-
 python/pyspark/sql/types.py             | 2 +-
 3 files changed, 2 insertions(+), 2 deletions(-)

diff --git a/python/pyspark/sql/classic/dataframe.py 
b/python/pyspark/sql/classic/dataframe.py
new file mode 100644
index 000000000000..e69de29bb2d1
diff --git a/python/pyspark/sql/dataframe.py b/python/pyspark/sql/dataframe.py
index afa979dab019..c52fa568b7b3 100644
--- a/python/pyspark/sql/dataframe.py
+++ b/python/pyspark/sql/dataframe.py
@@ -576,7 +576,7 @@ class DataFrame(PandasMapOpsMixin, PandasConversionMixin):
             except Exception as e:
                 raise PySparkValueError(
                     error_class="CANNOT_PARSE_DATATYPE",
-                    message_parameters={"error": str(e)},
+                    message_parameters={"msg": str(e)},
                 )
         return self._schema
 
diff --git a/python/pyspark/sql/types.py b/python/pyspark/sql/types.py
index a2a879695762..d4d6b6b086ae 100644
--- a/python/pyspark/sql/types.py
+++ b/python/pyspark/sql/types.py
@@ -1411,7 +1411,7 @@ def _parse_datatype_json_value(json_value: Union[dict, 
str]) -> DataType:
         else:
             raise PySparkValueError(
                 error_class="CANNOT_PARSE_DATATYPE",
-                message_parameters={"error": str(json_value)},
+                message_parameters={"msg": str(json_value)},
             )
     else:
         tpe = json_value["type"]


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org