[ https://issues.apache.org/jira/browse/SPARK-37247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Xinrong Meng updated SPARK-37247: --------------------------------- Description: {code:java} File "/Users/xinrong.meng/spark/python/pyspark/sql/tests/test_dataframe.py", line 957, in test_create_nan_decimal_dataframe self.spark.createDataFrame(data=[Decimal('NaN')], schema='decimal').collect(), File "/Users/xinrong.meng/spark/python/pyspark/sql/dataframe.py", line 751, in collect sock_info = self._jdf.collectToPython() File "/Users/xinrong.meng/spark/python/lib/py4j-0.10.9.2-src.zip/py4j/java_gateway.py", line 1309, in __call__ return_value = get_return_value( File "/Users/xinrong.meng/spark/python/pyspark/sql/utils.py", line 178, in deco return f(*a, **kw) File "/Users/xinrong.meng/spark/python/lib/py4j-0.10.9.2-src.zip/py4j/protocol.py", line 326, in get_return_value raise Py4JJavaError( py4j.protocol.Py4JJavaError: An error occurred while calling o135.collectToPython. : org.apache.spark.SparkException: Job aborted due to stage failure: Task 3 in stage 2.0 failed 1 times, most recent failure: Lost task 3.0 in stage 2.0 (TID 7) (172.16.203.223 executor driver): net.razorvine.pickle.PickleException: problem construction object: java.lang.reflect.InvocationTargetException ...{code} > Failed test_create_nan_decimal_dataframe > (pyspark.sql.tests.test_dataframe.DataFrameTests) > ------------------------------------------------------------------------------------------ > > Key: SPARK-37247 > URL: https://issues.apache.org/jira/browse/SPARK-37247 > Project: Spark > Issue Type: Sub-task > Components: PySpark > Affects Versions: 3.3.0 > Reporter: Xinrong Meng > Priority: Major > > {code:java} > File > "/Users/xinrong.meng/spark/python/pyspark/sql/tests/test_dataframe.py", line > 957, in test_create_nan_decimal_dataframe > self.spark.createDataFrame(data=[Decimal('NaN')], > schema='decimal').collect(), > File "/Users/xinrong.meng/spark/python/pyspark/sql/dataframe.py", line 751, > in collect > sock_info = self._jdf.collectToPython() > File > "/Users/xinrong.meng/spark/python/lib/py4j-0.10.9.2-src.zip/py4j/java_gateway.py", > line 1309, in __call__ > return_value = get_return_value( > File "/Users/xinrong.meng/spark/python/pyspark/sql/utils.py", line 178, in > deco > return f(*a, **kw) > File > "/Users/xinrong.meng/spark/python/lib/py4j-0.10.9.2-src.zip/py4j/protocol.py", > line 326, in get_return_value > raise Py4JJavaError( > py4j.protocol.Py4JJavaError: An error occurred while calling > o135.collectToPython. > : org.apache.spark.SparkException: Job aborted due to stage failure: Task 3 > in stage 2.0 failed 1 times, most recent failure: Lost task 3.0 in stage 2.0 > (TID 7) (172.16.203.223 executor driver): > net.razorvine.pickle.PickleException: problem construction object: > java.lang.reflect.InvocationTargetException > ...{code} -- This message was sent by Atlassian Jira (v8.20.1#820001) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org