Hyukjin Kwon created SPARK-48733: ------------------------------------ Summary: Do not set SET command in Python UDTF test Key: SPARK-48733 URL: https://issues.apache.org/jira/browse/SPARK-48733 Project: Spark Issue Type: Improvement Components: PySpark, Tests Affects Versions: 4.0.0 Reporter: Hyukjin Kwon
{code} # We do not use `self.sql_conf` here to test the SQL SET command # instead of using PySpark's `spark.conf.set`. old_value = self.spark.conf.get("spark.sql.execution.pythonUDTF.arrow.enabled") self.spark.sql("SET spark.sql.execution.pythonUDTF.arrow.enabled=False") self.assertEqual(udtf(TestUDTF, returnType="x: int").evalType, PythonEvalType.SQL_TABLE_UDF) self.spark.sql("SET spark.sql.execution.pythonUDTF.arrow.enabled=True") self.assertEqual( udtf(TestUDTF, returnType="x: int").evalType, PythonEvalType.SQL_ARROW_TABLE_UDF ) self.spark.conf.set("spark.sql.execution.pythonUDTF.arrow.enabled", old_value) {code} we don;t need to test SET command there -- This message was sent by Atlassian Jira (v8.20.10#820010) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org