Utkarsh Agarwal created SPARK-45772: ---------------------------------------
Summary: Add additional test coverage for input_file_name_expr Key: SPARK-45772 URL: https://issues.apache.org/jira/browse/SPARK-45772 Project: Spark Issue Type: Task Components: PySpark Affects Versions: 4.0.0 Reporter: Utkarsh Agarwal https://issues.apache.org/jira/browse/SPARK-44705 introduced changes to the evaluation of the `input_file_name()` expression in the presence of Python UDFs. This was done to maintain the behavior of the `input_file_name()` expression when the execution model of the PythonRunner was made single-threaded by https://issues.apache.org/jira/browse/SPARK-44705. We should add additional test coverage for `input_file_name()` + Python UDFs to prevent future breakages. -- This message was sent by Atlassian Jira (v8.20.10#820010) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org