Ryan Johnson created SPARK-44081:
------------------------------------
Summary: Simplify PartitionedFileUtil API
Key: SPARK-44081
URL: https://issues.apache.org/jira/browse/SPARK-44081
Project: Spark
Issue Type: Improvement
Components: Spark Core
Affects Versions: 3.5.0
Reporter: Ryan Johnson
Utility methods in {{PartitionedFileUtil}} take both {{file:
FileStatusWithMetadata}} and {{{}filePath: Path{}}}, even tho the latter can be
obtained easily from the former.
This was originally done for performance reasons, to allow callers to pass a
memoized {{Path}} and thus avoid the cost of an additional
{{FileStatus.getPath}} call.
Now that we have {{{}FileStatusWithMetadata{}}}, we no longer need the
redundancy because the new class can capture the path as a {{{}lazy val{}}}.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
