David Lewis created SPARK-41970:
-----------------------------------
Summary: SparkPath
Key: SPARK-41970
URL: https://issues.apache.org/jira/browse/SPARK-41970
Project: Spark
Issue Type: Improvement
Components: Spark Core
Affects Versions: 3.4.0
Reporter: David Lewis
Today, Spark represents file paths in various ways. Sometimes they are Hadoop
`Path`s, sometimes they are `Path.toString`s, and sometimes they are
`Path.toUri.toString`s.
This discrepancy means that Spark does not always work when user provided
strings have special characters. Sometimes Spark will try to create a URI with
an unescaped string; sometimes Spark will double-escape a path and try to
access the wrong file.
This issue proposes a new `SparkPath` class meant to provide type safety when
Spark is dealing with paths.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
