[ https://issues.apache.org/jira/browse/SPARK-41970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Apache Spark reassigned SPARK-41970: ------------------------------------ Assignee: Apache Spark > SparkPath > --------- > > Key: SPARK-41970 > URL: https://issues.apache.org/jira/browse/SPARK-41970 > Project: Spark > Issue Type: Improvement > Components: Spark Core > Affects Versions: 3.4.0 > Reporter: David Lewis > Assignee: Apache Spark > Priority: Major > > Today, Spark represents file paths in various ways. Sometimes they are Hadoop > `Path`s, sometimes they are `Path.toString`s, and sometimes they are > `Path.toUri.toString`s. > This discrepancy means that Spark does not always work when user provided > strings have special characters. Sometimes Spark will try to create a URI > with an unescaped string; sometimes Spark will double-escape a path and try > to access the wrong file. > > This issue proposes a new `SparkPath` class meant to provide type safety when > Spark is dealing with paths. -- This message was sent by Atlassian Jira (v8.20.10#820010) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org