[ https://issues.apache.org/jira/browse/SPARK-32364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Dongjoon Hyun updated SPARK-32364: ---------------------------------- Reporter: Girish A Pandit (was: Dongjoon Hyun) > Use CaseInsensitiveMap for DataFrameReader/Writer options > --------------------------------------------------------- > > Key: SPARK-32364 > URL: https://issues.apache.org/jira/browse/SPARK-32364 > Project: Spark > Issue Type: Bug > Components: SQL > Affects Versions: 2.0.2, 2.1.3, 2.2.3, 2.3.4, 2.4.6, 3.0.0 > Reporter: Girish A Pandit > Assignee: Dongjoon Hyun > Priority: Major > Fix For: 3.0.1, 3.1.0 > > > When a user have multiple options like path, paTH, and PATH for the same key > path, option/options is non-deterministic because extraOptions is HashMap. > This issue aims to use *CaseInsensitiveMap* instead of *HashMap* to fix this > bug fundamentally. > {code} > spark.read > .option("paTh", "1") > .option("PATH", "2") > .option("Path", "3") > .option("patH", "4") > .load("5") > ... > org.apache.spark.sql.AnalysisException: > Path does not exist: file:/.../1; > {code} -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org