Punit Shah created SPARK-32956: ---------------------------------- Summary: Duplicate Columns in a csv file Key: SPARK-32956 URL: https://issues.apache.org/jira/browse/SPARK-32956 Project: Spark Issue Type: Bug Components: Spark Core Affects Versions: 3.0.1, 3.0.0, 2.4.7, 2.4.6, 2.4.5, 2.4.4, 2.4.3 Reporter: Punit Shah
Imagine a csv file shaped like: ======================================================== Id,Product,Sale_Amount,Sale_Units,Sale_Amount2,Sale_Amount,Sale_Price 1,P,"6,40,728","6,40,728","6,40,728","6,40,728","6,40,728" 2,P,"5,81,644","5,81,644","5,81,644","5,81,644","5,81,644" ========================================================= Reading this with the header=True will result in a stacktrace. -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org