Carlos Barahona created SPARK-22578: ---------------------------------------
Summary: CSV with quoted line breaks not correctly parsed Key: SPARK-22578 URL: https://issues.apache.org/jira/browse/SPARK-22578 Project: Spark Issue Type: Bug Components: SQL Affects Versions: 2.2.0 Reporter: Carlos Barahona I believe the behavior addressed in SPARK-19610 still exists. Using spark 2.2.0, when attempting to read in a CSV file containing a quoted newline, the resulting dataset contains two separate items split along the quoted newline. Example text: {code:java} 4/28/2015 8:01,4/28/2015 8:19,0,100,1078,1,4/28/2015 8:19,email,"Hello World", 2,3,4,5 {code} scala> val csvFile = spark.read.csv("file:///path") csvFile: org.apache.spark.sql.DataFrame = [_c0: string, _c1: string ... 7 more fields] scala> csvFile.first() res2: org.apache.spark.sql.Row = [4/28/2015 8:01,4/28/2015 8:19,0,100,1078,1,4/28/2015 8:19,email,Hello] scala> csvFile.count() res3: Long = 2 -- This message was sent by Atlassian JIRA (v6.4.14#64029) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org