[ https://issues.apache.org/jira/browse/SPARK-19834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15925380#comment-15925380 ]
Soonmok Kwon commented on SPARK-19834: -------------------------------------- To resolve this issue we need to enable uniVocity csv parser options: escapeUnquotedValues and charToEscapeQuoteEscaping. It is good to add as it is also described in univocity library's README.md but Exposing an option that has currently a little bug has a risk. Maybe it is better to close this issue for now and re-open when Spark bumps up to uniVocity version 2.4.0. > csv escape of quote escape > -------------------------- > > Key: SPARK-19834 > URL: https://issues.apache.org/jira/browse/SPARK-19834 > Project: Spark > Issue Type: Bug > Components: SQL > Affects Versions: 2.1.0 > Reporter: Soonmok Kwon > Priority: Minor > Original Estimate: 4h > Remaining Estimate: 4h > > A DataFrame is stored in CSV format and loaded again. When there's backslash > followed by quotation mark, csv reading seems to make an error. > reference: > http://stackoverflow.com/questions/42607208/spark-csv-error-when-reading-backslash-and-quotation-mark -- This message was sent by Atlassian JIRA (v6.3.15#6346) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org