[ https://issues.apache.org/jira/browse/SPARK-28779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16913151#comment-16913151 ]
nicolas paris commented on SPARK-28779: --------------------------------------- good to know thanks > CSV writer doesn't handle older Mac line endings > ------------------------------------------------ > > Key: SPARK-28779 > URL: https://issues.apache.org/jira/browse/SPARK-28779 > Project: Spark > Issue Type: Bug > Components: Spark Core > Affects Versions: 2.3.0, 2.4.0 > Reporter: nicolas paris > Priority: Minor > > The spark csv writer does not consider "\r" as a newline in string type > columns. As a result, the resulting csv are not quoted, and they get > corrupted. > All \n, \r\n and \r should be considered as newline to allow robust csv > serialization. -- This message was sent by Atlassian Jira (v8.3.2#803003) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org