[ https://issues.apache.org/jira/browse/SPARK-28984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16925493#comment-16925493 ]
Hyukjin Kwon commented on SPARK-28984: -------------------------------------- Can you file an issue at Univocity side and let this JIRA proceed? > csv files should support multi-character separators > --------------------------------------------------- > > Key: SPARK-28984 > URL: https://issues.apache.org/jira/browse/SPARK-28984 > Project: Spark > Issue Type: Improvement > Components: SQL > Affects Versions: 3.0.0 > Reporter: cheng dai > Priority: Major > Attachments: multi_csv2.csv > > Original Estimate: 72h > Remaining Estimate: 72h > > The current version supports reading csv single-character delimiters, but now > many files do not follow such rules to generate files, but instead use > multi-character delimiters. Now I let spark by reading text and overwriting > multi-character delimiters. Successfully read csv, I think spark is necessary > to support csv files should support splitting of multi-character separators -- This message was sent by Atlassian Jira (v8.3.2#803003) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org