[
https://issues.apache.org/jira/browse/SPARK-28984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16925027#comment-16925027
]
Hyukjin Kwon commented on SPARK-28984:
--------------------------------------
Please post a self-contained reproducer with showing which option you are
setting. IIRC, this limit is inherited from Univocity. Please also suggest a
way to fix.
> csv files should support multi-character separators
> ---------------------------------------------------
>
> Key: SPARK-28984
> URL: https://issues.apache.org/jira/browse/SPARK-28984
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Affects Versions: 3.0.0
> Reporter: cheng
> Priority: Major
> Attachments: multi_csv2.csv
>
> Original Estimate: 72h
> Remaining Estimate: 72h
>
> The current version supports reading csv single-character delimiters, but now
> many files do not follow such rules to generate files, but instead use
> multi-character delimiters. Now I let spark by reading text and overwriting
> multi-character delimiters. Successfully read csv, I think spark is necessary
> to support csv files should support splitting of multi-character separators
--
This message was sent by Atlassian Jira
(v8.3.2#803003)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
