[jira] [Commented] (SPARK-32614) Support for treating the line as valid record if it starts with \u0000 or null character, or starts with any character mentioned as comment

2020-08-22 Thread chanduhawk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17182586#comment-17182586 ] chanduhawk commented on SPARK-32614: [~srowen] Univocity parser always takes default comment

[jira] [Commented] (SPARK-32614) Support for treating the line as valid record if it starts with \u0000 or null character, or starts with any character mentioned as comment

2020-08-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17182537#comment-17182537 ] Apache Spark commented on SPARK-32614: -- User 'srowen' has created a pull request for this issue:

[jira] [Commented] (SPARK-32614) Support for treating the line as valid record if it starts with \u0000 or null character, or starts with any character mentioned as comment

2020-08-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17182536#comment-17182536 ] Apache Spark commented on SPARK-32614: -- User 'srowen' has created a pull request for this issue:

[jira] [Commented] (SPARK-32614) Support for treating the line as valid record if it starts with \u0000 or null character, or starts with any character mentioned as comment

2020-08-22 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17182528#comment-17182528 ] Sean R. Owen commented on SPARK-32614: -- Sort of; Spark uses '\u' to mean "no comment

[jira] [Commented] (SPARK-32614) Support for treating the line as valid record if it starts with \u0000 or null character, or starts with any character mentioned as comment

2020-08-17 Thread chanduhawk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17179150#comment-17179150 ] chanduhawk commented on SPARK-32614: In spark if the comment option is not set then it will take

[jira] [Commented] (SPARK-32614) Support for treating the line as valid record if it starts with \u0000 or null character, or starts with any character mentioned as comment

2020-08-17 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17179148#comment-17179148 ] Sean R. Owen commented on SPARK-32614: -- Why a new option then? how about you don't process comments

[jira] [Commented] (SPARK-32614) Support for treating the line as valid record if it starts with \u0000 or null character, or starts with any character mentioned as comment

2020-08-17 Thread chanduhawk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17179097#comment-17179097 ] chanduhawk commented on SPARK-32614: [~srowen] Univocity parser i already raised PR and its merged

[jira] [Commented] (SPARK-32614) Support for treating the line as valid record if it starts with \u0000 or null character, or starts with any character mentioned as comment

2020-08-17 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17179064#comment-17179064 ] Sean R. Owen commented on SPARK-32614: -- I see, you're not saying that nulls are comment characters

[jira] [Commented] (SPARK-32614) Support for treating the line as valid record if it starts with \u0000 or null character, or starts with any character mentioned as comment

2020-08-16 Thread chanduhawk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17178560#comment-17178560 ] chanduhawk commented on SPARK-32614: If one of the rows the data file(CSV) starts with null or

[jira] [Commented] (SPARK-32614) Support for treating the line as valid record if it starts with \u0000 or null character, or starts with any character mentioned as comment

2020-08-16 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17178537#comment-17178537 ] Sean R. Owen commented on SPARK-32614: -- I dont' really understand this. Are you just saying you