[jira] [Comment Edited] (SPARK-32614) Support for treating the line as valid record if it starts with \u0000 or null character, or starts with any character mentioned as comment

2020-08-22 Thread chanduhawk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17182586#comment-17182586 ] chanduhawk edited comment on SPARK-32614 at 8/23/20, 5:20 AM: -- [~srowen]

[jira] [Commented] (SPARK-32614) Support for treating the line as valid record if it starts with \u0000 or null character, or starts with any character mentioned as comment

2020-08-22 Thread chanduhawk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17182586#comment-17182586 ] chanduhawk commented on SPARK-32614: [~srowen] Univocity parser always takes default comment

[jira] [Comment Edited] (SPARK-32614) Support for treating the line as valid record if it starts with \u0000 or null character, or starts with any character mentioned as comment

2020-08-22 Thread chanduhawk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17179150#comment-17179150 ] chanduhawk edited comment on SPARK-32614 at 8/22/20, 4:52 PM: -- [~srowen]

[jira] [Comment Edited] (SPARK-32614) Support for treating the line as valid record if it starts with \u0000 or null character, or starts with any character mentioned as comment

2020-08-17 Thread chanduhawk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17179150#comment-17179150 ] chanduhawk edited comment on SPARK-32614 at 8/17/20, 5:52 PM: -- In spark if

[jira] [Updated] (SPARK-32614) Support for treating the line as valid record if it starts with \u0000 or null character, or starts with any character mentioned as comment

2020-08-17 Thread chanduhawk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chanduhawk updated SPARK-32614: --- Description: In most of the data ware housing scenarios files does not have comment records and

[jira] [Updated] (SPARK-32614) Support for treating the line as valid record if it starts with \u0000 or null character, or starts with any character mentioned as comment

2020-08-17 Thread chanduhawk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chanduhawk updated SPARK-32614: --- Description: In most of the data ware housing scenarios files does not have comment records and

[jira] [Commented] (SPARK-32614) Support for treating the line as valid record if it starts with \u0000 or null character, or starts with any character mentioned as comment

2020-08-17 Thread chanduhawk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17179150#comment-17179150 ] chanduhawk commented on SPARK-32614: In spark if the comment option is not set then it will take

[jira] [Updated] (SPARK-32614) Support for treating the line as valid record if it starts with \u0000 or null character, or starts with any character mentioned as comment

2020-08-17 Thread chanduhawk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chanduhawk updated SPARK-32614: --- Affects Version/s: 2.2.3 > Support for treating the line as valid record if it starts with \u

[jira] [Comment Edited] (SPARK-32614) Support for treating the line as valid record if it starts with \u0000 or null character, or starts with any character mentioned as comment

2020-08-17 Thread chanduhawk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17179097#comment-17179097 ] chanduhawk edited comment on SPARK-32614 at 8/17/20, 4:25 PM: -- [~srowen]

[jira] [Comment Edited] (SPARK-32614) Support for treating the line as valid record if it starts with \u0000 or null character, or starts with any character mentioned as comment

2020-08-17 Thread chanduhawk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17179097#comment-17179097 ] chanduhawk edited comment on SPARK-32614 at 8/17/20, 4:24 PM: -- [~srowen]

[jira] [Commented] (SPARK-32614) Support for treating the line as valid record if it starts with \u0000 or null character, or starts with any character mentioned as comment

2020-08-17 Thread chanduhawk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17179097#comment-17179097 ] chanduhawk commented on SPARK-32614: [~srowen] Univocity parser i already raised PR and its merged

[jira] [Comment Edited] (SPARK-32614) Support for treating the line as valid record if it starts with \u0000 or null character, or starts with any character mentioned as comment

2020-08-16 Thread chanduhawk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17178560#comment-17178560 ] chanduhawk edited comment on SPARK-32614 at 8/17/20, 3:49 AM: -- [~srowen]

[jira] [Comment Edited] (SPARK-32614) Support for treating the line as valid record if it starts with \u0000 or null character, or starts with any character mentioned as comment

2020-08-16 Thread chanduhawk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17178560#comment-17178560 ] chanduhawk edited comment on SPARK-32614 at 8/16/20, 5:39 PM: -- *currently

[jira] [Comment Edited] (SPARK-32614) Support for treating the line as valid record if it starts with \u0000 or null character, or starts with any character mentioned as comment

2020-08-16 Thread chanduhawk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17178560#comment-17178560 ] chanduhawk edited comment on SPARK-32614 at 8/16/20, 5:37 PM: -- *currently

[jira] [Comment Edited] (SPARK-32614) Support for treating the line as valid record if it starts with \u0000 or null character, or starts with any character mentioned as comment

2020-08-16 Thread chanduhawk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17178560#comment-17178560 ] chanduhawk edited comment on SPARK-32614 at 8/16/20, 5:37 PM: -- *currently

[jira] [Commented] (SPARK-32614) Support for treating the line as valid record if it starts with \u0000 or null character, or starts with any character mentioned as comment

2020-08-16 Thread chanduhawk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17178560#comment-17178560 ] chanduhawk commented on SPARK-32614: If one of the rows the data file(CSV) starts with null or