[ 
https://issues.apache.org/jira/browse/ARROW-6004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16897257#comment-16897257
 ] 

Joris Van den Bossche commented on ARROW-6004:
----------------------------------------------

[~fsaintjacques] skipping empty lines is still the default behaviour, those 
nulls are only introduced when specifying the keyword. I don't think we have 
plans to change the default, so the question is then more: is it worth having 
this option? (pandas.read_csv has it for example)

> [C++] CSV reader ignore_empty_lines option doesn't handle empty lines
> ---------------------------------------------------------------------
>
>                 Key: ARROW-6004
>                 URL: https://issues.apache.org/jira/browse/ARROW-6004
>             Project: Apache Arrow
>          Issue Type: Bug
>          Components: C++
>            Reporter: Neal Richardson
>            Assignee: Antoine Pitrou
>            Priority: Minor
>              Labels: csv, pull-request-available
>          Time Spent: 3h 20m
>  Remaining Estimate: 0h
>
> Followup to https://issues.apache.org/jira/browse/ARROW-5747. If 
> {{ignore_empty_lines}} is false and there are empty lines, it fails to parse 
> (again, with {{Invalid: Empty CSV file}}).
> Correct behavior should be to fill those empty lines with missing data for 
> all columns.



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)

Reply via email to