[ 
https://issues.apache.org/jira/browse/FLINK-1208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14218494#comment-14218494
 ] 

ASF GitHub Bot commented on FLINK-1208:
---------------------------------------

Github user fhueske commented on a diff in the pull request:

    https://github.com/apache/incubator-flink/pull/201#discussion_r20606989
  
    --- Diff: 
flink-core/src/main/java/org/apache/flink/api/common/io/GenericCsvInputFormat.java
 ---
    @@ -279,6 +308,9 @@ protected boolean parseRecord(Object[] holders, byte[] 
bytes, int offset, int nu
                        // check valid start position
                        if (startPos >= limit) {
                                if (lenient) {
    +                                   if (LOG.isWarnEnabled()) {
    --- End diff --
    
    I think it might be even better to do the handling of invalid lines in the 
DelimitedInputFormat as it delegates the parsing of lines and could read the 
next line if something fails.


> Skip comment lines in CSV input format. Allow user to specify comment 
> character.
> --------------------------------------------------------------------------------
>
>                 Key: FLINK-1208
>                 URL: https://issues.apache.org/jira/browse/FLINK-1208
>             Project: Flink
>          Issue Type: Improvement
>          Components: Java API, Scala API
>    Affects Versions: 0.8-incubating
>            Reporter: Aljoscha Krettek
>            Assignee: Felix Neutatz
>            Priority: Minor
>              Labels: starter
>
> The current skipFirstLine is limited. Skipping arbitrary lines that start 
> with a certain character would be much more flexible while still easy to 
> implement.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to