Stefán Baxter created DRILL-3512:
------------------------------------

             Summary: json queries fails on unexpected EOL
                 Key: DRILL-3512
                 URL: https://issues.apache.org/jira/browse/DRILL-3512
             Project: Apache Drill
          Issue Type: Improvement
          Components: Storage - JSON
    Affects Versions: 1.1.0
            Reporter: Stefán Baxter
            Assignee: Steven Phillips
            Priority: Minor


querying directories or files that are open by some writer is a create way to 
keep up with data (csv/tsv) being logged out by servers, processes etc.

We did a small test where we appended a copy of our message stream (1k 
msg./sec.) to a json file and queried it with Drill. This worked just fine but 
every once in a while we would get Unexpected End of Line errors as the writer 
was appending to the file as Drill was reading it.

It would be great if an incomplete entry at the end of the file would simply be 
ignored. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to