Github user ssriniva123 commented on the issue:
https://github.com/apache/drill/pull/518
I have made several modifications to get accurate line nos:
- The main change is to move the json parser to the end of the current
record being processed since
previously multiple exceptions were thrown.
- BaseJsonProcessor contains new method protected
JsonExceptionProcessingState processJSONException().
-This is called by both CountingJsonReader and JsonProcessor whenever
parser encounters a jackson parsing exception.
-I have also added a new system setting
store.json.reader.print_skipped_invalid_record_number so that we can suppress
printing of line numbers.
- Added more unit test cases.
- System tested with various combinations on a local drill bit.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
