>From Hussain Towaileb <[email protected]>:
Hello Jenkins,
I'd like you to reexamine a change. Please visit
https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/21403?usp=email
to look at the new patch set (#2).
The following approvals got outdated and were removed:
Integration-Tests+1 by Jenkins, Verified+1 by Jenkins
Change subject: [NO ISSUE][EXT]: Handle interrupts when reading external
collections
......................................................................
[NO ISSUE][EXT]: Handle interrupts when reading external collections
Details:
- handle interrupts when reading from external collections.
- handle invalid utf8 chars when reading from external collections.
- add property to handle invalid characters, values are:
- replace (default) to replace invalid chars with ? and continue reading
- fail to fail fast and stop reading
- issue a warning if replacement takes place.
Ext-ref: MB-72470, MB-72724
Change-Id: Ib4c6f48470b77d3ba1e7bcc35240df468835f132
---
A asterixdb/asterix-app/data/json/illegal-character.json
M
asterixdb/asterix-app/src/test/java/org/apache/asterix/test/external_dataset/ExternalDatasetTestUtils.java
A
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/external-dataset/common/illegal-character/fail/test.000.container.sqlpp
A
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/external-dataset/common/illegal-character/fail/test.001.ddl.sqlpp
A
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/external-dataset/common/illegal-character/fail/test.002.query.sqlpp
A
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/external-dataset/common/illegal-character/fail/test.099.ddl.sqlpp
A
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/external-dataset/common/illegal-character/replace/test.000.container.sqlpp
A
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/external-dataset/common/illegal-character/replace/test.001.ddl.sqlpp
A
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/external-dataset/common/illegal-character/replace/test.002.query.sqlpp
A
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/external-dataset/common/illegal-character/replace/test.099.ddl.sqlpp
A
asterixdb/asterix-app/src/test/resources/runtimets/results/external-dataset/common/illegal-character/replace/result.002.adm
M
asterixdb/asterix-app/src/test/resources/runtimets/testsuite_external_dataset_azure_blob_storage.xml
M
asterixdb/asterix-app/src/test/resources/runtimets/testsuite_external_dataset_s3.xml
M
asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/input/record/reader/azure/blob/AzureBlobInputStream.java
M
asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/input/record/reader/azure/datalake/AzureDataLakeInputStream.java
M
asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/input/record/reader/stream/EmptyLineSeparatedRecordReader.java
M
asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/input/record/reader/stream/LineRecordReader.java
M
asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/input/record/reader/stream/SemiStructuredRecordReader.java
M
asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/input/record/reader/stream/StreamRecordReader.java
M
asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/input/stream/AsterixInputStreamReader.java
M
asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/util/ExternalDataConstants.java
M
asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/util/ExternalDataUtils.java
A
asterixdb/asterix-external-data/src/test/java/org/apache/asterix/external/input/stream/AsterixInputStreamReaderIllegalCharacterTest.java
M
hyracks-fullstack/hyracks/hyracks-api/src/main/java/org/apache/hyracks/api/util/ExceptionUtils.java
24 files changed, 504 insertions(+), 12 deletions(-)
git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb
refs/changes/03/21403/2
--
To view, visit https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/21403?usp=email
To unsubscribe, or for help writing mail filters, visit
https://asterix-gerrit.ics.uci.edu/settings?usp=email
Gerrit-MessageType: newpatchset
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Change-Id: Ib4c6f48470b77d3ba1e7bcc35240df468835f132
Gerrit-Change-Number: 21403
Gerrit-PatchSet: 2
Gerrit-Owner: Hussain Towaileb <[email protected]>
Gerrit-Reviewer: Jenkins <[email protected]>
