>From Hussain Towaileb <[email protected]>:
Attention is currently required from: Hussain Towaileb.
Hello Jenkins, Anon. E. Moose #1000171,
I'd like you to reexamine a change. Please visit
https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/17490
to look at the new patch set (#7).
Change subject: [ASTERIXDB-3182][*DB]: Add support to write to cloud as backend
storage
......................................................................
[ASTERIXDB-3182][*DB]: Add support to write to cloud as backend storage
- user model changes: no
- storage format changes: no
- interface changes: yes
Details:
- Add interface and APIs to write to cloud as backend storage.
- Add capability to read cloud client config from file or default to mock.
- Add capability to read cloud storage config from file or default to mock.
Change-Id: I116e6dd3bfcfca389108d6233326cb509854228c
---
A asterixdb/asterix-app/src/main/resources/cc-cloud-storage.conf
M
asterixdb/asterix-app/src/main/java/org/apache/asterix/app/nc/NCAppRuntimeContext.java
A
asterixdb/asterix-app/src/test/java/org/apache/asterix/api/common/CloudStorageAsterixHyracksIntegrationUtil.java
M
hyracks-fullstack/hyracks/hyracks-api/src/main/java/org/apache/hyracks/api/io/IIOManager.java
R
asterixdb/asterix-cloud/src/main/java/org/apache/asterix/cloud/CloudIOManager.java
A
asterixdb/asterix-cloud/src/main/java/org/apache/asterix/cloud/storage/FileCloudStorageConfiguration.java
A asterixdb/asterix-app/src/test/resources/cc-cloud-storage.conf
M
asterixdb/asterix-app/src/test/java/org/apache/asterix/api/common/AsterixHyracksIntegrationUtil.java
A
asterixdb/asterix-cloud/src/main/java/org/apache/asterix/cloud/clients/ICredentials.java
A
asterixdb/asterix-cloud/src/main/java/org/apache/asterix/cloud/storage/CloudStorageConfigurationProvider.java
A
asterixdb/asterix-app/src/test/java/org/apache/asterix/api/common/CloudUtils.java
R asterixdb/asterix-cloud/src/test/java/org.apache.asterix.cloud/LSMTest.java
D
hyracks-fullstack/hyracks/hyracks-control/hyracks-control-nc/src/main/java/org/apache/hyracks/control/nc/io/cloud/LocalCacheUtil.java
M asterixdb/asterix-app/pom.xml
A
asterixdb/asterix-cloud/src/main/java/org/apache/asterix/cloud/storage/ICloudStorageConfiguration.java
A
asterixdb/asterix-cloud/src/main/java/org/apache/asterix/cloud/storage/MockCloudStorageConfiguration.java
M asterixdb/pom.xml
R
asterixdb/asterix-cloud/src/main/java/org/apache/asterix/cloud/CloudFileHandle.java
M
hyracks-fullstack/hyracks/hyracks-control/hyracks-control-nc/src/main/java/org/apache/hyracks/control/nc/io/IOManager.java
A asterixdb/asterix-cloud/pom.xml
M
asterixdb/asterix-app/src/main/java/org/apache/asterix/app/cc/CcApplicationContext.java
R
asterixdb/asterix-cloud/src/main/java/org/apache/asterix/cloud/clients/ICloudClient.java
A
asterixdb/asterix-cloud/src/main/java/org/apache/asterix/cloud/clients/aws/s3/S3CloudClient.java
A
asterixdb/asterix-app/src/test/resources/runtimets/testsuite_cloud_storage_only.xml
R
asterixdb/asterix-cloud/src/test/java/org.apache.asterix.cloud/s3/LSMS3Test.java
R
asterixdb/asterix-cloud/src/main/java/org/apache/asterix/cloud/clients/aws/s3/S3BufferedWriter.java
D
hyracks-fullstack/hyracks/hyracks-control/hyracks-control-nc/src/main/java/org/apache/hyracks/control/nc/io/cloud/clients/NoOpCloudClient.java
A
asterixdb/asterix-app/src/test/resources/runtimets/results/cloud_storage/query/result.003.ignore
D
hyracks-fullstack/hyracks/hyracks-control/hyracks-control-nc/src/main/java/org/apache/hyracks/control/nc/io/cloud/clients/gcp/gcs/GCSCloudClient.java
A
asterixdb/asterix-app/src/main/java/org/apache/asterix/app/nc/task/CloudToLocalStorageCachingTask.java
A
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/cloud_storage/query/test.003.get.http
D
hyracks-fullstack/hyracks/hyracks-control/hyracks-control-nc/src/main/java/org/apache/hyracks/control/nc/io/cloud/clients/azure/blob/AzureBlobCloudClient.java
A
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/cloud_storage/query/test.001.update.sqlpp
A
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/cloud_storage/query/test.002.query.sqlpp
M asterixdb/asterix-server/pom.xml
M
asterixdb/asterix-app/src/main/java/org/apache/asterix/app/replication/NcLifecycleCoordinator.java
A
asterixdb/asterix-app/src/test/resources/runtimets/results/cloud_storage/query/result.002.adm
M hyracks-fullstack/hyracks/hyracks-control/hyracks-control-nc/pom.xml
M
hyracks-fullstack/hyracks/hyracks-api/src/main/java/org/apache/hyracks/api/io/FileReference.java
M asterixdb/src/main/appended-resources/supplemental-models.xml
A
asterixdb/src/main/licenses/content/raw.githubusercontent.com_awslabs_aws-crt-java_v0.21.10_NOTICE.txt
M hyracks-fullstack/pom.xml
A
asterixdb/asterix-cloud/src/main/java/org/apache/asterix/cloud/clients/aws/s3/credentials/S3MockCredentials.java
R
asterixdb/asterix-cloud/src/main/java/org/apache/asterix/cloud/clients/ICloudBufferedWriter.java
A
asterixdb/asterix-cloud/src/main/java/org/apache/asterix/cloud/clients/aws/s3/credentials/S3CredentialsProvider.java
A asterixdb/asterix-app/src/test/resources/runtimets/testsuite_cloud_storage.xml
R
asterixdb/asterix-cloud/src/main/java/org/apache/asterix/cloud/clients/aws/s3/S3Utils.java
R
asterixdb/asterix-cloud/src/main/java/org/apache/asterix/cloud/WriteBufferProvider.java
M
asterixdb/asterix-common/src/main/java/org/apache/asterix/common/api/IApplicationContext.java
M
asterixdb/asterix-common/src/main/java/org/apache/asterix/common/api/INcApplicationContext.java
R
asterixdb/asterix-cloud/src/main/java/org/apache/asterix/cloud/CloudResettableInputStream.java
D
hyracks-fullstack/hyracks/hyracks-control/hyracks-control-nc/src/main/java/org/apache/hyracks/control/nc/io/cloud/clients/aws/s3/S3CloudClient.java
A
asterixdb/asterix-cloud/src/main/java/org/apache/asterix/cloud/clients/aws/s3/credentials/IS3Credentials.java
A
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/cloud_storage/query/test.999.ddl.sqlpp
R
asterixdb/asterix-cloud/src/main/java/org/apache/asterix/cloud/clients/CloudClientProvider.java
A
asterixdb/asterix-app/src/test/java/org/apache/asterix/test/cloud_storage/CloudStorageTest.java
A
asterixdb/asterix-cloud/src/main/java/org/apache/asterix/cloud/clients/ICloudClientCredentialsProvider.java
M
asterixdb/asterix-app/src/test/java/org/apache/asterix/test/external_dataset/aws/AwsS3ExternalDatasetTest.java
A
asterixdb/asterix-cloud/src/main/java/org/apache/asterix/cloud/clients/aws/s3/credentials/FileCredentials.java
A
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/cloud_storage/query/test.000.ddl.sqlpp
60 files changed, 1,812 insertions(+), 836 deletions(-)
git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb
refs/changes/90/17490/7
--
To view, visit https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/17490
To unsubscribe, or for help writing mail filters, visit
https://asterix-gerrit.ics.uci.edu/settings
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Change-Id: I116e6dd3bfcfca389108d6233326cb509854228c
Gerrit-Change-Number: 17490
Gerrit-PatchSet: 7
Gerrit-Owner: Hussain Towaileb <[email protected]>
Gerrit-Reviewer: Anon. E. Moose #1000171
Gerrit-Reviewer: Jenkins <[email protected]>
Gerrit-Attention: Hussain Towaileb <[email protected]>
Gerrit-MessageType: newpatchset
