Change in asterixdb[master]: [ASTERIXDB-3390][STO]: Support GCS for cloud deployment

2024-05-02 Thread AsterixDB Code Review
>From Jenkins :

Attention is currently required from: Savyasach Reddy.
Jenkins has posted comments on this change. ( 
https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/18253 )

Change subject: [ASTERIXDB-3390][STO]: Support GCS for cloud deployment
..


Patch Set 21:

Integration Tests Successful

https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-trigger/451/ : SUCCESS


--
To view, visit https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/18253
To unsubscribe, or for help writing mail filters, visit 
https://asterix-gerrit.ics.uci.edu/settings

Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Change-Id: I0b9cad99de2d32d1e672a3d396897807687685e8
Gerrit-Change-Number: 18253
Gerrit-PatchSet: 21
Gerrit-Owner: Savyasach Reddy 
Gerrit-Reviewer: Anon. E. Moose #1000171
Gerrit-Reviewer: Jenkins 
Gerrit-CC: Murtadha Hubail 
Gerrit-CC: Wail Alkowaileet 
Gerrit-Attention: Savyasach Reddy 
Gerrit-Comment-Date: Fri, 03 May 2024 01:47:12 +
Gerrit-HasComments: No
Gerrit-Has-Labels: No
Gerrit-MessageType: comment


Change in asterixdb[master]: [ASTERIXDB-3390][STO]: Support GCS for cloud deployment

2024-05-02 Thread AsterixDB Code Review
>From Jenkins :

Attention is currently required from: Savyasach Reddy.
Jenkins has posted comments on this change. ( 
https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/18253 )

Change subject: [ASTERIXDB-3390][STO]: Support GCS for cloud deployment
..


Patch Set 21: Integration-Tests+1

Integration Tests Successful

https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-trigger/450/ : SUCCESS


--
To view, visit https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/18253
To unsubscribe, or for help writing mail filters, visit 
https://asterix-gerrit.ics.uci.edu/settings

Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Change-Id: I0b9cad99de2d32d1e672a3d396897807687685e8
Gerrit-Change-Number: 18253
Gerrit-PatchSet: 21
Gerrit-Owner: Savyasach Reddy 
Gerrit-Reviewer: Anon. E. Moose #1000171
Gerrit-Reviewer: Jenkins 
Gerrit-CC: Murtadha Hubail 
Gerrit-CC: Wail Alkowaileet 
Gerrit-Attention: Savyasach Reddy 
Gerrit-Comment-Date: Thu, 02 May 2024 21:17:56 +
Gerrit-HasComments: No
Gerrit-Has-Labels: Yes
Gerrit-MessageType: comment


Change in asterixdb[master]: [ASTERIXDB-3390][STO]: Support GCS for cloud deployment

2024-05-02 Thread AsterixDB Code Review
>From Savyasach Reddy :

Attention is currently required from: Savyasach Reddy.
Hello Jenkins, Anon. E. Moose #1000171,

I'd like you to reexamine a change. Please visit

https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/18253

to look at the new patch set (#21).

Change subject: [ASTERIXDB-3390][STO]: Support GCS for cloud deployment
..

[ASTERIXDB-3390][STO]: Support GCS for cloud deployment

Change-Id: I0b9cad99de2d32d1e672a3d396897807687685e8
---
M asterixdb/asterix-app/pom.xml
M 
asterixdb/asterix-cloud/src/main/java/org/apache/asterix/cloud/lazy/IParallelCacher.java
A 
asterixdb/asterix-cloud/src/main/java/org/apache/asterix/cloud/writer/GCSExternalFileWriterFactory.java
M 
asterixdb/asterix-app/src/test/resources/runtimets/testsuite_external_dataset_s3.xml
A 
asterixdb/asterix-cloud/src/main/java/org/apache/asterix/cloud/clients/google/gcs/GCSCloudClient.java
M 
asterixdb/asterix-metadata/src/main/java/org/apache/asterix/metadata/provider/ExternalWriterProvider.java
M 
asterixdb/asterix-cloud/src/main/java/org/apache/asterix/cloud/lazy/accessor/ReplaceableCloudAccessor.java
A asterixdb/asterix-app/src/test/resources/cc-cloud-storage-gcs.conf
M asterixdb/pom.xml
A 
asterixdb/asterix-cloud/src/main/java/org/apache/asterix/cloud/writer/GCSExternalFileWriter.java
A 
asterixdb/asterix-app/src/test/java/org/apache/asterix/test/cloud_storage/CloudStorageGCSTest.java
A 
asterixdb/asterix-cloud/src/main/java/org/apache/asterix/cloud/clients/google/gcs/GCSParallelDownloader.java
M asterixdb/asterix-cloud/pom.xml
A 
asterixdb/asterix-cloud/src/main/java/org/apache/asterix/cloud/clients/google/gcs/GCSClientConfig.java
A 
asterixdb/asterix-cloud/src/test/java/org/apache/asterix/cloud/gcs/LSMGCSTest.java
M 
asterixdb/asterix-cloud/src/main/java/org/apache/asterix/cloud/clients/ICloudClient.java
M 
asterixdb/asterix-cloud/src/main/java/org/apache/asterix/cloud/clients/CloudClientProvider.java
M 
asterixdb/asterix-cloud/src/main/java/org/apache/asterix/cloud/clients/IParallelDownloader.java
M 
asterixdb/asterix-cloud/src/main/java/org/apache/asterix/cloud/lazy/ParallelCacher.java
M 
asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/util/ExternalDataConstants.java
M 
asterixdb/asterix-cloud/src/main/java/org/apache/asterix/cloud/bulk/IBulkOperationCallBack.java
A 
asterixdb/asterix-cloud/src/main/java/org/apache/asterix/cloud/clients/google/gcs/GCSBufferedWriter.java
M 
asterixdb/asterix-cloud/src/main/java/org/apache/asterix/cloud/clients/ICloudBufferedWriter.java
23 files changed, 1,302 insertions(+), 12 deletions(-)


  git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb 
refs/changes/53/18253/21
--
To view, visit https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/18253
To unsubscribe, or for help writing mail filters, visit 
https://asterix-gerrit.ics.uci.edu/settings

Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Change-Id: I0b9cad99de2d32d1e672a3d396897807687685e8
Gerrit-Change-Number: 18253
Gerrit-PatchSet: 21
Gerrit-Owner: Savyasach Reddy 
Gerrit-Reviewer: Anon. E. Moose #1000171
Gerrit-Reviewer: Jenkins 
Gerrit-CC: Murtadha Hubail 
Gerrit-CC: Wail Alkowaileet 
Gerrit-Attention: Savyasach Reddy 
Gerrit-MessageType: newpatchset


Change in asterixdb[master]: [ASTERIXDB-3390][STO]: Support GCS for cloud deployment

2024-05-02 Thread AsterixDB Code Review
>From Savyasach Reddy :

Attention is currently required from: Savyasach Reddy.
Hello Jenkins, Anon. E. Moose #1000171,

I'd like you to reexamine a change. Please visit

https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/18253

to look at the new patch set (#20).

Change subject: [ASTERIXDB-3390][STO]: Support GCS for cloud deployment
..

[ASTERIXDB-3390][STO]: Support GCS for cloud deployment

Change-Id: I0b9cad99de2d32d1e672a3d396897807687685e8
---
M asterixdb/asterix-app/pom.xml
M 
asterixdb/asterix-cloud/src/main/java/org/apache/asterix/cloud/lazy/IParallelCacher.java
A 
asterixdb/asterix-cloud/src/main/java/org/apache/asterix/cloud/writer/GCSExternalFileWriterFactory.java
M 
asterixdb/asterix-app/src/test/resources/runtimets/testsuite_external_dataset_s3.xml
A 
asterixdb/asterix-cloud/src/main/java/org/apache/asterix/cloud/clients/google/gcs/GCSCloudClient.java
M 
asterixdb/asterix-metadata/src/main/java/org/apache/asterix/metadata/provider/ExternalWriterProvider.java
M 
asterixdb/asterix-cloud/src/main/java/org/apache/asterix/cloud/lazy/accessor/ReplaceableCloudAccessor.java
A asterixdb/asterix-app/src/test/resources/cc-cloud-storage-gcs.conf
M asterixdb/pom.xml
A 
asterixdb/asterix-cloud/src/main/java/org/apache/asterix/cloud/writer/GCSExternalFileWriter.java
A 
asterixdb/asterix-app/src/test/java/org/apache/asterix/test/cloud_storage/CloudStorageGCSTest.java
A 
asterixdb/asterix-cloud/src/main/java/org/apache/asterix/cloud/clients/google/gcs/GCSParallelDownloader.java
M asterixdb/asterix-cloud/pom.xml
A 
asterixdb/asterix-cloud/src/main/java/org/apache/asterix/cloud/clients/google/gcs/GCSClientConfig.java
A 
asterixdb/asterix-cloud/src/test/java/org/apache/asterix/cloud/gcs/LSMGCSTest.java
M 
asterixdb/asterix-cloud/src/main/java/org/apache/asterix/cloud/clients/ICloudClient.java
M 
asterixdb/asterix-cloud/src/main/java/org/apache/asterix/cloud/clients/CloudClientProvider.java
M 
asterixdb/asterix-cloud/src/main/java/org/apache/asterix/cloud/clients/IParallelDownloader.java
M 
asterixdb/asterix-cloud/src/main/java/org/apache/asterix/cloud/lazy/ParallelCacher.java
M 
asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/util/ExternalDataConstants.java
M 
asterixdb/asterix-cloud/src/main/java/org/apache/asterix/cloud/bulk/IBulkOperationCallBack.java
A 
asterixdb/asterix-cloud/src/main/java/org/apache/asterix/cloud/clients/google/gcs/GCSBufferedWriter.java
M 
asterixdb/asterix-cloud/src/main/java/org/apache/asterix/cloud/clients/ICloudBufferedWriter.java
23 files changed, 1,301 insertions(+), 12 deletions(-)


  git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb 
refs/changes/53/18253/20
--
To view, visit https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/18253
To unsubscribe, or for help writing mail filters, visit 
https://asterix-gerrit.ics.uci.edu/settings

Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Change-Id: I0b9cad99de2d32d1e672a3d396897807687685e8
Gerrit-Change-Number: 18253
Gerrit-PatchSet: 20
Gerrit-Owner: Savyasach Reddy 
Gerrit-Reviewer: Anon. E. Moose #1000171
Gerrit-Reviewer: Jenkins 
Gerrit-CC: Murtadha Hubail 
Gerrit-CC: Wail Alkowaileet 
Gerrit-Attention: Savyasach Reddy 
Gerrit-MessageType: newpatchset


Change in asterixdb[trinity]: [NO ISSUE]: Track more requests + jobs counts

2024-05-02 Thread AsterixDB Code Review
Attention is currently required from: Hussain Towaileb.
Anon. E. Moose #1000171 has posted comments on this change. ( 
https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/18263 )

Change subject: [NO ISSUE]: Track more requests + jobs counts
..


Patch Set 1: Contrib-2

Analytics Compatibility Tests Failed
https://cbjenkins.page.link/B1rSHa6segwzwiSW9 : UNSTABLE


--
To view, visit https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/18263
To unsubscribe, or for help writing mail filters, visit 
https://asterix-gerrit.ics.uci.edu/settings

Gerrit-Project: asterixdb
Gerrit-Branch: trinity
Gerrit-Change-Id: I8fa31a1e6bb6b1f1bcf90c59da646fc47546fc7c
Gerrit-Change-Number: 18263
Gerrit-PatchSet: 1
Gerrit-Owner: Hussain Towaileb 
Gerrit-Reviewer: Anon. E. Moose #1000171
Gerrit-Reviewer: Jenkins 
Gerrit-Attention: Hussain Towaileb 
Gerrit-Comment-Date: Thu, 02 May 2024 18:58:31 +
Gerrit-HasComments: No
Gerrit-Has-Labels: Yes
Gerrit-MessageType: comment


Change in asterixdb[trinity]: [NO ISSUE]: Track more requests + jobs counts

2024-05-02 Thread AsterixDB Code Review
>From Jenkins :

Jenkins has posted comments on this change. ( 
https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/18263 )

Change subject: [NO ISSUE]: Track more requests + jobs counts
..


Patch Set 1: Integration-Tests+1

Integration Tests Successful

https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-trigger/443/ : SUCCESS


-- 
To view, visit https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/18263
To unsubscribe, or for help writing mail filters, visit 
https://asterix-gerrit.ics.uci.edu/settings

Gerrit-Project: asterixdb
Gerrit-Branch: trinity
Gerrit-Change-Id: I8fa31a1e6bb6b1f1bcf90c59da646fc47546fc7c
Gerrit-Change-Number: 18263
Gerrit-PatchSet: 1
Gerrit-Owner: Hussain Towaileb 
Gerrit-Reviewer: Jenkins 
Gerrit-CC: Anon. E. Moose #1000171
Gerrit-Comment-Date: Thu, 02 May 2024 17:28:43 +
Gerrit-HasComments: No
Gerrit-Has-Labels: Yes
Gerrit-MessageType: comment


Change in asterixdb[master]: [ASTERIXDB-3390][STO]: Support GCS for cloud deployment

2024-05-02 Thread AsterixDB Code Review
>From Savyasach Reddy :

Attention is currently required from: Savyasach Reddy.
Savyasach Reddy has removed a vote from this change. ( 
https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/18253 )


Change subject: [ASTERIXDB-3390][STO]: Support GCS for cloud deployment
..


Removed Verified+1 by Jenkins 
--
To view, visit https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/18253
To unsubscribe, or for help writing mail filters, visit 
https://asterix-gerrit.ics.uci.edu/settings

Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Change-Id: I0b9cad99de2d32d1e672a3d396897807687685e8
Gerrit-Change-Number: 18253
Gerrit-PatchSet: 19
Gerrit-Owner: Savyasach Reddy 
Gerrit-Reviewer: Anon. E. Moose #1000171
Gerrit-Reviewer: Jenkins 
Gerrit-CC: Murtadha Hubail 
Gerrit-CC: Wail Alkowaileet 
Gerrit-Attention: Savyasach Reddy 
Gerrit-MessageType: deleteVote


Change in asterixdb[trinity]: [NO ISSUE]: Track more requests + jobs counts

2024-05-02 Thread AsterixDB Code Review
Anon. E. Moose #1000171 has posted comments on this change. ( 
https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/18263 )

Change subject: [NO ISSUE]: Track more requests + jobs counts
..


Patch Set 1:

Analytics Compatibility Compilation Successful
https://cbjenkins.page.link/A8g4aoa6nRzbqXH99 : SUCCESS


--
To view, visit https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/18263
To unsubscribe, or for help writing mail filters, visit 
https://asterix-gerrit.ics.uci.edu/settings

Gerrit-Project: asterixdb
Gerrit-Branch: trinity
Gerrit-Change-Id: I8fa31a1e6bb6b1f1bcf90c59da646fc47546fc7c
Gerrit-Change-Number: 18263
Gerrit-PatchSet: 1
Gerrit-Owner: Hussain Towaileb 
Gerrit-CC: Anon. E. Moose #1000171
Gerrit-CC: Jenkins 
Gerrit-Comment-Date: Thu, 02 May 2024 17:01:47 +
Gerrit-HasComments: No
Gerrit-Has-Labels: No
Gerrit-MessageType: comment


Change in asterixdb[trinity]: [NO ISSUE]: Track more requests + jobs counts

2024-05-02 Thread AsterixDB Code Review
>From Hussain Towaileb :

Hussain Towaileb has uploaded this change for review. ( 
https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/18263 )


Change subject: [NO ISSUE]: Track more requests + jobs counts
..

[NO ISSUE]: Track more requests + jobs counts

Change-Id: I8fa31a1e6bb6b1f1bcf90c59da646fc47546fc7c
---
M 
hyracks-fullstack/hyracks/hyracks-control/hyracks-control-cc/src/main/java/org/apache/hyracks/control/cc/job/IJobManager.java
M 
hyracks-fullstack/hyracks/hyracks-control/hyracks-control-cc/src/main/java/org/apache/hyracks/control/cc/job/JobManager.java
M 
hyracks-fullstack/hyracks/hyracks-http/src/main/java/org/apache/hyracks/http/server/HttpRequestCapacityController.java
M 
asterixdb/asterix-app/src/main/java/org/apache/asterix/api/http/server/QueryServiceServlet.java
M 
hyracks-fullstack/hyracks/hyracks-http/src/main/java/org/apache/hyracks/http/server/HttpServer.java
5 files changed, 129 insertions(+), 16 deletions(-)



  git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb 
refs/changes/63/18263/1

diff --git 
a/asterixdb/asterix-app/src/main/java/org/apache/asterix/api/http/server/QueryServiceServlet.java
 
b/asterixdb/asterix-app/src/main/java/org/apache/asterix/api/http/server/QueryServiceServlet.java
index f84e45a..07c76a0 100644
--- 
a/asterixdb/asterix-app/src/main/java/org/apache/asterix/api/http/server/QueryServiceServlet.java
+++ 
b/asterixdb/asterix-app/src/main/java/org/apache/asterix/api/http/server/QueryServiceServlet.java
@@ -433,7 +433,7 @@
 return true;
 case REQUEST_TIMEOUT:
 LOGGER.info(() -> "handleException: request execution 
timed out: " + param.toString());
-executionState.setStatus(ResultStatus.TIMEOUT, 
HttpResponseStatus.OK);
+executionState.setStatus(ResultStatus.TIMEOUT, 
HttpResponseStatus.SERVICE_UNAVAILABLE);
 return true;
 case REJECT_NODE_UNREGISTERED:
 case REJECT_BAD_CLUSTER_STATE:
diff --git 
a/hyracks-fullstack/hyracks/hyracks-control/hyracks-control-cc/src/main/java/org/apache/hyracks/control/cc/job/IJobManager.java
 
b/hyracks-fullstack/hyracks/hyracks-control/hyracks-control-cc/src/main/java/org/apache/hyracks/control/cc/job/IJobManager.java
index b2795d4..8d44542 100644
--- 
a/hyracks-fullstack/hyracks/hyracks-control/hyracks-control-cc/src/main/java/org/apache/hyracks/control/cc/job/IJobManager.java
+++ 
b/hyracks-fullstack/hyracks/hyracks-control/hyracks-control-cc/src/main/java/org/apache/hyracks/control/cc/job/IJobManager.java
@@ -130,4 +130,24 @@
  * @return the maximum number of jobs to queue before rejecting new jobs
  */
 int getJobQueueCapacity();
+
+/**
+ * @return total jobs
+ */
+long getTotalJobs();
+
+/**
+ * @return total failed jobs
+ */
+long getTotalFailedJobs();
+
+/**
+ * @return total cancelled jobs
+ */
+long getTotalCancelledJobs();
+
+/**
+ * @return total rejected jobs
+ */
+long getTotalRejectedJobs();
 }
diff --git 
a/hyracks-fullstack/hyracks/hyracks-control/hyracks-control-cc/src/main/java/org/apache/hyracks/control/cc/job/JobManager.java
 
b/hyracks-fullstack/hyracks/hyracks-control/hyracks-control-cc/src/main/java/org/apache/hyracks/control/cc/job/JobManager.java
index 4882f4a..7a99a3d 100644
--- 
a/hyracks-fullstack/hyracks/hyracks-control/hyracks-control-cc/src/main/java/org/apache/hyracks/control/cc/job/JobManager.java
+++ 
b/hyracks-fullstack/hyracks/hyracks-control/hyracks-control-cc/src/main/java/org/apache/hyracks/control/cc/job/JobManager.java
@@ -30,10 +30,12 @@
 import java.util.List;
 import java.util.Map;
 import java.util.Set;
+import java.util.concurrent.atomic.AtomicLong;

 import org.apache.hyracks.api.exceptions.ErrorCode;
 import org.apache.hyracks.api.exceptions.HyracksDataException;
 import org.apache.hyracks.api.exceptions.HyracksException;
+import org.apache.hyracks.api.exceptions.IError;
 import org.apache.hyracks.api.job.ActivityClusterGraph;
 import org.apache.hyracks.api.job.JobId;
 import org.apache.hyracks.api.job.JobSpecification;
@@ -66,11 +68,19 @@
 private final Map runMapArchive;
 private final Map> runMapHistory;
 private final IJobCapacityController jobCapacityController;
+private final AtomicLong totalJobs;
+private final AtomicLong totalFailedJobs;
+private final AtomicLong totalCancelledJobs;
+private final AtomicLong totalRejectedJobs;
 private IJobQueue jobQueue;

 public JobManager(CCConfig ccConfig, ClusterControllerService ccs, 
IJobCapacityController jobCapacityController) {
 this.ccs = ccs;
 this.jobCapacityController = jobCapacityController;
+this.totalJobs = new AtomicLong();
+this.totalFailedJobs = new AtomicLong();
+this.totalCancelledJobs = new AtomicLong();
+this.totalRejectedJobs = new 

Change in asterixdb[master]: [NO ISSUE]: Track rejected requests + total and reject jobs counts

2024-05-02 Thread AsterixDB Code Review
>From Hussain Towaileb :

Hussain Towaileb has abandoned this change. ( 
https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/18252 )

Change subject: [NO ISSUE]: Track rejected requests + total and reject jobs 
counts
..


Abandoned
--
To view, visit https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/18252
To unsubscribe, or for help writing mail filters, visit 
https://asterix-gerrit.ics.uci.edu/settings

Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Change-Id: I2a25322c5e3ca9b33d5c1bdc2594d1f6c833c801
Gerrit-Change-Number: 18252
Gerrit-PatchSet: 5
Gerrit-Owner: Hussain Towaileb 
Gerrit-Reviewer: Anon. E. Moose #1000171
Gerrit-Reviewer: Jenkins 
Gerrit-MessageType: abandon


Change in asterixdb[master]: [ASTERIXDB-3384][DOC] Document COPY

2024-05-02 Thread AsterixDB Code Review
>From Wail Alkowaileet :

Attention is currently required from: Peeyush Gupta, Ian Maxon, Hussain 
Towaileb.
Wail Alkowaileet has posted comments on this change. ( 
https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/18243 )

Change subject: [ASTERIXDB-3384][DOC] Document COPY
..


Patch Set 5: Code-Review+2


--
To view, visit https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/18243
To unsubscribe, or for help writing mail filters, visit 
https://asterix-gerrit.ics.uci.edu/settings

Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Change-Id: Ibdacf4e6b156a3b6ef15b1420a4102c122f8bf1c
Gerrit-Change-Number: 18243
Gerrit-PatchSet: 5
Gerrit-Owner: Ian Maxon 
Gerrit-Reviewer: Anon. E. Moose #1000171
Gerrit-Reviewer: Hussain Towaileb 
Gerrit-Reviewer: Ian Maxon 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Peeyush Gupta 
Gerrit-Reviewer: Wail Alkowaileet 
Gerrit-Attention: Peeyush Gupta 
Gerrit-Attention: Ian Maxon 
Gerrit-Attention: Hussain Towaileb 
Gerrit-Comment-Date: Thu, 02 May 2024 15:39:24 +
Gerrit-HasComments: No
Gerrit-Has-Labels: Yes
Gerrit-MessageType: comment


Change in asterixdb[master]: [ASTERIXDB-3390][STO]: Support GCS for cloud deployment

2024-05-02 Thread AsterixDB Code Review
>From Jenkins :

Attention is currently required from: Savyasach Reddy.
Jenkins has posted comments on this change. ( 
https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/18253 )

Change subject: [ASTERIXDB-3390][STO]: Support GCS for cloud deployment
..


Patch Set 19:

Integration Tests Successful

https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-trigger/440/ : SUCCESS


--
To view, visit https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/18253
To unsubscribe, or for help writing mail filters, visit 
https://asterix-gerrit.ics.uci.edu/settings

Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Change-Id: I0b9cad99de2d32d1e672a3d396897807687685e8
Gerrit-Change-Number: 18253
Gerrit-PatchSet: 19
Gerrit-Owner: Savyasach Reddy 
Gerrit-Reviewer: Anon. E. Moose #1000171
Gerrit-Reviewer: Jenkins 
Gerrit-CC: Murtadha Hubail 
Gerrit-CC: Wail Alkowaileet 
Gerrit-Attention: Savyasach Reddy 
Gerrit-Comment-Date: Thu, 02 May 2024 09:04:08 +
Gerrit-HasComments: No
Gerrit-Has-Labels: No
Gerrit-MessageType: comment


Change in asterixdb[master]: [ASTERIXDB-3390][STO]: Support GCS for cloud deployment

2024-05-02 Thread AsterixDB Code Review
>From Jenkins :

Attention is currently required from: Savyasach Reddy.
Jenkins has posted comments on this change. ( 
https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/18253 )

Change subject: [ASTERIXDB-3390][STO]: Support GCS for cloud deployment
..


Patch Set 19: Integration-Tests+1

Integration Tests Successful

https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-trigger/441/ : SUCCESS


--
To view, visit https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/18253
To unsubscribe, or for help writing mail filters, visit 
https://asterix-gerrit.ics.uci.edu/settings

Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Change-Id: I0b9cad99de2d32d1e672a3d396897807687685e8
Gerrit-Change-Number: 18253
Gerrit-PatchSet: 19
Gerrit-Owner: Savyasach Reddy 
Gerrit-Reviewer: Anon. E. Moose #1000171
Gerrit-Reviewer: Jenkins 
Gerrit-CC: Murtadha Hubail 
Gerrit-CC: Wail Alkowaileet 
Gerrit-Attention: Savyasach Reddy 
Gerrit-Comment-Date: Thu, 02 May 2024 08:39:18 +
Gerrit-HasComments: No
Gerrit-Has-Labels: Yes
Gerrit-MessageType: comment


Change in asterixdb[master]: [ASTERIXDB-3390][STO]: Support GCS for cloud deployment

2024-05-02 Thread AsterixDB Code Review
>From Savyasach Reddy :

Attention is currently required from: Savyasach Reddy.
Hello Jenkins, Anon. E. Moose #1000171,

I'd like you to reexamine a change. Please visit

https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/18253

to look at the new patch set (#19).

Change subject: [ASTERIXDB-3390][STO]: Support GCS for cloud deployment
..

[ASTERIXDB-3390][STO]: Support GCS for cloud deployment

Change-Id: I0b9cad99de2d32d1e672a3d396897807687685e8
---
M asterixdb/asterix-app/pom.xml
M 
asterixdb/asterix-cloud/src/main/java/org/apache/asterix/cloud/lazy/IParallelCacher.java
A 
asterixdb/asterix-cloud/src/main/java/org/apache/asterix/cloud/writer/GCSExternalFileWriterFactory.java
M 
asterixdb/asterix-app/src/test/resources/runtimets/testsuite_external_dataset_s3.xml
A 
asterixdb/asterix-cloud/src/main/java/org/apache/asterix/cloud/clients/google/gcs/GCSCloudClient.java
M 
asterixdb/asterix-metadata/src/main/java/org/apache/asterix/metadata/provider/ExternalWriterProvider.java
M 
asterixdb/asterix-cloud/src/main/java/org/apache/asterix/cloud/lazy/accessor/ReplaceableCloudAccessor.java
A asterixdb/asterix-app/src/test/resources/cc-cloud-storage-gcs.conf
M asterixdb/pom.xml
A 
asterixdb/asterix-cloud/src/main/java/org/apache/asterix/cloud/writer/GCSExternalFileWriter.java
A 
asterixdb/asterix-app/src/test/java/org/apache/asterix/test/cloud_storage/CloudStorageGCSTest.java
A 
asterixdb/asterix-cloud/src/main/java/org/apache/asterix/cloud/clients/google/gcs/GCSParallelDownloader.java
M asterixdb/asterix-cloud/pom.xml
A 
asterixdb/asterix-cloud/src/main/java/org/apache/asterix/cloud/clients/google/gcs/GCSClientConfig.java
A 
asterixdb/asterix-cloud/src/test/java/org/apache/asterix/cloud/gcs/LSMGCSTest.java
M 
asterixdb/asterix-cloud/src/main/java/org/apache/asterix/cloud/clients/ICloudClient.java
M 
asterixdb/asterix-cloud/src/main/java/org/apache/asterix/cloud/clients/CloudClientProvider.java
M 
asterixdb/asterix-cloud/src/main/java/org/apache/asterix/cloud/clients/IParallelDownloader.java
M 
asterixdb/asterix-cloud/src/main/java/org/apache/asterix/cloud/lazy/ParallelCacher.java
M 
asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/util/ExternalDataConstants.java
M 
asterixdb/asterix-cloud/src/main/java/org/apache/asterix/cloud/bulk/IBulkOperationCallBack.java
A 
asterixdb/asterix-cloud/src/main/java/org/apache/asterix/cloud/clients/google/gcs/GCSBufferedWriter.java
M 
asterixdb/asterix-cloud/src/main/java/org/apache/asterix/cloud/clients/ICloudBufferedWriter.java
23 files changed, 1,295 insertions(+), 12 deletions(-)


  git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb 
refs/changes/53/18253/19
--
To view, visit https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/18253
To unsubscribe, or for help writing mail filters, visit 
https://asterix-gerrit.ics.uci.edu/settings

Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Change-Id: I0b9cad99de2d32d1e672a3d396897807687685e8
Gerrit-Change-Number: 18253
Gerrit-PatchSet: 19
Gerrit-Owner: Savyasach Reddy 
Gerrit-Reviewer: Anon. E. Moose #1000171
Gerrit-Reviewer: Jenkins 
Gerrit-CC: Murtadha Hubail 
Gerrit-CC: Wail Alkowaileet 
Gerrit-Attention: Savyasach Reddy 
Gerrit-MessageType: newpatchset