[jira] [Commented] (NIFI-11439) Add Storage API URL to GCS Processors
[
https://issues.apache.org/jira/browse/NIFI-11439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17784000#comment-17784000
]
mayki commented on NIFI-11439:
--
Hello,
For the parameter Storage-api-url, it seems neither
"https://{*}storage{*}-xxx.p.googleapis.com/{*}storage{*}/v1/" nor
"https://{*}storage{*}-xxx.p.googleapis.com; working.
{code:java}
PutGCSObject[id=aea7e07c-018b-1000-] Failure completing upload
flowfile=test/minh.txt bucket=xxx key=test/minh.txt reason=404 Not Found
POST
https://storage-xxx.p.googleapis.com/upload/storage/v1/storage/v1/b/xxx/o?name=test/minh.txt=resumable
Not Found: com.google.cloud.storage.StorageException: 404 Not Found
PutGCSObject[id=aea7e07c-018b-1000-] Failure completing upload
flowfile=test/minh.txt bucket=xxx key=test/minh.txt reason=www.googleapis.com:
com.google.cloud.storage.StorageException: www.googleapis.com
- Caused by: java.net.UnknownHostException: www.googleapis.com {code}
Need we add something more in the processor ?
Thanks
> Add Storage API URL to GCS Processors
> -
>
> Key: NIFI-11439
> URL: https://issues.apache.org/jira/browse/NIFI-11439
> Project: Apache NiFi
> Issue Type: Improvement
>Reporter: Paul Grey
>Assignee: Paul Grey
>Priority: Minor
> Fix For: 2.0.0, 1.22.0
>
> Time Spent: 1h 10m
> Remaining Estimate: 0h
>
> AWS processors allow the override of the base endpoint for API calls to AWS
> services [1]. GCS libraries provide analogous capabilities, as documented
> here [2]. Expose a GCS processor property to enable GCS endpoint override
> behavior.
> [1]
> https://github.com/apache/nifi/blob/main/nifi-nar-bundles/nifi-aws-bundle/nifi-aws-abstract-processors/src/main/java/org/apache/nifi/processors/aws/AbstractAWSProcessor.java#L146-L154
> [2]
> https://cloud.google.com/storage/docs/request-endpoints#storage-set-client-endpoint-java
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Commented] (NIFI-11439) Add Storage API URL to GCS Processors
[ https://issues.apache.org/jira/browse/NIFI-11439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17712439#comment-17712439 ] ASF subversion and git services commented on NIFI-11439: Commit d762f35345a8486903a0b30d0923e1e8a3377863 in nifi's branch refs/heads/support/nifi-1.x from Paul Grey [ https://gitbox.apache.org/repos/asf?p=nifi.git;h=d762f35345 ] NIFI-11439 Corrected GCS Transit URI for custom Storage API URL This closes #7173 Signed-off-by: David Handermann (cherry picked from commit cff7808543716da5ca9f93356d7d762e15fdd143) > Add Storage API URL to GCS Processors > - > > Key: NIFI-11439 > URL: https://issues.apache.org/jira/browse/NIFI-11439 > Project: Apache NiFi > Issue Type: Improvement >Reporter: Paul Grey >Assignee: Paul Grey >Priority: Minor > Fix For: 2.0.0, 1.22.0 > > Time Spent: 1h 10m > Remaining Estimate: 0h > > AWS processors allow the override of the base endpoint for API calls to AWS > services [1]. GCS libraries provide analogous capabilities, as documented > here [2]. Expose a GCS processor property to enable GCS endpoint override > behavior. > [1] > https://github.com/apache/nifi/blob/main/nifi-nar-bundles/nifi-aws-bundle/nifi-aws-abstract-processors/src/main/java/org/apache/nifi/processors/aws/AbstractAWSProcessor.java#L146-L154 > [2] > https://cloud.google.com/storage/docs/request-endpoints#storage-set-client-endpoint-java -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (NIFI-11439) Add Storage API URL to GCS Processors
[ https://issues.apache.org/jira/browse/NIFI-11439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17712438#comment-17712438 ] ASF subversion and git services commented on NIFI-11439: Commit cff7808543716da5ca9f93356d7d762e15fdd143 in nifi's branch refs/heads/main from Paul Grey [ https://gitbox.apache.org/repos/asf?p=nifi.git;h=cff7808543 ] NIFI-11439 Corrected GCS Transit URI for custom Storage API URL This closes #7173 Signed-off-by: David Handermann > Add Storage API URL to GCS Processors > - > > Key: NIFI-11439 > URL: https://issues.apache.org/jira/browse/NIFI-11439 > Project: Apache NiFi > Issue Type: Improvement >Reporter: Paul Grey >Assignee: Paul Grey >Priority: Minor > Fix For: 2.0.0, 1.22.0 > > Time Spent: 1h 10m > Remaining Estimate: 0h > > AWS processors allow the override of the base endpoint for API calls to AWS > services [1]. GCS libraries provide analogous capabilities, as documented > here [2]. Expose a GCS processor property to enable GCS endpoint override > behavior. > [1] > https://github.com/apache/nifi/blob/main/nifi-nar-bundles/nifi-aws-bundle/nifi-aws-abstract-processors/src/main/java/org/apache/nifi/processors/aws/AbstractAWSProcessor.java#L146-L154 > [2] > https://cloud.google.com/storage/docs/request-endpoints#storage-set-client-endpoint-java -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (NIFI-11439) Add Storage API URL to GCS Processors
[ https://issues.apache.org/jira/browse/NIFI-11439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17712040#comment-17712040 ] ASF subversion and git services commented on NIFI-11439: Commit cd685671c8981114d5215513991df170e556062b in nifi's branch refs/heads/main from Paul Grey [ https://gitbox.apache.org/repos/asf?p=nifi.git;h=cd685671c8 ] NIFI-11439 Corrected Checkstyle violation on GCS Property Signed-off-by: David Handermann > Add Storage API URL to GCS Processors > - > > Key: NIFI-11439 > URL: https://issues.apache.org/jira/browse/NIFI-11439 > Project: Apache NiFi > Issue Type: Improvement >Reporter: Paul Grey >Assignee: Paul Grey >Priority: Minor > Fix For: 2.0.0, 1.22.0 > > Time Spent: 0.5h > Remaining Estimate: 0h > > AWS processors allow the override of the base endpoint for API calls to AWS > services [1]. GCS libraries provide analogous capabilities, as documented > here [2]. Expose a GCS processor property to enable GCS endpoint override > behavior. > [1] > https://github.com/apache/nifi/blob/main/nifi-nar-bundles/nifi-aws-bundle/nifi-aws-abstract-processors/src/main/java/org/apache/nifi/processors/aws/AbstractAWSProcessor.java#L146-L154 > [2] > https://cloud.google.com/storage/docs/request-endpoints#storage-set-client-endpoint-java -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (NIFI-11439) Add Storage API URL to GCS Processors
[ https://issues.apache.org/jira/browse/NIFI-11439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17712041#comment-17712041 ] ASF subversion and git services commented on NIFI-11439: Commit 98a0926680ea05a92b37fc9024d57fafdb6f65bb in nifi's branch refs/heads/support/nifi-1.x from Paul Grey [ https://gitbox.apache.org/repos/asf?p=nifi.git;h=98a0926680 ] NIFI-11439 Corrected Checkstyle violation on GCS Property Signed-off-by: David Handermann (cherry picked from commit cd685671c8981114d5215513991df170e556062b) > Add Storage API URL to GCS Processors > - > > Key: NIFI-11439 > URL: https://issues.apache.org/jira/browse/NIFI-11439 > Project: Apache NiFi > Issue Type: Improvement >Reporter: Paul Grey >Assignee: Paul Grey >Priority: Minor > Fix For: 2.0.0, 1.22.0 > > Time Spent: 0.5h > Remaining Estimate: 0h > > AWS processors allow the override of the base endpoint for API calls to AWS > services [1]. GCS libraries provide analogous capabilities, as documented > here [2]. Expose a GCS processor property to enable GCS endpoint override > behavior. > [1] > https://github.com/apache/nifi/blob/main/nifi-nar-bundles/nifi-aws-bundle/nifi-aws-abstract-processors/src/main/java/org/apache/nifi/processors/aws/AbstractAWSProcessor.java#L146-L154 > [2] > https://cloud.google.com/storage/docs/request-endpoints#storage-set-client-endpoint-java -- This message was sent by Atlassian Jira (v8.20.10#820010)
