[jira] [Commented] (NIFI-2809) Add processors for Google Cloud Storage Fetch/Put/Delete
[ https://issues.apache.org/jira/browse/NIFI-2809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15866014#comment-15866014 ] Frank Maritato commented on NIFI-2809: -- [~jameswing] you can close this ticket in favor of NIFI-3449 > Add processors for Google Cloud Storage Fetch/Put/Delete > > > Key: NIFI-2809 > URL: https://issues.apache.org/jira/browse/NIFI-2809 > Project: Apache NiFi > Issue Type: New Feature >Affects Versions: 1.1.0 >Reporter: Frank Maritato > Attachments: gcp_bundle.patch, gcs_bundle.patch, nifi-2809.patch > > > Creating a ticket to add nifi processors for Google Cloud Storage similar to > how the AWS S3 processors are done: > * FetchGCSObject > * PutGCSObject > * DeleteGCSObject > I have the code mostly written and will attach the patch file when complete. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (NIFI-2809) Add processors for Google Cloud Storage Fetch/Put/Delete
[ https://issues.apache.org/jira/browse/NIFI-2809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15858136#comment-15858136 ] Frank Maritato commented on NIFI-2809: -- Well, it certainly would have been better if he had communicated with me instead of doing his own thing. I will take a look. > Add processors for Google Cloud Storage Fetch/Put/Delete > > > Key: NIFI-2809 > URL: https://issues.apache.org/jira/browse/NIFI-2809 > Project: Apache NiFi > Issue Type: New Feature >Affects Versions: 1.1.0 >Reporter: Frank Maritato > Attachments: gcp_bundle.patch, gcs_bundle.patch, nifi-2809.patch > > > Creating a ticket to add nifi processors for Google Cloud Storage similar to > how the AWS S3 processors are done: > * FetchGCSObject > * PutGCSObject > * DeleteGCSObject > I have the code mostly written and will attach the patch file when complete. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (NIFI-2809) Add processors for Google Cloud Storage Fetch/Put/Delete
[ https://issues.apache.org/jira/browse/NIFI-2809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15854756#comment-15854756 ] Frank Maritato commented on NIFI-2809: -- [~philpot] Hi Andrew, I haven't had a chance to address the concerns in the last comment. Hopefully I can get to it this week and I will submit another patch. > Add processors for Google Cloud Storage Fetch/Put/Delete > > > Key: NIFI-2809 > URL: https://issues.apache.org/jira/browse/NIFI-2809 > Project: Apache NiFi > Issue Type: New Feature >Affects Versions: 1.1.0 >Reporter: Frank Maritato > Attachments: gcp_bundle.patch, gcs_bundle.patch, nifi-2809.patch > > > Creating a ticket to add nifi processors for Google Cloud Storage similar to > how the AWS S3 processors are done: > * FetchGCSObject > * PutGCSObject > * DeleteGCSObject > I have the code mostly written and will attach the patch file when complete. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (NIFI-3226) Elastic search url should support expression language
Frank Maritato created NIFI-3226:
Summary: Elastic search url should support expression language
Key: NIFI-3226
URL: https://issues.apache.org/jira/browse/NIFI-3226
Project: Apache NiFi
Issue Type: Improvement
Affects Versions: 1.1.0
Reporter: Frank Maritato
We have different environments, dev, staging, production, each with different
elastic search servers. Instead of having to manually change the url for each
elastic search processor can you please support expression language for this
property so I can specify ${elasticsearch.url} ?
The following two processors would need this change:
* PutElasticsearchHttp
* FetchElasticsearchHttp
Thanks!
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (NIFI-2809) Add processors for Google Cloud Storage Fetch/Put/Delete
[ https://issues.apache.org/jira/browse/NIFI-2809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Frank Maritato updated NIFI-2809: - Attachment: nifi-2809.patch New patch file containing the changes from the code review: * default values * licenses * unit tests * use object instead of filename Also, I added another processor: ListGCS for listing files in a bucket, optionally with a prefix. > Add processors for Google Cloud Storage Fetch/Put/Delete > > > Key: NIFI-2809 > URL: https://issues.apache.org/jira/browse/NIFI-2809 > Project: Apache NiFi > Issue Type: New Feature >Affects Versions: 1.1.0 >Reporter: Frank Maritato > Attachments: gcp_bundle.patch, gcs_bundle.patch, nifi-2809.patch > > > Creating a ticket to add nifi processors for Google Cloud Storage similar to > how the AWS S3 processors are done: > * FetchGCSObject > * PutGCSObject > * DeleteGCSObject > I have the code mostly written and will attach the patch file when complete. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (NIFI-2809) Add processors for Google Cloud Storage Fetch/Put/Delete
[ https://issues.apache.org/jira/browse/NIFI-2809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15563482#comment-15563482 ] Frank Maritato commented on NIFI-2809: -- Ok, no problem I will go through all these. I will add some unit tests that use mockito for when the gcp apis are called. I'm also working on google pubsub processors and I was able to create unit tests with mocks for those. > Add processors for Google Cloud Storage Fetch/Put/Delete > > > Key: NIFI-2809 > URL: https://issues.apache.org/jira/browse/NIFI-2809 > Project: Apache NiFi > Issue Type: New Feature >Affects Versions: 1.1.0 >Reporter: Frank Maritato > Attachments: gcp_bundle.patch, gcs_bundle.patch > > > Creating a ticket to add nifi processors for Google Cloud Storage similar to > how the AWS S3 processors are done: > * FetchGCSObject > * PutGCSObject > * DeleteGCSObject > I have the code mostly written and will attach the patch file when complete. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (NIFI-2809) Add processors for Google Cloud Storage Fetch/Put/Delete
[ https://issues.apache.org/jira/browse/NIFI-2809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Frank Maritato updated NIFI-2809: - Attachment: gcp_bundle.patch Updated patch: * includes only nifi-gcp-bundle files * update to nifi-assembly/NOTICE file > Add processors for Google Cloud Storage Fetch/Put/Delete > > > Key: NIFI-2809 > URL: https://issues.apache.org/jira/browse/NIFI-2809 > Project: Apache NiFi > Issue Type: New Feature >Affects Versions: 1.1.0 >Reporter: Frank Maritato > Attachments: gcp_bundle.patch, gcs_bundle.patch > > > Creating a ticket to add nifi processors for Google Cloud Storage similar to > how the AWS S3 processors are done: > * FetchGCSObject > * PutGCSObject > * DeleteGCSObject > I have the code mostly written and will attach the patch file when complete. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (NIFI-2809) Add processors for Google Cloud Storage Fetch/Put/Delete
[ https://issues.apache.org/jira/browse/NIFI-2809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15541157#comment-15541157 ] Frank Maritato commented on NIFI-2809: -- Thanks for looking at it!. Initially I had created gcs-bundle but I thought that if there are future google cloud platform things we wanted to add like bigquery or whatever that it would make more sense to set it up as gcp-bundle. I guess maybe my delete of the old gcs-bundle directory wasnt committed in my git branch and that is why the patch picked it up? Let me double check tomorrow and I can resubmit the patch. I will make that addition to the NOTICE file for the licensing. > Add processors for Google Cloud Storage Fetch/Put/Delete > > > Key: NIFI-2809 > URL: https://issues.apache.org/jira/browse/NIFI-2809 > Project: Apache NiFi > Issue Type: New Feature >Affects Versions: 1.1.0 >Reporter: Frank Maritato > Attachments: gcs_bundle.patch > > > Creating a ticket to add nifi processors for Google Cloud Storage similar to > how the AWS S3 processors are done: > * FetchGCSObject > * PutGCSObject > * DeleteGCSObject > I have the code mostly written and will attach the patch file when complete. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (NIFI-2809) Add processors for Google Cloud Storage Fetch/Put/Delete
[ https://issues.apache.org/jira/browse/NIFI-2809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Frank Maritato updated NIFI-2809: - Attachment: gcs_bundle.patch Initial patch for review. Integration tests included. Please review and let me know what changes need to be made. Thanks! > Add processors for Google Cloud Storage Fetch/Put/Delete > > > Key: NIFI-2809 > URL: https://issues.apache.org/jira/browse/NIFI-2809 > Project: Apache NiFi > Issue Type: New Feature >Affects Versions: 1.1.0 >Reporter: Frank Maritato > Attachments: gcs_bundle.patch > > > Creating a ticket to add nifi processors for Google Cloud Storage similar to > how the AWS S3 processors are done: > * FetchGCSObject > * PutGCSObject > * DeleteGCSObject > I have the code mostly written and will attach the patch file when complete. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (NIFI-2809) Add processors for Google Cloud Storage Fetch/Put/Delete
Frank Maritato created NIFI-2809: Summary: Add processors for Google Cloud Storage Fetch/Put/Delete Key: NIFI-2809 URL: https://issues.apache.org/jira/browse/NIFI-2809 Project: Apache NiFi Issue Type: New Feature Affects Versions: 1.1.0 Reporter: Frank Maritato Creating a ticket to add nifi processors for Google Cloud Storage similar to how the AWS S3 processors are done: * FetchGCSObject * PutGCSObject * DeleteGCSObject I have the code mostly written and will attach the patch file when complete. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
