[
https://issues.apache.org/jira/browse/NIFI-1107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15024907#comment-15024907
]
ASF GitHub Bot commented on NIFI-1107:
--------------------------------------
GitHub user jskora opened a pull request:
https://github.com/apache/nifi/pull/132
NIFI-1107 - Integrate Multipart uploads into the PutS3Object processor.
* Add nifi-ssl-context-service-nar to nifi-aws-nar pom.
* Add nifi-ssl-context-service-api to nifi-aws-processors pom.
* Add SSL context service and endpoint override properties to
AbstractAWSProcessor to support non-Amazon S3-compatible endpoints.
* Added Multipart upload API support, multipart threshold and size
properties, state tracking for multipart upload, and expanded flow file
attributes to PutS3Object.
* Updated annotations and property list for FetchS3Object and
DeleteS3Object.
* Added region to bucket in AbstractS3Test to minimize AWS propogation
issues during testing.
* Expanded tests in TestPutS3Object to validate new multipart logic.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/jskora/nifi NIFI-1107
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/nifi/pull/132.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #132
----
commit 52fd4180c7e929cbbdd3647d1b7aad68174b2f9c
Author: Joe Skora <[email protected]>
Date: 2015-11-24T17:15:01Z
Integrate Multipart uploads into the PutS3Object processor.
* Add nifi-ssl-context-service-nar to nifi-aws-nar pom.
* Add nifi-ssl-context-service-api to nifi-aws-processors pom.
* Add SSL context service and endpoint override properties to
AbstractAWSProcessor to support non-Amazon S3-compatible endpoints.
* Added Multipart upload API support, multipart threshold and size
properties, state tracking for multipart upload, and expanded flow file
attributes to PutS3Object.
* Updated annotations and property list for FetchS3Object and
DeleteS3Object.
* Added region to bucket in AbstractS3Test to minimize AWS propogation
issues during testing.
* Expanded tests in TestPutS3Object to validate new multipart logic.
----
> Create new PutS3ObjectMultipart processor
> -----------------------------------------
>
> Key: NIFI-1107
> URL: https://issues.apache.org/jira/browse/NIFI-1107
> Project: Apache NiFi
> Issue Type: New Feature
> Components: Core Framework
> Reporter: Joe Skora
> Assignee: Joe Skora
> Labels: s3
> Fix For: 0.5.0
>
>
> A new `PutS3ObjectMultipart` processor using the AWS S3 API to upload files
> larger than those supported by `PutS3Object` which has a [5GB
> limit|http://docs.aws.amazon.com/AmazonS3/latest/dev/UploadingObjects.html]
> limit.
> To support S3 compatible endpoints this will also add an `Endpoint Override
> URL` property to `AbstractAWSProcessor` to set the service
> [endpoint|http://docs.aws.amazon.com/AWSJavaSDK/latest/javadoc/com/amazonaws/AmazonWebServiceClient.html#setEndpoint(java.lang.String)]
> to override the endpoint URL normally selected based on the the Amazon
> region.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
