Hello, I'm having an issue attempting to upload a large fie ( 5.1GB ) to S3 storage ( not AWS, but rather Cloudian implementation ).
>From everything I've read, it appears NiFi is supposed to revert to a >multipart upload if the size of the file is greater than then "Multipart >Threshold" defined in the PutS3Object processor. This is not happening for >me, it just errors out with this message: ERROR o.a.nifi.processors.aws.s3.PutS3Object PutS3Object[id=cd683449-d9b3-1ce2-85ae-a0d900cfd488] Failed to put StandardFlowFileRecord[uuid=74a8d054-53cb-44d7-aca1-dabd94b50781,claim=StandardContentClaim [resourceClaim=StandardResourceClaim[id=1610459752598-174464, container=default, section=384], offset=59300, length=5109625339],offset=0,name=6477482,size=5109625339] to Amazon S3 due to com.amazonaws.services.s3.model.AmazonS3Exception: Your proposed upload exceeds the maximum allowed object size. (Service: Amazon S3; Status Code: 400; Error Code: EntityTooLarge; Request ID: 2f967706-9745-1564-a246-0a94ef6266cb; S3 Extended Request ID: a647d24f02954de69d161d24c3e48081), S3 Extended Request ID: a647d24f02954de69d161d24c3e48081: com.amazonaws.services.s3.model.AmazonS3Exception: Your proposed upload exceeds the maximum allowed object size. (Service: Amazon S3; Status Code: 400; Error Code: EntityTooLarge; Request ID: 2f967706-9745-1564-a246-0a94ef6266cb; S3 Extended Request ID: a647d24f02954de69d161d24c3e48081), S3 Extended Request ID: a647d24f02954de69d161d24c3e48081 com.amazonaws.services.s3.model.AmazonS3Exception: Your proposed upload exceeds the maximum allowed object size. (Service: Amazon S3; Status Code: 400; Error Code: EntityTooLarge; Request ID: 2f967706-9745-1564-a246-0a94ef6266cb; S3 Extended Request ID: a647d24f02954de69d161d24c3e48081) So my question is; Is NiFi supposed to detect the large file and then initiate the multipart upload, or is the server supposed to respond and cause NiFi to react to the size challenge? Regards, [cid:image001.gif@01D6E8D5.DBA77070] Dennis N Brown Data Architect Systems CARE Team Lenovo USA US PostgreSQL Association [Email]dbr...@lenovo.com<mailto:dbr...@lenovo.com> [2015-NewBrand-Lenovo-Services]
