[ https://issues.apache.org/jira/browse/HADOOP-14423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Steve Loughran updated HADOOP-14423: ------------------------------------ Attachment: HADOOP-14423-HADOOP-13345-002.patch patch 002, rebased onto latest s3guard branch. unlikely to be any different from the previous one, but now that s3guard is compiling again, yetus should review it > s3guard will set file length to -1 on a putObjectDirect(stream, -1) call > ------------------------------------------------------------------------ > > Key: HADOOP-14423 > URL: https://issues.apache.org/jira/browse/HADOOP-14423 > Project: Hadoop Common > Issue Type: Sub-task > Components: fs/s3 > Affects Versions: 3.0.0-alpha4 > Reporter: Steve Loughran > Assignee: Steve Loughran > Priority: Minor > Attachments: HADOOP-14423-HADOOP-13345-001.patch, > HADOOP-14423-HADOOP-13345-002.patch > > > You can pass a negative number into {{S3AFileSystem.putObjectDirect}}, which > means "put until the end of the stream". S3guard has been using this {{len}} > argument: it needs to be using the actual number of bytes uploaded. Also > relevant with client side encryption, when the amount of data put > the > amount of data in the file or stream. > Noted in the committer branch after I added some more assertions, I've > changed it there so making changes to S3AFS.putObjectDirect to pull the > content length to pass in to finishedWrite() from the {{PutObjectResult}} > instead. This can be picked into the s3guard branch -- This message was sent by Atlassian JIRA (v6.4.14#64029) --------------------------------------------------------------------- To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org