[ https://issues.apache.org/jira/browse/YARN-4818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15196359#comment-15196359 ]
Brook Zhou commented on YARN-4818: ---------------------------------- You're right, it was some issue with our FileSystem implementation. I will cancel this. Sorry about the confusion. > AggregatedLogFormat.LogValue.write() incorrectly truncates files > ---------------------------------------------------------------- > > Key: YARN-4818 > URL: https://issues.apache.org/jira/browse/YARN-4818 > Project: Hadoop YARN > Issue Type: Bug > Components: nodemanager > Affects Versions: 2.8.0 > Reporter: Brook Zhou > Assignee: Brook Zhou > Labels: log-aggregation > Fix For: 2.8.0 > > Attachments: YARN-4818-v0.patch > > > AggregatedLogFormat.LogValue.write() currently has a bug where it only writes > in blocks of the buffer size (65535). This is because > FileInputStream.read(byte[] buf) returns -1 if there are less than buf.length > bytes remaining. In cases where the file size is not an exact multiple of > 65535 bytes, the remaining bytes are truncated. -- This message was sent by Atlassian JIRA (v6.3.4#6332)