Chris Nauroth created HDFS-10312: ------------------------------------ Summary: Large block reports may fail to decode at NameNode due to 64 MB protobuf maximum length restriction. Key: HDFS-10312 URL: https://issues.apache.org/jira/browse/HDFS-10312 Project: Hadoop HDFS Issue Type: Bug Components: namenode Reporter: Chris Nauroth Assignee: Chris Nauroth
Our RPC server caps the maximum size of incoming messages at 64 MB by default. For exceptional circumstances, this can be uptuned using {{ipc.maximum.data.length}}. However, for block reports, there is still an internal maximum length restriction of 64 MB enforced by protobuf. (Sample stack trace to follow in comments.) This issue proposes to apply the same override to our block list decoding, so that large block reports can proceed. -- This message was sent by Atlassian JIRA (v6.3.4#6332)