[jira] [Resolved] (HDFS-15613) RBF: Router FSCK fails after HDFS-14442

[ https://issues.apache.org/jira/browse/HDFS-15613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved HDFS-15613. -- Fix Version/s: 3.4.0 3.3.1 Target Version/s: 3.3.1, 3.4.0 (was:

[jira] [Created] (HDFS-15616) [SBN] Disable trigger edit Log Roll for Observers

Janus Chow created HDFS-15616: - Summary: [SBN] Disable trigger edit Log Roll for Observers Key: HDFS-15616 URL: https://issues.apache.org/jira/browse/HDFS-15616 Project: Hadoop HDFS Issue Type:

[jira] [Resolved] (HDFS-15615) HDFS user permission does not work correctly

[ https://issues.apache.org/jira/browse/HDFS-15615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Heba Aboulmagd resolved HDFS-15615. --- Release Note: adding users to hdfs group, causes the permission to not work correctly

Unable to adjust buffer size passed to compress (zlib) in HDFS

Hello, Working with HDFS and zlib compression, I am trying to change the buffer size passed into the top of the libz.so implementation. Our understanding is this should be changed with the parameter io.file.buffer.size. The default is 64K and no matter how we change this parameter the buffer

Re: [E] Re: Increased DN heap usage during Hadoop 3 upgrade

Sorry for not being specific. I was referring to HDFS-8791 (block ID-based DN storage layout can be very slow for datanode on ext4) where it is in 2.8 and above. As I understand it, the increased heap usage only occurs during upgrade. No issue

Re: [E] Re: Increased DN heap usage during Hadoop 3 upgrade

To be clear, we are running 2.8 and 2.10. Although we don't see any issues, I am curious whether the change in heap usage is amplified on dense datanodes. Kihwal On Tue, Oct 6, 2020 at 5:00 PM Kihwal Lee wrote: > Which layout change are you referring to? The only layout change I know of > was

Re: [E] Re: Increased DN heap usage during Hadoop 3 upgrade

Which layout change are you referring to? The only layout change I know of was done in 2.7, IIRC. We backported that to 2.6 and did not see any adverse effects at that time. Is datanode using more heap all the time? Or is it running into trouble when generating full block reports? Kihwal On

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86_64

For more details, see https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/287/ [Oct 5, 2020 8:09:14 AM] (Adam Antal) YARN-10393. MR job live lock caused by completed state container leak in heartbeat between node manager and RM. Contributed by zhenzhao wang and Jim Brennan

Apache Hadoop qbt Report: branch-2.10+JDK7 on Linux/x86_64

For more details, see https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/78/ No changes -1 overall The following subsystems voted -1: asflicense hadolint jshint pathlen unit xml The following subsystems voted -1 but were configured to be filtered/ignored: