[jira] [Created] (HDFS-9478) Reason for failing ipc.FairCallQueue contruction should be thrown

Archana T created HDFS-9478: --- Summary: Reason for failing ipc.FairCallQueue contruction should be thrown Key: HDFS-9478 URL: https://issues.apache.org/jira/browse/HDFS-9478 Project: Hadoop HDFS Is

[jira] [Updated] (HDFS-9038) Reserved space is erroneously counted towards non-DFS used.

[ https://issues.apache.org/jira/browse/HDFS-9038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-9038: --- Attachment: HDFS-9038-005.patch Uploaded the patch..Kindly review.. > Reserved space i

[jira] [Created] (HDFS-9479) DeadLock Between DFSOutputStream and LeaseRenewer when Network unstable

Bob created HDFS-9479: - Summary: DeadLock Between DFSOutputStream and LeaseRenewer when Network unstable Key: HDFS-9479 URL: https://issues.apache.org/jira/browse/HDFS-9479 Project: Hadoop HDFS Issue Ty

[jira] [Updated] (HDFS-9479) DeadLock Between DFSOutputStream and LeaseRenewer when Network unstable

[ https://issues.apache.org/jira/browse/HDFS-9479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-9479: - Target Version/s: 2.7.3 Priority: Blocker (was: Critical) > DeadLock Between DFSOutputStream a

[jira] [Assigned] (HDFS-9479) DeadLock Happened Between DFSOutputStream and LeaseRenewer when Network unstable

[ https://issues.apache.org/jira/browse/HDFS-9479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob reassigned HDFS-9479: - Assignee: Bob > DeadLock Happened Between DFSOutputStream and LeaseRenewer when Network > unstable >

[jira] [Updated] (HDFS-9479) DeadLock Happened Between DFSOutputStream and LeaseRenewer when Network unstable

[ https://issues.apache.org/jira/browse/HDFS-9479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob updated HDFS-9479: -- Summary: DeadLock Happened Between DFSOutputStream and LeaseRenewer when Network unstable (was: DeadLock Between DFSOutp

[jira] [Commented] (HDFS-7435) PB encoding of block reports is very inefficient

[ https://issues.apache.org/jira/browse/HDFS-7435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15031939#comment-15031939 ] Daryn Sharp commented on HDFS-7435: --- [~liuml07], good catch! Not sure how I accidentally

[jira] [Updated] (HDFS-9417) Clean up the RAT warnings in the HDFS-8707 branch.

[ https://issues.apache.org/jira/browse/HDFS-9417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen updated HDFS-9417: - Attachment: HDFS-9417.HDFS-8707.000.patch Uploaded first pass at clearing up the warnings. Couldn't run th

[jira] [Commented] (HDFS-9479) DeadLock Happened Between DFSOutputStream and LeaseRenewer when Network unstable

[ https://issues.apache.org/jira/browse/HDFS-9479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15031952#comment-15031952 ] Brahma Reddy Battula commented on HDFS-9479: Thanks for reporting . Dupe of HDF

[jira] [Commented] (HDFS-8791) block ID-based DN storage layout can be very slow for datanode on ext4

[ https://issues.apache.org/jira/browse/HDFS-8791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15031954#comment-15031954 ] Kihwal Lee commented on HDFS-8791: -- This is what I saw on the upgraded node before it got

[jira] [Commented] (HDFS-9233) Create LICENSE.txt and NOTICES files for libhdfs++

[ https://issues.apache.org/jira/browse/HDFS-9233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15031957#comment-15031957 ] Bob Hansen commented on HDFS-9233: -- [~owen.omalley] - I was looking for examples to follow

[jira] [Commented] (HDFS-9479) DeadLock Happened Between DFSOutputStream and LeaseRenewer when Network unstable

[ https://issues.apache.org/jira/browse/HDFS-9479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15031961#comment-15031961 ] Brahma Reddy Battula commented on HDFS-9479: I mean HDFS-9294. > DeadLock Happ

[jira] [Commented] (HDFS-9479) DeadLock Happened Between DFSOutputStream and LeaseRenewer when Network unstable

[ https://issues.apache.org/jira/browse/HDFS-9479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15031966#comment-15031966 ] Kihwal Lee commented on HDFS-9479: -- Yes It looked familiar. I think it is a dupe. > DeadL

[jira] [Resolved] (HDFS-9479) DeadLock Happened Between DFSOutputStream and LeaseRenewer when Network unstable

[ https://issues.apache.org/jira/browse/HDFS-9479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee resolved HDFS-9479. -- Resolution: Duplicate Target Version/s: (was: 2.7.3) > DeadLock Happened Between DFSOutputStr

[jira] [Commented] (HDFS-9477) namenode starts failed:FSEditLogLoader: Encountered exception on operation TimesOp

[ https://issues.apache.org/jira/browse/HDFS-9477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15031973#comment-15031973 ] Daryn Sharp commented on HDFS-9477: --- Notice that it's occurring because of an atime updat

[jira] [Commented] (HDFS-9468) DfsAdmin command set dataXceiver count for datanode

[ https://issues.apache.org/jira/browse/HDFS-9468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15031995#comment-15031995 ] Kihwal Lee commented on HDFS-9468: -- Why don't you make it refreshable? Some configs in dat

[jira] [Commented] (HDFS-9452) libhdfs++ Fix memory stomp in OpenFileForRead.

[ https://issues.apache.org/jira/browse/HDFS-9452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15032026#comment-15032026 ] James Clampffer commented on HDFS-9452: --- Committed to HDFS-8707. Thanks for the poin

[jira] [Commented] (HDFS-8791) block ID-based DN storage layout can be very slow for datanode on ext4

[ https://issues.apache.org/jira/browse/HDFS-8791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15032081#comment-15032081 ] Kihwal Lee commented on HDFS-8791: -- bq. I will test it again if that is the case. Retest

[jira] [Created] (HDFS-9480) Expose nonDfsUsed via StorageTypeStats and DatanodeStatistics

Brahma Reddy Battula created HDFS-9480: -- Summary: Expose nonDfsUsed via StorageTypeStats and DatanodeStatistics Key: HDFS-9480 URL: https://issues.apache.org/jira/browse/HDFS-9480 Project: Hadoo

[jira] [Created] (HDFS-9481) Expose reservedForReplicas as a metric

Brahma Reddy Battula created HDFS-9481: -- Summary: Expose reservedForReplicas as a metric Key: HDFS-9481 URL: https://issues.apache.org/jira/browse/HDFS-9481 Project: Hadoop HDFS Issue T

[jira] [Created] (HDFS-9482) Expose reservedForReplicas as a metric

Brahma Reddy Battula created HDFS-9482: -- Summary: Expose reservedForReplicas as a metric Key: HDFS-9482 URL: https://issues.apache.org/jira/browse/HDFS-9482 Project: Hadoop HDFS Issue T

[jira] [Updated] (HDFS-9482) Replace DatanodeInfo constructors with a builder pattern

[ https://issues.apache.org/jira/browse/HDFS-9482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-9482: --- Summary: Replace DatanodeInfo constructors with a builder pattern (was: Expose reserv

[jira] [Commented] (HDFS-9038) Reserved space is erroneously counted towards non-DFS used.

[ https://issues.apache.org/jira/browse/HDFS-9038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15032110#comment-15032110 ] Brahma Reddy Battula commented on HDFS-9038: Raised separate jira's for above t

[jira] [Created] (HDFS-9483) Documentation does not cover use of "swebhdfs" as URL scheme for SSL-secured WebHDFS.

Chris Nauroth created HDFS-9483: --- Summary: Documentation does not cover use of "swebhdfs" as URL scheme for SSL-secured WebHDFS. Key: HDFS-9483 URL: https://issues.apache.org/jira/browse/HDFS-9483 Proje

[jira] [Resolved] (HDFS-9471) Webhdfs not working with shell command when kerberos security+https is enabled.

[ https://issues.apache.org/jira/browse/HDFS-9471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth resolved HDFS-9471. - Resolution: Not A Problem [~surendrasingh], that's a good point about the documentation. I filed

[jira] [Commented] (HDFS-9425) Expose number of blocks per volume as a metric

[ https://issues.apache.org/jira/browse/HDFS-9425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15032116#comment-15032116 ] Brahma Reddy Battula commented on HDFS-9425: can somebody review this patch..?,

[jira] [Work started] (HDFS-9474) TestPipelinesFailover would fail if ifconfig is not available

[ https://issues.apache.org/jira/browse/HDFS-9474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-9474 started by John Zhuge. > TestPipelinesFailover would fail if ifconfig is not available >

[jira] [Updated] (HDFS-9474) TestPipelinesFailover would fail if ifconfig is not available

[ https://issues.apache.org/jira/browse/HDFS-9474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-9474: - Attachment: HDFS-9474.001.patch > TestPipelinesFailover would fail if ifconfig is not available > -

[jira] [Assigned] (HDFS-9483) Documentation does not cover use of "swebhdfs" as URL scheme for SSL-secured WebHDFS.

[ https://issues.apache.org/jira/browse/HDFS-9483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore reassigned HDFS-9483: Assignee: Surendra Singh Lilhore > Documentation does not cover use of "sweb

[jira] [Commented] (HDFS-9470) Encryption zone on root not loaded from fsimage after NN restart

[ https://issues.apache.org/jira/browse/HDFS-9470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15032170#comment-15032170 ] Haohui Mai commented on HDFS-9470: -- Looks like it is an important fix but it has relativel

[jira] [Updated] (HDFS-8871) Decommissioning of a node with a failed volume may not start

[ https://issues.apache.org/jira/browse/HDFS-8871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8871: - Target Version/s: 2.7.3, 2.6.4 (was: 2.7.3, 2.6.3) > Decommissioning of a node with a failed volume may no

[jira] [Commented] (HDFS-8871) Decommissioning of a node with a failed volume may not start

[ https://issues.apache.org/jira/browse/HDFS-8871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15032172#comment-15032172 ] Junping Du commented on HDFS-8871: -- Moving this to 2.6.4 as no update for a while. > Deco

[jira] [Updated] (HDFS-8791) block ID-based DN storage layout can be very slow for datanode on ext4

[ https://issues.apache.org/jira/browse/HDFS-8791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8791: - Target Version/s: 2.6.3 > block ID-based DN storage layout can be very slow for datanode on ext4 >

[jira] [Commented] (HDFS-8791) block ID-based DN storage layout can be very slow for datanode on ext4

[ https://issues.apache.org/jira/browse/HDFS-8791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15032178#comment-15032178 ] Haohui Mai commented on HDFS-8791: -- Marking it as a critical bug of 2.6.3. I think it's i

[jira] [Commented] (HDFS-9470) Encryption zone on root not loaded from fsimage after NN restart

[ https://issues.apache.org/jira/browse/HDFS-9470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15032181#comment-15032181 ] Xiao Chen commented on HDFS-9470: - Thanks [~wheat9] for the comment. I'll watch out for the

[jira] [Commented] (HDFS-8791) block ID-based DN storage layout can be very slow for datanode on ext4

[ https://issues.apache.org/jira/browse/HDFS-8791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15032187#comment-15032187 ] Junping Du commented on HDFS-8791: -- bq. I think it's important to cherry-pick this patch t

[jira] [Commented] (HDFS-8791) block ID-based DN storage layout can be very slow for datanode on ext4

[ https://issues.apache.org/jira/browse/HDFS-8791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15032190#comment-15032190 ] Kihwal Lee commented on HDFS-8791: -- bq. Marking it as a critical bug of 2.6.3. If you want

[jira] [Commented] (HDFS-9474) TestPipelinesFailover would fail if ifconfig is not available

[ https://issues.apache.org/jira/browse/HDFS-9474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15032200#comment-15032200 ] Yongjun Zhang commented on HDFS-9474: - Hi John, Thanks for the patch. Two minor: # Sug

[jira] [Commented] (HDFS-9038) Reserved space is erroneously counted towards non-DFS used.

[ https://issues.apache.org/jira/browse/HDFS-9038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15032253#comment-15032253 ] Hadoop QA commented on HDFS-9038: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9273) ACLs on root directory may be lost after NN restart

[ https://issues.apache.org/jira/browse/HDFS-9273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15032262#comment-15032262 ] Sangjin Lee commented on HDFS-9273: --- +1 SGTM > ACLs on root directory may be lost after

[jira] [Commented] (HDFS-9470) Encryption zone on root not loaded from fsimage after NN restart

[ https://issues.apache.org/jira/browse/HDFS-9470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15032264#comment-15032264 ] Sangjin Lee commented on HDFS-9470: --- +1 SGTM > Encryption zone on root not loaded from f

[jira] [Created] (HDFS-9484) NNThroughputBenchmark$BlockReportStats should not send empty block reports

Mingliang Liu created HDFS-9484: --- Summary: NNThroughputBenchmark$BlockReportStats should not send empty block reports Key: HDFS-9484 URL: https://issues.apache.org/jira/browse/HDFS-9484 Project: Hadoop

[jira] [Commented] (HDFS-7435) PB encoding of block reports is very inefficient

[ https://issues.apache.org/jira/browse/HDFS-7435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15032285#comment-15032285 ] Mingliang Liu commented on HDFS-7435: - Thanks for your comment, [~daryn] and [~shv]. I

[jira] [Updated] (HDFS-9484) NNThroughputBenchmark$BlockReportStats should not send empty block reports

[ https://issues.apache.org/jira/browse/HDFS-9484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9484: Description: In {{NNThroughputBenchmark$BlockReportStats#formBlockReport()}}, the {{blockReportList}

[jira] [Updated] (HDFS-9474) TestPipelinesFailover would fail if ifconfig is not available

[ https://issues.apache.org/jira/browse/HDFS-9474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-9474: - Attachment: HDFS-9474.002.patch > TestPipelinesFailover would fail if ifconfig is not available > -

[jira] [Updated] (HDFS-9469) DiskBalancer : Add Planner

[ https://issues.apache.org/jira/browse/HDFS-9469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-9469: --- Attachment: HDFS-9469-HDFS-1312.001.patch Attaching patch for code review. I will submit the patch afte

[jira] [Updated] (HDFS-6363) Improve concurrency while checking inclusion and exclusion of datanodes

[ https://issues.apache.org/jira/browse/HDFS-6363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benoy Antony updated HDFS-6363: --- Attachment: HDFS-6363-003.patch Attaching the patch after fixing checkstyle issues. > Improve concurr

[jira] [Commented] (HDFS-9429) Tests in TestDFSAdminWithHA intermittently fail with EOFException

[ https://issues.apache.org/jira/browse/HDFS-9429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15032355#comment-15032355 ] Colin Patrick McCabe commented on HDFS-9429: This looks good. Just one comment

[jira] [Updated] (HDFS-9269) Need to update the documentation and wrapper for fuse-dfs

[ https://issues.apache.org/jira/browse/HDFS-9269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9269: -- Attachment: HDFS-9269.002.patch Rev02: Made the wrapper more self contained. Still need more test

[jira] [Work started] (HDFS-9269) Need to update the documentation and wrapper for fuse-dfs

[ https://issues.apache.org/jira/browse/HDFS-9269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-9269 started by Wei-Chiu Chuang. - > Need to update the documentation and wrapper for fuse-dfs > --

[jira] [Commented] (HDFS-9474) TestPipelinesFailover would fail if ifconfig is not available

[ https://issues.apache.org/jira/browse/HDFS-9474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15032383#comment-15032383 ] Yongjun Zhang commented on HDFS-9474: - Thanks for the new rev John. +1 on rev 002 pendi

[jira] [Commented] (HDFS-9429) Tests in TestDFSAdminWithHA intermittently fail with EOFException

[ https://issues.apache.org/jira/browse/HDFS-9429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15032411#comment-15032411 ] Xiao Chen commented on HDFS-9429: - Thanks Colin for the comment! I'd love to make improveme

[jira] [Commented] (HDFS-9470) Encryption zone on root not loaded from fsimage after NN restart

[ https://issues.apache.org/jira/browse/HDFS-9470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15032451#comment-15032451 ] Hadoop QA commented on HDFS-9470: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9470) Encryption zone on root not loaded from fsimage after NN restart

[ https://issues.apache.org/jira/browse/HDFS-9470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15032477#comment-15032477 ] Xiao Chen commented on HDFS-9470: - The test failures looks unrelated, and passed locally.

[jira] [Commented] (HDFS-7764) DirectoryScanner shouldn't abort the scan if one directory had an error

[ https://issues.apache.org/jira/browse/HDFS-7764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15032490#comment-15032490 ] Colin Patrick McCabe commented on HDFS-7764: Thanks, [~rakeshr]. {code} 856

[jira] [Commented] (HDFS-8791) block ID-based DN storage layout can be very slow for datanode on ext4

[ https://issues.apache.org/jira/browse/HDFS-8791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15032506#comment-15032506 ] Colin Patrick McCabe commented on HDFS-8791: Thanks, guys. +1 for this in trunk

[jira] [Commented] (HDFS-9484) NNThroughputBenchmark$BlockReportStats should not send empty block reports

[ https://issues.apache.org/jira/browse/HDFS-9484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15032516#comment-15032516 ] Colin Patrick McCabe commented on HDFS-9484: Good find, [~liuml07]. > NNThroug

[jira] [Commented] (HDFS-9449) DiskBalancer : Add connectors

[ https://issues.apache.org/jira/browse/HDFS-9449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15032543#comment-15032543 ] Anu Engineer commented on HDFS-9449: test failures are not related to this patch. > Di

[jira] [Commented] (HDFS-8820) Simplify enabling NameNode RPC congestion control and FairCallQueue

[ https://issues.apache.org/jira/browse/HDFS-8820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15032571#comment-15032571 ] Ming Ma commented on HDFS-8820: --- Thanks [~arpitagarwal]. * The last change made to {{RpcEngi

[jira] [Commented] (HDFS-8831) Trash Support for deletion in HDFS encryption zone

[ https://issues.apache.org/jira/browse/HDFS-8831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15032584#comment-15032584 ] Arpit Agarwal commented on HDFS-8831: - Hi [~xyao], thanks for the detailed design note.

[jira] [Commented] (HDFS-6363) Improve concurrency while checking inclusion and exclusion of datanodes

[ https://issues.apache.org/jira/browse/HDFS-6363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15032603#comment-15032603 ] Hadoop QA commented on HDFS-6363: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9470) Encryption zone on root not loaded from fsimage after NN restart

[ https://issues.apache.org/jira/browse/HDFS-9470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15032620#comment-15032620 ] Andrew Wang commented on HDFS-9470: --- LGTM, I'll commit this down to trunk, branch-2, bran

[jira] [Updated] (HDFS-6363) Improve concurrency while checking inclusion and exclusion of datanodes

[ https://issues.apache.org/jira/browse/HDFS-6363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benoy Antony updated HDFS-6363: --- Attachment: HDFS-6363-004.patch > Improve concurrency while checking inclusion and exclusion of datanod

[jira] [Updated] (HDFS-9452) libhdfs++ Fix memory stomp in OpenFileForRead.

[ https://issues.apache.org/jira/browse/HDFS-9452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9452: -- Resolution: Fixed Status: Resolved (was: Patch Available) > libhdfs++ Fix memory stomp i

[jira] [Commented] (HDFS-9381) When same block came for replication for Striped mode, we can move that block to PendingReplications

[ https://issues.apache.org/jira/browse/HDFS-9381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15032632#comment-15032632 ] Zhe Zhang commented on HDFS-9381: - The v03 patch LGTM; I haven't manually verified the unit

[jira] [Commented] (HDFS-9228) libhdfs++ should respect NN retry configuration settings

[ https://issues.apache.org/jira/browse/HDFS-9228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15032635#comment-15032635 ] James Clampffer commented on HDFS-9228: --- Looks good to me, just found 2 small things

[jira] [Commented] (HDFS-9129) Move the safemode block count into BlockManager

[ https://issues.apache.org/jira/browse/HDFS-9129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15032643#comment-15032643 ] Jing Zhao commented on HDFS-9129: - The latest patch looks pretty good to me. The only minor

[jira] [Commented] (HDFS-9449) DiskBalancer : Add connectors

[ https://issues.apache.org/jira/browse/HDFS-9449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15032650#comment-15032650 ] Tsz Wo Nicholas Sze commented on HDFS-9449: --- - DBNameNodeConnector.connector shou

[jira] [Commented] (HDFS-9294) DFSClient deadlock when close file and failed to renew lease

[ https://issues.apache.org/jira/browse/HDFS-9294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15032659#comment-15032659 ] Tsz Wo Nicholas Sze commented on HDFS-9294: --- [~Deng FEI], are you going to post a

[jira] [Created] (HDFS-9485) Make BlockManager#removeFromExcessReplicateMap accept BlockInfo instead of Block

Mingliang Liu created HDFS-9485: --- Summary: Make BlockManager#removeFromExcessReplicateMap accept BlockInfo instead of Block Key: HDFS-9485 URL: https://issues.apache.org/jira/browse/HDFS-9485 Project: H

[jira] [Updated] (HDFS-9485) Make BlockManager#removeFromExcessReplicateMap accept BlockInfo instead of Block

[ https://issues.apache.org/jira/browse/HDFS-9485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9485: Status: Patch Available (was: Open) > Make BlockManager#removeFromExcessReplicateMap accept BlockInf

[jira] [Updated] (HDFS-9485) Make BlockManager#removeFromExcessReplicateMap accept BlockInfo instead of Block

[ https://issues.apache.org/jira/browse/HDFS-9485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9485: Attachment: HDFS-9485.000.patch > Make BlockManager#removeFromExcessReplicateMap accept BlockInfo ins

[jira] [Updated] (HDFS-9470) Encryption zone on root not loaded from fsimage after NN restart

[ https://issues.apache.org/jira/browse/HDFS-9470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-9470: -- Resolution: Fixed Fix Version/s: 2.6.3 2.7.2 Status: Resolved (was:

[jira] [Commented] (HDFS-9228) libhdfs++ should respect NN retry configuration settings

[ https://issues.apache.org/jira/browse/HDFS-9228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15032683#comment-15032683 ] Bob Hansen commented on HDFS-9228: -- Land HDFS-9144 first; I'll have to rebase this and res

[jira] [Commented] (HDFS-9446) tSize of libhdfs in hadoop-2.7.1 is still int32_t

[ https://issues.apache.org/jira/browse/HDFS-9446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15032684#comment-15032684 ] Colin Patrick McCabe commented on HDFS-9446: Please do not change the type of {

[jira] [Updated] (HDFS-6533) intermittent org.apache.hadoop.hdfs.server.datanode.TestBPOfferService.testBasicFunctionalitytest failure

[ https://issues.apache.org/jira/browse/HDFS-6533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-6533: -- Attachment: HDFS-6533.002.patch Rev02. I ran rev01 code locally for a few thousand times, and it

[jira] [Updated] (HDFS-6533) intermittent org.apache.hadoop.hdfs.server.datanode.TestBPOfferService.testBasicFunctionalitytest failure

[ https://issues.apache.org/jira/browse/HDFS-6533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-6533: -- Status: Patch Available (was: Open) > intermittent > org.apache.hadoop.hdfs.server.datanode.Tes

[jira] [Commented] (HDFS-7984) webhdfs:// needs to support provided delegation tokens

[ https://issues.apache.org/jira/browse/HDFS-7984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15032689#comment-15032689 ] Allen Wittenauer commented on HDFS-7984: If I understand the code change correctly,

[jira] [Commented] (HDFS-9470) Encryption zone on root not loaded from fsimage after NN restart

[ https://issues.apache.org/jira/browse/HDFS-9470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15032695#comment-15032695 ] Hudson commented on HDFS-9470: -- FAILURE: Integrated in Hadoop-trunk-Commit #8901 (See [https:

[jira] [Updated] (HDFS-9484) NNThroughputBenchmark$BlockReportStats should not send empty block reports

[ https://issues.apache.org/jira/browse/HDFS-9484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9484: Description: In {{NNThroughputBenchmark$BlockReportStats#formBlockReport()}}, the {{blockReportList}

[jira] [Updated] (HDFS-9484) NNThroughputBenchmark$BlockReportStats should not send empty block reports

[ https://issues.apache.org/jira/browse/HDFS-9484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9484: Description: There are two potential bugs that make the {{NNThroughputBenchmark$BlockReportStats}} s

[jira] [Commented] (HDFS-8905) Refactor DFSInputStream#ReaderStrategy

[ https://issues.apache.org/jira/browse/HDFS-8905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15032701#comment-15032701 ] Zhe Zhang commented on HDFS-8905: - Thanks Kai for the update. The new patch looks reasonabl

[jira] [Updated] (HDFS-8957) Consolidate client striping input stream codes for stateful read and positional read

[ https://issues.apache.org/jira/browse/HDFS-8957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8957: Fix Version/s: (was: HDFS-7285) > Consolidate client striping input stream codes for stateful read and >

[jira] [Commented] (HDFS-9484) NNThroughputBenchmark$BlockReportStats should not send empty block reports

[ https://issues.apache.org/jira/browse/HDFS-9484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15032704#comment-15032704 ] Mingliang Liu commented on HDFS-9484: - Thanks [~cmccabe] for your confirmation. I updat

[jira] [Updated] (HDFS-8957) Consolidate client striping input stream codes for stateful read and positional read

[ https://issues.apache.org/jira/browse/HDFS-8957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8957: Component/s: erasure-coding > Consolidate client striping input stream codes for stateful read and > positio

[jira] [Commented] (HDFS-9470) Encryption zone on root not loaded from fsimage after NN restart

[ https://issues.apache.org/jira/browse/HDFS-9470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15032707#comment-15032707 ] Xiao Chen commented on HDFS-9470: - Thanks [~andrew.wang] for committing and resolving cherr

[jira] [Commented] (HDFS-9436) Make NNThroughputBenchmark$BlockReportStats run with 10 datanodes by default

[ https://issues.apache.org/jira/browse/HDFS-9436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15032708#comment-15032708 ] Mingliang Liu commented on HDFS-9436: - I updated the JIRA [HDFS-9484] to track the effo

[jira] [Commented] (HDFS-6533) intermittent org.apache.hadoop.hdfs.server.datanode.TestBPOfferService.testBasicFunctionalitytest failure

[ https://issues.apache.org/jira/browse/HDFS-6533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15032716#comment-15032716 ] Arpit Agarwal commented on HDFS-6533: - Thanks for taking this up [~jojochuang]. Inste

[jira] [Created] (HDFS-9486) Valgrind failures when using more than 1 io_service worker thread.

James Clampffer created HDFS-9486: - Summary: Valgrind failures when using more than 1 io_service worker thread. Key: HDFS-9486 URL: https://issues.apache.org/jira/browse/HDFS-9486 Project: Hadoop HDFS

[jira] [Commented] (HDFS-9381) When same block came for replication for Striped mode, we can move that block to PendingReplications

[ https://issues.apache.org/jira/browse/HDFS-9381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15032723#comment-15032723 ] Jing Zhao commented on HDFS-9381: - Thanks for the discussion, Uma and Zhe! bq. To determin

[jira] [Created] (HDFS-9487) libhdfs++ Enable builds with no compiler optimizations

James Clampffer created HDFS-9487: - Summary: libhdfs++ Enable builds with no compiler optimizations Key: HDFS-9487 URL: https://issues.apache.org/jira/browse/HDFS-9487 Project: Hadoop HDFS Is

[jira] [Commented] (HDFS-9487) libhdfs++ Enable builds with no compiler optimizations

[ https://issues.apache.org/jira/browse/HDFS-9487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15032738#comment-15032738 ] Bob Hansen commented on HDFS-9487: -- http://unix.stackexchange.com/questions/187455/how-to-

[jira] [Commented] (HDFS-8791) block ID-based DN storage layout can be very slow for datanode on ext4

[ https://issues.apache.org/jira/browse/HDFS-8791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15032740#comment-15032740 ] Chris Trezzo commented on HDFS-8791: I am finishing up the unit test and will post it l

[jira] [Commented] (HDFS-9485) Make BlockManager#removeFromExcessReplicateMap accept BlockInfo instead of Block

[ https://issues.apache.org/jira/browse/HDFS-9485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15032745#comment-15032745 ] Jing Zhao commented on HDFS-9485: - The patch looks good to me. +1 pending Jenkins. > Make

[jira] [Commented] (HDFS-8647) Abstract BlockManager's rack policy into BlockPlacementPolicy

[ https://issues.apache.org/jira/browse/HDFS-8647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15032747#comment-15032747 ] Zhe Zhang commented on HDFS-8647: - [~brahmareddy] [~mingma] [~walter.k.su] I wonder whether

[jira] [Updated] (HDFS-9449) DiskBalancer : Add connectors

[ https://issues.apache.org/jira/browse/HDFS-9449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-9449: --- Attachment: HDFS-9449-HDFS-1312.003.patch Thank for the review [~szetszwo]. I have addressed all your c

[jira] [Commented] (HDFS-8986) Add option to -du to calculate directory space usage excluding snapshots

[ https://issues.apache.org/jira/browse/HDFS-8986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15032762#comment-15032762 ] Chris Nauroth commented on HDFS-8986: - I see {{-du}} mentioned here. I recommend that

[jira] [Commented] (HDFS-8986) Add option to -du to calculate directory space usage excluding snapshots

[ https://issues.apache.org/jira/browse/HDFS-8986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15032770#comment-15032770 ] Chris Nauroth commented on HDFS-8986: - Within the scope of this JIRA, I also suggest th

[jira] [Commented] (HDFS-8986) Add option to -du to calculate directory space usage excluding snapshots

[ https://issues.apache.org/jira/browse/HDFS-8986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15032786#comment-15032786 ] Gautam Gopalakrishnan commented on HDFS-8986: - I feel I should invert the reque

[jira] [Commented] (HDFS-8986) Add option to -du to calculate directory space usage excluding snapshots

[ https://issues.apache.org/jira/browse/HDFS-8986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15032805#comment-15032805 ] Chris Nauroth commented on HDFS-8986: - I don't think we can change the default behavior

  1   2   >