[jira] [Created] (HDFS-14228) Incorrect getSnapshottableDirListing() javadoc

Wei-Chiu Chuang created HDFS-14228: -- Summary: Incorrect getSnapshottableDirListing() javadoc Key: HDFS-14228 URL: https://issues.apache.org/jira/browse/HDFS-14228 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-14194) Mention HDFS ACL incompatible changes more explicitly

Wei-Chiu Chuang created HDFS-14194: -- Summary: Mention HDFS ACL incompatible changes more explicitly Key: HDFS-14194 URL: https://issues.apache.org/jira/browse/HDFS-14194 Project: Hadoop HDFS

[jira] [Created] (HDFS-14176) Replace incorrect use of system property user.name

Wei-Chiu Chuang created HDFS-14176: -- Summary: Replace incorrect use of system property user.name Key: HDFS-14176 URL: https://issues.apache.org/jira/browse/HDFS-14176 Project: Hadoop HDFS

Re:

+Hdfs-dev Hi Shuubham, Just like to clarify a bit. What's the purpose of this work? Is this for the general block placement policy in HDFS, or the balancer/mover/diskbalancer, or decommissioning/recommissioning? Block placement is determined by NameNode. Do you intend to shorten the time to

Changing RPC SASL options without full cluster restart?

Hi fellow Hadoop developers, Do you know a way to change RPC SASL options without full cluster restart? (that is, rolling restart)? For example, enabling RPC encryption? Currently if you try to do rolling restart after enabling RPC encryption, applications such as HBase would fail to connect to

Re: [DISCUSS] Hadoop RPC encryption performance improvements

ing my comments, both > use blocking IO (obvious nonstarter). HADOOP-10768 is a hand rolled > TLS-like encryption which I don't feel is something the community can or > should maintain from a security standpoint. > > Daryn > > On Wed, Oct 31, 2018 at 8:43 AM Wei-Chiu Chu

[jira] [Created] (HDFS-14126) DataNode DirectoryScanner holding global lock for too long

Wei-Chiu Chuang created HDFS-14126: -- Summary: DataNode DirectoryScanner holding global lock for too long Key: HDFS-14126 URL: https://issues.apache.org/jira/browse/HDFS-14126 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-8533) Mismatch in displaying the "MissingBlock" count in fsck and in other metric reports

[ https://issues.apache.org/jira/browse/HDFS-8533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-8533. --- Resolution: Duplicate I'm going to resolve this jira because HDFS-10213 fixed the bug

[jira] [Created] (HDFS-14122) KMS Benchmark Tool

Wei-Chiu Chuang created HDFS-14122: -- Summary: KMS Benchmark Tool Key: HDFS-14122 URL: https://issues.apache.org/jira/browse/HDFS-14122 Project: Hadoop HDFS Issue Type: Improvement

Re: RPC connect error when using kerberos Auth

Not sure about integrity -- I've seen very few if at all installations with integrity option enabled. Regarding privacy -- have you made sure both client and server enabled SASL privacy? Both sides must have consistent RPC settings for them to talk. On Wed, Nov 28, 2018 at 12:58 AM ZongtianHou

Re: [DISCUSS] Hadoop RPC encryption performance improvements

> > helps. > > > > > > The two cited jiras had some critical flaws. Skimming my comments, > both > > > use blocking IO (obvious nonstarter). HADOOP-10768 is a hand rolled > > > TLS-like encryption which I don't feel is something the community can > or

Re: [DISCUSS] Hadoop RPC encryption performance improvements

Ping. Any one? Cloudera is interested in moving forward with the RPC encryption improvements, but I just like to get a consensus which approach to go with. Otherwise I'll pick HADOOP-10768 since it's ready for commit, and I've spent time on testing it. On Thu, Oct 25, 2018 at 11:04 AM Wei-Chiu

[DISCUSS] Hadoop RPC encryption performance improvements

Folks, I would like to invite all to discuss the various Hadoop RPC encryption performance improvements. As you probably know, Hadoop RPC encryption currently relies on Java SASL, and have _really_ bad performance (in terms of number of RPCs per second, around 15~20% of the one without SASL)

[jira] [Resolved] (HDFS-14018) Compilation fails in branch-3.0

[ https://issues.apache.org/jira/browse/HDFS-14018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-14018. Resolution: Done > Compilation fails in branch-

HDFS Native tests are broken

Folks, Looks like a bunch of native tests are failing consistently. Looking back the earliest failure I saw was from a precommit job for HDFS-1915 in October 3rd. Some tests failed miserably with JVM crash error. @Pranay Singh is trying to

[jira] [Reopened] (HDFS-13941) make storageId in BlockPoolTokenSecretManager.checkAccess optional

[ https://issues.apache.org/jira/browse/HDFS-13941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reopened HDFS-13941: Hello [~ajayydv] thanks for your patch. Looks like branch-3.0 doesn't compile after

Re: Hadoop 3.2 Release Plan proposal

Thanks Sunil G for driving the release, I filed HADOOP-15866 for a compat fix. If any one has cycle please review it, as I think it is needed for 3.2.0. On Thu, Oct 18, 2018 at 4:43 AM Sunil G wrote: > Hi Folks, > > As we previously

[jira] [Created] (HDFS-13999) Bogus missing block warning if the file is under construction when NN starts

Wei-Chiu Chuang created HDFS-13999: -- Summary: Bogus missing block warning if the file is under construction when NN starts Key: HDFS-13999 URL: https://issues.apache.org/jira/browse/HDFS-13999

[DISCUSS] Deprecate fuse-dfs

Hi fellow Hadoop developers, I want to start this thread to raise the awareness of the quality of fuse-dfs. It appears that this sub-component is not being developed and maintained, and appears not many are using it. In the past two years, there has been only one bug fixed (HDFS-13322).

Re: NN run progressively slower

Yiqun, Is this related to HDFS-9260? Note that HDFS-9260 was backported since CDH5.7 and above. I'm interested to learn more. Did you observe clients failing to close file due to insufficient number of block replicas? Did NN fail over? Did you have gc logging enabled? Any chance to take a heap

[jira] [Resolved] (HDFS-13830) Backport HDFS-13141 to branch-3.0: WebHDFS: Add support for getting snasphottable directory list

[ https://issues.apache.org/jira/browse/HDFS-13830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-13830. Resolution: Fixed Fix Version/s: 3.0.4 Pushed to branch-3.0. Thanks [~smeng

[jira] [Reopened] (HDFS-13831) Make block increment deletion number configurable

[ https://issues.apache.org/jira/browse/HDFS-13831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reopened HDFS-13831: Sorry to reopen. There are minor code conflicts in branch-3.0. Will attach branch-3.0 patch

[jira] [Resolved] (HDFS-3584) Blocks are getting marked as corrupt with append operation under high load.

[ https://issues.apache.org/jira/browse/HDFS-3584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-3584. --- Resolution: Duplicate Target Version/s: (was: ) Close this one. Thanks

[jira] [Resolved] (HDFS-8718) Block replicating cannot work after upgrading to 2.7

[ https://issues.apache.org/jira/browse/HDFS-8718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-8718. --- Resolution: Duplicate Thanks [~hexiaoqiao] for identifying the duplicates

[jira] [Created] (HDFS-13758) DatanodeManager should throw exception if it has BlockRecoveryCommand but the block is not under construction

Wei-Chiu Chuang created HDFS-13758: -- Summary: DatanodeManager should throw exception if it has BlockRecoveryCommand but the block is not under construction Key: HDFS-13758 URL: https://issues.apache.org/jira

[jira] [Created] (HDFS-13757) After HDFS-12886, close() can throw AssertionError "Negative replicas!"

Wei-Chiu Chuang created HDFS-13757: -- Summary: After HDFS-12886, close() can throw AssertionError "Negative replicas!" Key: HDFS-13757 URL: https://issues.apache.org/jira/browse/HDFS-13757

[jira] [Created] (HDFS-13738) fsck -list-corruptfileblocks has infinite loop if user is not privileged.

Wei-Chiu Chuang created HDFS-13738: -- Summary: fsck -list-corruptfileblocks has infinite loop if user is not privileged. Key: HDFS-13738 URL: https://issues.apache.org/jira/browse/HDFS-13738 Project

[jira] [Created] (HDFS-13730) BlockReaderRemote.sendReadResult throws NPE

Wei-Chiu Chuang created HDFS-13730: -- Summary: BlockReaderRemote.sendReadResult throws NPE Key: HDFS-13730 URL: https://issues.apache.org/jira/browse/HDFS-13730 Project: Hadoop HDFS Issue

Re: [VOTE] reset/force push to clean up inadvertent merge commit pushed to trunk

I'm sorry I come to this thread late. Anu commented on INFRA-16727 saying he reverted the commit. Do we still need the vote? Thanks On Thu, Jul 5, 2018 at 2:47 PM Rohith Sharma K S wrote: > +1 > > On 5 July 2018 at 14:37, Subru Krishnan wrote: > > > Folks, > > > > There was a merge commit

[jira] [Created] (HDFS-13672) clearCorruptLazyPersistFiles could crash NameNode

Wei-Chiu Chuang created HDFS-13672: -- Summary: clearCorruptLazyPersistFiles could crash NameNode Key: HDFS-13672 URL: https://issues.apache.org/jira/browse/HDFS-13672 Project: Hadoop HDFS

[jira] [Created] (HDFS-13667) Typo: Marking all "datandoes" as stale

Wei-Chiu Chuang created HDFS-13667: -- Summary: Typo: Marking all "datandoes" as stale Key: HDFS-13667 URL: https://issues.apache.org/jira/browse/HDFS-13667 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-13638) DataNode Can't replicate block because NameNode thinks the length is 9223372036854775807

[ https://issues.apache.org/jira/browse/HDFS-13638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-13638. Resolution: Duplicate Okay I think this is fixed by HDFS-10453. Resolve this jira. Thanks

[jira] [Created] (HDFS-13662) TestBlockReaderLocal#testStatisticsForErasureCodingRead is flaky

Wei-Chiu Chuang created HDFS-13662: -- Summary: TestBlockReaderLocal#testStatisticsForErasureCodingRead is flaky Key: HDFS-13662 URL: https://issues.apache.org/jira/browse/HDFS-13662 Project: Hadoop

[jira] [Created] (HDFS-13659) Add more test coverage for contentSummary for snapshottable path

Wei-Chiu Chuang created HDFS-13659: -- Summary: Add more test coverage for contentSummary for snapshottable path Key: HDFS-13659 URL: https://issues.apache.org/jira/browse/HDFS-13659 Project: Hadoop

[jira] [Created] (HDFS-13638) DataNode Can't replicate block because NameNode thinks the length is 9223372036854775807

Wei-Chiu Chuang created HDFS-13638: -- Summary: DataNode Can't replicate block because NameNode thinks the length is 9223372036854775807 Key: HDFS-13638 URL: https://issues.apache.org/jira/browse/HDFS-13638

[jira] [Created] (HDFS-13635) Incorrect message when block is not found

Wei-Chiu Chuang created HDFS-13635: -- Summary: Incorrect message when block is not found Key: HDFS-13635 URL: https://issues.apache.org/jira/browse/HDFS-13635 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-13613) RegionServer log is flooded with "Execution rejected, Executing in current thread"

Wei-Chiu Chuang created HDFS-13613: -- Summary: RegionServer log is flooded with "Execution rejected, Executing in current thread" Key: HDFS-13613 URL: https://issues.apache.org/jira/browse/

[jira] [Created] (HDFS-13612) Short-circuit read: unknown response code ERROR

Wei-Chiu Chuang created HDFS-13612: -- Summary: Short-circuit read: unknown response code ERROR Key: HDFS-13612 URL: https://issues.apache.org/jira/browse/HDFS-13612 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-6359) WebHdfs NN servlet issues redirects in safemode or standby

[ https://issues.apache.org/jira/browse/HDFS-6359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-6359. --- Resolution: Duplicate I believe this is a dup of HDFS-5122 > WebHdfs NN servlet iss

[jira] [Resolved] (HDFS-6371) In HA setup, the standby NN should redirect WebHDFS write requests to the active NN

[ https://issues.apache.org/jira/browse/HDFS-6371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-6371. --- Resolution: Duplicate I believe this is a dup of HDFS-5122 > In HA setup, the standby

[jira] [Resolved] (HDFS-4702) remove namesystem lock from DatanodeManager#fetchDatanodes

[ https://issues.apache.org/jira/browse/HDFS-4702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-4702. --- Resolution: Duplicate Target Version/s: (was: ) Looking at code, this lock

[jira] [Resolved] (HDFS-5123) Hftp should support namenode logical service names in URI

[ https://issues.apache.org/jira/browse/HDFS-5123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-5123. --- Resolution: Won't Fix hftp is deprecated and removed in Hadoop3. Resolve it as won't fix

[jira] [Resolved] (HDFS-8406) Lease recovery continually failed

[ https://issues.apache.org/jira/browse/HDFS-8406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-8406. --- Resolution: Duplicate > Lease recovery continually fai

Re: Apache Hadoop 3.0.3 Release plan

Thanks Yongjun for driving 3.0.3 release! IMHO, could we consider adding YARN-7190 into the list? I understand that it is listed as an incompatible change, however, because of this bug, HBase considers the entire Hadoop 3.0.x line not production

Re: [DISCUSSION] Create a branch to work on non-blocking access to HDFS

Given that HBase 2 uses async output by default, the way that code is maintained today in HBase is not sustainable. That piece of code should be maintained in HDFS. I am +1 as a participant in both communities. On Thu, May 3, 2018 at 9:14 AM, Stack wrote: > Ok with you lot if

[jira] [Created] (HDFS-13524) Occasional "All datanodes are bad" error in TestLargeBlock#testLargeBlockSize

Wei-Chiu Chuang created HDFS-13524: -- Summary: Occasional "All datanodes are bad" error in TestLargeBlock#testLargeBlockSize Key: HDFS-13524 URL: https://issues.apache.org/jira/browse/

[jira] [Resolved] (HDFS-6589) TestDistributedFileSystem.testAllWithNoXmlDefaults failed intermittently

[ https://issues.apache.org/jira/browse/HDFS-6589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-6589. --- Resolution: Cannot Reproduce Resolve as cannot reproduce. The last time I see this bug was 2

[jira] [Created] (HDFS-13521) NFS Gateway should support impersonation

Wei-Chiu Chuang created HDFS-13521: -- Summary: NFS Gateway should support impersonation Key: HDFS-13521 URL: https://issues.apache.org/jira/browse/HDFS-13521 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-13520) fuse_dfs to support keytab based login

Wei-Chiu Chuang created HDFS-13520: -- Summary: fuse_dfs to support keytab based login Key: HDFS-13520 URL: https://issues.apache.org/jira/browse/HDFS-13520 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-13492) Limit httpfs binds to certain IP addresses in branch-2

Wei-Chiu Chuang created HDFS-13492: -- Summary: Limit httpfs binds to certain IP addresses in branch-2 Key: HDFS-13492 URL: https://issues.apache.org/jira/browse/HDFS-13492 Project: Hadoop HDFS

[jira] [Created] (HDFS-13487) Backport HDFS-11915 to branch-2.8, branch-2.7

Wei-Chiu Chuang created HDFS-13487: -- Summary: Backport HDFS-11915 to branch-2.8, branch-2.7 Key: HDFS-13487 URL: https://issues.apache.org/jira/browse/HDFS-13487 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-13486) Backport HDFS-11817 to branch-2.7

Wei-Chiu Chuang created HDFS-13486: -- Summary: Backport HDFS-11817 to branch-2.7 Key: HDFS-13486 URL: https://issues.apache.org/jira/browse/HDFS-13486 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-13485) DataNode WebUI throws NPE

Wei-Chiu Chuang created HDFS-13485: -- Summary: DataNode WebUI throws NPE Key: HDFS-13485 URL: https://issues.apache.org/jira/browse/HDFS-13485 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-13440) Log HDFS file name when client fails to connect

Wei-Chiu Chuang created HDFS-13440: -- Summary: Log HDFS file name when client fails to connect Key: HDFS-13440 URL: https://issues.apache.org/jira/browse/HDFS-13440 Project: Hadoop HDFS

Re: Apache Hadoop 2.9.1 Release Plan

Done. Both HDFS-11915 and HDFS-13364 are in branch-2.9 and branch-2.9.1. Thank you Sammi for driving 2.9.1 release On Fri, Apr 6, 2018 at 10:14 AM, Wei-Chiu Chuang <weic...@cloudera.com> wrote: > >1. > Looks like: >2. HDFS-13347 <https://issues.apache.org/j

Re: Apache Hadoop 2.9.1 Release Plan

.1 release. > > Would you help to cherry-pick it to both branch-2.9 and branch-2.9.1? > > > Thanks, > Sammi > > -Original Message- > From: Wei-Chiu Chuang [mailto:weic...@cloudera.com] > Sent: Thursday, April 5, 2018 1:30 AM > To: Chen, Sammi <sammi.c...

Re: Apache Hadoop 2.9.1 Release Plan

Sorry Sammi I was late to this thread. Please considering incorporating HDFS-11915. Sync rbw dir on the first hsync() to avoid file lost on power failure. I thought it was already in 2.9.1 but turns out it didn't land. The cherry pick to branch-2.9 is conflict free. On Mon, Apr 2, 2018 at 4:34

[jira] [Created] (HDFS-13393) Improve OOM logging

Wei-Chiu Chuang created HDFS-13393: -- Summary: Improve OOM logging Key: HDFS-13393 URL: https://issues.apache.org/jira/browse/HDFS-13393 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Resolved] (HDFS-12165) getSnapshotDiffReport throws NegativeArraySizeException for very large snapshot diff summary

[ https://issues.apache.org/jira/browse/HDFS-12165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-12165. Resolution: Duplicate > getSnapshotDiffReport throws NegativeArraySizeException for v

[jira] [Created] (HDFS-13363) Record file path when FSDirAclOp throws AclException

Wei-Chiu Chuang created HDFS-13363: -- Summary: Record file path when FSDirAclOp throws AclException Key: HDFS-13363 URL: https://issues.apache.org/jira/browse/HDFS-13363 Project: Hadoop HDFS

[jira] [Created] (HDFS-13357) Improve AclException message "Invalid ACL: only directories may have a default ACL."

Wei-Chiu Chuang created HDFS-13357: -- Summary: Improve AclException message "Invalid ACL: only directories may have a default ACL." Key: HDFS-13357 URL: https://issues.apache.org/jira/browse/

Re: [VOTE] Adopt HDSL as a new Hadoop subproject

+1 (binding) Happy to see the community converge on a proposal. On Fri, Mar 23, 2018 at 11:18 AM, Andrew Wang wrote: > +1 > > If this VOTE is to gather consensus about establishing a new subproject, > let's definitely proceed with that. > > It sounds like we're

[jira] [Created] (HDFS-13330) Clean up dead code

Wei-Chiu Chuang created HDFS-13330: -- Summary: Clean up dead code Key: HDFS-13330 URL: https://issues.apache.org/jira/browse/HDFS-13330 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Resolved] (HDFS-10992) file is under construction but no leases found

[ https://issues.apache.org/jira/browse/HDFS-10992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-10992. Resolution: Duplicate > file is under construction but no leases fo

[jira] [Created] (HDFS-13103) HDFS Client write acknowledgement timeout should not depend on read timeout

Wei-Chiu Chuang created HDFS-13103: -- Summary: HDFS Client write acknowledgement timeout should not depend on read timeout Key: HDFS-13103 URL: https://issues.apache.org/jira/browse/HDFS-13103

[jira] [Created] (HDFS-13040) Kerberized inotify client fails despite kinit properly

Wei-Chiu Chuang created HDFS-13040: -- Summary: Kerberized inotify client fails despite kinit properly Key: HDFS-13040 URL: https://issues.apache.org/jira/browse/HDFS-13040 Project: Hadoop HDFS

Re: [VOTE] Release Apache Hadoop 3.0.0 RC1

Hi Andrew, thanks the tremendous effort. I found an empty "patchprocess" directory in the source tarball, that is not there if you clone from github. Any chance you might have some leftover trash when you made the tarball? Not wanting to nitpicking, but you might want to double check so we don't

[jira] [Created] (HDFS-12915) Fix findbugs warning in INodeFile$HeaderFormat.getBlockLayoutRedundancy

Wei-Chiu Chuang created HDFS-12915: -- Summary: Fix findbugs warning in INodeFile$HeaderFormat.getBlockLayoutRedundancy Key: HDFS-12915 URL: https://issues.apache.org/jira/browse/HDFS-12915 Project

Re: [VOTE] Release Apache Hadoop 3.0.0 RC0

@vinod I followed your command but I could not reproduce your problem. [weichiu@storage-1 hadoop-3.0.0-src]$ ls -al hadoop-common-project/hadoop-c ommon/target/hadoop-common-3.0.0.tar.gz -rw-rw-r-- 1 weichiu weichiu 37052439 Nov 20 21:59

Re: [DISCUSS] Apache Hadoop 2.7.5 Release Plan

Hi Konstantin, Thanks for initiating the release effort. I am marking HDFS-12641 as a blocker for Hadoop 2.7.5 because during our internal testing for CDH we found a regression in HDFS-11445 that was fixed by HDFS-11755 (technically not a real

[jira] [Resolved] (HDFS-12820) Decommissioned datanode is counted in service cause datanode allcating failure

[ https://issues.apache.org/jira/browse/HDFS-12820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-12820. Resolution: Duplicate Thanks for reporting the issue, [~xiegang112]. Hadoop 2.4.0 is an old

[jira] [Created] (HDFS-12737) Thousands of sockets lingering in TIME_WAIT state due to frequent file open operations

Wei-Chiu Chuang created HDFS-12737: -- Summary: Thousands of sockets lingering in TIME_WAIT state due to frequent file open operations Key: HDFS-12737 URL: https://issues.apache.org/jira/browse/HDFS-12737

[jira] [Resolved] (HDFS-12676) when blocks has corrupted replicas，throws Exception

[ https://issues.apache.org/jira/browse/HDFS-12676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-12676. Resolution: Duplicate Resolving it as a dup. Thanks @lynn for reporting it. > when blo

[jira] [Created] (HDFS-12644) Offer a non-privileged listEncryptionZone operation

Wei-Chiu Chuang created HDFS-12644: -- Summary: Offer a non-privileged listEncryptionZone operation Key: HDFS-12644 URL: https://issues.apache.org/jira/browse/HDFS-12644 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-11797) BlockManager#createLocatedBlocks() can throw ArrayIndexOutofBoundsException when corrupt replicas are inconsistent

[ https://issues.apache.org/jira/browse/HDFS-11797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-11797. Resolution: Duplicate I'm going to close it as a dup of HDFS-11445. Feel free to reopen

[jira] [Resolved] (HDFS-12630) Rolling restart can create inconsistency between blockMap and corrupt replicas map

[ https://issues.apache.org/jira/browse/HDFS-12630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-12630. Resolution: Duplicate > Rolling restart can create inconsistency between block

[jira] [Created] (HDFS-12641) Backport HDFS-11755 into branch-2.7 to fix a regression in HDFS-11755

Wei-Chiu Chuang created HDFS-12641: -- Summary: Backport HDFS-11755 into branch-2.7 to fix a regression in HDFS-11755 Key: HDFS-12641 URL: https://issues.apache.org/jira/browse/HDFS-12641 Project

[jira] [Created] (HDFS-12619) Do not catch and throw unchecked exceptions if IBRs fail to process

Wei-Chiu Chuang created HDFS-12619: -- Summary: Do not catch and throw unchecked exceptions if IBRs fail to process Key: HDFS-12619 URL: https://issues.apache.org/jira/browse/HDFS-12619 Project

[jira] [Created] (HDFS-12485) expunge may not remove trash from non-home directory encryption zone

Wei-Chiu Chuang created HDFS-12485: -- Summary: expunge may not remove trash from non-home directory encryption zone Key: HDFS-12485 URL: https://issues.apache.org/jira/browse/HDFS-12485 Project

[jira] [Created] (HDFS-12484) hdfs dfs -expunge requires superuser permission after 2.8

Wei-Chiu Chuang created HDFS-12484: -- Summary: hdfs dfs -expunge requires superuser permission after 2.8 Key: HDFS-12484 URL: https://issues.apache.org/jira/browse/HDFS-12484 Project: Hadoop HDFS

If primary replica is unresponsive, hsync() hangs

Hello my dear HDFS dev colleagues, It appears that when a dfs client writes and hsync(), and if the primary replica (that is, the first DataNode in the write pipeline) is unresponsive to the hsync() request, the hsync() would wait at DataStreamer#waitForAckedSeqno(). In one scenario, we saw this

[jira] [Created] (HDFS-12372) Document the impact of HDFS-11069 (Tighten the authorization of datanode RPC)

Wei-Chiu Chuang created HDFS-12372: -- Summary: Document the impact of HDFS-11069 (Tighten the authorization of datanode RPC) Key: HDFS-12372 URL: https://issues.apache.org/jira/browse/HDFS-12372

[jira] [Created] (HDFS-12293) DataNode should log file name on disk error

Wei-Chiu Chuang created HDFS-12293: -- Summary: DataNode should log file name on disk error Key: HDFS-12293 URL: https://issues.apache.org/jira/browse/HDFS-12293 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-12279) TestPipelinesFailover#testPipelineRecoveryStress fails due to race condition

Wei-Chiu Chuang created HDFS-12279: -- Summary: TestPipelinesFailover#testPipelineRecoveryStress fails due to race condition Key: HDFS-12279 URL: https://issues.apache.org/jira/browse/HDFS-12279

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

Hi, I'm sorry coming to this vote late. Daryn mentioned in HDFS-12136 that HDFS-11160 has a performance regression at DataNode due to the way it locks dataset lock. HDFS-11160 is in Hadoop 2.7.4.

Re: How to restore data from HDFS rm -skipTrash

If the directory has snapshot enabled, the file can be retrieved from the past snapshots. Otherwise, the file inodes are removed from namenode metadata, and blocks are scheduled for deletion. You might want to play with edit log a bit. Remove the delete entries from edit logs. But it's hacky and

[jira] [Created] (HDFS-12249) dfsadmin -metaSave to output maintenance mode blocks

Wei-Chiu Chuang created HDFS-12249: -- Summary: dfsadmin -metaSave to output maintenance mode blocks Key: HDFS-12249 URL: https://issues.apache.org/jira/browse/HDFS-12249 Project: Hadoop HDFS

[jira] [Created] (HDFS-12245) Update INodeId javadoc

Wei-Chiu Chuang created HDFS-12245: -- Summary: Update INodeId javadoc Key: HDFS-12245 URL: https://issues.apache.org/jira/browse/HDFS-12245 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-12243) Trash emptier should use Time.monotonicNow()

Wei-Chiu Chuang created HDFS-12243: -- Summary: Trash emptier should use Time.monotonicNow() Key: HDFS-12243 URL: https://issues.apache.org/jira/browse/HDFS-12243 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-12241) HttpFS to support overloaded FileSystem#rename API

Wei-Chiu Chuang created HDFS-12241: -- Summary: HttpFS to support overloaded FileSystem#rename API Key: HDFS-12241 URL: https://issues.apache.org/jira/browse/HDFS-12241 Project: Hadoop HDFS

[jira] [Created] (HDFS-12240) Document WebHDFS rename API parameter renameoptions

Wei-Chiu Chuang created HDFS-12240: -- Summary: Document WebHDFS rename API parameter renameoptions Key: HDFS-12240 URL: https://issues.apache.org/jira/browse/HDFS-12240 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-10799) NameNode should use loginUser(hdfs) to serve iNotify requests

[ https://issues.apache.org/jira/browse/HDFS-10799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-10799. Resolution: Won't Fix Close this jira because the proposed solution does not seem

[jira] [Created] (HDFS-12186) Add INodeAttributeProvider startup progress into HDFS Web UI

Wei-Chiu Chuang created HDFS-12186: -- Summary: Add INodeAttributeProvider startup progress into HDFS Web UI Key: HDFS-12186 URL: https://issues.apache.org/jira/browse/HDFS-12186 Project: Hadoop HDFS

[jira] [Created] (HDFS-12176) dfsadmin shows DFS Used%: NaN% if the cluster has zero block.

Wei-Chiu Chuang created HDFS-12176: -- Summary: dfsadmin shows DFS Used%: NaN% if the cluster has zero block. Key: HDFS-12176 URL: https://issues.apache.org/jira/browse/HDFS-12176 Project: Hadoop HDFS

[jira] [Created] (HDFS-12165) getSnapshotDiffReport throws NegativeArraySizeException for very large snapshot diff summary

Wei-Chiu Chuang created HDFS-12165: -- Summary: getSnapshotDiffReport throws NegativeArraySizeException for very large snapshot diff summary Key: HDFS-12165 URL: https://issues.apache.org/jira/browse/HDFS-12165

[jira] [Created] (HDFS-12112) TestBlockManager#testBlockManagerMachinesArray sometimes fails with NPE

Wei-Chiu Chuang created HDFS-12112: -- Summary: TestBlockManager#testBlockManagerMachinesArray sometimes fails with NPE Key: HDFS-12112 URL: https://issues.apache.org/jira/browse/HDFS-12112 Project

[jira] [Created] (HDFS-12062) removeErasureCodingPolicy needs super user permission

Wei-Chiu Chuang created HDFS-12062: -- Summary: removeErasureCodingPolicy needs super user permission Key: HDFS-12062 URL: https://issues.apache.org/jira/browse/HDFS-12062 Project: Hadoop HDFS

[jira] [Created] (HDFS-12061) Add TraceScope for multiple DFSClient EC operations

Wei-Chiu Chuang created HDFS-12061: -- Summary: Add TraceScope for multiple DFSClient EC operations Key: HDFS-12061 URL: https://issues.apache.org/jira/browse/HDFS-12061 Project: Hadoop HDFS

[jira] [Created] (HDFS-12036) Add audit log for getErasureCodingPolicy, getErasureCodingPolicies, getErasureCodingCodecs

Wei-Chiu Chuang created HDFS-12036: -- Summary: Add audit log for getErasureCodingPolicy, getErasureCodingPolicies, getErasureCodingCodecs Key: HDFS-12036 URL: https://issues.apache.org/jira/browse/HDFS-12036

[jira] [Resolved] (HDFS-11661) GetContentSummary uses excessive amounts of memory

[ https://issues.apache.org/jira/browse/HDFS-11661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-11661. Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.1

<    1   2   3   4   5   6   7   8   >