[jira] [Created] (HDFS-12186) Add INodeAttributeProvider startup progress into HDFS Web UI

2017-07-21 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-12186: -- Summary: Add INodeAttributeProvider startup progress into HDFS Web UI Key: HDFS-12186 URL: https://issues.apache.org/jira/browse/HDFS-12186 Project: Hadoop HDFS

[jira] [Created] (HDFS-12176) dfsadmin shows DFS Used%: NaN% if the cluster has zero block.

2017-07-20 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-12176: -- Summary: dfsadmin shows DFS Used%: NaN% if the cluster has zero block. Key: HDFS-12176 URL: https://issues.apache.org/jira/browse/HDFS-12176 Project: Hadoop HDFS

[jira] [Created] (HDFS-12165) getSnapshotDiffReport throws NegativeArraySizeException for very large snapshot diff summary

2017-07-19 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-12165: -- Summary: getSnapshotDiffReport throws NegativeArraySizeException for very large snapshot diff summary Key: HDFS-12165 URL: https://issues.apache.org/jira/browse/HDFS-12165

[jira] [Created] (HDFS-12112) TestBlockManager#testBlockManagerMachinesArray sometimes fails with NPE

2017-07-10 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-12112: -- Summary: TestBlockManager#testBlockManagerMachinesArray sometimes fails with NPE Key: HDFS-12112 URL: https://issues.apache.org/jira/browse/HDFS-12112 Project

[jira] [Created] (HDFS-12062) removeErasureCodingPolicy needs super user permission

2017-06-28 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-12062: -- Summary: removeErasureCodingPolicy needs super user permission Key: HDFS-12062 URL: https://issues.apache.org/jira/browse/HDFS-12062 Project: Hadoop HDFS

[jira] [Created] (HDFS-12061) Add TraceScope for multiple DFSClient EC operations

2017-06-28 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-12061: -- Summary: Add TraceScope for multiple DFSClient EC operations Key: HDFS-12061 URL: https://issues.apache.org/jira/browse/HDFS-12061 Project: Hadoop HDFS

[jira] [Created] (HDFS-12036) Add audit log for getErasureCodingPolicy, getErasureCodingPolicies, getErasureCodingCodecs

2017-06-26 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-12036: -- Summary: Add audit log for getErasureCodingPolicy, getErasureCodingPolicies, getErasureCodingCodecs Key: HDFS-12036 URL: https://issues.apache.org/jira/browse/HDFS-12036

[jira] [Resolved] (HDFS-11787) After HDFS-11515, -du still throws ConcurrentModificationException

2017-05-24 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-11787. Resolution: Fixed Assignee: Wei-Chiu Chuang Fix Version/s: 2.8.1

[jira] [Resolved] (HDFS-11661) GetContentSummary uses excessive amounts of memory

2017-05-24 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-11661. Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.1

[jira] [Created] (HDFS-11787) After HDFS-11515, -du still throws ConcurrentModificationException

2017-05-09 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-11787: -- Summary: After HDFS-11515, -du still throws ConcurrentModificationException Key: HDFS-11787 URL: https://issues.apache.org/jira/browse/HDFS-11787 Project: Hadoop

[jira] [Resolved] (HDFS-11515) -du throws ConcurrentModificationException

2017-05-09 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-11515. Resolution: Fixed > -du throws ConcurrentModificationExcept

[jira] [Reopened] (HDFS-11515) -du throws ConcurrentModificationException

2017-05-03 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reopened HDFS-11515: I ran du on a CDH5.11.0 + HDFS-11515 patch NameNode using a production cluster fsimage

[jira] [Created] (HDFS-11741) Long running balancer may fail due to expired DataEncryptionKey

2017-05-02 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-11741: -- Summary: Long running balancer may fail due to expired DataEncryptionKey Key: HDFS-11741 URL: https://issues.apache.org/jira/browse/HDFS-11741 Project: Hadoop

[jira] [Created] (HDFS-11705) BUG: Inconsistent storagespace for directory

2017-04-26 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-11705: -- Summary: BUG: Inconsistent storagespace for directory Key: HDFS-11705 URL: https://issues.apache.org/jira/browse/HDFS-11705 Project: Hadoop HDFS Issue

Re: HADOOP-14316: Switching from Findbugs to Spotbugs

2017-04-19 Thread Wei-Chiu Chuang
Hi Allen, That sounds scary. Would you mind to share the list of bugs that spotbugs found? Sounds like some of them may warrant new blockers jiras for Hadoop 3. Thank you, Wei-Chiu Chuang > On Apr 19, 2017, at 10:44 AM, Allen Wittenauer > wrote: > > HADOOP-14316 signature.asc

[jira] [Created] (HDFS-11633) FSImage load fallback may disable all erasure coding policies

2017-04-07 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-11633: -- Summary: FSImage load fallback may disable all erasure coding policies Key: HDFS-11633 URL: https://issues.apache.org/jira/browse/HDFS-11633 Project: Hadoop

[jira] [Created] (HDFS-11626) Deprecate oiv_legacy tool

2017-04-05 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-11626: -- Summary: Deprecate oiv_legacy tool Key: HDFS-11626 URL: https://issues.apache.org/jira/browse/HDFS-11626 Project: Hadoop HDFS Issue Type: Task

[jira] [Created] (HDFS-11598) Improve -setrep for Erasure Coded files

2017-03-30 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-11598: -- Summary: Improve -setrep for Erasure Coded files Key: HDFS-11598 URL: https://issues.apache.org/jira/browse/HDFS-11598 Project: Hadoop HDFS Issue Type

Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)

2017-03-21 Thread Wei-Chiu Chuang
-2.8.0-src.tar.gz is 33MB comparing to hadoop-2.7.3-src.tar.gz which is 18MB. So probably it’s the amount of changes made into Hadoop 2.8 makes such difference in size. Regards, Wei-Chiu Chuang > On Mar 21, 2017, at 9:39 AM, Akira Ajisaka wrote: > > Thanks Junping! > &

[jira] [Created] (HDFS-11526) Fix confusing block recovery message

2017-03-10 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-11526: -- Summary: Fix confusing block recovery message Key: HDFS-11526 URL: https://issues.apache.org/jira/browse/HDFS-11526 Project: Hadoop HDFS Issue Type: Bug

[jira] [Reopened] (HDFS-11499) Decommissioning stuck because of failing recovery

2017-03-10 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reopened HDFS-11499: Reopen the issue to submit the branch-2.8 patch > Decommissioning stuck because of fail

[jira] [Reopened] (HDFS-11486) Client close() should not fail fast if the last block is being decommissioned

2017-03-09 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reopened HDFS-11486: > Client close() should not fail fast if the last block is being decommissio

[jira] [Resolved] (HDFS-11486) Client close() should not fail fast if the last block is being decommissioned

2017-03-09 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-11486. Resolution: Duplicate The fix in HDFS-11499 also fixes this same bug. So close it as a dup

[jira] [Created] (HDFS-11515) -du throws ConcurrentModificationException

2017-03-08 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-11515: -- Summary: -du throws ConcurrentModificationException Key: HDFS-11515 URL: https://issues.apache.org/jira/browse/HDFS-11515 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-11486) Client close() should not fail fast if the last block is being decommissioned

2017-03-02 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-11486: -- Summary: Client close() should not fail fast if the last block is being decommissioned Key: HDFS-11486 URL: https://issues.apache.org/jira/browse/HDFS-11486

[jira] [Reopened] (HDFS-8498) Blocks can be committed with wrong size

2017-03-02 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reopened HDFS-8498: --- Sorry to reopen. Attach a branch-2.7 patch for precommit. > Blocks can be committed with wr

[jira] [Created] (HDFS-11472) Fix inconsistent replica size after a data pipeline failure

2017-02-28 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-11472: -- Summary: Fix inconsistent replica size after a data pipeline failure Key: HDFS-11472 URL: https://issues.apache.org/jira/browse/HDFS-11472 Project: Hadoop HDFS

[jira] [Created] (HDFS-11467) Add ErasureCodingPolicyManager section in OIV XML/ReverseXML and OEV tools

2017-02-27 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-11467: -- Summary: Add ErasureCodingPolicyManager section in OIV XML/ReverseXML and OEV tools Key: HDFS-11467 URL: https://issues.apache.org/jira/browse/HDFS-11467 Project

[jira] [Reopened] (HDFS-6804) race condition between transferring block and appending block causes "Unexpected checksum mismatch exception"

2017-02-15 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reopened HDFS-6804: --- [~brahmareddy] I haven't run the patch, but if you attach a patch I am happy to revi

[jira] [Resolved] (HDFS-6804) race condition between transferring block and appending block causes "Unexpected checksum mismatch exception"

2017-02-07 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-6804. --- Resolution: Duplicate > race condition between transferring block and appending block cau

[jira] [Created] (HDFS-11333) Namenode unable to start if plugins can not be found

2017-01-11 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-11333: -- Summary: Namenode unable to start if plugins can not be found Key: HDFS-11333 URL: https://issues.apache.org/jira/browse/HDFS-11333 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-11308) NameNode doFence state judgment problem

2017-01-10 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-11308. Resolution: Duplicate Thanks [~tangshangwen] and [~iwasakims] for filing the jira and

[jira] [Created] (HDFS-11306) Dump remaining edit logs from buffer if edit log can't be rolled.

2017-01-09 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-11306: -- Summary: Dump remaining edit logs from buffer if edit log can't be rolled. Key: HDFS-11306 URL: https://issues.apache.org/jira/browse/HDFS-11306 Project: H

[jira] [Created] (HDFS-11271) Typo in NameNode UI

2016-12-22 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-11271: -- Summary: Typo in NameNode UI Key: HDFS-11271 URL: https://issues.apache.org/jira/browse/HDFS-11271 Project: Hadoop HDFS Issue Type: Bug

Unnecessary FsDatasetImpl lock in FsVolumeImpl#getDfsUsed?

2016-12-19 Thread Wei-Chiu Chuang
hash table bpSlices is a ConcurrentHashMap so iteration over this object doesn’t need a lock. It also seems to be an overkill because the operation does not modify BlockPoolSlice object at all. I do not see extra benefits locking on FsDatasetImpl object. Thoughts? Wei-Chiu Chuang -- A very happy

[jira] [Created] (HDFS-11260) Slow writer threads are not stopped

2016-12-17 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-11260: -- Summary: Slow writer threads are not stopped Key: HDFS-11260 URL: https://issues.apache.org/jira/browse/HDFS-11260 Project: Hadoop HDFS Issue Type: Bug

[jira] [Resolved] (HDFS-11254) Standby NameNode may crash during failover if loading edits takes too long

2016-12-16 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-11254. Resolution: Duplicate I'm going to close it as HDFS-8865 can help eliminate this

[jira] [Created] (HDFS-11254) Failover may fail if loading edits takes too long

2016-12-15 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-11254: -- Summary: Failover may fail if loading edits takes too long Key: HDFS-11254 URL: https://issues.apache.org/jira/browse/HDFS-11254 Project: Hadoop HDFS

[jira] [Created] (HDFS-11229) HDFS-11056 failed to close meta file

2016-12-09 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-11229: -- Summary: HDFS-11056 failed to close meta file Key: HDFS-11229 URL: https://issues.apache.org/jira/browse/HDFS-11229 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-11225) NameNode crashed because deleteSnapshot held FSNamesystem lock too long

2016-12-08 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-11225: -- Summary: NameNode crashed because deleteSnapshot held FSNamesystem lock too long Key: HDFS-11225 URL: https://issues.apache.org/jira/browse/HDFS-11225 Project

[jira] [Created] (HDFS-11219) Lease is leaked if block has no replica and length > 0

2016-12-07 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-11219: -- Summary: Lease is leaked if block has no replica and length > 0 Key: HDFS-11219 URL: https://issues.apache.org/jira/browse/HDFS-11219 Project: Hadoop H

[jira] [Created] (HDFS-11187) Optimize last partial chunk checksum calculation for Finalized replica

2016-11-29 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-11187: -- Summary: Optimize last partial chunk checksum calculation for Finalized replica Key: HDFS-11187 URL: https://issues.apache.org/jira/browse/HDFS-11187 Project

[jira] [Created] (HDFS-11181) Fuse wrapper has a typo

2016-11-28 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-11181: -- Summary: Fuse wrapper has a typo Key: HDFS-11181 URL: https://issues.apache.org/jira/browse/HDFS-11181 Project: Hadoop HDFS Issue Type: Bug

[jira] [Resolved] (HDFS-11155) VolumeScanner should report the latest generation stamp of a bad replica

2016-11-19 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-11155. Resolution: Not A Problem It turns out the symptom described in this jira is part of HDFS

[jira] [Created] (HDFS-11160) VolumeScanner incorrectly reports good replicas as corrupt due to race condition

2016-11-19 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-11160: -- Summary: VolumeScanner incorrectly reports good replicas as corrupt due to race condition Key: HDFS-11160 URL: https://issues.apache.org/jira/browse/HDFS-11160

[jira] [Created] (HDFS-11155) VolumeScanner should report the latest generation stamp of a bad replica

2016-11-17 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-11155: -- Summary: VolumeScanner should report the latest generation stamp of a bad replica Key: HDFS-11155 URL: https://issues.apache.org/jira/browse/HDFS-11155 Project

[jira] [Created] (HDFS-11084) OIV ReverseXML processor does not recognize sticky bit

2016-11-01 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-11084: -- Summary: OIV ReverseXML processor does not recognize sticky bit Key: HDFS-11084 URL: https://issues.apache.org/jira/browse/HDFS-11084 Project: Hadoop HDFS

[jira] [Created] (HDFS-11070) NPE in BlockSender due to race condition

2016-10-27 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-11070: -- Summary: NPE in BlockSender due to race condition Key: HDFS-11070 URL: https://issues.apache.org/jira/browse/HDFS-11070 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-11066) Improve test coverage for Java coder/ISA-L native coder

2016-10-26 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-11066: -- Summary: Improve test coverage for Java coder/ISA-L native coder Key: HDFS-11066 URL: https://issues.apache.org/jira/browse/HDFS-11066 Project: Hadoop HDFS

[jira] [Created] (HDFS-11061) Fix dfs -count -t or update its documentation

2016-10-26 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-11061: -- Summary: Fix dfs -count -t or update its documentation Key: HDFS-11061 URL: https://issues.apache.org/jira/browse/HDFS-11061 Project: Hadoop HDFS Issue

Re: Apache Hadoop qbt Report: trunk+JDK8 on Linux/ppc64le

2016-10-25 Thread Wei-Chiu Chuang
It seems many tests are failing after HADOOP-13514. The failed tests are reproducible locally. > On Oct 25, 2016, at 11:53 AM, Apache Jenkins Server > wrote: > > For more details, see > https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/135/ > > [Oct 24, 2016 1:28:44 PM] (kihwal

[jira] [Created] (HDFS-11056) Concurrent append and read operations lead to checksum error

2016-10-25 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-11056: -- Summary: Concurrent append and read operations lead to checksum error Key: HDFS-11056 URL: https://issues.apache.org/jira/browse/HDFS-11056 Project: Hadoop HDFS

[jira] [Created] (HDFS-11055) Update log4j.properties for httpfs to imporve test logging

2016-10-25 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-11055: -- Summary: Update log4j.properties for httpfs to imporve test logging Key: HDFS-11055 URL: https://issues.apache.org/jira/browse/HDFS-11055 Project: Hadoop HDFS

[Erasure Coding] Java-based codec does not seem to reconstruct strips correctly

2016-10-21 Thread Wei-Chiu Chuang
ilures this way. But I think this is severe enough to become a blocker for the next Hadoop 3 alpha release. Best, Wei-Chiu Chuang A very happy Clouderan

[jira] [Created] (HDFS-11041) Unable to unregister FsDatasetState MBean if if DataNode is shutdown twice

2016-10-21 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-11041: -- Summary: Unable to unregister FsDatasetState MBean if if DataNode is shutdown twice Key: HDFS-11041 URL: https://issues.apache.org/jira/browse/HDFS-11041 Project

[jira] [Resolved] (HDFS-11019) Inconsistent number of corrupt replicas if a corrupt replica is reported multiple times

2016-10-20 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-11019. Resolution: Duplicate I am pretty sure this is a dup of HDFS-9958 . Thanks [~kshukla] for

[jira] [Created] (HDFS-11035) Better documentation for maintenace mode and upgrade domain

2016-10-19 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-11035: -- Summary: Better documentation for maintenace mode and upgrade domain Key: HDFS-11035 URL: https://issues.apache.org/jira/browse/HDFS-11035 Project: Hadoop HDFS

[jira] [Created] (HDFS-11022) DataNode unable to remove corrupt block replica due to race condition

2016-10-17 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-11022: -- Summary: DataNode unable to remove corrupt block replica due to race condition Key: HDFS-11022 URL: https://issues.apache.org/jira/browse/HDFS-11022 Project

[jira] [Created] (HDFS-11019) Inconsistent number of corrupt replicas if a corrupt replica is reported multiple times

2016-10-15 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-11019: -- Summary: Inconsistent number of corrupt replicas if a corrupt replica is reported multiple times Key: HDFS-11019 URL: https://issues.apache.org/jira/browse/HDFS-11019

[jira] [Created] (HDFS-11018) Incorrect check and message in FsDatasetImpl#invalidate

2016-10-14 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-11018: -- Summary: Incorrect check and message in FsDatasetImpl#invalidate Key: HDFS-11018 URL: https://issues.apache.org/jira/browse/HDFS-11018 Project: Hadoop HDFS

[jira] [Created] (HDFS-10999) Use more generic "low redundancy" blocks instead of "under replicated" blocks

2016-10-11 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-10999: -- Summary: Use more generic "low redundancy" blocks instead of "under replicated" blocks Key: HDFS-10999 URL: https://issues.apache.org/ji

[jira] [Created] (HDFS-10983) OIV webhdfs interface should make an EC file explicit

2016-10-07 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-10983: -- Summary: OIV webhdfs interface should make an EC file explicit Key: HDFS-10983 URL: https://issues.apache.org/jira/browse/HDFS-10983 Project: Hadoop HDFS

[jira] [Created] (HDFS-10976) Fsck should mark EC files explicitly

2016-10-06 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-10976: -- Summary: Fsck should mark EC files explicitly Key: HDFS-10976 URL: https://issues.apache.org/jira/browse/HDFS-10976 Project: Hadoop HDFS Issue Type: Sub

[jira] [Created] (HDFS-10975) fsck -list-corruptfileblocks does not report corrupt EC files

2016-10-06 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-10975: -- Summary: fsck -list-corruptfileblocks does not report corrupt EC files Key: HDFS-10975 URL: https://issues.apache.org/jira/browse/HDFS-10975 Project: Hadoop HDFS

[jira] [Created] (HDFS-10974) Document replication factor for EC files.

2016-10-06 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-10974: -- Summary: Document replication factor for EC files. Key: HDFS-10974 URL: https://issues.apache.org/jira/browse/HDFS-10974 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-10971) Distcp should not copy replication factor if source file is erasure coded

2016-10-06 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-10971: -- Summary: Distcp should not copy replication factor if source file is erasure coded Key: HDFS-10971 URL: https://issues.apache.org/jira/browse/HDFS-10971 Project

[jira] [Created] (HDFS-10935) TestFileChecksum tests are failing after HDFS-10460 (Mac only?)

2016-09-30 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-10935: -- Summary: TestFileChecksum tests are failing after HDFS-10460 (Mac only?) Key: HDFS-10935 URL: https://issues.apache.org/jira/browse/HDFS-10935 Project: Hadoop

[jira] [Reopened] (HDFS-10609) Uncaught InvalidEncryptionKeyException during pipeline recovery may abort downstream applications

2016-09-29 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reopened HDFS-10609: Reopen to attach a branch-2.7 patch. > Uncaught InvalidEncryptionKeyException during pipel

[jira] [Created] (HDFS-10910) HDFS Erasure Coding doc should state its currently supported erasure coding policies

2016-09-27 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-10910: -- Summary: HDFS Erasure Coding doc should state its currently supported erasure coding policies Key: HDFS-10910 URL: https://issues.apache.org/jira/browse/HDFS-10910

[jira] [Created] (HDFS-10909) De-duplicate code in ErasureCodingWorker#initializeStripedReadThreadPool and DFSClient#initThreadsNumForStripedReads

2016-09-27 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-10909: -- Summary: De-duplicate code in ErasureCodingWorker#initializeStripedReadThreadPool and DFSClient#initThreadsNumForStripedReads Key: HDFS-10909 URL: https://issues.apache.org

[jira] [Created] (HDFS-10908) Improve StripedBlockReader#createBlockReader error logging

2016-09-27 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-10908: -- Summary: Improve StripedBlockReader#createBlockReader error logging Key: HDFS-10908 URL: https://issues.apache.org/jira/browse/HDFS-10908 Project: Hadoop HDFS

[jira] [Created] (HDFS-10907) Fix Erasure Coding documentation

2016-09-27 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-10907: -- Summary: Fix Erasure Coding documentation Key: HDFS-10907 URL: https://issues.apache.org/jira/browse/HDFS-10907 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-10905) Refactor DataStreamer#createBlockOutputStream

2016-09-26 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-10905: -- Summary: Refactor DataStreamer#createBlockOutputStream Key: HDFS-10905 URL: https://issues.apache.org/jira/browse/HDFS-10905 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-10876) Dispatcher#dispatch should log IOException stacktrace

2016-09-20 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-10876: -- Summary: Dispatcher#dispatch should log IOException stacktrace Key: HDFS-10876 URL: https://issues.apache.org/jira/browse/HDFS-10876 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-10777) DataNode should report&remove volume failures if DU cannot access files

2016-09-16 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-10777. Resolution: Invalid Close this jira as invalid and I'll file an improvement jira t

[jira] [Created] (HDFS-10799) NameNode should use loginUser(hdfs) to serve iNotify requests

2016-08-25 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-10799: -- Summary: NameNode should use loginUser(hdfs) to serve iNotify requests Key: HDFS-10799 URL: https://issues.apache.org/jira/browse/HDFS-10799 Project: Hadoop HDFS

[jira] [Created] (HDFS-10792) RedundantEditLogInputStream should log caught exceptions

2016-08-24 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-10792: -- Summary: RedundantEditLogInputStream should log caught exceptions Key: HDFS-10792 URL: https://issues.apache.org/jira/browse/HDFS-10792 Project: Hadoop HDFS

[jira] [Created] (HDFS-10777) DataNode should report&remove volume failures if DU cannot access files

2016-08-18 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-10777: -- Summary: DataNode should report&remove volume failures if DU cannot access files Key: HDFS-10777 URL: https://issues.apache.org/jira/browse/HDFS-10777 Pro

[jira] [Resolved] (HDFS-10741) TestRefreshUserMappings.testRefreshSuperUserGroupsConfiguration fails consistently.

2016-08-09 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-10741. Resolution: Duplicate Looks like it's a dup of HDFS-10738 where a patch is uploaded.

[jira] [Created] (HDFS-10732) TestTracing#testTracing is failing in trunk

2016-08-08 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-10732: -- Summary: TestTracing#testTracing is failing in trunk Key: HDFS-10732 URL: https://issues.apache.org/jira/browse/HDFS-10732 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-10731) FSDirectory#verifyMaxDirItems does not log path name

2016-08-08 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-10731: -- Summary: FSDirectory#verifyMaxDirItems does not log path name Key: HDFS-10731 URL: https://issues.apache.org/jira/browse/HDFS-10731 Project: Hadoop HDFS

[jira] [Created] (HDFS-10729) NameNode crashes when loading edits because max directory items is exceeded

2016-08-07 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-10729: -- Summary: NameNode crashes when loading edits because max directory items is exceeded Key: HDFS-10729 URL: https://issues.apache.org/jira/browse/HDFS-10729

[jira] [Created] (HDFS-10701) TestDFSStripedOutputStreamWithFailure#testBlockTokenExpired occasionally fails

2016-07-28 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-10701: -- Summary: TestDFSStripedOutputStreamWithFailure#testBlockTokenExpired occasionally fails Key: HDFS-10701 URL: https://issues.apache.org/jira/browse/HDFS-10701

[jira] [Resolved] (HDFS-10698) Test org.apache.hadoop.cli.TestHDFSCLI fails in trunk

2016-07-27 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-10698. Resolution: Duplicate thx Youngjun for filing the jira. This is a dup of HDFS-10696 where a

Re: [VOTE] Release Apache Hadoop 2.7.3 RC0

2016-07-26 Thread Wei-Chiu Chuang
I noticed two issues: (1) I ran hadoop checknative, but it seems the binary tarball was not compiled with native library for Linux. On the contrary, the Hadoop built from source tarball with maven -Pnative can find the native libraries on the same host. (2) I noticed that the release dates in CHA

[jira] [Created] (HDFS-10609) Uncaught InvalidEncryptionKeyException during pipeline recovery may abort downstream applications

2016-07-11 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-10609: -- Summary: Uncaught InvalidEncryptionKeyException during pipeline recovery may abort downstream applications Key: HDFS-10609 URL: https://issues.apache.org/jira/browse/HDFS

[jira] [Created] (HDFS-10587) Incorrect offset/length calculation in pipeline recovery causes block corruption

2016-06-28 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-10587: -- Summary: Incorrect offset/length calculation in pipeline recovery causes block corruption Key: HDFS-10587 URL: https://issues.apache.org/jira/browse/HDFS-10587

[jira] [Created] (HDFS-10512) VolumeScanner may terminate to due NPE in DataNode.reportBadBlocks

2016-06-09 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-10512: -- Summary: VolumeScanner may terminate to due NPE in DataNode.reportBadBlocks Key: HDFS-10512 URL: https://issues.apache.org/jira/browse/HDFS-10512 Project: Hadoop

[jira] [Resolved] (HDFS-9912) Make HDFS Federation docs up to date

2016-05-31 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-9912. --- Resolution: Not A Bug While dfsclusterhealth.jsp is removed, there is a patch to add it back

[jira] [Created] (HDFS-10457) DataNode should not auto-format block pool directory if VERSION is missing

2016-05-24 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-10457: -- Summary: DataNode should not auto-format block pool directory if VERSION is missing Key: HDFS-10457 URL: https://issues.apache.org/jira/browse/HDFS-10457 Project

[jira] [Created] (HDFS-10452) SASL negotation should support buffer size negotiation

2016-05-23 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-10452: -- Summary: SASL negotation should support buffer size negotiation Key: HDFS-10452 URL: https://issues.apache.org/jira/browse/HDFS-10452 Project: Hadoop HDFS

[jira] [Created] (HDFS-10435) Document property fs.getspaceused.classname

2016-05-19 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-10435: -- Summary: Document property fs.getspaceused.classname Key: HDFS-10435 URL: https://issues.apache.org/jira/browse/HDFS-10435 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-10379) Fox IOUtils#cleanup and IOUtils#closeStream javadoc

2016-05-08 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-10379: -- Summary: Fox IOUtils#cleanup and IOUtils#closeStream javadoc Key: HDFS-10379 URL: https://issues.apache.org/jira/browse/HDFS-10379 Project: Hadoop HDFS

[jira] [Created] (HDFS-10360) DataNode may format directory and lose blocks if If current/VERSION is missing

2016-05-03 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-10360: -- Summary: DataNode may format directory and lose blocks if If current/VERSION is missing Key: HDFS-10360 URL: https://issues.apache.org/jira/browse/HDFS-10360

[jira] [Created] (HDFS-10324) Trash directory in an encryption zone should be pre-created with sticky bit

2016-04-21 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-10324: -- Summary: Trash directory in an encryption zone should be pre-created with sticky bit Key: HDFS-10324 URL: https://issues.apache.org/jira/browse/HDFS-10324

[jira] [Created] (HDFS-10280) Document new dfsadmin command -evictWriters

2016-04-12 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-10280: -- Summary: Document new dfsadmin command -evictWriters Key: HDFS-10280 URL: https://issues.apache.org/jira/browse/HDFS-10280 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-10272) Hadoop Fault Injection framework seems broken

2016-04-08 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-10272: -- Summary: Hadoop Fault Injection framework seems broken Key: HDFS-10272 URL: https://issues.apache.org/jira/browse/HDFS-10272 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-10260) TestFsDatasetImpl#testCleanShutdownOfVolume often fails

2016-04-05 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-10260: -- Summary: TestFsDatasetImpl#testCleanShutdownOfVolume often fails Key: HDFS-10260 URL: https://issues.apache.org/jira/browse/HDFS-10260 Project: Hadoop HDFS

[jira] [Created] (HDFS-10210) Remove the defunct startKdc profile

2016-03-24 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-10210: -- Summary: Remove the defunct startKdc profile Key: HDFS-10210 URL: https://issues.apache.org/jira/browse/HDFS-10210 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-10187) Add a "list" refresh handler to list all registered refresh identifiers/handlers

2016-03-21 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-10187: -- Summary: Add a "list" refresh handler to list all registered refresh identifiers/handlers Key: HDFS-10187 URL: https://issues.apache.org/jira/browse/

<    2   3   4   5   6   7   8   >