[jira] [Resolved] (HDFS-7620) Change disk quota calculation for EC files

2015-03-17 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-7620. - Resolution: Duplicate Hi [~tasanuma0829], I just find that this issue has been solved by HDFS-7826. I

[jira] [Resolved] (HDFS-7912) Erasure Coding: track BlockInfo instead of Block in UnderReplicatedBlocks and PendingReplicationBlocks

2015-03-17 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-7912. - Resolution: Fixed Fix Version/s: HDFS-7285 Hadoop Flags: Reviewed Thanks for the review, Zhe

[jira] [Created] (HDFS-7943) Append cannot handle the last block with length greater than the preferred block size

2015-03-17 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-7943: --- Summary: Append cannot handle the last block with length greater than the preferred block size Key: HDFS-7943 URL: https://issues.apache.org/jira/browse/HDFS-7943 Project

[jira] [Resolved] (HDFS-7936) Erasure coding: resolving conflicts when merging with HDFS-7903 and HDFS-7435

2015-03-16 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-7936. - Resolution: Fixed Fix Version/s: HDFS-7285 Hadoop Flags: Reviewed I've committed

[jira] [Resolved] (HDFS-7826) Erasure Coding: Update INodeFile quota computation for striped blocks

2015-03-16 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-7826. - Resolution: Fixed Fix Version/s: HDFS-7285 Hadoop Flags: Reviewed I've committed this. Thanks

[jira] [Created] (HDFS-7905) Refactor the checking the minimum replication logic in BlockManager

2015-03-09 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-7905: --- Summary: Refactor the checking the minimum replication logic in BlockManager Key: HDFS-7905 URL: https://issues.apache.org/jira/browse/HDFS-7905 Project: Hadoop HDFS

[jira] [Created] (HDFS-7907) Update DecommissionManager to support striped blocks

2015-03-09 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-7907: --- Summary: Update DecommissionManager to support striped blocks Key: HDFS-7907 URL: https://issues.apache.org/jira/browse/HDFS-7907 Project: Hadoop HDFS Issue Type: Sub

[jira] [Resolved] (HDFS-7905) Refactor the checking the minimum replication logic in BlockManager

2015-03-09 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-7905. - Resolution: Won't Fix Looks like instead of doing this refactoring in trunk, it is easier to keep

[jira] [Created] (HDFS-7912) Erasure Coding: track BlockInfo instead of Block in UnderReplicatedBlocks and PendingReplicationBlocks

2015-03-09 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-7912: --- Summary: Erasure Coding: track BlockInfo instead of Block in UnderReplicatedBlocks and PendingReplicationBlocks Key: HDFS-7912 URL: https://issues.apache.org/jira/browse/HDFS-7912

[jira] [Resolved] (HDFS-7853) Erasure coding: extend LocatedBlocks to support reading from striped files

2015-03-09 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-7853. - Resolution: Fixed Fix Version/s: HDFS-7285 Hadoop Flags: Reviewed I've committed

[jira] [Resolved] (HDFS-7895) open and getFileInfo APIs treat paths inconsistently wrt protocol

2015-03-05 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-7895. - Resolution: Invalid open and getFileInfo APIs treat paths inconsistently wrt protocol

[jira] [Resolved] (HDFS-7872) Erasure Coding: INodeFile.dumpTreeRecursively() supports to print striped blocks

2015-03-05 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-7872. - Resolution: Fixed Fix Version/s: HDFS-7285 Hadoop Flags: Reviewed I've committed

[jira] [Resolved] (HDFS-7837) Erasure Coding: allocate and persist striped blocks in NameNode

2015-03-02 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-7837. - Resolution: Fixed Fix Version/s: HDFS-7285 Hadoop Flags: Reviewed Thanks Zhe again

[jira] [Created] (HDFS-7871) NameNodeEditLogRoller can keep printing Swallowing exception message

2015-03-02 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-7871: --- Summary: NameNodeEditLogRoller can keep printing Swallowing exception message Key: HDFS-7871 URL: https://issues.apache.org/jira/browse/HDFS-7871 Project: Hadoop HDFS

[jira] [Created] (HDFS-7864) Erasure Coding: Update safemode calculation for striped blocks

2015-03-01 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-7864: --- Summary: Erasure Coding: Update safemode calculation for striped blocks Key: HDFS-7864 URL: https://issues.apache.org/jira/browse/HDFS-7864 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-7749) Erasure Coding: Add striped block support in INodeFile

2015-02-25 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-7749. - Resolution: Fixed Fix Version/s: HDFS-7285 Hadoop Flags: Reviewed Thanks Zhe! I've committed

[jira] [Created] (HDFS-7837) Allocate and persist striped blocks in FSNamesystem

2015-02-24 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-7837: --- Summary: Allocate and persist striped blocks in FSNamesystem Key: HDFS-7837 URL: https://issues.apache.org/jira/browse/HDFS-7837 Project: Hadoop HDFS Issue Type: Sub

[jira] [Resolved] (HDFS-7825) HdfsDataInputStream::read(ByteBuffer) method doesn't conform to its API

2015-02-23 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-7825. - Resolution: Duplicate Duplicated with HADOOP-11039 HdfsDataInputStream::read(ByteBuffer) method doesn't

[jira] [Created] (HDFS-7828) List variable length blocks in Fsck

2015-02-23 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-7828: --- Summary: List variable length blocks in Fsck Key: HDFS-7828 URL: https://issues.apache.org/jira/browse/HDFS-7828 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Created] (HDFS-7829) Code clean up for LocatedBlock

2015-02-23 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-7829: --- Summary: Code clean up for LocatedBlock Key: HDFS-7829 URL: https://issues.apache.org/jira/browse/HDFS-7829 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Resolved] (HDFS-7716) Erasure Coding: extend BlockInfo to handle EC info

2015-02-10 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-7716. - Resolution: Fixed Hadoop Flags: Reviewed I've committed this (to both the HDFS-EC and HDFS-7285

[jira] [Created] (HDFS-7743) Code cleanup of BlockInfo and rename BlockInfo to BlockReplicationInfo

2015-02-06 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-7743: --- Summary: Code cleanup of BlockInfo and rename BlockInfo to BlockReplicationInfo Key: HDFS-7743 URL: https://issues.apache.org/jira/browse/HDFS-7743 Project: Hadoop HDFS

[jira] [Created] (HDFS-7749) Add stripped block support in INodeFile

2015-02-06 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-7749: --- Summary: Add stripped block support in INodeFile Key: HDFS-7749 URL: https://issues.apache.org/jira/browse/HDFS-7749 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-7728) Avoid updating quota usage while loading edits

2015-02-02 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-7728: --- Summary: Avoid updating quota usage while loading edits Key: HDFS-7728 URL: https://issues.apache.org/jira/browse/HDFS-7728 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-7717) Erasure Coding: provide a tool for convert files between replication and erasure coding

2015-01-30 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-7717: --- Summary: Erasure Coding: provide a tool for convert files between replication and erasure coding Key: HDFS-7717 URL: https://issues.apache.org/jira/browse/HDFS-7717 Project

[jira] [Created] (HDFS-7716) Erasure Coding: extend BlockInfo to handle EC info

2015-01-30 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-7716: --- Summary: Erasure Coding: extend BlockInfo to handle EC info Key: HDFS-7716 URL: https://issues.apache.org/jira/browse/HDFS-7716 Project: Hadoop HDFS Issue Type: Sub

[jira] [Created] (HDFS-7663) Erasure Coding: support Append on EC file

2015-01-22 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-7663: --- Summary: Erasure Coding: support Append on EC file Key: HDFS-7663 URL: https://issues.apache.org/jira/browse/HDFS-7663 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-7622) Erasure Coding: handling truncated files

2015-01-15 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-7622: --- Summary: Erasure Coding: handling truncated files Key: HDFS-7622 URL: https://issues.apache.org/jira/browse/HDFS-7622 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-7619) Erasure Coding: Handling files in snapshots

2015-01-15 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-7619: --- Summary: Erasure Coding: Handling files in snapshots Key: HDFS-7619 URL: https://issues.apache.org/jira/browse/HDFS-7619 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-7621) Erasure Coding: update the Balancer/Mover data migration logic

2015-01-15 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-7621: --- Summary: Erasure Coding: update the Balancer/Mover data migration logic Key: HDFS-7621 URL: https://issues.apache.org/jira/browse/HDFS-7621 Project: Hadoop HDFS

[jira] [Created] (HDFS-7535) Utilize Snapshot diff report for distcp

2014-12-16 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-7535: --- Summary: Utilize Snapshot diff report for distcp Key: HDFS-7535 URL: https://issues.apache.org/jira/browse/HDFS-7535 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Created] (HDFS-7508) Clean up path resolving in FSNamesystem/FSDirectory

2014-12-10 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-7508: --- Summary: Clean up path resolving in FSNamesystem/FSDirectory Key: HDFS-7508 URL: https://issues.apache.org/jira/browse/HDFS-7508 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-7509) Avoid resolving path multiple times in rename/mkdir

2014-12-10 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-7509: --- Summary: Avoid resolving path multiple times in rename/mkdir Key: HDFS-7509 URL: https://issues.apache.org/jira/browse/HDFS-7509 Project: Hadoop HDFS Issue Type: Sub

[jira] [Created] (HDFS-7498) Simplify the logic in INodesInPath

2014-12-08 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-7498: --- Summary: Simplify the logic in INodesInPath Key: HDFS-7498 URL: https://issues.apache.org/jira/browse/HDFS-7498 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Created] (HDFS-7474) Avoid resolve path in FSPermissionChecker

2014-12-04 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-7474: --- Summary: Avoid resolve path in FSPermissionChecker Key: HDFS-7474 URL: https://issues.apache.org/jira/browse/HDFS-7474 Project: Hadoop HDFS Issue Type: Improvement

Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-14 Thread Jing Zhao
+1 (binding) Verified checksums and signatures. Successfully deploy a cluster with NameNode HA setup and run some hdfs commands. Thanks, -Jing On Fri, Nov 14, 2014 at 3:58 PM, Chris Nauroth cnaur...@hortonworks.com wrote: +1 (binding) - Verified checksums and signatures for source and

[jira] [Created] (HDFS-7388) Improve the log for HA failover

2014-11-10 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-7388: --- Summary: Improve the log for HA failover Key: HDFS-7388 URL: https://issues.apache.org/jira/browse/HDFS-7388 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Resolved] (HDFS-7296) HdfsConstants#MEMORY_STORAGE_POLICY_ID and HdfsConstants#MEMORY_STORAGE_POLICY_ID are missing in branch-2

2014-10-27 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-7296. - Resolution: Fixed Fix Version/s: 2.6.0 Thanks for the review, Chris! I've committed this to branch

[jira] [Created] (HDFS-7228) Add an SSD policy into the default BlockStoragePolicySuite

2014-10-10 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-7228: --- Summary: Add an SSD policy into the default BlockStoragePolicySuite Key: HDFS-7228 URL: https://issues.apache.org/jira/browse/HDFS-7228 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-7167) NPE while running Mover if the given path is for a file

2014-09-29 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-7167: --- Summary: NPE while running Mover if the given path is for a file Key: HDFS-7167 URL: https://issues.apache.org/jira/browse/HDFS-7167 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-7140) Add a tool to list all the existing block storage policies

2014-09-24 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-7140: --- Summary: Add a tool to list all the existing block storage policies Key: HDFS-7140 URL: https://issues.apache.org/jira/browse/HDFS-7140 Project: Hadoop HDFS Issue

Re: Thinking ahead to hadoop-2.6

2014-09-24 Thread Jing Zhao
Just to give a quick update about the current status of HDFS-6584 (archival storage). So far after HDFS-7081 got committed this morning, the main functionalities have already been finished. As a summary two new DistributedFileSystem APIs are added: getStoragePolicies and setStoragePolicy. We have

Re: [VOTE] Merge HDFS-6581 to trunk - Writing to replicas in memory.

2014-09-23 Thread Jing Zhao
+1. This is a very useful feature and the performance number looks convincing. Thanks, -Jing On Tue, Sep 23, 2014 at 5:12 PM, Xiaoyu Yao x...@hortonworks.com wrote: +1 non-binding. I’ve reviewed most of the changes in the branch and the E2E perf numbers looks good. Thanks, Xiaoyu On Sep

[jira] [Created] (HDFS-7131) During HA upgrade, JournalNode should also copy the committedTxnId file into the current directory

2014-09-22 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-7131: --- Summary: During HA upgrade, JournalNode should also copy the committedTxnId file into the current directory Key: HDFS-7131 URL: https://issues.apache.org/jira/browse/HDFS-7131

[jira] [Resolved] (HDFS-7088) Archival Storage: fix TestBalancer and TestBalancerWithMultipleNameNodes

2014-09-18 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-7088. - Resolution: Fixed Hadoop Flags: Reviewed I've committed this. Archival Storage: fix TestBalancer

[jira] [Created] (HDFS-7092) Document the logic about Delegation Token is generated and used in both HA and non-HA setup

2014-09-18 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-7092: --- Summary: Document the logic about Delegation Token is generated and used in both HA and non-HA setup Key: HDFS-7092 URL: https://issues.apache.org/jira/browse/HDFS-7092

[jira] [Resolved] (HDFS-6864) Archival Storage: add user documentation

2014-09-17 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-6864. - Resolution: Fixed Hadoop Flags: Reviewed I've committed this. Thanks for working on this, [~szetszwo

[jira] [Created] (HDFS-7072) Fix TestBlockManager#testUseDelHint

2014-09-16 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-7072: --- Summary: Fix TestBlockManager#testUseDelHint Key: HDFS-7072 URL: https://issues.apache.org/jira/browse/HDFS-7072 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-7076) Persist Block Storage Policy in FSImage and Edit Log

2014-09-16 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-7076: --- Summary: Persist Block Storage Policy in FSImage and Edit Log Key: HDFS-7076 URL: https://issues.apache.org/jira/browse/HDFS-7076 Project: Hadoop HDFS Issue Type: Sub

[jira] [Resolved] (HDFS-7052) Archival Storage: Add Mover into hdfs script

2014-09-16 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-7052. - Resolution: Fixed I've committed this. Archival Storage: Add Mover into hdfs script

[jira] [Created] (HDFS-7081) Add new DistributedFileSystem API for getting all the existing storage policies

2014-09-16 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-7081: --- Summary: Add new DistributedFileSystem API for getting all the existing storage policies Key: HDFS-7081 URL: https://issues.apache.org/jira/browse/HDFS-7081 Project: Hadoop

[jira] [Created] (HDFS-7052) Add Mover into hdfs script

2014-09-12 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-7052: --- Summary: Add Mover into hdfs script Key: HDFS-7052 URL: https://issues.apache.org/jira/browse/HDFS-7052 Project: Hadoop HDFS Issue Type: Sub-task Reporter

[jira] [Resolved] (HDFS-7053) Failed to rollback hdfs version from 2.4.1 to 2.2.0

2014-09-12 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-7053. - Resolution: Invalid Close this jira as invalid. Failed to rollback hdfs version from 2.4.1 to 2.2.0

[jira] [Created] (HDFS-7062) Archival Storage: skip under construction block for migration

2014-09-12 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-7062: --- Summary: Archival Storage: skip under construction block for migration Key: HDFS-7062 URL: https://issues.apache.org/jira/browse/HDFS-7062 Project: Hadoop HDFS Issue

[jira] [Resolved] (HDFS-7034) Archival Storage: Fix TestBlockPlacement and TestStorageMover

2014-09-11 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-7034. - Resolution: Fixed Hadoop Flags: Reviewed I've committed this. Archival Storage: Fix

[jira] [Resolved] (HDFS-7039) Archival Storage: fix Balancer tests

2014-09-11 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-7039. - Resolution: Fixed Hadoop Flags: Reviewed +1. I've committed this. Archival Storage: fix Balancer

[jira] [Created] (HDFS-7034) Fix TestBlockPlacement and TestStorageMover

2014-09-09 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-7034: --- Summary: Fix TestBlockPlacement and TestStorageMover Key: HDFS-7034 URL: https://issues.apache.org/jira/browse/HDFS-7034 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-7030) Add more unit tests for DatanodeStorageInfo

2014-09-08 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-7030: --- Summary: Add more unit tests for DatanodeStorageInfo Key: HDFS-7030 URL: https://issues.apache.org/jira/browse/HDFS-7030 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Resolved] (HDFS-6875) Archival Storage: support migration for a list of specified paths

2014-09-08 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-6875. - Resolution: Fixed I've committed this. Archival Storage: support migration for a list of specified paths

[jira] [Resolved] (HDFS-7027) Archival Storage: Mover does not terminate when some storage type is out of space

2014-09-08 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-7027. - Resolution: Fixed Hadoop Flags: Reviewed Thanks for fixing this, Nicholas! +1. I've committed

[jira] [Resolved] (HDFS-7029) Archival Storage: fix TestDFSInotifyEventInputStream and TestDistributedFileSystem

2014-09-08 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-7029. - Resolution: Fixed Hadoop Flags: Reviewed I've committed this. Archival Storage: fix

[jira] [Created] (HDFS-6996) SnapshotDiff report can hit IndexOutOfBoundsException when there are nested renamed directory/file

2014-09-04 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-6996: --- Summary: SnapshotDiff report can hit IndexOutOfBoundsException when there are nested renamed directory/file Key: HDFS-6996 URL: https://issues.apache.org/jira/browse/HDFS-6996

[jira] [Resolved] (HDFS-6961) Archival Storage: BlockPlacementPolicy#chooseTarget should check each valid storage type in each choosing round

2014-09-04 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-6961. - Resolution: Fixed Hadoop Flags: Reviewed I've committed this. Archival Storage

[jira] [Resolved] (HDFS-6876) Archival Storage: support set/get storage policy in DFSAdmin

2014-09-04 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-6876. - Resolution: Fixed Hadoop Flags: Reviewed Thanks for the review, Nicholas! I've committed

[jira] [Resolved] (HDFS-6969) Archival Storage: INode#getStoragePolicyID should always return the latest storage policy

2014-09-01 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-6969. - Resolution: Fixed Hadoop Flags: Reviewed Thanks again, Nicholas! I've committed this. Archival

[jira] [Created] (HDFS-6969) Archival Storage: INode#getStoragePolicyID should always return the latest storage policy

2014-08-28 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-6969: --- Summary: Archival Storage: INode#getStoragePolicyID should always return the latest storage policy Key: HDFS-6969 URL: https://issues.apache.org/jira/browse/HDFS-6969 Project

[jira] [Resolved] (HDFS-6911) Archival Storage: check if a block is already scheduled in Mover

2014-08-27 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-6911. - Resolution: Fixed Hadoop Flags: Reviewed I've committed this. Thanks Nicholas! Archival Storage

[jira] [Resolved] (HDFS-6920) Archival Storage: check the storage type of delNodeHintStorage when deleting a replica

2014-08-27 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-6920. - Resolution: Fixed Hadoop Flags: Reviewed I've committed this. Thanks Nicholas! Archival Storage

[jira] [Resolved] (HDFS-6944) Archival Storage: add retry and termination logic for Mover

2014-08-27 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-6944. - Resolution: Fixed Thanks for the review, Nicholas! I've committed this. Archival Storage: add retry

[jira] [Created] (HDFS-6961) BlockPlacementPolicy#chooseTarget should check each valid storage type in each choosing round

2014-08-27 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-6961: --- Summary: BlockPlacementPolicy#chooseTarget should check each valid storage type in each choosing round Key: HDFS-6961 URL: https://issues.apache.org/jira/browse/HDFS-6961

[jira] [Resolved] (HDFS-6906) Archival Storage: Add more tests for BlockStoragePolicy

2014-08-25 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-6906. - Resolution: Fixed Hadoop Flags: Reviewed Archival Storage: Add more tests for BlockStoragePolicy

[jira] [Created] (HDFS-6944) Archival Storage: add a test framework for testing different migration scenarios

2014-08-25 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-6944: --- Summary: Archival Storage: add a test framework for testing different migration scenarios Key: HDFS-6944 URL: https://issues.apache.org/jira/browse/HDFS-6944 Project: Hadoop

[jira] [Resolved] (HDFS-6863) Archival Storage: Support migration for snapshot paths

2014-08-21 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-6863. - Resolution: Fixed Hadoop Flags: Reviewed I've committed this. Thanks for the review, Nicholas

[jira] [Created] (HDFS-6875) Archival Storage: support migration for a list of specified paths

2014-08-19 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-6875: --- Summary: Archival Storage: support migration for a list of specified paths Key: HDFS-6875 URL: https://issues.apache.org/jira/browse/HDFS-6875 Project: Hadoop HDFS

[jira] [Created] (HDFS-6876) Archival Storage: support set/get storage policy in DFSAdmin

2014-08-19 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-6876: --- Summary: Archival Storage: support set/get storage policy in DFSAdmin Key: HDFS-6876 URL: https://issues.apache.org/jira/browse/HDFS-6876 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-6864) Archival Storage: add documentation for the new migration tool

2014-08-18 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-6864: --- Summary: Archival Storage: add documentation for the new migration tool Key: HDFS-6864 URL: https://issues.apache.org/jira/browse/HDFS-6864 Project: Hadoop HDFS

[jira] [Created] (HDFS-6863) Archival Storage: Support migration for customized paths and snapshot paths

2014-08-18 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-6863: --- Summary: Archival Storage: Support migration for customized paths and snapshot paths Key: HDFS-6863 URL: https://issues.apache.org/jira/browse/HDFS-6863 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-6801) Archival Storage: Add a new data migration tool

2014-08-18 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-6801. - Resolution: Fixed Hadoop Flags: Reviewed I've committed this. Archival Storage: Add a new data

[jira] [Created] (HDFS-6847) Archival Storage: Support storage policy on a directory

2014-08-13 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-6847: --- Summary: Archival Storage: Support storage policy on a directory Key: HDFS-6847 URL: https://issues.apache.org/jira/browse/HDFS-6847 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-6844) Archival Storage: Extend HdfsFileStatus to get storage policy

2014-08-12 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-6844: --- Summary: Archival Storage: Extend HdfsFileStatus to get storage policy Key: HDFS-6844 URL: https://issues.apache.org/jira/browse/HDFS-6844 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-6838) Code cleanup for unnecessary INode replacement

2014-08-11 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-6838: --- Summary: Code cleanup for unnecessary INode replacement Key: HDFS-6838 URL: https://issues.apache.org/jira/browse/HDFS-6838 Project: Hadoop HDFS Issue Type: Bug

[jira] [Resolved] (HDFS-6822) In branch-1, Namenode and datanode fails to replace _HOST to hostname for hadoop.http.authentication.kerberos.principal

2014-08-06 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-6822. - Resolution: Fixed Fix Version/s: 1.3.0 Target Version/s: (was: 1.2.1) Hadoop

[jira] [Created] (HDFS-6822) In branch-1, Namenode and datanode fails to replace _HOST to hostname for hadoop.http.authentication.kerberos.principal

2014-08-05 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-6822: --- Summary: In branch-1, Namenode and datanode fails to replace _HOST to hostname for hadoop.http.authentication.kerberos.principal Key: HDFS-6822 URL: https://issues.apache.org/jira/browse

[jira] [Created] (HDFS-6609) Use DirectorySnapshottableFeature to represent a snapshottable directory

2014-06-30 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-6609: --- Summary: Use DirectorySnapshottableFeature to represent a snapshottable directory Key: HDFS-6609 URL: https://issues.apache.org/jira/browse/HDFS-6609 Project: Hadoop HDFS

[jira] [Reopened] (HDFS-6527) Edit log corruption due to defered INode removal

2014-06-24 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao reopened HDFS-6527: - Reopen the jira and wait for [~kihwal] to comment. Edit log corruption due to defered INode removal

[jira] [Created] (HDFS-6593) Move SnapshotDiffInfo out of INodeDirectorySnapshottable

2014-06-23 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-6593: --- Summary: Move SnapshotDiffInfo out of INodeDirectorySnapshottable Key: HDFS-6593 URL: https://issues.apache.org/jira/browse/HDFS-6593 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-6551) Rename with OVERWRITE may throw NPE when the target file/directory is a reference INode

2014-06-16 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-6551: --- Summary: Rename with OVERWRITE may throw NPE when the target file/directory is a reference INode Key: HDFS-6551 URL: https://issues.apache.org/jira/browse/HDFS-6551 Project

Re: HDFS-6376

2014-05-28 Thread Jing Zhao
Hi Dave, The Jenkins only runs against trunk. Thus you need to upload a patch for trunk instead of 2.4. Thanks, -Jing On Wed, May 28, 2014 at 11:28 AM, dlmar...@comcast.net wrote: I’m trying to complete this issue, but I am unable to get it to build in Jenkins. The patch applies for my

[jira] [Created] (HDFS-6444) Add documentation for http/https policy configuration/setup

2014-05-22 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-6444: --- Summary: Add documentation for http/https policy configuration/setup Key: HDFS-6444 URL: https://issues.apache.org/jira/browse/HDFS-6444 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-6438) Update WebHdfs document for Snapshot related APIs

2014-05-20 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-6438: --- Summary: Update WebHdfs document for Snapshot related APIs Key: HDFS-6438 URL: https://issues.apache.org/jira/browse/HDFS-6438 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-6420) DFSAdmin#refreshNodes should be sent to both NameNodes in HA setup

2014-05-16 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-6420: --- Summary: DFSAdmin#refreshNodes should be sent to both NameNodes in HA setup Key: HDFS-6420 URL: https://issues.apache.org/jira/browse/HDFS-6420 Project: Hadoop HDFS

[jira] [Created] (HDFS-6385) Show when block deletion will start after NameNode startup in WebUI

2014-05-13 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-6385: --- Summary: Show when block deletion will start after NameNode startup in WebUI Key: HDFS-6385 URL: https://issues.apache.org/jira/browse/HDFS-6385 Project: Hadoop HDFS

[jira] [Created] (HDFS-6266) Identify full path for a given INode

2014-04-21 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-6266: --- Summary: Identify full path for a given INode Key: HDFS-6266 URL: https://issues.apache.org/jira/browse/HDFS-6266 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Created] (HDFS-6227) ShortCuit Read failed due to ClosedChannelException

2014-04-09 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-6227: --- Summary: ShortCuit Read failed due to ClosedChannelException Key: HDFS-6227 URL: https://issues.apache.org/jira/browse/HDFS-6227 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-6212) Deprecate the BackupNode and CheckpointNode from branch-2

2014-04-08 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-6212: --- Summary: Deprecate the BackupNode and CheckpointNode from branch-2 Key: HDFS-6212 URL: https://issues.apache.org/jira/browse/HDFS-6212 Project: Hadoop HDFS Issue Type

[jira] [Resolved] (HDFS-5138) Support HDFS upgrade in HA

2014-03-24 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-5138. - Resolution: Fixed Fix Version/s: 2.4.0 I've merged this to branch-2 and branch-2.4.0. Support

[jira] [Created] (HDFS-6135) In HDFS upgrade with HA setup, JournalNode cannot handle layout version bump when rolling back

2014-03-21 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-6135: --- Summary: In HDFS upgrade with HA setup, JournalNode cannot handle layout version bump when rolling back Key: HDFS-6135 URL: https://issues.apache.org/jira/browse/HDFS-6135

[jira] [Resolved] (HDFS-6131) Move HDFSHighAvailabilityWithNFS.apt.vm and HDFSHighAvailabilityWithQJM.apt.vm from Yarn to HDFS

2014-03-20 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-6131. - Resolution: Fixed Fix Version/s: 2.4.0 Hadoop Flags: Reviewed Thanks very much to Arpit

[jira] [Resolved] (HDFS-6113) Rolling upgrae exception

2014-03-18 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-6113. - Resolution: Invalid Based on Kihwal and Nicholas's comments, let's close this jira first. Fengdong

[jira] [Created] (HDFS-6062) TestRetryCacheWithHA#testConcat is flaky

2014-03-05 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-6062: --- Summary: TestRetryCacheWithHA#testConcat is flaky Key: HDFS-6062 URL: https://issues.apache.org/jira/browse/HDFS-6062 Project: Hadoop HDFS Issue Type: Bug

<    1   2   3   4   >