[jira] [Created] (HDFS-8036) Use snapshot path as source when using snapshot diff report in DistCp

2015-03-31 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-8036: --- Summary: Use snapshot path as source when using snapshot diff report in DistCp Key: HDFS-8036 URL: https://issues.apache.org/jira/browse/HDFS-8036 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-8005) Erasure Coding: simplify striped block recovery work computation and add tests

2015-03-30 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-8005. - Resolution: Fixed Fix Version/s: HDFS-7285 Hadoop Flags: Reviewed I've committed this. T

[jira] [Resolved] (HDFS-7907) Erasure Coding: track invalid, corrupt, and under-recovery striped blocks in NameNode

2015-03-30 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-7907. - Resolution: Fixed Fix Version/s: HDFS-7285 Hadoop Flags: Reviewed I've committed this t

[jira] [Created] (HDFS-8005) Erasure Coding: simplify striped block recovery work computation and add tests

2015-03-27 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-8005: --- Summary: Erasure Coding: simplify striped block recovery work computation and add tests Key: HDFS-8005 URL: https://issues.apache.org/jira/browse/HDFS-8005 Project: Hadoop

[jira] [Created] (HDFS-7991) Allow users to skip checkpoint when stopping NameNode

2015-03-25 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-7991: --- Summary: Allow users to skip checkpoint when stopping NameNode Key: HDFS-7991 URL: https://issues.apache.org/jira/browse/HDFS-7991 Project: Hadoop HDFS Issue Type

[jira] [Resolved] (HDFS-7827) Erasure Coding: support striped blocks in non-protobuf fsimage

2015-03-23 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-7827. - Resolution: Fixed Fix Version/s: HDFS-7285 Hadoop Flags: Reviewed I've committed this t

[jira] [Resolved] (HDFS-7864) Erasure Coding: Update safemode calculation for striped blocks

2015-03-23 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-7864. - Resolution: Fixed Fix Version/s: HDFS-7285 Hadoop Flags: Reviewed I've committed this t

[jira] [Created] (HDFS-7957) Truncate should verify quota before making changes

2015-03-18 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-7957: --- Summary: Truncate should verify quota before making changes Key: HDFS-7957 URL: https://issues.apache.org/jira/browse/HDFS-7957 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-7943) Append cannot handle the last block with length greater than the preferred block size

2015-03-17 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-7943: --- Summary: Append cannot handle the last block with length greater than the preferred block size Key: HDFS-7943 URL: https://issues.apache.org/jira/browse/HDFS-7943 Project

[jira] [Resolved] (HDFS-7912) Erasure Coding: track BlockInfo instead of Block in UnderReplicatedBlocks and PendingReplicationBlocks

2015-03-17 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-7912. - Resolution: Fixed Fix Version/s: HDFS-7285 Hadoop Flags: Reviewed Thanks for the review, Zhe

[jira] [Resolved] (HDFS-7620) Change disk quota calculation for EC files

2015-03-16 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-7620. - Resolution: Duplicate Hi [~tasanuma0829], I just find that this issue has been solved by HDFS-7826. I

[jira] [Resolved] (HDFS-7826) Erasure Coding: Update INodeFile quota computation for striped blocks

2015-03-16 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-7826. - Resolution: Fixed Fix Version/s: HDFS-7285 Hadoop Flags: Reviewed I've committed this. T

[jira] [Resolved] (HDFS-7936) Erasure coding: resolving conflicts when merging with HDFS-7903 and HDFS-7435

2015-03-16 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-7936. - Resolution: Fixed Fix Version/s: HDFS-7285 Hadoop Flags: Reviewed I've committed

[jira] [Created] (HDFS-7912) Erasure Coding: track BlockInfo instead of Block in UnderReplicatedBlocks and PendingReplicationBlocks

2015-03-09 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-7912: --- Summary: Erasure Coding: track BlockInfo instead of Block in UnderReplicatedBlocks and PendingReplicationBlocks Key: HDFS-7912 URL: https://issues.apache.org/jira/browse/HDFS-7912

[jira] [Resolved] (HDFS-7853) Erasure coding: extend LocatedBlocks to support reading from striped files

2015-03-09 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-7853. - Resolution: Fixed Fix Version/s: HDFS-7285 Hadoop Flags: Reviewed I've committed

[jira] [Resolved] (HDFS-7905) Refactor the checking the minimum replication logic in BlockManager

2015-03-09 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-7905. - Resolution: Won't Fix Looks like instead of doing this refactoring in trunk, it is easier to kee

[jira] [Created] (HDFS-7907) Update DecommissionManager to support striped blocks

2015-03-09 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-7907: --- Summary: Update DecommissionManager to support striped blocks Key: HDFS-7907 URL: https://issues.apache.org/jira/browse/HDFS-7907 Project: Hadoop HDFS Issue Type: Sub

[jira] [Created] (HDFS-7905) Refactor the checking the minimum replication logic in BlockManager

2015-03-09 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-7905: --- Summary: Refactor the checking the minimum replication logic in BlockManager Key: HDFS-7905 URL: https://issues.apache.org/jira/browse/HDFS-7905 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-7872) Erasure Coding: INodeFile.dumpTreeRecursively() supports to print striped blocks

2015-03-05 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-7872. - Resolution: Fixed Fix Version/s: HDFS-7285 Hadoop Flags: Reviewed I've committed this t

[jira] [Resolved] (HDFS-7895) open and getFileInfo APIs treat paths inconsistently wrt protocol

2015-03-05 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-7895. - Resolution: Invalid > open and getFileInfo APIs treat paths inconsistently wrt proto

[jira] [Created] (HDFS-7871) NameNodeEditLogRoller can keep printing "Swallowing exception" message

2015-03-02 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-7871: --- Summary: NameNodeEditLogRoller can keep printing "Swallowing exception" message Key: HDFS-7871 URL: https://issues.apache.org/jira/browse/HDFS-7871 Project: H

[jira] [Resolved] (HDFS-7837) Erasure Coding: allocate and persist striped blocks in NameNode

2015-03-02 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-7837. - Resolution: Fixed Fix Version/s: HDFS-7285 Hadoop Flags: Reviewed Thanks Zhe again for the

[jira] [Created] (HDFS-7864) Erasure Coding: Update safemode calculation for striped blocks

2015-03-01 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-7864: --- Summary: Erasure Coding: Update safemode calculation for striped blocks Key: HDFS-7864 URL: https://issues.apache.org/jira/browse/HDFS-7864 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-7749) Erasure Coding: Add striped block support in INodeFile

2015-02-25 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-7749. - Resolution: Fixed Fix Version/s: HDFS-7285 Hadoop Flags: Reviewed Thanks Zhe! I've comm

[jira] [Created] (HDFS-7837) Allocate and persist striped blocks in FSNamesystem

2015-02-24 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-7837: --- Summary: Allocate and persist striped blocks in FSNamesystem Key: HDFS-7837 URL: https://issues.apache.org/jira/browse/HDFS-7837 Project: Hadoop HDFS Issue Type: Sub

[jira] [Created] (HDFS-7829) Code clean up for LocatedBlock

2015-02-23 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-7829: --- Summary: Code clean up for LocatedBlock Key: HDFS-7829 URL: https://issues.apache.org/jira/browse/HDFS-7829 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Created] (HDFS-7828) List variable length blocks in Fsck

2015-02-23 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-7828: --- Summary: List variable length blocks in Fsck Key: HDFS-7828 URL: https://issues.apache.org/jira/browse/HDFS-7828 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Created] (HDFS-7827) Erasure Coding: support striped blocks in non-protobuf fsimage

2015-02-23 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-7827: --- Summary: Erasure Coding: support striped blocks in non-protobuf fsimage Key: HDFS-7827 URL: https://issues.apache.org/jira/browse/HDFS-7827 Project: Hadoop HDFS

[jira] [Created] (HDFS-7826) Erasure Coding: Update INodeFile quota computation for striped blocks

2015-02-23 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-7826: --- Summary: Erasure Coding: Update INodeFile quota computation for striped blocks Key: HDFS-7826 URL: https://issues.apache.org/jira/browse/HDFS-7826 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-7825) HdfsDataInputStream::read(ByteBuffer) method doesn't conform to its API

2015-02-23 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-7825. - Resolution: Duplicate Duplicated with HADOOP-11039 > HdfsDataInputStream::read(ByteBuffer) method does

[jira] [Resolved] (HDFS-7716) Erasure Coding: extend BlockInfo to handle EC info

2015-02-10 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-7716. - Resolution: Fixed Hadoop Flags: Reviewed I've committed this (to both the HDFS-EC and HDFS

[jira] [Created] (HDFS-7749) Add stripped block support in INodeFile

2015-02-06 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-7749: --- Summary: Add stripped block support in INodeFile Key: HDFS-7749 URL: https://issues.apache.org/jira/browse/HDFS-7749 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-7743) Code cleanup of BlockInfo and rename BlockInfo to BlockReplicationInfo

2015-02-06 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-7743: --- Summary: Code cleanup of BlockInfo and rename BlockInfo to BlockReplicationInfo Key: HDFS-7743 URL: https://issues.apache.org/jira/browse/HDFS-7743 Project: Hadoop HDFS

[jira] [Created] (HDFS-7728) Avoid updating quota usage while loading edits

2015-02-02 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-7728: --- Summary: Avoid updating quota usage while loading edits Key: HDFS-7728 URL: https://issues.apache.org/jira/browse/HDFS-7728 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-7717) Erasure Coding: provide a tool for convert files between replication and erasure coding

2015-01-30 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-7717: --- Summary: Erasure Coding: provide a tool for convert files between replication and erasure coding Key: HDFS-7717 URL: https://issues.apache.org/jira/browse/HDFS-7717 Project

[jira] [Created] (HDFS-7716) Erasure Coding: extend BlockInfo to handle EC info

2015-01-30 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-7716: --- Summary: Erasure Coding: extend BlockInfo to handle EC info Key: HDFS-7716 URL: https://issues.apache.org/jira/browse/HDFS-7716 Project: Hadoop HDFS Issue Type: Sub

[jira] [Created] (HDFS-7663) Erasure Coding: support Append on EC file

2015-01-22 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-7663: --- Summary: Erasure Coding: support Append on EC file Key: HDFS-7663 URL: https://issues.apache.org/jira/browse/HDFS-7663 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-7622) Erasure Coding: handling truncated files

2015-01-15 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-7622: --- Summary: Erasure Coding: handling truncated files Key: HDFS-7622 URL: https://issues.apache.org/jira/browse/HDFS-7622 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-7621) Erasure Coding: update the Balancer/Mover data migration logic

2015-01-15 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-7621: --- Summary: Erasure Coding: update the Balancer/Mover data migration logic Key: HDFS-7621 URL: https://issues.apache.org/jira/browse/HDFS-7621 Project: Hadoop HDFS

[jira] [Created] (HDFS-7619) Erasure Coding: Handling files in snapshots

2015-01-15 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-7619: --- Summary: Erasure Coding: Handling files in snapshots Key: HDFS-7619 URL: https://issues.apache.org/jira/browse/HDFS-7619 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-7535) Utilize Snapshot diff report for distcp

2014-12-16 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-7535: --- Summary: Utilize Snapshot diff report for distcp Key: HDFS-7535 URL: https://issues.apache.org/jira/browse/HDFS-7535 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Created] (HDFS-7509) Avoid resolving path multiple times in rename/mkdir

2014-12-10 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-7509: --- Summary: Avoid resolving path multiple times in rename/mkdir Key: HDFS-7509 URL: https://issues.apache.org/jira/browse/HDFS-7509 Project: Hadoop HDFS Issue Type: Sub

[jira] [Created] (HDFS-7508) Clean up path resolving in FSNamesystem/FSDirectory

2014-12-10 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-7508: --- Summary: Clean up path resolving in FSNamesystem/FSDirectory Key: HDFS-7508 URL: https://issues.apache.org/jira/browse/HDFS-7508 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-7498) Simplify the logic in INodesInPath

2014-12-08 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-7498: --- Summary: Simplify the logic in INodesInPath Key: HDFS-7498 URL: https://issues.apache.org/jira/browse/HDFS-7498 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Created] (HDFS-7474) Avoid resolve path in FSPermissionChecker

2014-12-04 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-7474: --- Summary: Avoid resolve path in FSPermissionChecker Key: HDFS-7474 URL: https://issues.apache.org/jira/browse/HDFS-7474 Project: Hadoop HDFS Issue Type: Improvement

Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-14 Thread Jing Zhao
+1 (binding) Verified checksums and signatures. Successfully deploy a cluster with NameNode HA setup and run some hdfs commands. Thanks, -Jing On Fri, Nov 14, 2014 at 3:58 PM, Chris Nauroth wrote: > +1 (binding) > > - Verified checksums and signatures for source and binary tarballs. > - Starte

[jira] [Created] (HDFS-7388) Improve the log for HA failover

2014-11-10 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-7388: --- Summary: Improve the log for HA failover Key: HDFS-7388 URL: https://issues.apache.org/jira/browse/HDFS-7388 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Resolved] (HDFS-7296) HdfsConstants#MEMORY_STORAGE_POLICY_ID and HdfsConstants#MEMORY_STORAGE_POLICY_ID are missing in branch-2

2014-10-27 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-7296. - Resolution: Fixed Fix Version/s: 2.6.0 Thanks for the review, Chris! I've committed this to b

[jira] [Created] (HDFS-7228) Add an SSD policy into the default BlockStoragePolicySuite

2014-10-10 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-7228: --- Summary: Add an SSD policy into the default BlockStoragePolicySuite Key: HDFS-7228 URL: https://issues.apache.org/jira/browse/HDFS-7228 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-7167) NPE while running Mover if the given path is for a file

2014-09-29 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-7167: --- Summary: NPE while running Mover if the given path is for a file Key: HDFS-7167 URL: https://issues.apache.org/jira/browse/HDFS-7167 Project: Hadoop HDFS Issue Type

Re: Thinking ahead to hadoop-2.6

2014-09-24 Thread Jing Zhao
Just to give a quick update about the current status of HDFS-6584 (archival storage). So far after HDFS-7081 got committed this morning, the main functionalities have already been finished. As a summary two new DistributedFileSystem APIs are added: getStoragePolicies and setStoragePolicy. We have a

[jira] [Created] (HDFS-7140) Add a tool to list all the existing block storage policies

2014-09-24 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-7140: --- Summary: Add a tool to list all the existing block storage policies Key: HDFS-7140 URL: https://issues.apache.org/jira/browse/HDFS-7140 Project: Hadoop HDFS Issue

Re: [VOTE] Merge HDFS-6581 to trunk - Writing to replicas in memory.

2014-09-23 Thread Jing Zhao
+1. This is a very useful feature and the performance number looks convincing. Thanks, -Jing On Tue, Sep 23, 2014 at 5:12 PM, Xiaoyu Yao wrote: > +1 non-binding. I’ve reviewed most of the changes in the branch and the > E2E perf numbers looks good. > > Thanks, > Xiaoyu > > On Sep 23, 2014, at 4

[jira] [Created] (HDFS-7131) During HA upgrade, JournalNode should also copy the committedTxnId file into the current directory

2014-09-22 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-7131: --- Summary: During HA upgrade, JournalNode should also copy the committedTxnId file into the current directory Key: HDFS-7131 URL: https://issues.apache.org/jira/browse/HDFS-7131

[jira] [Created] (HDFS-7092) Document the logic about Delegation Token is generated and used in both HA and non-HA setup

2014-09-18 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-7092: --- Summary: Document the logic about Delegation Token is generated and used in both HA and non-HA setup Key: HDFS-7092 URL: https://issues.apache.org/jira/browse/HDFS-7092

[jira] [Resolved] (HDFS-7088) Archival Storage: fix TestBalancer and TestBalancerWithMultipleNameNodes

2014-09-18 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-7088. - Resolution: Fixed Hadoop Flags: Reviewed I've committed this. > Archival Storage: fix Test

[jira] [Resolved] (HDFS-6864) Archival Storage: add user documentation

2014-09-17 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-6864. - Resolution: Fixed Hadoop Flags: Reviewed I've committed this. Thanks for working on this, [~sze

[jira] [Created] (HDFS-7081) Add new DistributedFileSystem API for getting all the existing storage policies

2014-09-16 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-7081: --- Summary: Add new DistributedFileSystem API for getting all the existing storage policies Key: HDFS-7081 URL: https://issues.apache.org/jira/browse/HDFS-7081 Project: Hadoop

[jira] [Resolved] (HDFS-7052) Archival Storage: Add Mover into hdfs script

2014-09-16 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-7052. - Resolution: Fixed I've committed this. > Archival Storage: Add Mover into hdf

[jira] [Created] (HDFS-7076) Persist Block Storage Policy in FSImage and Edit Log

2014-09-16 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-7076: --- Summary: Persist Block Storage Policy in FSImage and Edit Log Key: HDFS-7076 URL: https://issues.apache.org/jira/browse/HDFS-7076 Project: Hadoop HDFS Issue Type: Sub

[jira] [Created] (HDFS-7072) Fix TestBlockManager#testUseDelHint

2014-09-16 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-7072: --- Summary: Fix TestBlockManager#testUseDelHint Key: HDFS-7072 URL: https://issues.apache.org/jira/browse/HDFS-7072 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Resolved] (HDFS-7062) Archival Storage: skip under construction block for migration

2014-09-15 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-7062. - Resolution: Fixed Hadoop Flags: Reviewed Thanks Nicholas for the review. I've committed

[jira] [Created] (HDFS-7062) Archival Storage: skip under construction block for migration

2014-09-12 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-7062: --- Summary: Archival Storage: skip under construction block for migration Key: HDFS-7062 URL: https://issues.apache.org/jira/browse/HDFS-7062 Project: Hadoop HDFS Issue

[jira] [Resolved] (HDFS-7053) Failed to rollback hdfs version from 2.4.1 to 2.2.0

2014-09-12 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-7053. - Resolution: Invalid Close this jira as invalid. > Failed to rollback hdfs version from 2.4.1 to 2.

[jira] [Created] (HDFS-7052) Add Mover into hdfs script

2014-09-11 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-7052: --- Summary: Add Mover into hdfs script Key: HDFS-7052 URL: https://issues.apache.org/jira/browse/HDFS-7052 Project: Hadoop HDFS Issue Type: Sub-task Reporter

[jira] [Resolved] (HDFS-7039) Archival Storage: fix Balancer tests

2014-09-11 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-7039. - Resolution: Fixed Hadoop Flags: Reviewed +1. I've committed this. > Archival Storage: fix

[jira] [Resolved] (HDFS-7034) Archival Storage: Fix TestBlockPlacement and TestStorageMover

2014-09-11 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-7034. - Resolution: Fixed Hadoop Flags: Reviewed I've committed this. > Archival Stor

[jira] [Created] (HDFS-7034) Fix TestBlockPlacement and TestStorageMover

2014-09-09 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-7034: --- Summary: Fix TestBlockPlacement and TestStorageMover Key: HDFS-7034 URL: https://issues.apache.org/jira/browse/HDFS-7034 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Resolved] (HDFS-7029) Archival Storage: fix TestDFSInotifyEventInputStream and TestDistributedFileSystem

2014-09-08 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-7029. - Resolution: Fixed Hadoop Flags: Reviewed I've committed this. > Archival Stor

[jira] [Resolved] (HDFS-7027) Archival Storage: Mover does not terminate when some storage type is out of space

2014-09-08 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-7027. - Resolution: Fixed Hadoop Flags: Reviewed Thanks for fixing this, Nicholas! +1. I've committed

[jira] [Resolved] (HDFS-6875) Archival Storage: support migration for a list of specified paths

2014-09-08 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-6875. - Resolution: Fixed I've committed this. > Archival Storage: support migration for a list of s

[jira] [Created] (HDFS-7030) Add more unit tests for DatanodeStorageInfo

2014-09-08 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-7030: --- Summary: Add more unit tests for DatanodeStorageInfo Key: HDFS-7030 URL: https://issues.apache.org/jira/browse/HDFS-7030 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Resolved] (HDFS-6876) Archival Storage: support set/get storage policy in DFSAdmin

2014-09-04 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-6876. - Resolution: Fixed Hadoop Flags: Reviewed Thanks for the review, Nicholas! I've committed

[jira] [Resolved] (HDFS-6961) Archival Storage: BlockPlacementPolicy#chooseTarget should check each valid storage type in each choosing round

2014-09-04 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-6961. - Resolution: Fixed Hadoop Flags: Reviewed I've committed this. > Archival

[jira] [Created] (HDFS-6996) SnapshotDiff report can hit IndexOutOfBoundsException when there are nested renamed directory/file

2014-09-04 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-6996: --- Summary: SnapshotDiff report can hit IndexOutOfBoundsException when there are nested renamed directory/file Key: HDFS-6996 URL: https://issues.apache.org/jira/browse/HDFS-6996

[jira] [Resolved] (HDFS-6969) Archival Storage: INode#getStoragePolicyID should always return the latest storage policy

2014-09-01 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-6969. - Resolution: Fixed Hadoop Flags: Reviewed Thanks again, Nicholas! I've committed this. >

[jira] [Created] (HDFS-6969) Archival Storage: INode#getStoragePolicyID should always return the latest storage policy

2014-08-28 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-6969: --- Summary: Archival Storage: INode#getStoragePolicyID should always return the latest storage policy Key: HDFS-6969 URL: https://issues.apache.org/jira/browse/HDFS-6969 Project

[jira] [Created] (HDFS-6961) BlockPlacementPolicy#chooseTarget should check each valid storage type in each choosing round

2014-08-27 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-6961: --- Summary: BlockPlacementPolicy#chooseTarget should check each valid storage type in each choosing round Key: HDFS-6961 URL: https://issues.apache.org/jira/browse/HDFS-6961

[jira] [Resolved] (HDFS-6944) Archival Storage: add retry and termination logic for Mover

2014-08-27 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-6944. - Resolution: Fixed Thanks for the review, Nicholas! I've committed this. > Archival Storage: a

[jira] [Resolved] (HDFS-6920) Archival Storage: check the storage type of delNodeHintStorage when deleting a replica

2014-08-27 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-6920. - Resolution: Fixed Hadoop Flags: Reviewed I've committed this. Thanks Nicholas! > Archival

[jira] [Resolved] (HDFS-6911) Archival Storage: check if a block is already scheduled in Mover

2014-08-27 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-6911. - Resolution: Fixed Hadoop Flags: Reviewed I've committed this. Thanks Nicholas! > Archival

[jira] [Created] (HDFS-6944) Archival Storage: add a test framework for testing different migration scenarios

2014-08-25 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-6944: --- Summary: Archival Storage: add a test framework for testing different migration scenarios Key: HDFS-6944 URL: https://issues.apache.org/jira/browse/HDFS-6944 Project: Hadoop

[jira] [Resolved] (HDFS-6906) Archival Storage: Add more tests for BlockStoragePolicy

2014-08-24 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-6906. - Resolution: Fixed Hadoop Flags: Reviewed > Archival Storage: Add more tests for BlockStoragePol

[jira] [Resolved] (HDFS-6863) Archival Storage: Support migration for snapshot paths

2014-08-21 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-6863. - Resolution: Fixed Hadoop Flags: Reviewed I've committed this. Thanks for the review, Nic

[jira] [Created] (HDFS-6876) Archival Storage: support set/get storage policy in DFSAdmin

2014-08-19 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-6876: --- Summary: Archival Storage: support set/get storage policy in DFSAdmin Key: HDFS-6876 URL: https://issues.apache.org/jira/browse/HDFS-6876 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-6875) Archival Storage: support migration for a list of specified paths

2014-08-19 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-6875: --- Summary: Archival Storage: support migration for a list of specified paths Key: HDFS-6875 URL: https://issues.apache.org/jira/browse/HDFS-6875 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-6801) Archival Storage: Add a new data migration tool

2014-08-18 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-6801. - Resolution: Fixed Hadoop Flags: Reviewed I've committed this. > Archival Storage: Add a

[jira] [Created] (HDFS-6863) Archival Storage: Support migration for customized paths and snapshot paths

2014-08-18 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-6863: --- Summary: Archival Storage: Support migration for customized paths and snapshot paths Key: HDFS-6863 URL: https://issues.apache.org/jira/browse/HDFS-6863 Project: Hadoop HDFS

[jira] [Created] (HDFS-6864) Archival Storage: add documentation for the new migration tool

2014-08-18 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-6864: --- Summary: Archival Storage: add documentation for the new migration tool Key: HDFS-6864 URL: https://issues.apache.org/jira/browse/HDFS-6864 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-6844) Archival Storage: Extend HdfsFileStatus to get storage policy

2014-08-13 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-6844. - Resolution: Duplicate HDFS-6847 will cover the same functionality. Close this as duplicate. > Archi

[jira] [Created] (HDFS-6847) Archival Storage: Support storage policy on a directory

2014-08-13 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-6847: --- Summary: Archival Storage: Support storage policy on a directory Key: HDFS-6847 URL: https://issues.apache.org/jira/browse/HDFS-6847 Project: Hadoop HDFS Issue Type

[jira] [Resolved] (HDFS-6835) Archival Storage: Add a new API to set storage policy

2014-08-12 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-6835. - Resolution: Fixed I've committed this. > Archival Storage: Add a new API to set storag

[jira] [Created] (HDFS-6844) Archival Storage: Extend HdfsFileStatus to get storage policy

2014-08-12 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-6844: --- Summary: Archival Storage: Extend HdfsFileStatus to get storage policy Key: HDFS-6844 URL: https://issues.apache.org/jira/browse/HDFS-6844 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-6838) Code cleanup for unnecessary INode replacement

2014-08-11 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-6838: --- Summary: Code cleanup for unnecessary INode replacement Key: HDFS-6838 URL: https://issues.apache.org/jira/browse/HDFS-6838 Project: Hadoop HDFS Issue Type: Bug

[jira] [Resolved] (HDFS-6822) In branch-1, Namenode and datanode fails to replace "_HOST" to hostname for hadoop.http.authentication.kerberos.principal

2014-08-06 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-6822. - Resolution: Fixed Fix Version/s: 1.3.0 Target Version/s: (was: 1.2.1) Hadoop

[jira] [Created] (HDFS-6822) In branch-1, Namenode and datanode fails to replace "_HOST" to hostname for hadoop.http.authentication.kerberos.principal

2014-08-05 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-6822: --- Summary: In branch-1, Namenode and datanode fails to replace "_HOST" to hostname for hadoop.http.authentication.kerberos.principal Key: HDFS-6822 URL: https://issues.apache.org/j

[jira] [Created] (HDFS-6609) Use DirectorySnapshottableFeature to represent a snapshottable directory

2014-06-30 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-6609: --- Summary: Use DirectorySnapshottableFeature to represent a snapshottable directory Key: HDFS-6609 URL: https://issues.apache.org/jira/browse/HDFS-6609 Project: Hadoop HDFS

[jira] [Reopened] (HDFS-6527) Edit log corruption due to defered INode removal

2014-06-24 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao reopened HDFS-6527: - Reopen the jira and wait for [~kihwal] to comment. > Edit log corruption due to defered INode remo

[jira] [Created] (HDFS-6593) Move SnapshotDiffInfo out of INodeDirectorySnapshottable

2014-06-23 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-6593: --- Summary: Move SnapshotDiffInfo out of INodeDirectorySnapshottable Key: HDFS-6593 URL: https://issues.apache.org/jira/browse/HDFS-6593 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-6551) Rename with OVERWRITE may throw NPE when the target file/directory is a reference INode

2014-06-16 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-6551: --- Summary: Rename with OVERWRITE may throw NPE when the target file/directory is a reference INode Key: HDFS-6551 URL: https://issues.apache.org/jira/browse/HDFS-6551 Project

<    1   2   3   4   5   >