Jing Zhao created HDFS-5080:
---
Summary: BootstrapStandby not working with QJM when the existing
NN is active
Key: HDFS-5080
URL: https://issues.apache.org/jira/browse/HDFS-5080
Project: Hadoop HDFS
[
https://issues.apache.org/jira/browse/HDFS-4926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jing Zhao resolved HDFS-4926.
-
Resolution: Fixed
Fix Version/s: 2.1.1-beta
Hadoop Flags: Reviewed
I've committed th
Jing Zhao created HDFS-5076:
---
Summary: Create http servlets to enable querying NN's last applied
transaction ID and most recent checkpoint's transaction ID
Key: HDFS-5076
URL: https://issues.apache.org/jira/b
Jing Zhao created HDFS-5045:
---
Summary: Add more unit tests for retry cache to cover all
AtMostOnce methods
Key: HDFS-5045
URL: https://issues.apache.org/jira/browse/HDFS-5045
Project: Hadoop HDFS
Jing Zhao created HDFS-5038:
---
Summary: Backport several branch-2 APIs to branch-1
Key: HDFS-5038
URL: https://issues.apache.org/jira/browse/HDFS-5038
Project: Hadoop HDFS
Issue Type: Bug
Jing Zhao created HDFS-5025:
---
Summary: Record ClientId and CalldId in EditLog to enable
rebuilding retry cache in case of HA failover
Key: HDFS-5025
URL: https://issues.apache.org/jira/browse/HDFS-5025
Jing Zhao created HDFS-5020:
---
Summary: Make DatanodeProtocol#blockReceivedAndDeleted idempotent
Key: HDFS-5020
URL: https://issues.apache.org/jira/browse/HDFS-5020
Project: Hadoop HDFS
Issue Type
Jing Zhao created HDFS-5013:
---
Summary: Improve HDFS HA document
Key: HDFS-5013
URL: https://issues.apache.org/jira/browse/HDFS-5013
Project: Hadoop HDFS
Issue Type: Improvement
Affects
Jing Zhao created HDFS-5005:
---
Summary: Move SnapshotException and SnapshotAccessControlException
to o.a.h.hdfs.protocol
Key: HDFS-5005
URL: https://issues.apache.org/jira/browse/HDFS-5005
Project: Hadoop
Hi Sugato,
Do you want to read the data from hdfs? From the log it seems like
you're reading data from a "RawLocalFileSystem". Maybe you need to check if
you have set your default file system in the configuration correctly (
fs.default.name or fs.defaultFS, depending on your hadoop version)?
Hi Hemant,
HDFS-4213 (https://issues.apache.org/jira/browse/HDFS-4213) may be
the one you're looking for. In general, an hsync which can update the
file size on NN is enabled. You may call
"hsync(EnumSet.of(SyncFlag.UPDATE_LENGTH))" to do that.
Thanks,
-Jing
On Thu, Jul 11, 2013 at 1:38 AM,
Jing Zhao created HDFS-4978:
---
Summary: Make disallowSnapshot idempotent
Key: HDFS-4978
URL: https://issues.apache.org/jira/browse/HDFS-4978
Project: Hadoop HDFS
Issue Type: Improvement
Affects
Jing Zhao created HDFS-4971:
---
Summary: Move IO operations out of locking in OpenFileCtx
Key: HDFS-4971
URL: https://issues.apache.org/jira/browse/HDFS-4971
Project: Hadoop HDFS
Issue Type: Sub
Jing Zhao created HDFS-4877:
---
Summary: Snapshot: fix the scenario where a directory is renamed
under its prior descendant
Key: HDFS-4877
URL: https://issues.apache.org/jira/browse/HDFS-4877
Project: Hadoop
Jing Zhao created HDFS-4863:
---
Summary: The root directory should be added to the snapshottable
directory list while loading fsimage
Key: HDFS-4863
URL: https://issues.apache.org/jira/browse/HDFS-4863
[
https://issues.apache.org/jira/browse/HDFS-4847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jing Zhao resolved HDFS-4847.
-
Resolution: Invalid
".snapshot" is not a directory thus commands such as "count" and
Jing Zhao created HDFS-4857:
---
Summary: Snapshot.Root and AbstractINodeDiff#snapshotINode should
not be put into INodeMap when loading FSImage
Key: HDFS-4857
URL: https://issues.apache.org/jira/browse/HDFS-4857
Jing Zhao created HDFS-4842:
---
Summary: Snapshot: identify the correct prior snapshot when
deleting a snapshot under a renamed subtree
Key: HDFS-4842
URL: https://issues.apache.org/jira/browse/HDFS-4842
Jing Zhao created HDFS-4809:
---
Summary: Add more unit tests for the undo section of rename
Key: HDFS-4809
URL: https://issues.apache.org/jira/browse/HDFS-4809
Project: Hadoop HDFS
Issue Type: Sub
Jing Zhao created HDFS-4806:
---
Summary: For an INodeDirectoryWithSnapshot, use
INode#isInLatestSnapshot() to check if the added/removed child should be
recorded in snapshot diff
Key: HDFS-4806
URL: https
Jing Zhao created HDFS-4800:
---
Summary: Fix INodeDirectoryWithSnapshot#cleanDeletedINode
Key: HDFS-4800
URL: https://issues.apache.org/jira/browse/HDFS-4800
Project: Hadoop HDFS
Issue Type: Sub
Jing Zhao created HDFS-4791:
---
Summary: Update and fix deletion of reference inode
Key: HDFS-4791
URL: https://issues.apache.org/jira/browse/HDFS-4791
Project: Hadoop HDFS
Issue Type: Sub-task
Jing Zhao created HDFS-4773:
---
Summary: Fix bugs in quota usage updating/computation
Key: HDFS-4773
URL: https://issues.apache.org/jira/browse/HDFS-4773
Project: Hadoop HDFS
Issue Type: Sub-task
Jing Zhao created HDFS-4761:
---
Summary: Refresh INodeMap in FSDirectory#reset()
Key: HDFS-4761
URL: https://issues.apache.org/jira/browse/HDFS-4761
Project: Hadoop HDFS
Issue Type: Bug
Affects
Jing Zhao created HDFS-4760:
---
Summary: Update inodeMap after node replacement
Key: HDFS-4760
URL: https://issues.apache.org/jira/browse/HDFS-4760
Project: Hadoop HDFS
Issue Type: Sub-task
Jing Zhao created HDFS-4757:
---
Summary: Update FSDirectory#inodeMap when replacing an
INodeDirectory while setting quota
Key: HDFS-4757
URL: https://issues.apache.org/jira/browse/HDFS-4757
Project: Hadoop
Jing Zhao created HDFS-4749:
---
Summary: Use INodeId to identify the corresponding directory node
for FSImage saving/loading
Key: HDFS-4749
URL: https://issues.apache.org/jira/browse/HDFS-4749
Project
Jing Zhao created HDFS-4742:
---
Summary: Fix appending a renamed file
Key: HDFS-4742
URL: https://issues.apache.org/jira/browse/HDFS-4742
Project: Hadoop HDFS
Issue Type: Sub-task
Jing Zhao created HDFS-4729:
---
Summary: Update OfflineImageViewer and fix TestOfflineImageViewer
Key: HDFS-4729
URL: https://issues.apache.org/jira/browse/HDFS-4729
Project: Hadoop HDFS
Issue Type
Jing Zhao created HDFS-4727:
---
Summary: Update inodeMap after deleting files/directories/snapshots
Key: HDFS-4727
URL: https://issues.apache.org/jira/browse/HDFS-4727
Project: Hadoop HDFS
Issue
Jing Zhao created HDFS-4726:
---
Summary: Fix test failures after merging the mapping from INodeId
to INode
Key: HDFS-4726
URL: https://issues.apache.org/jira/browse/HDFS-4726
Project: Hadoop HDFS
Jing Zhao created HDFS-4700:
---
Summary: Fix the undo section of rename
Key: HDFS-4700
URL: https://issues.apache.org/jira/browse/HDFS-4700
Project: Hadoop HDFS
Issue Type: Sub-task
Jing Zhao created HDFS-4694:
---
Summary: The SecondaryNameNode may change the inode id of root
while doing checkpoint
Key: HDFS-4694
URL: https://issues.apache.org/jira/browse/HDFS-4694
Project: Hadoop HDFS
Jing Zhao created HDFS-4686:
---
Summary: Fix quota computation for rename with snapshots
Key: HDFS-4686
URL: https://issues.apache.org/jira/browse/HDFS-4686
Project: Hadoop HDFS
Issue Type: Sub-task
Jing Zhao created HDFS-4675:
---
Summary: Fix rename across snapshottable directories
Key: HDFS-4675
URL: https://issues.apache.org/jira/browse/HDFS-4675
Project: Hadoop HDFS
Issue Type: Sub-task
Jing Zhao created HDFS-4667:
---
Summary: Capture renamed files/directories in snapshot diff report
Key: HDFS-4667
URL: https://issues.apache.org/jira/browse/HDFS-4667
Project: Hadoop HDFS
Issue Type
Jing Zhao created HDFS-4666:
---
Summary: Disallow users to create file/dir named ".snapshot"
Key: HDFS-4666
URL: https://issues.apache.org/jira/browse/HDFS-4666
Project: Hadoop HDFS
Issue
Jing Zhao created HDFS-4650:
---
Summary: Add unit tests for rename with snapshots
Key: HDFS-4650
URL: https://issues.apache.org/jira/browse/HDFS-4650
Project: Hadoop HDFS
Issue Type: Sub-task
Jing Zhao created HDFS-4648:
---
Summary: For snapshot deletion, when merging the diff from
to-delete snapshot to the prior snapshot, make sure files/directories created
after the prior snapshot get deleted
Key: HDFS-4648
Jing Zhao created HDFS-4637:
---
Summary: INodeDirectory#replaceSelf4Quota may convert a newly
created directory (which is not included in the latest snapshot) to an
INodeDirectoryWithSnapshot
Key: HDFS-4637
URL: https
Jing Zhao created HDFS-4636:
---
Summary: Update quota usage when deleting a file/dir that is not
included in the latest snapshot
Key: HDFS-4636
URL: https://issues.apache.org/jira/browse/HDFS-4636
Project
Jing Zhao created HDFS-4627:
---
Summary: Fix FSImageFormat#Loader#loadFilesUnderConstruction
Key: HDFS-4627
URL: https://issues.apache.org/jira/browse/HDFS-4627
Project: Hadoop HDFS
Issue Type: Sub
Jing Zhao created HDFS-4622:
---
Summary: Remove redundant synchronized from
FSNamesystem#rollEditLog in branch-1
Key: HDFS-4622
URL: https://issues.apache.org/jira/browse/HDFS-4622
Project: Hadoop HDFS
Jing Zhao created HDFS-4616:
---
Summary: Update the FilesDeleted metric while deleting file/dir in
the current tree
Key: HDFS-4616
URL: https://issues.apache.org/jira/browse/HDFS-4616
Project: Hadoop HDFS
Jing Zhao created HDFS-4563:
---
Summary: Update namespace/diskspace after deleting snapshots
Key: HDFS-4563
URL: https://issues.apache.org/jira/browse/HDFS-4563
Project: Hadoop HDFS
Issue Type: Sub
Jing Zhao created HDFS-4557:
---
Summary: Fix FSDirectory#delete when INode#cleanSubtree returns 0
Key: HDFS-4557
URL: https://issues.apache.org/jira/browse/HDFS-4557
Project: Hadoop HDFS
Issue Type
Jing Zhao created HDFS-4550:
---
Summary: Refactor INodesInPath and add extra check for path ending
with "/.snapshot"
Key: HDFS-4550
URL: https://issues.apache.org/jira/browse/HDFS-4550
Project: H
Jing Zhao created HDFS-4524:
---
Summary: Update SnapshotManager#snapshottables when loading fsimage
Key: HDFS-4524
URL: https://issues.apache.org/jira/browse/HDFS-4524
Project: Hadoop HDFS
Issue
Jing Zhao created HDFS-4520:
---
Summary: Support listing snapshots under a snapshottable directory
using "ls"
Key: HDFS-4520
URL: https://issues.apache.org/jira/browse/HDFS-4520
Project: H
Jing Zhao created HDFS-4514:
---
Summary: Add CLI support for snapshot rename, diff report, and
snapshottable directory listing
Key: HDFS-4514
URL: https://issues.apache.org/jira/browse/HDFS-4514
Project
Jing Zhao created HDFS-4499:
---
Summary: Fix file/directory/snapshot deletion for file diff
Key: HDFS-4499
URL: https://issues.apache.org/jira/browse/HDFS-4499
Project: Hadoop HDFS
Issue Type: Sub
Jing Zhao created HDFS-4479:
---
Summary: In branch-1, logSync() may be called with the
FSNamesystem lock held in commitBlockSynchronization
Key: HDFS-4479
URL: https://issues.apache.org/jira/browse/HDFS-4479
Jing Zhao created HDFS-4432:
---
Summary: Support INodeFileUnderConstructionWithSnapshot in FSImage
saving/loading
Key: HDFS-4432
URL: https://issues.apache.org/jira/browse/HDFS-4432
Project: Hadoop HDFS
Jing Zhao created HDFS-4431:
---
Summary: Support snapshot in OfflineImageViewer
Key: HDFS-4431
URL: https://issues.apache.org/jira/browse/HDFS-4431
Project: Hadoop HDFS
Issue Type: Sub-task
Jing Zhao created HDFS-4429:
---
Summary: Add unit tests for taking snapshots while file appending
Key: HDFS-4429
URL: https://issues.apache.org/jira/browse/HDFS-4429
Project: Hadoop HDFS
Issue Type
Jing Zhao created HDFS-4414:
---
Summary: Create a DiffReport class to represent the diff between
snapshots to end users
Key: HDFS-4414
URL: https://issues.apache.org/jira/browse/HDFS-4414
Project: Hadoop
Jing Zhao created HDFS-4395:
---
Summary: INodeDirectorySnapshottable's constructor should take
into account the scenario when passed-in dir is of the type
INodeDirectoryWithSnapshot
Key: HDFS-4395
URL:
Jing Zhao created HDFS-4381:
---
Summary: Add javadoc for FSImageFormat with description about the
FSImage format with/without localNameINodes
Key: HDFS-4381
URL: https://issues.apache.org/jira/browse/HDFS-4381
Jing Zhao created HDFS-4361:
---
Summary: When listing snapshottable directories, only return those
where the user has permission to take snapshots
Key: HDFS-4361
URL: https://issues.apache.org/jira/browse/HDFS-4361
Jing Zhao created HDFS-4357:
---
Summary: After calling replaceSelf, further operations that should
be processed on the new INode may be applied to the original INode
Key: HDFS-4357
URL: https://issues.apache.org/jira
Jing Zhao created HDFS-4245:
---
Summary: Include snapshot related operations in
OfflineEditsViewerHelper#runOperations() to fix test failures in
TestOfflineEditsViewer
Key: HDFS-4245
URL: https://issues.apache.org/jira
Jing Zhao created HDFS-4244:
---
Summary: Support deleting snapshots
Key: HDFS-4244
URL: https://issues.apache.org/jira/browse/HDFS-4244
Project: Hadoop HDFS
Issue Type: Sub-task
Reporter
Jing Zhao created HDFS-4230:
---
Summary: Listing all the current snapshottable directories
Key: HDFS-4230
URL: https://issues.apache.org/jira/browse/HDFS-4230
Project: Hadoop HDFS
Issue Type: Sub
Jing Zhao created HDFS-4213:
---
Summary: When the client calls hsync(), allows the client to
update the file length in the NameNode
Key: HDFS-4213
URL: https://issues.apache.org/jira/browse/HDFS-4213
Project
Jing Zhao created HDFS-4196:
---
Summary: Support renaming of snapshots
Key: HDFS-4196
URL: https://issues.apache.org/jira/browse/HDFS-4196
Project: Hadoop HDFS
Issue Type: Sub-task
Jing Zhao created HDFS-4187:
---
Summary: Add testcases for replication handling in snapshots
Key: HDFS-4187
URL: https://issues.apache.org/jira/browse/HDFS-4187
Project: Hadoop HDFS
Issue Type: Sub
Jing Zhao created HDFS-4175:
---
Summary: Extend existing TestSnapshot to support more complicated
directory structure and more modifications on current files/direcotories
Key: HDFS-4175
URL: https://issues.apache.org
Jing Zhao created HDFS-4174:
---
Summary: Backport HDFS-1031 to branch-1: to list a few of the
corrupted files in WebUI
Key: HDFS-4174
URL: https://issues.apache.org/jira/browse/HDFS-4174
Project: Hadoop HDFS
Jing Zhao created HDFS-4159:
---
Summary: Rename should fail when the destination dir is
snapshottable and has snapshots
Key: HDFS-4159
URL: https://issues.apache.org/jira/browse/HDFS-4159
Project: Hadoop
Jing Zhao created HDFS-4150:
---
Summary: Update inode in blocksMap when deleting original/snapshot
file
Key: HDFS-4150
URL: https://issues.apache.org/jira/browse/HDFS-4150
Project: Hadoop HDFS
Jing Zhao created HDFS-4147:
---
Summary: Deletion of snapshottable dir with snapshots should fail
Key: HDFS-4147
URL: https://issues.apache.org/jira/browse/HDFS-4147
Project: Hadoop HDFS
Issue Type
Jing Zhao created HDFS-4144:
---
Summary: Create test for all snapshot-related metrics
Key: HDFS-4144
URL: https://issues.apache.org/jira/browse/HDFS-4144
Project: Hadoop HDFS
Issue Type: Sub-task
Jing Zhao created HDFS-4133:
---
Summary: Add testcases for testing basic snapshot functionalities
Key: HDFS-4133
URL: https://issues.apache.org/jira/browse/HDFS-4133
Project: Hadoop HDFS
Issue Type
Jing Zhao created HDFS-4124:
---
Summary: Refactor INodeDirectory#getExistingPathINodes() to enable
it to return more information other than the INode array
Key: HDFS-4124
URL: https://issues.apache.org/jira/browse/HDFS
Jing Zhao created HDFS-4106:
---
Summary: BPServiceActor#lastHeartbeat, lastBlockReport and
lastDeletedReport should be declared as volatile
Key: HDFS-4106
URL: https://issues.apache.org/jira/browse/HDFS-4106
Jing Zhao created HDFS-4096:
---
Summary: Add snapshot information to namenode WebUI
Key: HDFS-4096
URL: https://issues.apache.org/jira/browse/HDFS-4096
Project: Hadoop HDFS
Issue Type: Sub-task
Jing Zhao created HDFS-4095:
---
Summary: Add snapshot related metrics
Key: HDFS-4095
URL: https://issues.apache.org/jira/browse/HDFS-4095
Project: Hadoop HDFS
Issue Type: Sub-task
Jing Zhao created HDFS-4093:
---
Summary: In branch-1-win, AzureBlockPlacementPolicy#chooseTarget
only returns one DN when replication factor is greater than 3.
Key: HDFS-4093
URL: https://issues.apache.org/jira/browse
Jing Zhao created HDFS-4072:
---
Summary: When deleting a file, it would be better to also remove
corresponding block records from BlockManager#pendingReplications
Key: HDFS-4072
URL: https://issues.apache.org/jira/browse
[
https://issues.apache.org/jira/browse/HDFS-3953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jing Zhao resolved HDFS-3953.
-
Resolution: Duplicate
Duplicated with HDFS-4070
> DFSOutputStream constructor does
Jing Zhao created HDFS-4071:
---
Summary: Add number of stale DataNodes to metrics for Branch-1
Key: HDFS-4071
URL: https://issues.apache.org/jira/browse/HDFS-4071
Project: Hadoop HDFS
Issue Type
Jing Zhao created HDFS-4066:
---
Summary: Fix compile warnings for libwebhdfs
Key: HDFS-4066
URL: https://issues.apache.org/jira/browse/HDFS-4066
Project: Hadoop HDFS
Issue Type: Sub-task
Affects
Jing Zhao created HDFS-4062:
---
Summary: In branch-1, FSNameSystem#invalidateWorkForOneNode and
FSNameSystem#computeReplicationWorkForBlock should print logs outside of the
namesystem lock
Key: HDFS-4062
URL: https
Jing Zhao created HDFS-4059:
---
Summary: Add number of stale DataNodes to metrics
Key: HDFS-4059
URL: https://issues.apache.org/jira/browse/HDFS-4059
Project: Hadoop HDFS
Issue Type: Sub-task
Jing Zhao created HDFS-4052:
---
Summary: FSNameSystem#invalidateWorkForOneNode and
FSNameSystem#computeReplicationWorkForBlock in branch-1 should print debug
information outside of the namesystem lock
Key: HDFS-4052
URL
Jing Zhao created HDFS-3995:
---
Summary: Use DFSTestUtil.createFile() for file creation and
writing in test cases
Key: HDFS-3995
URL: https://issues.apache.org/jira/browse/HDFS-3995
Project: Hadoop HDFS
Jing Zhao created HDFS-3966:
---
Summary: For branch-1, TestFileCreation should use JUnit4 to make
assumeTrue work
Key: HDFS-3966
URL: https://issues.apache.org/jira/browse/HDFS-3966
Project: Hadoop HDFS
Jing Zhao created HDFS-3953:
---
Summary: DFSOutputStream constructor does not use bufferSize
parameter
Key: HDFS-3953
URL: https://issues.apache.org/jira/browse/HDFS-3953
Project: Hadoop HDFS
Issue
Jing Zhao created HDFS-3952:
---
Summary: Support hdfsHFlush and hdfsFlush in libwebhdfs (C client)
Key: HDFS-3952
URL: https://issues.apache.org/jira/browse/HDFS-3952
Project: Hadoop HDFS
Issue Type
Jing Zhao created HDFS-3927:
---
Summary: DFSInputStream#blockSeekTo may print incorrect warn msg
for IOException
Key: HDFS-3927
URL: https://issues.apache.org/jira/browse/HDFS-3927
Project: Hadoop HDFS
Jing Zhao created HDFS-3923:
---
Summary: libwebhdfs testing code cleanup
Key: HDFS-3923
URL: https://issues.apache.org/jira/browse/HDFS-3923
Project: Hadoop HDFS
Issue Type: Sub-task
Jing Zhao created HDFS-3920:
---
Summary: libwebdhfs code cleanup: string processing and using
strerror consistently to handle all errors
Key: HDFS-3920
URL: https://issues.apache.org/jira/browse/HDFS-3920
Jing Zhao created HDFS-3917:
---
Summary: Remove JNI code from libwebhdfs (C client library)
Key: HDFS-3917
URL: https://issues.apache.org/jira/browse/HDFS-3917
Project: Hadoop HDFS
Issue Type
Jing Zhao created HDFS-3912:
---
Summary: Detecting and avoiding stale datanodes for writing
Key: HDFS-3912
URL: https://issues.apache.org/jira/browse/HDFS-3912
Project: Hadoop HDFS
Issue Type: Sub
Jing Zhao created HDFS-3888:
---
Summary: BlockPlacementPolicyDefault#LOG should be removed
Key: HDFS-3888
URL: https://issues.apache.org/jira/browse/HDFS-3888
Project: Hadoop HDFS
Issue Type: Bug
Jing Zhao created HDFS-3887:
---
Summary: Remove redundant chooseTarget methods in
BlockPlacementPolicy.java
Key: HDFS-3887
URL: https://issues.apache.org/jira/browse/HDFS-3887
Project: Hadoop HDFS
Jing Zhao created HDFS-3860:
---
Summary: HeartbeatManager#Monitor may wrongly hold the writelock
of namesystem
Key: HDFS-3860
URL: https://issues.apache.org/jira/browse/HDFS-3860
Project: Hadoop HDFS
Jing Zhao created HDFS-3844:
---
Summary: Add @Override where necessary and remove unnecessary
{@inheritdoc} and imports
Key: HDFS-3844
URL: https://issues.apache.org/jira/browse/HDFS-3844
Project: Hadoop
Jing Zhao created HDFS-3834:
---
Summary: Unused Command.java fields NAME, DESCRIPTION and USAGE
Key: HDFS-3834
URL: https://issues.apache.org/jira/browse/HDFS-3834
Project: Hadoop HDFS
Issue Type
Jing Zhao created HDFS-3827:
---
Summary: TestHASafeMode#assertSafemode should be made static
Key: HDFS-3827
URL: https://issues.apache.org/jira/browse/HDFS-3827
Project: Hadoop HDFS
Issue Type: Bug
301 - 400 of 404 matches
Mail list logo
