[jira] Updated: (HDFS-781) Metrics PendingDeletionBlocks is not decremented
[
https://issues.apache.org/jira/browse/HDFS-781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Suresh Srinivas updated HDFS-781:
-
Resolution: Fixed
Fix Version/s: 0.22.0
0.21.0
0.20.2
Status: Resolved (was: Patch Available)
> Metrics PendingDeletionBlocks is not decremented
>
>
> Key: HDFS-781
> URL: https://issues.apache.org/jira/browse/HDFS-781
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: name-node
>Affects Versions: 0.20.2, 0.21.0, 0.22.0
>Reporter: Suresh Srinivas
>Assignee: Suresh Srinivas
>Priority: Blocker
> Fix For: 0.20.2, 0.21.0, 0.22.0
>
> Attachments: hdfs-781.1.patch, hdfs-781.2.patch, hdfs-781.3.patch,
> hdfs-781.4.patch, hdfs-781.patch, hdfs-781.rel20.1.patch, hdfs-781.rel20.patch
>
>
> PendingDeletionBlocks is not decremented decremented when blocks pending
> deletion in {{BlockManager.recentInvalidateSets}} are sent to datanode for
> deletion. This results in invalid value in the metrics.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HDFS-468) libhdfs should expose symlink dfs API
[ https://issues.apache.org/jira/browse/HDFS-468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12786789#action_12786789 ] Eli Collins commented on HDFS-468: -- There isn't a specific jira for that task but you might want to follow HDFS-765. > libhdfs should expose symlink dfs API > - > > Key: HDFS-468 > URL: https://issues.apache.org/jira/browse/HDFS-468 > Project: Hadoop HDFS > Issue Type: New Feature >Reporter: Pete Wyckoff > -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (HDFS-755) Read multiple checksum chunks at once in DFSInputStream
[ https://issues.apache.org/jira/browse/HDFS-755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12786788#action_12786788 ] Raghu Angadi commented on HDFS-755: --- The patch looks good except that BlockReader.in seems to buffered with a large buffer. Most of the data might still be going through extra copy. I haven't run the patch yet... > Read multiple checksum chunks at once in DFSInputStream > --- > > Key: HDFS-755 > URL: https://issues.apache.org/jira/browse/HDFS-755 > Project: Hadoop HDFS > Issue Type: Improvement > Components: hdfs client >Affects Versions: 0.22.0 >Reporter: Todd Lipcon >Assignee: Todd Lipcon > Attachments: hdfs-755.txt, hdfs-755.txt, hdfs-755.txt, hdfs-755.txt, > hdfs-755.txt > > > HADOOP-3205 adds the ability for FSInputChecker subclasses to read multiple > checksum chunks in a single call to readChunk. This is the HDFS-side use of > that new feature. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (HDFS-468) libhdfs should expose symlink dfs API
[ https://issues.apache.org/jira/browse/HDFS-468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12786781#action_12786781 ] weimin zhu commented on HDFS-468: - ok,I will wait for the the task that libhdfs being moved over to FileContext. can you teach me the number of jira for the task. > libhdfs should expose symlink dfs API > - > > Key: HDFS-468 > URL: https://issues.apache.org/jira/browse/HDFS-468 > Project: Hadoop HDFS > Issue Type: New Feature >Reporter: Pete Wyckoff > -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (HDFS-781) Metrics PendingDeletionBlocks is not decremented
[
https://issues.apache.org/jira/browse/HDFS-781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12786769#action_12786769
]
Suresh Srinivas commented on HDFS-781:
--
Just committed this patch to trunk and branch 0.21.
> Metrics PendingDeletionBlocks is not decremented
>
>
> Key: HDFS-781
> URL: https://issues.apache.org/jira/browse/HDFS-781
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: name-node
>Affects Versions: 0.20.2, 0.21.0, 0.22.0
>Reporter: Suresh Srinivas
>Assignee: Suresh Srinivas
>Priority: Blocker
> Attachments: hdfs-781.1.patch, hdfs-781.2.patch, hdfs-781.3.patch,
> hdfs-781.4.patch, hdfs-781.patch, hdfs-781.rel20.1.patch, hdfs-781.rel20.patch
>
>
> PendingDeletionBlocks is not decremented decremented when blocks pending
> deletion in {{BlockManager.recentInvalidateSets}} are sent to datanode for
> deletion. This results in invalid value in the metrics.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HDFS-804) New unit tests for concurrent lease recovery
[
https://issues.apache.org/jira/browse/HDFS-804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12786767#action_12786767
]
Hairong Kuang commented on HDFS-804:
The new unit tests look good to me. Cos, could you please add two more tests:
(1) lease recovery on a file with zero block; (1) lease recovery a file with 1
block? Sorry for the late new request. Hope it is not a lot of work.
> New unit tests for concurrent lease recovery
>
>
> Key: HDFS-804
> URL: https://issues.apache.org/jira/browse/HDFS-804
> Project: Hadoop HDFS
> Issue Type: Test
> Components: test
>Affects Versions: 0.21.0, 0.22.0
>Reporter: Konstantin Boudnik
>Assignee: Konstantin Boudnik
> Attachments: HDFS-804.patch, HDFS-804.patch
>
>
> {{FSNamesystem}} code which process concurrent lease recovery isn't tested.
> We need new test cases to cover these spots.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HDFS-468) libhdfs should expose symlink dfs API
[ https://issues.apache.org/jira/browse/HDFS-468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12786766#action_12786766 ] Eli Collins commented on HDFS-468: -- libhdfs currently uses FileSystem, and symlinks are implemented in FileContext so this tasks depends on libhdfs being moved over to FileContext. > libhdfs should expose symlink dfs API > - > > Key: HDFS-468 > URL: https://issues.apache.org/jira/browse/HDFS-468 > Project: Hadoop HDFS > Issue Type: New Feature >Reporter: Pete Wyckoff > -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (HDFS-468) libhdfs should expose symlink dfs API
[ https://issues.apache.org/jira/browse/HDFS-468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12786764#action_12786764 ] weimin zhu commented on HDFS-468: - I will implement libhdfs symlinks using the latest patch of HDFS-245 too > libhdfs should expose symlink dfs API > - > > Key: HDFS-468 > URL: https://issues.apache.org/jira/browse/HDFS-468 > Project: Hadoop HDFS > Issue Type: New Feature >Reporter: Pete Wyckoff > -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HDFS-427) fuse-dfs should support symlinks
[ https://issues.apache.org/jira/browse/HDFS-427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] weimin zhu updated HDFS-427: Description: implement dfs_symlink(from, to) and dfs_readlink(path,buf,size) was: implement dfs_symlink(from, to) > fuse-dfs should support symlinks > > > Key: HDFS-427 > URL: https://issues.apache.org/jira/browse/HDFS-427 > Project: Hadoop HDFS > Issue Type: Bug > Components: contrib/fuse-dfs >Reporter: Pete Wyckoff > > implement dfs_symlink(from, to) and dfs_readlink(path,buf,size) -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (HDFS-427) fuse-dfs should support symlinks
[ https://issues.apache.org/jira/browse/HDFS-427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12786763#action_12786763 ] weimin zhu commented on HDFS-427: - I will implement fuse-dfs symlinks using the latest patch of HDFS-245 > fuse-dfs should support symlinks > > > Key: HDFS-427 > URL: https://issues.apache.org/jira/browse/HDFS-427 > Project: Hadoop HDFS > Issue Type: Bug > Components: contrib/fuse-dfs >Reporter: Pete Wyckoff > > implement dfs_symlink(from, to) -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
