[jira] [Commented] (HDFS-4732) TestDFSUpgradeFromImage fails on Windows due to failure to unpack old image tarball that contains hard links

[ https://issues.apache.org/jira/browse/HDFS-4732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13640328#comment-13640328 ] Hudson commented on HDFS-4732: -- Integrated in Hadoop-Yarn-trunk #193 (See [https://builds.apa

[jira] [Commented] (HDFS-4737) JVM path embedded in fuse binaries

[ https://issues.apache.org/jira/browse/HDFS-4737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13640331#comment-13640331 ] Hudson commented on HDFS-4737: -- Integrated in Hadoop-Yarn-trunk #193 (See [https://builds.apa

[jira] [Commented] (HDFS-4732) TestDFSUpgradeFromImage fails on Windows due to failure to unpack old image tarball that contains hard links

[ https://issues.apache.org/jira/browse/HDFS-4732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13640413#comment-13640413 ] Hudson commented on HDFS-4732: -- Integrated in Hadoop-Hdfs-trunk #1382 (See [https://builds.ap

[jira] [Commented] (HDFS-4737) JVM path embedded in fuse binaries

[ https://issues.apache.org/jira/browse/HDFS-4737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13640416#comment-13640416 ] Hudson commented on HDFS-4737: -- Integrated in Hadoop-Hdfs-trunk #1382 (See [https://builds.ap

[jira] [Commented] (HDFS-4738) Fix javadoc and other warnings in the snapshot branch

[ https://issues.apache.org/jira/browse/HDFS-4738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13640419#comment-13640419 ] Hudson commented on HDFS-4738: -- Integrated in Hadoop-Hdfs-Snapshots-Branch-build #167 (See [h

[jira] [Commented] (HDFS-4735) DisallowSnapshot throws IllegalStateException

[ https://issues.apache.org/jira/browse/HDFS-4735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13640420#comment-13640420 ] Hudson commented on HDFS-4735: -- Integrated in Hadoop-Hdfs-Snapshots-Branch-build #167 (See [h

[jira] [Commented] (HDFS-4305) Add a configurable limit on number of blocks per file, and min block size

[ https://issues.apache.org/jira/browse/HDFS-4305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13640433#comment-13640433 ] Suresh Srinivas commented on HDFS-4305: --- Given that the problems due to very small bl

[jira] [Commented] (HDFS-4489) Use InodeID as as an identifier of a file in HDFS protocols and APIs

[ https://issues.apache.org/jira/browse/HDFS-4489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13640438#comment-13640438 ] Suresh Srinivas commented on HDFS-4489: --- I am planning to push the subtasks of this j

[jira] [Commented] (HDFS-4732) TestDFSUpgradeFromImage fails on Windows due to failure to unpack old image tarball that contains hard links

[ https://issues.apache.org/jira/browse/HDFS-4732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13640463#comment-13640463 ] Hudson commented on HDFS-4732: -- Integrated in Hadoop-Mapreduce-trunk #1409 (See [https://buil

[jira] [Commented] (HDFS-4737) JVM path embedded in fuse binaries

[ https://issues.apache.org/jira/browse/HDFS-4737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13640466#comment-13640466 ] Hudson commented on HDFS-4737: -- Integrated in Hadoop-Mapreduce-trunk #1409 (See [https://buil

[jira] [Updated] (HDFS-4129) Add utility methods to dump NameNode in memory tree for testing

[ https://issues.apache.org/jira/browse/HDFS-4129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-4129: -- Fix Version/s: 2.0.5-beta I merged this change into branch-2 to be picked up for 2.0.5-beta.

[jira] [Updated] (HDFS-4152) Add a new class for the parameter in INode.collectSubtreeBlocksAndClear(..)

[ https://issues.apache.org/jira/browse/HDFS-4152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-4152: -- Affects Version/s: 2.0.5-beta I merged this change into branch-2. > Add a new c

[jira] [Commented] (HDFS-4671) DFSAdmin fetchImage should require superuser privilege even when security is not enabled

[ https://issues.apache.org/jira/browse/HDFS-4671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13640552#comment-13640552 ] Daryn Sharp commented on HDFS-4671: --- Yes, consistency is good, and I think it's worth doi

[jira] [Updated] (HDFS-4124) Refactor INodeDirectory#getExistingPathINodes() to enable returning more than INode array

[ https://issues.apache.org/jira/browse/HDFS-4124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-4124: -- Fix Version/s: 2.0.5-beta I committed this change to branch-2. > Refactor INode

[jira] [Updated] (HDFS-4152) Add a new class for the parameter in INode.collectSubtreeBlocksAndClear(..)

[ https://issues.apache.org/jira/browse/HDFS-4152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-4152: -- Fix Version/s: 2.0.5-beta I merged this patch to branch-2. > Add a new class fo

[jira] [Updated] (HDFS-4721) Speed up lease/block recovery when DN fails and a block goes into recovery

[ https://issues.apache.org/jira/browse/HDFS-4721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Sharma updated HDFS-4721: --- Attachment: 4721-trunk-v2.patch > Speed up lease/block recovery when DN fails and a block goes int

[jira] [Commented] (HDFS-4721) Speed up lease/block recovery when DN fails and a block goes into recovery

[ https://issues.apache.org/jira/browse/HDFS-4721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13640619#comment-13640619 ] Varun Sharma commented on HDFS-4721: [~szetszwo] I had a question about lease recovery

[jira] [Updated] (HDFS-4206) Change the fields in INode and its subclasses to private

[ https://issues.apache.org/jira/browse/HDFS-4206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-4206: -- Fix Version/s: 2.0.5-beta I merged this change to branch-2. > Change the fields

[jira] [Updated] (HDFS-4215) Improvements on INode and image loading

[ https://issues.apache.org/jira/browse/HDFS-4215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-4215: -- Fix Version/s: 2.0.5-beta I merged this patch to branch-2. > Improvements on IN

[jira] [Created] (HDFS-4739) NN can miscalculate the number of extra edit log segments to retain

Aaron T. Myers created HDFS-4739: Summary: NN can miscalculate the number of extra edit log segments to retain Key: HDFS-4739 URL: https://issues.apache.org/jira/browse/HDFS-4739 Project: Hadoop HDFS

[jira] [Updated] (HDFS-4739) NN can miscalculate the number of extra edit log segments to retain

[ https://issues.apache.org/jira/browse/HDFS-4739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-4739: - Attachment: HDFS-4739.patch Attached patch fixes the issue by: # Discounting truly required segme

[jira] [Updated] (HDFS-4739) NN can miscalculate the number of extra edit log segments to retain

[ https://issues.apache.org/jira/browse/HDFS-4739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-4739: - Status: Patch Available (was: Open) > NN can miscalculate the number of extra edit log segmen

[jira] [Updated] (HDFS-4151) Passing INodesInPath instead of INode[] in FSDirectory

[ https://issues.apache.org/jira/browse/HDFS-4151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-4151: -- Fix Version/s: 2.0.5-beta I merged this patch to branch-2. > Passing INodesInPa

[jira] [Commented] (HDFS-4698) provide client-side metrics for remote reads, local reads, and short-circuit reads

[ https://issues.apache.org/jira/browse/HDFS-4698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13640739#comment-13640739 ] Colin Patrick McCabe commented on HDFS-4698: Thanks for the review. Looking at

[jira] [Commented] (HDFS-4721) Speed up lease/block recovery when DN fails and a block goes into recovery

[ https://issues.apache.org/jira/browse/HDFS-4721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13640741#comment-13640741 ] Hadoop QA commented on HDFS-4721: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-4209) Clean up the addNode/addChild/addChildNoQuotaCheck methods in FSDirectory

[ https://issues.apache.org/jira/browse/HDFS-4209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-4209: -- Fix Version/s: 2.0.5-beta I merged this change to branch-2. > Clean up the addN

[jira] [Updated] (HDFS-4334) Add a unique id to each INode

[ https://issues.apache.org/jira/browse/HDFS-4334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-4334: -- Fix Version/s: 2.0.5-beta I merged this change to branch-2. > Add a unique id t

[jira] [Moved] (HDFS-4740) TestWebHdfsUrl timeouts too conservative for Windows

[ https://issues.apache.org/jira/browse/HDFS-4740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal moved HADOOP-9499 to HDFS-4740: - Component/s: (was: test) test Fix

[jira] [Updated] (HDFS-4740) TestWebHdfsUrl timeouts too conservative for Windows

[ https://issues.apache.org/jira/browse/HDFS-4740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-4740: Attachment: HDFS-4740.patch Fix all test cases in TestWebHdfsUrl to avoid spurious timeouts.

[jira] [Updated] (HDFS-4296) Add layout version for HDFS-4256 for release 1.2.0

[ https://issues.apache.org/jira/browse/HDFS-4296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-4296: -- Fix Version/s: 2.0.5-beta I merged this patch to branch-2. > Add layout version

[jira] [Commented] (HDFS-4698) provide client-side metrics for remote reads, local reads, and short-circuit reads

[ https://issues.apache.org/jira/browse/HDFS-4698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13640762#comment-13640762 ] Aaron T. Myers commented on HDFS-4698: -- bq. I think it would not be too difficult to u

[jira] [Updated] (HDFS-4740) TestWebHdfsUrl timeouts too conservative for Windows

[ https://issues.apache.org/jira/browse/HDFS-4740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-4740: Status: Patch Available (was: Open) +1 for the patch. I verified on both Mac and Windows. Thanks,

[jira] [Commented] (HDFS-4659) Support setting execution bit for regular files

[ https://issues.apache.org/jira/browse/HDFS-4659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13640766#comment-13640766 ] Sanjay Radia commented on HDFS-4659: +1 Please file jira to change ls command to displ

[jira] [Commented] (HDFS-4740) TestWebHdfsUrl timeouts too conservative for Windows

[ https://issues.apache.org/jira/browse/HDFS-4740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13640769#comment-13640769 ] Arpit Agarwal commented on HDFS-4740: - Thanks for the quick review! >

[jira] [Commented] (HDFS-4339) Persist inode id in fsimage and editlog

[ https://issues.apache.org/jira/browse/HDFS-4339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13640779#comment-13640779 ] Hudson commented on HDFS-4339: -- Integrated in Hadoop-trunk-Commit #3656 (See [https://builds.

[jira] [Commented] (HDFS-4734) Tests that use ShellCommandFencer are broken on Windows

[ https://issues.apache.org/jira/browse/HDFS-4734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13640783#comment-13640783 ] Chris Nauroth commented on HDFS-4734: - +1 for the patch. I verified by running the tes

[jira] [Updated] (HDFS-4686) Fix quota computation for rename with snapshots

[ https://issues.apache.org/jira/browse/HDFS-4686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-4686: Attachment: HDFS-4686.003.patch Thanks for the comments, Nicholas! Update the patch based on your comments.

[jira] [Updated] (HDFS-4346) Refactor INodeId and GenerationStamp

[ https://issues.apache.org/jira/browse/HDFS-4346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-4346: -- Fix Version/s: 2.0.5-beta I merged this change to branch-2. > Refactor INodeId

[jira] [Updated] (HDFS-4740) TestWebHdfsUrl timeouts too conservative for Windows

[ https://issues.apache.org/jira/browse/HDFS-4740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-4740: Description: This issue is to track the following Windows test failures: # TestWebHdfsUrl#testSecure

[jira] [Updated] (HDFS-4740) TestWebHdfsUrl and TestDFSUtil fail on Windows

[ https://issues.apache.org/jira/browse/HDFS-4740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-4740: Summary: TestWebHdfsUrl and TestDFSUtil fail on Windows (was: TestWebHdfsUrl timeouts too conservat

[jira] [Commented] (HDFS-4710) Turning off HDFS short-circuit checksums unexpectedly slows down Hive

[ https://issues.apache.org/jira/browse/HDFS-4710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13640799#comment-13640799 ] Todd Lipcon commented on HDFS-4710: --- If we wrap the underlying fd in a BufferedInputStrea

[jira] [Commented] (HDFS-4740) TestWebHdfsUrl and TestDFSUtil fail on Windows

[ https://issues.apache.org/jira/browse/HDFS-4740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13640801#comment-13640801 ] Arpit Agarwal commented on HDFS-4740: - I am expanding the scope of this Jira to include

[jira] [Updated] (HDFS-4740) TestWebHdfsUrl and TestDFSUtil fail on Windows

[ https://issues.apache.org/jira/browse/HDFS-4740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-4740: Attachment: HDFS-4740.002.patch Combined patch for both tests. > TestWebHdfsUrl and

[jira] [Commented] (HDFS-4739) NN can miscalculate the number of extra edit log segments to retain

[ https://issues.apache.org/jira/browse/HDFS-4739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13640826#comment-13640826 ] Hadoop QA commented on HDFS-4739: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-4659) Support setting execution bit for regular files

[ https://issues.apache.org/jira/browse/HDFS-4659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13640843#comment-13640843 ] Brandon Li commented on HDFS-4659: -- Thanks! JIRA HADOOP-9501 has been created to trick the

[jira] [Commented] (HDFS-4740) TestWebHdfsUrl and TestDFSUtil fail on Windows

[ https://issues.apache.org/jira/browse/HDFS-4740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13640846#comment-13640846 ] Chris Nauroth commented on HDFS-4740: - +1 for the new patch too. I reran tests to veri

[jira] [Resolved] (HDFS-4713) Wrong server principal is used for rpc calls to namenode if HA is enabled

[ https://issues.apache.org/jira/browse/HDFS-4713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee resolved HDFS-4713. -- Resolution: Won't Fix By requiring "_HOST" to be used, we rely on the rpc server address to guess the s

[jira] [Commented] (HDFS-4708) Add snapshot user guide

[ https://issues.apache.org/jira/browse/HDFS-4708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13640868#comment-13640868 ] Tsz Wo (Nicholas), SZE commented on HDFS-4708: -- Hi Aaron, I choose xdoc since

[jira] [Commented] (HDFS-4610) Move to using common utils FileUtil#setReadable/Writable/Executable and FileUtil#canRead/Write/Execute

[ https://issues.apache.org/jira/browse/HDFS-4610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13640870#comment-13640870 ] Chris Nauroth commented on HDFS-4610: - {{TestNNStorageRetentionFunctional}} is another

[jira] [Commented] (HDFS-4610) Move to using common utils FileUtil#setReadable/Writable/Executable and FileUtil#canRead/Write/Execute

[ https://issues.apache.org/jira/browse/HDFS-4610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13640888#comment-13640888 ] Ivan Mitic commented on HDFS-4610: -- bq. TestNNStorageRetentionFunctional is another HDFS t

[jira] [Updated] (HDFS-4610) Move to using common utils FileUtil#setReadable/Writable/Executable and FileUtil#canRead/Write/Execute

[ https://issues.apache.org/jira/browse/HDFS-4610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Mitic updated HDFS-4610: - Attachment: HDFS-4610.commonfileutils.2.patch Attaching the updated patch after rebase. >

[jira] [Updated] (HDFS-4739) NN can miscalculate the number of extra edit log segments to retain

[ https://issues.apache.org/jira/browse/HDFS-4739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-4739: - Attachment: HDFS-4739.patch Missed a bounds check. Updated patch should fix the test failures.

[jira] [Commented] (HDFS-4740) TestWebHdfsUrl and TestDFSUtil fail on Windows

[ https://issues.apache.org/jira/browse/HDFS-4740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13640899#comment-13640899 ] Hadoop QA commented on HDFS-4740: - {color:green}+1 overall{color}. Here are the results of

[jira] [Created] (HDFS-4741) TestStorageRestore#testStorageRestoreFailure fails on Windows

Arpit Agarwal created HDFS-4741: --- Summary: TestStorageRestore#testStorageRestoreFailure fails on Windows Key: HDFS-4741 URL: https://issues.apache.org/jira/browse/HDFS-4741 Project: Hadoop HDFS

[jira] [Commented] (HDFS-4708) Add snapshot user guide

[ https://issues.apache.org/jira/browse/HDFS-4708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13640901#comment-13640901 ] Aaron T. Myers commented on HDFS-4708: -- Hi Nicholas, what limitation are you referring

[jira] [Updated] (HDFS-4686) Fix quota computation for rename with snapshots

[ https://issues.apache.org/jira/browse/HDFS-4686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-4686: - Component/s: (was: datanode) Hadoop Flags: Reviewed +1 patch looks good.

[jira] [Resolved] (HDFS-4686) Fix quota computation for rename with snapshots

[ https://issues.apache.org/jira/browse/HDFS-4686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE resolved HDFS-4686. -- Resolution: Fixed Fix Version/s: Snapshot (HDFS-2802) I have committed th

[jira] [Commented] (HDFS-4708) Add snapshot user guide

[ https://issues.apache.org/jira/browse/HDFS-4708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13640924#comment-13640924 ] Tsz Wo (Nicholas), SZE commented on HDFS-4708: -- For some apt limitations, see

[jira] [Created] (HDFS-4742) Fix appending a renamed file

Jing Zhao created HDFS-4742: --- Summary: Fix appending a renamed file Key: HDFS-4742 URL: https://issues.apache.org/jira/browse/HDFS-4742 Project: Hadoop HDFS Issue Type: Sub-task Reporte

[jira] [Commented] (HDFS-4739) NN can miscalculate the number of extra edit log segments to retain

[ https://issues.apache.org/jira/browse/HDFS-4739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13640931#comment-13640931 ] Todd Lipcon commented on HDFS-4739: --- +1 pending Jenkins > NN can miscalc

[jira] [Updated] (HDFS-4742) Fix appending a renamed file

[ https://issues.apache.org/jira/browse/HDFS-4742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-4742: Attachment: HDFS-4742.001.patch Initial patch with a new unit test. > Fix appending a renam

[jira] [Updated] (HDFS-4729) Fix OfflineImageViewer and permission checking for snapshot operations

[ https://issues.apache.org/jira/browse/HDFS-4729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-4729: - Component/s: (was: datanode) Description: The format of FSImage is updat

[jira] [Resolved] (HDFS-4729) Fix OfflineImageViewer and permission checking for snapshot operations

[ https://issues.apache.org/jira/browse/HDFS-4729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE resolved HDFS-4729. -- Resolution: Fixed Fix Version/s: Snapshot (HDFS-2802) I have committed th

[jira] [Commented] (HDFS-4504) DFSOutputStream#close doesn't always release resources (such as leases)

[ https://issues.apache.org/jira/browse/HDFS-4504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13640937#comment-13640937 ] Todd Lipcon commented on HDFS-4504: --- Does this fully solve the problem, given that leases

[jira] [Created] (HDFS-4743) TestNNStorageRetentionManager fails on Windows

Chris Nauroth created HDFS-4743: --- Summary: TestNNStorageRetentionManager fails on Windows Key: HDFS-4743 URL: https://issues.apache.org/jira/browse/HDFS-4743 Project: Hadoop HDFS Issue Type: Bu

[jira] [Commented] (HDFS-4710) Turning off HDFS short-circuit checksums unexpectedly slows down Hive

[ https://issues.apache.org/jira/browse/HDFS-4710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13640942#comment-13640942 ] Gopal V commented on HDFS-4710: --- I did consider that as a fix, but a regular BufferedInputStr

[jira] [Commented] (HDFS-4710) Turning off HDFS short-circuit checksums unexpectedly slows down Hive

[ https://issues.apache.org/jira/browse/HDFS-4710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13640944#comment-13640944 ] Todd Lipcon commented on HDFS-4710: --- Check out o.a.h.fs.BufferedFSInputStream which shoul

[jira] [Updated] (HDFS-4743) TestNNStorageRetentionManager fails on Windows

[ https://issues.apache.org/jira/browse/HDFS-4743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-4743: Attachment: HDFS-4743.1.patch This patch corrects 2 problems with this test: # It was iterating ove

[jira] [Updated] (HDFS-4743) TestNNStorageRetentionManager fails on Windows

[ https://issues.apache.org/jira/browse/HDFS-4743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-4743: Status: Patch Available (was: Open) > TestNNStorageRetentionManager fails on Windows >

[jira] [Commented] (HDFS-4740) TestWebHdfsUrl and TestDFSUtil fail on Windows

[ https://issues.apache.org/jira/browse/HDFS-4740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13640960#comment-13640960 ] Hadoop QA commented on HDFS-4740: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-4739) NN can miscalculate the number of extra edit log segments to retain

[ https://issues.apache.org/jira/browse/HDFS-4739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13640968#comment-13640968 ] Chris Nauroth commented on HDFS-4739: - +1 for the patch. Nice catch, Aaron! BTW, I al

[jira] [Commented] (HDFS-4710) Turning off HDFS short-circuit checksums unexpectedly slows down Hive

[ https://issues.apache.org/jira/browse/HDFS-4710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13640970#comment-13640970 ] Colin Patrick McCabe commented on HDFS-4710: I do agree that {{BufferedFSInputS

[jira] [Commented] (HDFS-4504) DFSOutputStream#close doesn't always release resources (such as leases)

[ https://issues.apache.org/jira/browse/HDFS-4504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13640985#comment-13640985 ] Colin Patrick McCabe commented on HDFS-4504: bq. Does this fully solve the prob

[jira] [Updated] (HDFS-4340) Update addBlock() to inculde inode id as additional argument

[ https://issues.apache.org/jira/browse/HDFS-4340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-4340: -- Description: I merged this change to branch-2. Fix Version/s: 2.0.5-beta > Update addB

[jira] [Updated] (HDFS-4502) WebHdfsFileSystem handling of fileld breaks compatibility

[ https://issues.apache.org/jira/browse/HDFS-4502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-4502: -- Fix Version/s: 2.0.5-beta I merged this change to branch-2. > WebHdfsFileSystem

[jira] [Updated] (HDFS-4434) Provide a mapping from INodeId to INode

[ https://issues.apache.org/jira/browse/HDFS-4434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-4434: -- Fix Version/s: 2.0.5-beta I merged this change to branch-2. > Provide a mapping

[jira] [Commented] (HDFS-4736) SnapshotAccessControlException does not return valid exit codes

[ https://issues.apache.org/jira/browse/HDFS-4736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13640994#comment-13640994 ] Tsz Wo (Nicholas), SZE commented on HDFS-4736: -- I have verified it. This is a

[jira] [Updated] (HDFS-4736) SnapshotAccessControlException does not return valid exit codes

[ https://issues.apache.org/jira/browse/HDFS-4736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-4736: - Issue Type: Bug (was: Sub-task) Parent: (was: HDFS-2802) > Snapsh

[jira] [Updated] (HDFS-4736) chmod does not return error exit codes for some exceptions

[ https://issues.apache.org/jira/browse/HDFS-4736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-4736: - Component/s: (was: datanode) (was: namenode)

[jira] [Updated] (HDFS-4489) Use InodeID as as an identifier of a file in HDFS protocols and APIs

[ https://issues.apache.org/jira/browse/HDFS-4489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-4489: -- Fix Version/s: 2.0.5-beta I have merged the subtasks of this jira into branch-2.

[jira] [Created] (HDFS-4744) TestBlockRecovery should bind ephemeral ports redux

Andrew Purtell created HDFS-4744: Summary: TestBlockRecovery should bind ephemeral ports redux Key: HDFS-4744 URL: https://issues.apache.org/jira/browse/HDFS-4744 Project: Hadoop HDFS Issue T

[jira] [Commented] (HDFS-4739) NN can miscalculate the number of extra edit log segments to retain

[ https://issues.apache.org/jira/browse/HDFS-4739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13641028#comment-13641028 ] Hadoop QA commented on HDFS-4739: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-4698) provide client-side metrics for remote reads, local reads, and short-circuit reads

[ https://issues.apache.org/jira/browse/HDFS-4698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-4698: --- Attachment: HDFS-4698.002.patch > provide client-side metrics for remote reads, lo

[jira] [Created] (HDFS-4745) TestDataTransferKeepalive#testSlowReader has race condition that causes sporadic failure

Chris Nauroth created HDFS-4745: --- Summary: TestDataTransferKeepalive#testSlowReader has race condition that causes sporadic failure Key: HDFS-4745 URL: https://issues.apache.org/jira/browse/HDFS-4745 Pr

[jira] [Commented] (HDFS-4721) Speed up lease/block recovery when DN fails and a block goes into recovery

[ https://issues.apache.org/jira/browse/HDFS-4721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13641075#comment-13641075 ] Tsz Wo (Nicholas), SZE commented on HDFS-4721: -- > ... lease recovery can occur

[jira] [Commented] (HDFS-4721) Speed up lease/block recovery when DN fails and a block goes into recovery

[ https://issues.apache.org/jira/browse/HDFS-4721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13641082#comment-13641082 ] Tsz Wo (Nicholas), SZE commented on HDFS-4721: -- Varun, it seems that the patch

[jira] [Updated] (HDFS-4745) TestDataTransferKeepalive#testSlowReader has race condition that causes sporadic failure

[ https://issues.apache.org/jira/browse/HDFS-4745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-4745: Attachment: HDFS-4745.1.patch This patch introduces a polling loop before asserting that there are 0

[jira] [Updated] (HDFS-4745) TestDataTransferKeepalive#testSlowReader has race condition that causes sporadic failure

[ https://issues.apache.org/jira/browse/HDFS-4745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-4745: Status: Patch Available (was: Open) > TestDataTransferKeepalive#testSlowReader has race conditi

[jira] [Commented] (HDFS-4743) TestNNStorageRetentionManager fails on Windows

[ https://issues.apache.org/jira/browse/HDFS-4743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13641099#comment-13641099 ] Hadoop QA commented on HDFS-4743: - {color:green}+1 overall{color}. Here are the results of

[jira] [Created] (HDFS-4746) ClassCastException in BlockManager.addStoredBlock() due to that blockReceived came after file was closed.

Konstantin Shvachko created HDFS-4746: - Summary: ClassCastException in BlockManager.addStoredBlock() due to that blockReceived came after file was closed. Key: HDFS-4746 URL: https://issues.apache.org/jira/bro

[jira] [Commented] (HDFS-4721) Speed up lease/block recovery when DN fails and a block goes into recovery

[ https://issues.apache.org/jira/browse/HDFS-4721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13641117#comment-13641117 ] Varun Sharma commented on HDFS-4721: Sure, I am checking on the unit tests. Okay, I wa

[jira] [Commented] (HDFS-4721) Speed up lease/block recovery when DN fails and a block goes into recovery

[ https://issues.apache.org/jira/browse/HDFS-4721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13641127#comment-13641127 ] Tsz Wo (Nicholas), SZE commented on HDFS-4721: -- At (e), is the file closed? A

[jira] [Created] (HDFS-4747) Convert snapshot user guide to APT from XDOC

Aaron T. Myers created HDFS-4747: Summary: Convert snapshot user guide to APT from XDOC Key: HDFS-4747 URL: https://issues.apache.org/jira/browse/HDFS-4747 Project: Hadoop HDFS Issue Type: Su

[jira] [Updated] (HDFS-4747) Convert snapshot user guide to APT from XDOC

[ https://issues.apache.org/jira/browse/HDFS-4747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-4747: - Attachment: HDFS-4747.patch Here's a patch which addresses the issue. The content is identical to

[jira] [Commented] (HDFS-4708) Add snapshot user guide

[ https://issues.apache.org/jira/browse/HDFS-4708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13641134#comment-13641134 ] Aaron T. Myers commented on HDFS-4708: -- Thanks for the pointer, Nicholas. It doesn't l

[jira] [Commented] (HDFS-4721) Speed up lease/block recovery when DN fails and a block goes into recovery

[ https://issues.apache.org/jira/browse/HDFS-4721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13641135#comment-13641135 ] Varun Sharma commented on HDFS-4721: I dont think - if i grep the file name - all I hav

[jira] [Updated] (HDFS-4747) Convert snapshot user guide to APT from XDOC

[ https://issues.apache.org/jira/browse/HDFS-4747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-4747: - Attachment: HdfsSnapshots.html Including the rendered HTML file so folks can see that easily.

[jira] [Commented] (HDFS-4746) ClassCastException in BlockManager.addStoredBlock() due to that blockReceived came after file was closed.

[ https://issues.apache.org/jira/browse/HDFS-4746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13641138#comment-13641138 ] Konstantin Shvachko commented on HDFS-4746: --- This is the race condition between c

[jira] [Created] (HDFS-4748) MiniJournalCluster#restartJournalNode leaks resources, which causes sporadic test failures

Chris Nauroth created HDFS-4748: --- Summary: MiniJournalCluster#restartJournalNode leaks resources, which causes sporadic test failures Key: HDFS-4748 URL: https://issues.apache.org/jira/browse/HDFS-4748

[jira] [Commented] (HDFS-4747) Convert snapshot user guide to APT from XDOC

[ https://issues.apache.org/jira/browse/HDFS-4747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13641142#comment-13641142 ] Tsz Wo (Nicholas), SZE commented on HDFS-4747: -- Hi Aaron, I don't think it is

  1   2   >