[jira] [Commented] (HDFS-8248) Store INodeId instead of the INodeFile object in BlockInfoContiguous

2015-08-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14710735#comment-14710735 ] Hadoop QA commented on HDFS-8248: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-5851) Support memory as a storage medium

2015-08-25 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14710744#comment-14710744 ] Vinayakumar B commented on HDFS-5851: - This Jira should be marked as duplicate of HDFS-

[jira] [Commented] (HDFS-8909) Erasure coding: update BlockInfoContiguousUC and BlockInfoStripedUC to use BlockUnderConstructionFeature

2015-08-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14710763#comment-14710763 ] Hadoop QA commented on HDFS-8909: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-7285) Erasure Coding Support inside HDFS

2015-08-25 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14710770#comment-14710770 ] Zhe Zhang commented on HDFS-7285: - [~vinayrpet] Could you take a look at the results compar

[jira] [Commented] (HDFS-8838) Tolerate datanode failures in DFSStripedOutputStream when the data length is small

2015-08-25 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14710773#comment-14710773 ] Zhe Zhang commented on HDFS-8838: - {{HDFS-7285-merge}} and {{HDFS-7285-REBASE}} are interme

[jira] [Commented] (HDFS-8838) Tolerate datanode failures in DFSStripedOutputStream when the data length is small

2015-08-25 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14710775#comment-14710775 ] Zhe Zhang commented on HDFS-8838: - Thanks Walter for the discussion. If you are still +1 on

[jira] [Updated] (HDFS-8941) DistributedFileSystem listCorruptFileBlocks API should resolve relative path

2015-08-25 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-8941: --- Status: Open (was: Patch Available) > DistributedFileSystem listCorruptFileBlocks API should resolve relative

[jira] [Updated] (HDFS-8941) DistributedFileSystem listCorruptFileBlocks API should resolve relative path

2015-08-25 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-8941: --- Status: Patch Available (was: Open) > DistributedFileSystem listCorruptFileBlocks API should resolve relative

[jira] [Commented] (HDFS-7116) Add a command to get the balancer bandwidth

2015-08-25 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14710820#comment-14710820 ] Rakesh R commented on HDFS-7116: It looks like test case failures are not related to the pr

[jira] [Commented] (HDFS-8951) Move shortcircuit to hdfs-client

2015-08-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14710844#comment-14710844 ] Hadoop QA commented on HDFS-8951: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8900) Compact XAttrs to optimize memory footprint.

2015-08-25 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14710857#comment-14710857 ] Yi Liu commented on HDFS-8900: -- Thanks Andrew, Colin and Brahma. The findbugs doesn't exist.

[jira] [Updated] (HDFS-8900) Compact XAttrs to optimize memory footprint.

2015-08-25 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-8900: - Resolution: Fixed Hadoop Flags: Incompatible change,Reviewed (was: Incompatible change) Fix Version/s:

[jira] [Commented] (HDFS-8155) Support OAuth2 in WebHDFS

2015-08-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14710910#comment-14710910 ] Hadoop QA commented on HDFS-8155: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8900) Compact XAttrs to optimize memory footprint.

2015-08-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14710920#comment-14710920 ] Hudson commented on HDFS-8900: -- FAILURE: Integrated in Hadoop-trunk-Commit #8348 (See [https:

[jira] [Commented] (HDFS-8900) Compact XAttrs to optimize memory footprint.

2015-08-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14710947#comment-14710947 ] Hudson commented on HDFS-8900: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #309 (See [htt

[jira] [Commented] (HDFS-8892) ShortCircuitCache.CacheCleaner can add Slot.isInvalid() check too

2015-08-25 Thread Ravikumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14710959#comment-14710959 ] Ravikumar commented on HDFS-8892: - I am fine if this runs in a separate thread as you said…

[jira] [Commented] (HDFS-8520) Patch for PPC64 block size

2015-08-25 Thread Tony Reix (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14710968#comment-14710968 ] Tony Reix commented on HDFS-8520: - Hi Andrew Sorry of answering so late. I was busy with ot

[jira] [Commented] (HDFS-8900) Compact XAttrs to optimize memory footprint.

2015-08-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14711003#comment-14711003 ] Hudson commented on HDFS-8900: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1037 (See [https://

[jira] [Updated] (HDFS-8853) Erasure Coding: Provide ECSchema validation when creating ECZone

2015-08-25 Thread J.Andreina (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] J.Andreina updated HDFS-8853: - Attachment: HDFS-8853-HDFS-7285-05.patch Thanks [~vinayrpet]. Have updated the patch fixing the comments. P

[jira] [Commented] (HDFS-8938) Refactor BlockManager in blockmanagement

2015-08-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14711041#comment-14711041 ] Hadoop QA commented on HDFS-8938: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-8894) Set SO_KEEPALIVE on DN server sockets

2015-08-25 Thread kanaka kumar avvaru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kanaka kumar avvaru updated HDFS-8894: -- Status: Patch Available (was: Open) > Set SO_KEEPALIVE on DN server sockets > --

[jira] [Updated] (HDFS-8894) Set SO_KEEPALIVE on DN server sockets

2015-08-25 Thread kanaka kumar avvaru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kanaka kumar avvaru updated HDFS-8894: -- Status: Open (was: Patch Available) > Set SO_KEEPALIVE on DN server sockets > --

[jira] [Updated] (HDFS-8836) Skip newline on empty files with getMerge -nl

2015-08-25 Thread kanaka kumar avvaru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kanaka kumar avvaru updated HDFS-8836: -- Attachment: HDFS-8836-01.patch > Skip newline on empty files with getMerge -nl >

[jira] [Commented] (HDFS-8900) Compact XAttrs to optimize memory footprint.

2015-08-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14711045#comment-14711045 ] Hudson commented on HDFS-8900: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2253 (See [htt

[jira] [Updated] (HDFS-8836) Skip newline on empty files with getMerge -nl

2015-08-25 Thread kanaka kumar avvaru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kanaka kumar avvaru updated HDFS-8836: -- Status: Patch Available (was: Open) Attached a patch to add a new flag {{-skip-empty-fil

[jira] [Commented] (HDFS-8763) Incremental blockreport order may replicate unnecessary block

2015-08-25 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14711052#comment-14711052 ] Brahma Reddy Battula commented on HDFS-8763: Change of {{dfs.namenode.replicati

[jira] [Updated] (HDFS-8581) count cmd calculate wrong when huge files exist in one folder

2015-08-25 Thread J.Andreina (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] J.Andreina updated HDFS-8581: - Attachment: HDFS-8581.2.patch Patch is updated. Please review. > count cmd calculate wrong when huge file

[jira] [Commented] (HDFS-8900) Compact XAttrs to optimize memory footprint.

2015-08-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1475#comment-1475 ] Hudson commented on HDFS-8900: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2234 (See [https://

[jira] [Commented] (HDFS-8900) Compact XAttrs to optimize memory footprint.

2015-08-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1474#comment-1474 ] Hudson commented on HDFS-8900: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #304 (See

[jira] [Updated] (HDFS-8771) If IPCLoggerChannel#purgeLogsOlderThan takes too long, Namenode could not send another RPC calls to Journalnodes

2015-08-25 Thread kanaka kumar avvaru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kanaka kumar avvaru updated HDFS-8771: -- Attachment: HDFS-8771-01.patch > If IPCLoggerChannel#purgeLogsOlderThan takes too long, N

[jira] [Updated] (HDFS-8771) If IPCLoggerChannel#purgeLogsOlderThan takes too long, Namenode could not send another RPC calls to Journalnodes

2015-08-25 Thread kanaka kumar avvaru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kanaka kumar avvaru updated HDFS-8771: -- Status: Patch Available (was: Open) Attached a patch to handle the {{purgeLogsOlderThan}

[jira] [Commented] (HDFS-5696) Examples for httpfs REST API incorrect on apache.org

2015-08-25 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1479#comment-1479 ] Harsh J commented on HDFS-5696: --- Thanks for reporting this. Care to submit a fix changing the

[jira] [Commented] (HDFS-8836) Skip newline on empty files with getMerge -nl

2015-08-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14711131#comment-14711131 ] Hadoop QA commented on HDFS-8836: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8941) DistributedFileSystem listCorruptFileBlocks API should resolve relative path

2015-08-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14711173#comment-14711173 ] Hadoop QA commented on HDFS-8941: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-6515) testPageRounder (org.apache.hadoop.hdfs.server.datanode.TestFsDatasetCache)

2015-08-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14711289#comment-14711289 ] Hadoop QA commented on HDFS-6515: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8900) Compact XAttrs to optimize memory footprint.

2015-08-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14711326#comment-14711326 ] Hudson commented on HDFS-8900: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #296 (See [htt

[jira] [Commented] (HDFS-8581) count cmd calculate wrong when huge files exist in one folder

2015-08-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14711399#comment-14711399 ] Hadoop QA commented on HDFS-8581: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8771) If IPCLoggerChannel#purgeLogsOlderThan takes too long, Namenode could not send another RPC calls to Journalnodes

2015-08-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14711437#comment-14711437 ] Hadoop QA commented on HDFS-8771: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-7765) FSOutputSummer throwing ArrayIndexOutOfBoundsException

2015-08-25 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-7765: - Assignee: Janmejay Singh (was: Surendra Singh Lilhore) > FSOutputSummer throwing A

[jira] [Updated] (HDFS-8894) Set SO_KEEPALIVE on DN server sockets

2015-08-25 Thread kanaka kumar avvaru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kanaka kumar avvaru updated HDFS-8894: -- Attachment: HDFS-8894-01.patch > Set SO_KEEPALIVE on DN server sockets >

[jira] [Updated] (HDFS-1148) Convert FSDataset to ReadWriteLock

2015-08-25 Thread Yong Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yong Zhang updated HDFS-1148: - Attachment: HDFS-1148.003.patch > Convert FSDataset to ReadWriteLock > -- >

[jira] [Commented] (HDFS-8846) Create edit log files with old layout version for upgrade testing

2015-08-25 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14711658#comment-14711658 ] Zhe Zhang commented on HDFS-8846: - The change is test-only and is not related to {{TestEdit

[jira] [Commented] (HDFS-8943) Read apis in ByteRangeInputStream does not read all the bytes specified when chunked transfer-encoding is used in the server

2015-08-25 Thread Shradha Revankar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14711664#comment-14711664 ] Shradha Revankar commented on HDFS-8943: Thanks, I've created this https://issues.a

[jira] [Commented] (HDFS-8373) Ec files can't be deleted into Trash because of that Trash isn't EC zone.

2015-08-25 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14711665#comment-14711665 ] Zhe Zhang commented on HDFS-8373: - Good catch [~brahmareddy]. Once HDFS-8833 is finalized l

[jira] [Commented] (HDFS-8915) TestFSNamesystem.testFSLockGetWaiterCount fails intermittently in jenkins

2015-08-25 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14711680#comment-14711680 ] Anu Engineer commented on HDFS-8915: This was a tracking bug to see if this failure hap

[jira] [Resolved] (HDFS-8915) TestFSNamesystem.testFSLockGetWaiterCount fails intermittently in jenkins

2015-08-25 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer resolved HDFS-8915. Resolution: Invalid > TestFSNamesystem.testFSLockGetWaiterCount fails intermittently in jenkins > ---

[jira] [Updated] (HDFS-8938) Refactor BlockManager in blockmanagement

2015-08-25 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-8938: Attachment: HDFS-8938.005.patch > Refactor BlockManager in blockmanagement >

[jira] [Commented] (HDFS-8894) Set SO_KEEPALIVE on DN server sockets

2015-08-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14711714#comment-14711714 ] Hadoop QA commented on HDFS-8894: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-1148) Convert FSDataset to ReadWriteLock

2015-08-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14711727#comment-14711727 ] Hadoop QA commented on HDFS-1148: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-8894) Set SO_KEEPALIVE on DN server sockets

2015-08-25 Thread kanaka kumar avvaru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kanaka kumar avvaru updated HDFS-8894: -- Attachment: (was: HDFS-8894-01.patch) > Set SO_KEEPALIVE on DN server sockets > -

[jira] [Commented] (HDFS-8951) Move shortcircuit to hdfs-client

2015-08-25 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14711775#comment-14711775 ] Haohui Mai commented on HDFS-8951: -- Thanks for the work. {code} +package org.apache.hadoo

[jira] [Updated] (HDFS-8836) Skip newline on empty files with getMerge -nl

2015-08-25 Thread kanaka kumar avvaru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kanaka kumar avvaru updated HDFS-8836: -- Attachment: HDFS-8836-02.patch > Skip newline on empty files with getMerge -nl >

[jira] [Commented] (HDFS-8836) Skip newline on empty files with getMerge -nl

2015-08-25 Thread kanaka kumar avvaru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14711827#comment-14711827 ] kanaka kumar avvaru commented on HDFS-8836: --- Updated patch for jenkin reported er

[jira] [Updated] (HDFS-8894) Set SO_KEEPALIVE on DN server sockets

2015-08-25 Thread kanaka kumar avvaru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kanaka kumar avvaru updated HDFS-8894: -- Attachment: HDFS-8894-01.patch Some problems in earlier build. Uploading same patch again

[jira] [Updated] (HDFS-8771) If IPCLoggerChannel#purgeLogsOlderThan takes too long, Namenode could not send another RPC calls to Journalnodes

2015-08-25 Thread kanaka kumar avvaru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kanaka kumar avvaru updated HDFS-8771: -- Attachment: HDFS-8771-02.patch > If IPCLoggerChannel#purgeLogsOlderThan takes too long, N

[jira] [Commented] (HDFS-8771) If IPCLoggerChannel#purgeLogsOlderThan takes too long, Namenode could not send another RPC calls to Journalnodes

2015-08-25 Thread kanaka kumar avvaru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14711839#comment-14711839 ] kanaka kumar avvaru commented on HDFS-8771: --- updated patch for checkstyle and whi

[jira] [Updated] (HDFS-6955) DN should reserve disk space for a full block when creating tmp files

2015-08-25 Thread kanaka kumar avvaru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kanaka kumar avvaru updated HDFS-6955: -- Attachment: HDFS-6955-03.patch updated patch for required check style errors. Test failur

[jira] [Commented] (HDFS-8155) Support OAuth2 in WebHDFS

2015-08-25 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14711874#comment-14711874 ] Chris Nauroth commented on HDFS-8155: - Hi [~jghoman]. Nice work! I have a few comment

[jira] [Created] (HDFS-8953) DataNode Metrics logging

2015-08-25 Thread kanaka kumar avvaru (JIRA)
kanaka kumar avvaru created HDFS-8953: - Summary: DataNode Metrics logging Key: HDFS-8953 URL: https://issues.apache.org/jira/browse/HDFS-8953 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Commented] (HDFS-8833) Erasure coding: store EC schema and cell size in INodeFile and eliminate notion of EC zones

2015-08-25 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14711882#comment-14711882 ] Zhe Zhang commented on HDFS-8833: - {{TestFSNamesystem}} passes consistently on local node.

[jira] [Commented] (HDFS-8885) ByteRangeInputStream used in webhdfs does not override available()

2015-08-25 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14711935#comment-14711935 ] Chris Nauroth commented on HDFS-8885: - Hello [~srevanka]. Thank you for posting the pa

[jira] [Commented] (HDFS-8833) Erasure coding: store EC schema and cell size in INodeFile and eliminate notion of EC zones

2015-08-25 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14711937#comment-14711937 ] Zhe Zhang commented on HDFS-8833: - The failure will be addressed by HDFS-8704. > Erasure c

[jira] [Commented] (HDFS-8784) BlockInfo#numNodes should be numStorages

2015-08-25 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14711936#comment-14711936 ] Arpit Agarwal commented on HDFS-8784: - The NameNode does not support more than one repl

[jira] [Commented] (HDFS-8836) Skip newline on empty files with getMerge -nl

2015-08-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14711950#comment-14711950 ] Hadoop QA commented on HDFS-8836: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8846) Create edit log files with old layout version for upgrade testing

2015-08-25 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14711980#comment-14711980 ] Colin Patrick McCabe commented on HDFS-8846: +1. Thanks, [~zhz]. > Create edi

[jira] [Updated] (HDFS-8846) Add a unit test for INotify functionality across a layout version upgrade

2015-08-25 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8846: --- Summary: Add a unit test for INotify functionality across a layout version upgrade (wa

[jira] [Updated] (HDFS-8846) Add a unit test of INotify functionality across a layout version upgrade

2015-08-25 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8846: --- Summary: Add a unit test of INotify functionality across a layout version upgrade (was

[jira] [Commented] (HDFS-8520) Patch for PPC64 block size

2015-08-25 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14711995#comment-14711995 ] Andrew Wang commented on HDFS-8520: --- Hi Tony, My point is that we don't really have PPC6

[jira] [Commented] (HDFS-8704) Erasure Coding: client fails to write large file when one datanode fails

2015-08-25 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14712004#comment-14712004 ] Zhe Zhang commented on HDFS-8704: - Thanks for the work Bo. Please find my comments below: #

[jira] [Commented] (HDFS-8938) Refactor BlockManager in blockmanagement

2015-08-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14712006#comment-14712006 ] Hadoop QA commented on HDFS-8938: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-8846) Add a unit test for INotify functionality across a layout version upgrade

2015-08-25 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8846: --- Resolution: Fixed Fix Version/s: 2.8.0 Target Version/s: 2.8.0 (was: 2

[jira] [Commented] (HDFS-8846) Add a unit test for INotify functionality across a layout version upgrade

2015-08-25 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14712016#comment-14712016 ] Zhe Zhang commented on HDFS-8846: - Thanks Colin for reviewing the patch! > Add a unit test

[jira] [Commented] (HDFS-8937) Fix the exception when set replication to Erasure Coding files

2015-08-25 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14712025#comment-14712025 ] Zhe Zhang commented on HDFS-8937: - Thanks [~demongaorui] for reporting the issue. We will p

[jira] [Work started] (HDFS-8950) NameNode refresh doesn't remove DataNodes

2015-08-25 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-8950 started by Daniel Templeton. -- > NameNode refresh doesn't remove DataNodes >

[jira] [Commented] (HDFS-8846) Add a unit test for INotify functionality across a layout version upgrade

2015-08-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14712037#comment-14712037 ] Hudson commented on HDFS-8846: -- FAILURE: Integrated in Hadoop-trunk-Commit #8349 (See [https:

[jira] [Commented] (HDFS-8248) Store INodeId instead of the INodeFile object in BlockInfoContiguous

2015-08-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14712068#comment-14712068 ] Hadoop QA commented on HDFS-8248: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8951) Move shortcircuit to hdfs-client

2015-08-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14712075#comment-14712075 ] Hadoop QA commented on HDFS-8951: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-8950) NameNode refresh doesn't remove DataNodes

2015-08-25 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-8950: - Target Version/s: 2.8.0 > NameNode refresh doesn't remove DataNodes > -

[jira] [Commented] (HDFS-8909) Erasure coding: update BlockInfoContiguousUC and BlockInfoStripedUC to use BlockUnderConstructionFeature

2015-08-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14712083#comment-14712083 ] Hadoop QA commented on HDFS-8909: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-8950) NameNode refresh doesn't remove DataNodes

2015-08-25 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-8950: --- Attachment: 28531.patch Here's a patch for a unit test and fix. The HostFileManager now exclud

[jira] [Commented] (HDFS-8846) Add a unit test for INotify functionality across a layout version upgrade

2015-08-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14712097#comment-14712097 ] Hudson commented on HDFS-8846: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1038 (See [https://

[jira] [Updated] (HDFS-8950) NameNode refresh doesn't remove DataNodes

2015-08-25 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-8950: --- Attachment: (was: 28531.patch) > NameNode refresh doesn't remove DataNodes > --

[jira] [Commented] (HDFS-8950) NameNode refresh doesn't remove DataNodes

2015-08-25 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14712123#comment-14712123 ] Daniel Templeton commented on HDFS-8950: Pulled the patch temporarily while test_pa

[jira] [Commented] (HDFS-8846) Add a unit test for INotify functionality across a layout version upgrade

2015-08-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14712126#comment-14712126 ] Hudson commented on HDFS-8846: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #305 (See

[jira] [Commented] (HDFS-8846) Add a unit test for INotify functionality across a layout version upgrade

2015-08-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14712135#comment-14712135 ] Hudson commented on HDFS-8846: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #310 (See [htt

[jira] [Commented] (HDFS-8771) If IPCLoggerChannel#purgeLogsOlderThan takes too long, Namenode could not send another RPC calls to Journalnodes

2015-08-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14712148#comment-14712148 ] Hadoop QA commented on HDFS-8771: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8894) Set SO_KEEPALIVE on DN server sockets

2015-08-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14712153#comment-14712153 ] Hadoop QA commented on HDFS-8894: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-6955) DN should reserve disk space for a full block when creating tmp files

2015-08-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14712167#comment-14712167 ] Hadoop QA commented on HDFS-6955: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8939) Test(S)WebHdfsFileContextMainOperations failing on branch-2

2015-08-25 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14712168#comment-14712168 ] Chris Nauroth commented on HDFS-8939: - bq. ...am getting a bit concerned about the back

[jira] [Updated] (HDFS-8951) Move shortcircuit to hdfs-client

2015-08-25 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-8951: Attachment: HDFS-8951.002.patch Thank you [~wheat9]! I refined the patch to address the two problems

[jira] [Updated] (HDFS-8950) NameNode refresh doesn't remove DataNodes

2015-08-25 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-8950: --- Attachment: HDFS-8950.001.patch Once more with feeling. > NameNode refresh doesn't remove Data

[jira] [Updated] (HDFS-8950) NameNode refresh doesn't remove DataNodes

2015-08-25 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-8950: --- Fix Version/s: 2.8.0 Status: Patch Available (was: In Progress) Ready for review >

[jira] [Updated] (HDFS-8950) NameNode refresh doesn't remove DataNodes

2015-08-25 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-8950: --- Attachment: HDFS-8950.002.patch Just noticed an extraneous import in the patch. (Swing?!? WTF?

[jira] [Commented] (HDFS-8846) Add a unit test for INotify functionality across a layout version upgrade

2015-08-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14712233#comment-14712233 ] Hudson commented on HDFS-8846: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2254 (See [htt

[jira] [Commented] (HDFS-8846) Add a unit test for INotify functionality across a layout version upgrade

2015-08-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14712265#comment-14712265 ] Hudson commented on HDFS-8846: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #297 (See [htt

[jira] [Commented] (HDFS-8846) Add a unit test for INotify functionality across a layout version upgrade

2015-08-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14712277#comment-14712277 ] Hudson commented on HDFS-8846: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2235 (See [https://

[jira] [Commented] (HDFS-8945) Update the description about replica placement in HDFS Architecture documentation

2015-08-25 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14712306#comment-14712306 ] Andrew Wang commented on HDFS-8945: --- Good idea to update this, thanks for working on it.

[jira] [Commented] (HDFS-8763) Incremental blockreport order may replicate unnecessary block

2015-08-25 Thread Ajith S (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14712355#comment-14712355 ] Ajith S commented on HDFS-8763: --- Hi all, agree with changing {{dfs.namenode.replication.inte

[jira] [Commented] (HDFS-8897) Loadbalancer always exits with : java.io.IOException: Another Balancer is running.. Exiting ...

2015-08-25 Thread Xu Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14712382#comment-14712382 ] Xu Chen commented on HDFS-8897: --- [~Alexandre LINTE] I was encounter this issue too , when I u

[jira] [Created] (HDFS-8954) Not all the one block in RAM_DISK use lazy_persist policy

2015-08-25 Thread Xu Chen (JIRA)
Xu Chen created HDFS-8954: - Summary: Not all the one block in RAM_DISK use lazy_persist policy Key: HDFS-8954 URL: https://issues.apache.org/jira/browse/HDFS-8954 Project: Hadoop HDFS Issue Type: Bug

  1   2   >