[jira] [Commented] (HDFS-8900) Compact XAttrs to optimize memory footprint.

2015-08-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14710718#comment-14710718 ] Hadoop QA commented on HDFS-8900: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8838) Tolerate datanode failures in DFSStripedOutputStream when the data length is small

2015-08-24 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14710695#comment-14710695 ] Li Bo commented on HDFS-8838: - hi, Walter Su 我看了下branch, 跟7285相关的有 remotes/origin/HDFS-7285

[jira] [Commented] (HDFS-8939) Test(S)WebHdfsFileContextMainOperations failing on branch-2

2015-08-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14710671#comment-14710671 ] Hadoop QA commented on HDFS-8939: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8118) Delay in checkpointing Trash can leave trash for 2 intervals before deleting

2015-08-24 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14710624#comment-14710624 ] Harsh J commented on HDFS-8118: --- Thanks Casey, You can run individual tests locally via {{mv

[jira] [Commented] (HDFS-4750) Support NFSv3 interface to HDFS

2015-08-24 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14710621#comment-14710621 ] Yongjun Zhang commented on HDFS-4750: - Hi [~brandonli] If your answer to "Is it by des

[jira] [Commented] (HDFS-8943) Read apis in ByteRangeInputStream does not read all the bytes specified when chunked transfer-encoding is used in the server

2015-08-24 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14710610#comment-14710610 ] Chris Nauroth commented on HDFS-8943: - It's unclear to me why the HBase code treats par

[jira] [Updated] (HDFS-8951) Move shortcircuit to hdfs-client

2015-08-24 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-8951: Attachment: HDFS-8951.001.patch > Move shortcircuit to hdfs-client >

[jira] [Updated] (HDFS-8938) Refactor BlockManager in blockmanagement

2015-08-24 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-8938: Attachment: HDFS-8938.004.patch The v4 patch rebases from the trunk branch, and make variable members

[jira] [Commented] (HDFS-8388) Time and Date format need to be in sync in Namenode UI page

2015-08-24 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14710602#comment-14710602 ] Surendra Singh Lilhore commented on HDFS-8388: -- Thanks [~vinayrpet] and [~whea

[jira] [Commented] (HDFS-4750) Support NFSv3 interface to HDFS

2015-08-24 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14710603#comment-14710603 ] Yongjun Zhang commented on HDFS-4750: - Hi [~brandonli], Thanks for your earlier work h

[jira] [Commented] (HDFS-8951) Move shortcircuit to hdfs-client

2015-08-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14710597#comment-14710597 ] Hadoop QA commented on HDFS-8951: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8929) Add a metric to expose the timestamp of the last journal

2015-08-24 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14710586#comment-14710586 ] Surendra Singh Lilhore commented on HDFS-8929: -- Failed test cases are unrelate

[jira] [Updated] (HDFS-8155) Support OAuth2 in WebHDFS

2015-08-24 Thread Jakob Homan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Homan updated HDFS-8155: -- Attachment: HDFS-8155.002.patch Revised patch based on ChrisD's comments. Still applies to trunk and bra

[jira] [Updated] (HDFS-8155) Support OAuth2 in WebHDFS

2015-08-24 Thread Jakob Homan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Homan updated HDFS-8155: -- Status: Patch Available (was: Open) > Support OAuth2 in WebHDFS > - > >

[jira] [Commented] (HDFS-8943) Read apis in ByteRangeInputStream does not read all the bytes specified when chunked transfer-encoding is used in the server

2015-08-24 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14710574#comment-14710574 ] Haohui Mai commented on HDFS-8943: -- {{ByteRangeInputStream}} is the wrong place to fix. Th

[jira] [Updated] (HDFS-8248) Store INodeId instead of the INodeFile object in BlockInfoContiguous

2015-08-24 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8248: - Attachment: HDFS-8248.007.patch > Store INodeId instead of the INodeFile object in BlockInfoContiguous > --

[jira] [Reopened] (HDFS-8943) Read apis in ByteRangeInputStream does not read all the bytes specified when chunked transfer-encoding is used in the server

2015-08-24 Thread Jakob Homan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Homan reopened HDFS-8943: --- We need a fix for this, let's not close it until we've reached one. > Read apis in ByteRangeInputStream do

[jira] [Commented] (HDFS-8833) Erasure coding: store EC schema and cell size in INodeFile and eliminate notion of EC zones

2015-08-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14710559#comment-14710559 ] Hadoop QA commented on HDFS-8833: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8846) Create edit log files with old layout version for upgrade testing

2015-08-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14710552#comment-14710552 ] Hadoop QA commented on HDFS-8846: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8909) Erasure coding: update BlockInfoContiguousUC and BlockInfoStripedUC to use BlockUnderConstructionFeature

2015-08-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14710554#comment-14710554 ] Hadoop QA commented on HDFS-8909: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8248) Store INodeId instead of the INodeFile object in BlockInfoContiguous

2015-08-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14710547#comment-14710547 ] Hadoop QA commented on HDFS-8248: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8948) Use GenericTestUtils to set log levels in TestPread and TestReplaceDatanodeOnFailure

2015-08-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14710541#comment-14710541 ] Hudson commented on HDFS-8948: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #293 (See [htt

[jira] [Commented] (HDFS-8928) Improvements for BlockUnderConstructionFeature: ReplicaUnderConstruction as a separate class and replicas as an array

2015-08-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14710543#comment-14710543 ] Hudson commented on HDFS-8928: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #293 (See [htt

[jira] [Commented] (HDFS-8932) NPE thrown in NameNode when try to get "TotalSyncCount" metric before editLogStream initialization

2015-08-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14710540#comment-14710540 ] Hudson commented on HDFS-8932: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #293 (See [htt

[jira] [Commented] (HDFS-8943) Read apis in ByteRangeInputStream does not read all the bytes specified when chunked transfer-encoding is used in the server

2015-08-24 Thread Shradha Revankar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14710527#comment-14710527 ] Shradha Revankar commented on HDFS-8943: The loop will only read upto len bytes. Un

[jira] [Commented] (HDFS-8948) Use GenericTestUtils to set log levels in TestPread and TestReplaceDatanodeOnFailure

2015-08-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14710515#comment-14710515 ] Hudson commented on HDFS-8948: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2250 (See [htt

[jira] [Commented] (HDFS-8928) Improvements for BlockUnderConstructionFeature: ReplicaUnderConstruction as a separate class and replicas as an array

2015-08-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14710517#comment-14710517 ] Hudson commented on HDFS-8928: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2250 (See [htt

[jira] [Commented] (HDFS-8932) NPE thrown in NameNode when try to get "TotalSyncCount" metric before editLogStream initialization

2015-08-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14710514#comment-14710514 ] Hudson commented on HDFS-8932: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2250 (See [htt

[jira] [Commented] (HDFS-8900) Compact XAttrs to optimize memory footprint.

2015-08-24 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14710483#comment-14710483 ] Andrew Wang commented on HDFS-8900: --- I like the PACK_THRESHOLD as a solution, doesn't cha

[jira] [Commented] (HDFS-8900) Compact XAttrs to optimize memory footprint.

2015-08-24 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14710479#comment-14710479 ] Brahma Reddy Battula commented on HDFS-8900: Latest patch should be ok as you a

[jira] [Commented] (HDFS-8932) NPE thrown in NameNode when try to get "TotalSyncCount" metric before editLogStream initialization

2015-08-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14710469#comment-14710469 ] Hudson commented on HDFS-8932: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #306 (See [htt

[jira] [Commented] (HDFS-8948) Use GenericTestUtils to set log levels in TestPread and TestReplaceDatanodeOnFailure

2015-08-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14710461#comment-14710461 ] Hudson commented on HDFS-8948: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2231 (See [https://

[jira] [Commented] (HDFS-8928) Improvements for BlockUnderConstructionFeature: ReplicaUnderConstruction as a separate class and replicas as an array

2015-08-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14710463#comment-14710463 ] Hudson commented on HDFS-8928: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2231 (See [https://

[jira] [Commented] (HDFS-8932) NPE thrown in NameNode when try to get "TotalSyncCount" metric before editLogStream initialization

2015-08-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14710460#comment-14710460 ] Hudson commented on HDFS-8932: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2231 (See [https://

[jira] [Commented] (HDFS-8934) Move ShortCircuitShm to hdfs-client

2015-08-24 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14710456#comment-14710456 ] Andrew Wang commented on HDFS-8934: --- Haohui, all we're asking here is a little more care

[jira] [Commented] (HDFS-8829) DataNode sets SO_RCVBUF explicitly is disabling tcp auto-tuning

2015-08-24 Thread He Tianyi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14710434#comment-14710434 ] He Tianyi commented on HDFS-8829: - Hi [~cmccabe], About the second comment: Actually {{DEF

[jira] [Updated] (HDFS-8248) Store INodeId instead of the INodeFile object in BlockInfoContiguous

2015-08-24 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8248: - Attachment: HDFS-8248.006.patch > Store INodeId instead of the INodeFile object in BlockInfoContiguous > --

[jira] [Commented] (HDFS-8934) Move ShortCircuitShm to hdfs-client

2015-08-24 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14710430#comment-14710430 ] Haohui Mai commented on HDFS-8934: -- bq. look at Andrew's old JIRAs doing this for various

[jira] [Commented] (HDFS-8932) NPE thrown in NameNode when try to get "TotalSyncCount" metric before editLogStream initialization

2015-08-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14710419#comment-14710419 ] Hudson commented on HDFS-8932: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1034 (See [https://

[jira] [Commented] (HDFS-8948) Use GenericTestUtils to set log levels in TestPread and TestReplaceDatanodeOnFailure

2015-08-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14710420#comment-14710420 ] Hudson commented on HDFS-8948: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1034 (See [https://

[jira] [Commented] (HDFS-8928) Improvements for BlockUnderConstructionFeature: ReplicaUnderConstruction as a separate class and replicas as an array

2015-08-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14710422#comment-14710422 ] Hudson commented on HDFS-8928: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1034 (See [https://

[jira] [Updated] (HDFS-8900) Compact XAttrs to optimize memory footprint.

2015-08-24 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-8900: - Attachment: HDFS-8900.005.patch Update patch to fix the checkstyle and add more comment in XAttrFeature. > Compact

[jira] [Commented] (HDFS-8248) Store INodeId instead of the INodeFile object in BlockInfoContiguous

2015-08-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14710405#comment-14710405 ] Hadoop QA commented on HDFS-8248: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-8909) Erasure coding: update BlockInfoContiguousUC and BlockInfoStripedUC to use BlockUnderConstructionFeature

2015-08-24 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-8909: Attachment: HDFS-8909-HDFS-7285.003.patch Works for me. Repost patch for Jing to trigger Jenkins against newl

[jira] [Updated] (HDFS-8909) Erasure coding: update BlockInfoContiguousUC and BlockInfoStripedUC to use BlockUnderConstructionFeature

2015-08-24 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-8909: Status: Patch Available (was: Open) > Erasure coding: update BlockInfoContiguousUC and BlockInfoStripedUC to

[jira] [Commented] (HDFS-8934) Move ShortCircuitShm to hdfs-client

2015-08-24 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14710392#comment-14710392 ] Colin Patrick McCabe commented on HDFS-8934: We could have converted to using s

[jira] [Updated] (HDFS-8952) InputStream.PositionRead() should be aware of available DNs

2015-08-24 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8952: - Target Version/s: HDFS-8707 > InputStream.PositionRead() should be aware of available DNs > ---

[jira] [Updated] (HDFS-8952) InputStream.PositionRead() should be aware of available DNs

2015-08-24 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8952: - Attachment: HDFS-8952.000.patch > InputStream.PositionRead() should be aware of available DNs > ---

[jira] [Created] (HDFS-8952) InputStream.PositionRead() should be aware of available DNs

2015-08-24 Thread Haohui Mai (JIRA)
Haohui Mai created HDFS-8952: Summary: InputStream.PositionRead() should be aware of available DNs Key: HDFS-8952 URL: https://issues.apache.org/jira/browse/HDFS-8952 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-8932) NPE thrown in NameNode when try to get "TotalSyncCount" metric before editLogStream initialization

2015-08-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14710380#comment-14710380 ] Hudson commented on HDFS-8932: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #301 (See

[jira] [Commented] (HDFS-8948) Use GenericTestUtils to set log levels in TestPread and TestReplaceDatanodeOnFailure

2015-08-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14710381#comment-14710381 ] Hudson commented on HDFS-8948: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #301 (See

[jira] [Commented] (HDFS-8928) Improvements for BlockUnderConstructionFeature: ReplicaUnderConstruction as a separate class and replicas as an array

2015-08-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14710383#comment-14710383 ] Hudson commented on HDFS-8928: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #301 (See

[jira] [Commented] (HDFS-8929) Add a metric to expose the timestamp of the last journal

2015-08-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14710374#comment-14710374 ] Hadoop QA commented on HDFS-8929: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8928) Improvements for BlockUnderConstructionFeature: ReplicaUnderConstruction as a separate class and replicas as an array

2015-08-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14710369#comment-14710369 ] Hudson commented on HDFS-8928: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #305 (See [htt

[jira] [Commented] (HDFS-8948) Use GenericTestUtils to set log levels in TestPread and TestReplaceDatanodeOnFailure

2015-08-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14710367#comment-14710367 ] Hudson commented on HDFS-8948: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #305 (See [htt

[jira] [Updated] (HDFS-8951) Move shortcircuit to hdfs-client

2015-08-24 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-8951: Status: Patch Available (was: Open) > Move shortcircuit to hdfs-client > ---

[jira] [Updated] (HDFS-8951) Move shortcircuit to hdfs-client

2015-08-24 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-8951: Attachment: HDFS-8951.000.patch The v0 patch moves all classes in {{hdfs/shortcircuit}} to {{hdfs-cl

[jira] [Comment Edited] (HDFS-8900) Compact XAttrs to optimize memory footprint.

2015-08-24 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14710345#comment-14710345 ] Yi Liu edited comment on HDFS-8900 at 8/25/15 12:42 AM: The test fa

[jira] [Commented] (HDFS-8900) Compact XAttrs to optimize memory footprint.

2015-08-24 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14710345#comment-14710345 ] Yi Liu commented on HDFS-8900: -- The test failures are not related, and findbugs don't exist. [

[jira] [Created] (HDFS-8951) Move shortcircuit to hdfs-client

2015-08-24 Thread Mingliang Liu (JIRA)
Mingliang Liu created HDFS-8951: --- Summary: Move shortcircuit to hdfs-client Key: HDFS-8951 URL: https://issues.apache.org/jira/browse/HDFS-8951 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Updated] (HDFS-8951) Move shortcircuit to hdfs-client

2015-08-24 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-8951: Description: This jira tracks the effort of moving the {{shortcircuit}} package into the hdfs-client

[jira] [Updated] (HDFS-8925) Move BlockReader to hdfs-client

2015-08-24 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-8925: Target Version/s: 2.8.0 Fix Version/s: (was: 2.8.0) > Move BlockReader to hdfs-client > --

[jira] [Comment Edited] (HDFS-8900) Compact XAttrs to optimize memory footprint.

2015-08-24 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14710328#comment-14710328 ] Yi Liu edited comment on HDFS-8900 at 8/25/15 12:36 AM: -I missed t

[jira] [Commented] (HDFS-8900) Compact XAttrs to optimize memory footprint.

2015-08-24 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14710328#comment-14710328 ] Yi Liu commented on HDFS-8900: -- I missed to reset the variables at the beginning of XAttrFeatu

[jira] [Issue Comment Deleted] (HDFS-8900) Compact XAttrs to optimize memory footprint.

2015-08-24 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-8900: - Comment: was deleted (was: \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem || Runtime || Co

[jira] [Commented] (HDFS-8938) Refactor BlockManager in blockmanagement

2015-08-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14710319#comment-14710319 ] Hadoop QA commented on HDFS-8938: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-8909) Erasure coding: update BlockInfoContiguousUC and BlockInfoStripedUC to use BlockUnderConstructionFeature

2015-08-24 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-8909: Attachment: HDFS-8909.003.patch Thanks for the review, Walter and Zhe. Update the patch to address Walter's

[jira] [Commented] (HDFS-8928) Improvements for BlockUnderConstructionFeature: ReplicaUnderConstruction as a separate class and replicas as an array

2015-08-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14710309#comment-14710309 ] Hudson commented on HDFS-8928: -- FAILURE: Integrated in Hadoop-trunk-Commit #8345 (See [https:

[jira] [Commented] (HDFS-8948) Use GenericTestUtils to set log levels in TestPread and TestReplaceDatanodeOnFailure

2015-08-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14710307#comment-14710307 ] Hudson commented on HDFS-8948: -- FAILURE: Integrated in Hadoop-trunk-Commit #8345 (See [https:

[jira] [Commented] (HDFS-8932) NPE thrown in NameNode when try to get "TotalSyncCount" metric before editLogStream initialization

2015-08-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14710306#comment-14710306 ] Hudson commented on HDFS-8932: -- FAILURE: Integrated in Hadoop-trunk-Commit #8345 (See [https:

[jira] [Updated] (HDFS-8932) NPE thrown in NameNode when try to get "TotalSyncCount" metric before editLogStream initialization

2015-08-24 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-8932: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved (was:

[jira] [Commented] (HDFS-8939) Test(S)WebHdfsFileContextMainOperations failing on branch-2

2015-08-24 Thread Jakob Homan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14710298#comment-14710298 ] Jakob Homan commented on HDFS-8939: --- btw, [~aw], any idea why Jenkins isn't picking this

[jira] [Updated] (HDFS-8939) Test(S)WebHdfsFileContextMainOperations failing on branch-2

2015-08-24 Thread Jakob Homan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Homan updated HDFS-8939: -- Status: Open (was: Patch Available) > Test(S)WebHdfsFileContextMainOperations failing on branch-2 >

[jira] [Updated] (HDFS-8939) Test(S)WebHdfsFileContextMainOperations failing on branch-2

2015-08-24 Thread Jakob Homan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Homan updated HDFS-8939: -- Status: Patch Available (was: Open) > Test(S)WebHdfsFileContextMainOperations failing on branch-2 >

[jira] [Updated] (HDFS-8939) Test(S)WebHdfsFileContextMainOperations failing on branch-2

2015-08-24 Thread Jakob Homan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Homan updated HDFS-8939: -- Attachment: HDFS-8939-branch-2.002.patch Branch 2 has a test for these custom properties, which of course

[jira] [Updated] (HDFS-8948) Use GenericTestUtils to set log levels in TestPread and TestReplaceDatanodeOnFailure

2015-08-24 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8948: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved (was:

[jira] [Updated] (HDFS-8948) Use GenericTestUtils to set log levels in TestPread and TestReplaceDatanodeOnFailure

2015-08-24 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8948: - Summary: Use GenericTestUtils to set log levels in TestPread and TestReplaceDatanodeOnFailure (was: Fix fa

[jira] [Commented] (HDFS-8948) Fix failing tests in TestPread and TestReplaceDatanodeOnFailure

2015-08-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14710242#comment-14710242 ] Hadoop QA commented on HDFS-8948: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-7285) Erasure Coding Support inside HDFS

2015-08-24 Thread Zhe Zhang (JIRA)
Key: HDFS-7285 > URL: https://issues.apache.org/jira/browse/HDFS-7285 > Project: Hadoop HDFS > Issue Type: New Feature >Reporter: Weihua Jiang >Assignee: Zhe Zhang > Attachments: Compare-consolidated-20150824.diff,

[jira] [Commented] (HDFS-8930) Block report lease may leak if the 2nd full block report comes when NN is still in safemode

2015-08-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14710228#comment-14710228 ] Hudson commented on HDFS-8930: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #292 (See [htt

[jira] [Commented] (HDFS-8930) Block report lease may leak if the 2nd full block report comes when NN is still in safemode

2015-08-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14710224#comment-14710224 ] Hudson commented on HDFS-8930: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2249 (See [htt

[jira] [Updated] (HDFS-8928) Improvements for BlockUnderConstructionFeature: ReplicaUnderConstruction as a separate class and replicas as an array

2015-08-24 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-8928: Priority: Minor (was: Major) > Improvements for BlockUnderConstructionFeature: ReplicaUnderConstruction as a

[jira] [Updated] (HDFS-8928) Improvements for BlockUnderConstructionFeature: ReplicaUnderConstruction as a separate class and replicas as an array

2015-08-24 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-8928: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved (was: P

[jira] [Commented] (HDFS-8930) Block report lease may leak if the 2nd full block report comes when NN is still in safemode

2015-08-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14710213#comment-14710213 ] Hudson commented on HDFS-8930: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2230 (See [https://

[jira] [Updated] (HDFS-8248) Store INodeId instead of the INodeFile object in BlockInfoContiguous

2015-08-24 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8248: - Labels: (was: BB2015-05-TBR) > Store INodeId instead of the INodeFile object in BlockInfoContiguous > ---

[jira] [Commented] (HDFS-8928) Improvements for BlockUnderConstructionFeature: ReplicaUnderConstruction as a separate class and replicas as an array

2015-08-24 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14710207#comment-14710207 ] Haohui Mai commented on HDFS-8928: -- +1 > Improvements for BlockUnderConstructionFeature:

[jira] [Commented] (HDFS-8930) Block report lease may leak if the 2nd full block report comes when NN is still in safemode

2015-08-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14710188#comment-14710188 ] Hudson commented on HDFS-8930: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #300 (See

[jira] [Updated] (HDFS-8833) Erasure coding: store EC schema and cell size in INodeFile and eliminate notion of EC zones

2015-08-24 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8833: Attachment: HDFS-8833-HDFS-7285.02.patch Updating the patch again to fix all reported test failures. [~jingz

[jira] [Comment Edited] (HDFS-7285) Erasure Coding Support inside HDFS

2015-08-24 Thread Andrew Wang (JIRA)
3 PM: - I have rebased the {{HDFS-7285-REBASE}} branch that [~vinayrpet] created on top of HDFS-6407, the same starting point as {{HDFS-7285-merge}}. I then compared the HEAD of these 2 branches. As can be seen from the attached {{Compare-consolidated-20150824.diff}} file, most differences are cosm

[jira] [Commented] (HDFS-8928) Improvements for BlockUnderConstructionFeature: ReplicaUnderConstruction as a separate class and replicas as an array

2015-08-24 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14710152#comment-14710152 ] Zhe Zhang commented on HDFS-8928: - Thanks Jing for updating the patch. The 01 patch LGTM. N

[jira] [Commented] (HDFS-8928) Improvements for BlockUnderConstructionFeature: ReplicaUnderConstruction as a separate class and replicas as an array

2015-08-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14710141#comment-14710141 ] Hadoop QA commented on HDFS-8928: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8930) Block report lease may leak if the 2nd full block report comes when NN is still in safemode

2015-08-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14710138#comment-14710138 ] Hudson commented on HDFS-8930: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1033 (See [https://

[jira] [Commented] (HDFS-8846) Create edit log files with old layout version for upgrade testing

2015-08-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14710137#comment-14710137 ] Hadoop QA commented on HDFS-8846: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-8248) Store INodeId instead of the INodeFile object in BlockInfoContiguous

2015-08-24 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8248: - Attachment: HDFS-8248.005.patch > Store INodeId instead of the INodeFile object in BlockInfoContiguous > --

[jira] [Commented] (HDFS-8248) Store INodeId instead of the INodeFile object in BlockInfoContiguous

2015-08-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14710115#comment-14710115 ] Hadoop QA commented on HDFS-8248: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-5180) Output the processing time of slow RPC request to node's log

2015-08-24 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-5180: - Resolution: Duplicate Fix Version/s: 2.8.0 Status: Resolved (was: Patch Available) Resol

[jira] [Commented] (HDFS-8388) Time and Date format need to be in sync in Namenode UI page

2015-08-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14710084#comment-14710084 ] Hadoop QA commented on HDFS-8388: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8943) Read apis in ByteRangeInputStream does not read all the bytes specified when chunked transfer-encoding is used in the server

2015-08-24 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14710081#comment-14710081 ] Haohui Mai commented on HDFS-8943: -- Closing this as invalid. There are no guarantees that

[jira] [Resolved] (HDFS-8943) Read apis in ByteRangeInputStream does not read all the bytes specified when chunked transfer-encoding is used in the server

2015-08-24 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai resolved HDFS-8943. -- Resolution: Invalid > Read apis in ByteRangeInputStream does not read all the bytes specified when > chu

[jira] [Commented] (HDFS-8934) Move ShortCircuitShm to hdfs-client

2015-08-24 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14710068#comment-14710068 ] Haohui Mai commented on HDFS-8934: -- Particularly for this incident, the test code fails be

  1   2   >