[jira] [Commented] (HDFS-3405) Checkpointing should use HTTP POST or PUT instead of GET-GET to send merged fsimages

2014-03-07 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13924757#comment-13924757 ] Akira AJISAKA commented on HDFS-3405: - [~andrew.wang], would you please delete GetImage

[jira] [Updated] (HDFS-6066) logGenerationStamp is not needed to reduce editlog size

2014-03-07 Thread chenping (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenping updated HDFS-6066: --- Attachment: HDFS-6066-trunk.2.patch fix failure tests, that check txids > logGenerationStamp is not needed to

[jira] [Commented] (HDFS-6055) Change default configuration to limit file name length in HDFS

2014-03-07 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13924744#comment-13924744 ] Suresh Srinivas commented on HDFS-6055: --- +1 for the change, pending jenkins. > Cha

[jira] [Updated] (HDFS-6055) Change default configuration to limit file name length in HDFS

2014-03-07 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-6055: Status: Patch Available (was: Open) > Change default configuration to limit file name length in HDF

[jira] [Updated] (HDFS-6055) Change default configuration to limit file name length in HDFS

2014-03-07 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-6055: Attachment: HDFS-6055.1.patch I'm attaching a patch that changes the default limit to 255. This fu

[jira] [Updated] (HDFS-6055) Change default configuration to limit file name length in HDFS

2014-03-07 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-6055: Target Version/s: 3.0.0, 2.4.0 Affects Version/s: 2.4.0 3.0.0 > Change d

[jira] [Commented] (HDFS-6078) TestIncrementalBlockReports is flaky

2014-03-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13924718#comment-13924718 ] Hadoop QA commented on HDFS-6078: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-6038) JournalNode hardcodes NameNodeLayoutVersion in the edit log file

2014-03-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13924709#comment-13924709 ] Hadoop QA commented on HDFS-6038: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-5535) Umbrella jira for improved HDFS rolling upgrades

2014-03-07 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-5535: -- Status: Open (was: Patch Available) > Umbrella jira for improved HDFS rolling upgrades

[jira] [Commented] (HDFS-5535) Umbrella jira for improved HDFS rolling upgrades

2014-03-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13924696#comment-13924696 ] Hadoop QA commented on HDFS-5535: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-6070) Cleanup use of ReadStatistics in DFSInputStream

2014-03-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13924691#comment-13924691 ] Hadoop QA commented on HDFS-6070: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-5535) Umbrella jira for improved HDFS rolling upgrades

2014-03-07 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-5535: -- Attachment: h5535_20140304-branch-2.patch h5535_20140304-branch-2.patch: for branch-2.

[jira] [Commented] (HDFS-5978) Create a tool to take fsimage and expose read-only WebHDFS API

2014-03-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13924678#comment-13924678 ] Hadoop QA commented on HDFS-5978: - {color:green}+1 overall{color}. Here are the results of

[jira] [Created] (HDFS-6079) Timeout for getFileBlockStorageLocations does not work

2014-03-07 Thread Andrew Wang (JIRA)
Andrew Wang created HDFS-6079: - Summary: Timeout for getFileBlockStorageLocations does not work Key: HDFS-6079 URL: https://issues.apache.org/jira/browse/HDFS-6079 Project: Hadoop HDFS Issue Type

[jira] [Updated] (HDFS-6078) TestIncrementalBlockReports is flaky

2014-03-07 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-6078: -- Priority: Minor (was: Major) Hadoop Flags: Reviewed +1 patch looks good. > Tes

[jira] [Updated] (HDFS-6078) TestIncrementalBlockReports is flaky

2014-03-07 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6078: Attachment: HDFS-6078.01.patch Simple fix to relax the check. This does not affect the correctness o

[jira] [Updated] (HDFS-6078) TestIncrementalBlockReports is flaky

2014-03-07 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6078: Status: Patch Available (was: Open) > TestIncrementalBlockReports is flaky > --

[jira] [Created] (HDFS-6078) TestIncrementalBlockReports is flaky

2014-03-07 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HDFS-6078: --- Summary: TestIncrementalBlockReports is flaky Key: HDFS-6078 URL: https://issues.apache.org/jira/browse/HDFS-6078 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-6077) running slive with webhdfs on secure HA cluster fails with un kown host exception

2014-03-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13924629#comment-13924629 ] Hadoop QA commented on HDFS-6077: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-5535) Umbrella jira for improved HDFS rolling upgrades

2014-03-07 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13924625#comment-13924625 ] Tsz Wo Nicholas Sze commented on HDFS-5535: --- We don't really need to wait for HDF

[jira] [Commented] (HDFS-3405) Checkpointing should use HTTP POST or PUT instead of GET-GET to send merged fsimages

2014-03-07 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13924623#comment-13924623 ] Tsz Wo Nicholas Sze commented on HDFS-3405: --- Sure, let's merge HDFS-5535 to branc

[jira] [Commented] (HDFS-3405) Checkpointing should use HTTP POST or PUT instead of GET-GET to send merged fsimages

2014-03-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13924615#comment-13924615 ] Hudson commented on HDFS-3405: -- SUCCESS: Integrated in Hadoop-trunk-Commit #5287 (See [https:

[jira] [Commented] (HDFS-6068) Disallow snapshot names that are also invalid directory names

2014-03-07 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13924611#comment-13924611 ] Andrew Wang commented on HDFS-6068: --- I agree with Nicholas, I think we should just reuse

[jira] [Resolved] (HDFS-4301) 2NN image transfer timeout problematic

2014-03-07 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang resolved HDFS-4301. --- Resolution: Duplicate Target Version/s: 2.0.3-alpha, 3.0.0 (was: 3.0.0, 2.0.3-alpha) Since

[jira] [Commented] (HDFS-6038) JournalNode hardcodes NameNodeLayoutVersion in the edit log file

2014-03-07 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13924578#comment-13924578 ] Jing Zhao commented on HDFS-6038: - [~tlipcon], do you also want to take a look at the patch

[jira] [Updated] (HDFS-3405) Checkpointing should use HTTP POST or PUT instead of GET-GET to send merged fsimages

2014-03-07 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-3405: -- Fix Version/s: 3.0.0 > Checkpointing should use HTTP POST or PUT instead of GET-GET to send merged > fs

[jira] [Commented] (HDFS-3405) Checkpointing should use HTTP POST or PUT instead of GET-GET to send merged fsimages

2014-03-07 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13924573#comment-13924573 ] Andrew Wang commented on HDFS-3405: --- Committed to trunk. [~sureshms] or [~szetszwo], do y

[jira] [Commented] (HDFS-6038) JournalNode hardcodes NameNodeLayoutVersion in the edit log file

2014-03-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13924561#comment-13924561 ] Hadoop QA commented on HDFS-6038: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-3405) Checkpointing should use HTTP POST or PUT instead of GET-GET to send merged fsimages

2014-03-07 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13924557#comment-13924557 ] Andrew Wang commented on HDFS-3405: --- I ran the failed test locally and it worked. Will co

[jira] [Commented] (HDFS-5196) Provide more snapshot information in WebUI

2014-03-07 Thread Shinichi Yamashita (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13924555#comment-13924555 ] Shinichi Yamashita commented on HDFS-5196: -- Thank you for your comment. I will cha

[jira] [Updated] (HDFS-6070) Cleanup use of ReadStatistics in DFSInputStream

2014-03-07 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-6070: -- Status: Patch Available (was: Open) > Cleanup use of ReadStatistics in DFSInputStream > ---

[jira] [Commented] (HDFS-5064) Standby checkpoints should not block concurrent readers

2014-03-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13924521#comment-13924521 ] Hudson commented on HDFS-5064: -- SUCCESS: Integrated in Hadoop-trunk-Commit #5286 (See [https:

[jira] [Commented] (HDFS-6076) SimulatedDataSet should not create DatanodeRegistration with namenode layout version and type

2014-03-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13924520#comment-13924520 ] Hudson commented on HDFS-6076: -- SUCCESS: Integrated in Hadoop-trunk-Commit #5286 (See [https:

[jira] [Commented] (HDFS-2538) option to disable fsck dots

2014-03-07 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13924515#comment-13924515 ] Akira AJISAKA commented on HDFS-2538: - Thanks for the update, [~kamrul]. I'm okay with

[jira] [Commented] (HDFS-5846) Assigning DEFAULT_RACK in resolveNetworkLocation method can break data resiliency

2014-03-07 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13924512#comment-13924512 ] Chris Nauroth commented on HDFS-5846: - Hi, [~nikola.vujic]. This patch mostly looks go

[jira] [Updated] (HDFS-6076) SimulatedDataSet should not create DatanodeRegistration with namenode layout version and type

2014-03-07 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-6076: -- Resolution: Fixed Fix Version/s: 3.0.0 Hadoop Flags: Reviewed Stat

[jira] [Updated] (HDFS-5064) Standby checkpoints should not block concurrent readers

2014-03-07 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-5064: -- Resolution: Fixed Fix Version/s: 2.4.0 Status: Resolved (was: Patch Available) Commit

[jira] [Updated] (HDFS-5978) Create a tool to take fsimage and expose read-only WebHDFS API

2014-03-07 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HDFS-5978: Target Version/s: 2.5.0 Status: Patch Available (was: Open) > Create a tool to take f

[jira] [Commented] (HDFS-5274) Add Tracing to HDFS

2014-03-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13924490#comment-13924490 ] Hadoop QA commented on HDFS-5274: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-5978) Create a tool to take fsimage and expose read-only WebHDFS API

2014-03-07 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HDFS-5978: Attachment: HDFS-5978.patch Attaching a first patch which only exposes {{LISTSTATUS}} in WebHDFS. >

[jira] [Commented] (HDFS-6076) SimulatedDataSet should not create DatanodeRegistration with namenode layout version and type

2014-03-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13924481#comment-13924481 ] Hadoop QA commented on HDFS-6076: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-5064) Standby checkpoints should not block concurrent readers

2014-03-07 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13924477#comment-13924477 ] Andrew Wang commented on HDFS-5064: --- Restating my +1, going to commit this shortly. > St

[jira] [Commented] (HDFS-4685) Implementation of ACLs in HDFS

2014-03-07 Thread Claudio Fahey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13924472#comment-13924472 ] Claudio Fahey commented on HDFS-4685: - I am currently traveling and will be back on Mon

[jira] [Updated] (HDFS-4685) Implementation of ACLs in HDFS

2014-03-07 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-4685: Release Note: HDFS now supports ACLs (Access Control Lists). ACLs can specify fine-grained file per

[jira] [Updated] (HDFS-5274) Add Tracing to HDFS

2014-03-07 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-5274: --- Attachment: 3node_get_200mb.png 3node_put_200mb.png adding screen shots of tra

[jira] [Updated] (HDFS-6077) running slive with webhdfs on secure HA cluster fails with un kown host exception

2014-03-07 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-6077: -- Description: SliveTest fails with following. See the comment for more logs. {noformat}

[jira] [Commented] (HDFS-6071) BlockReaderLocal doesn't return -1 on EOF when doing a zero-length read on a short file

2014-03-07 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13924447#comment-13924447 ] Andrew Wang commented on HDFS-6071: --- Looks generally good. Two review comments: - Should

[jira] [Updated] (HDFS-6077) running slive with webhdfs on secure HA cluster fails with un kown host exception

2014-03-07 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6077: Status: Patch Available (was: Open) > running slive with webhdfs on secure HA cluster fails with un kown ho

[jira] [Updated] (HDFS-6077) running slive with webhdfs on secure HA cluster fails with un kown host exception

2014-03-07 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6077: Attachment: HDFS-6077.000.patch A simple patch to fix. > running slive with webhdfs on secure HA cluster fa

[jira] [Commented] (HDFS-6077) running slive with webhdfs on secure HA cluster fails with un kown host exception

2014-03-07 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13924442#comment-13924442 ] Jing Zhao commented on HDFS-6077: - This is actually a similar issue with HDFS-5339: Securit

[jira] [Commented] (HDFS-6077) running slive with webhdfs on secure HA cluster fails with un kown host exception

2014-03-07 Thread Arpit Gupta (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13924433#comment-13924433 ] Arpit Gupta commented on HDFS-6077: --- {code} RUNNING: /usr/lib/hadoop/bin/hadoop org.apach

[jira] [Created] (HDFS-6077) running slive with webhdfs on secure HA cluster fails with un kown host exception

2014-03-07 Thread Arpit Gupta (JIRA)
Arpit Gupta created HDFS-6077: - Summary: running slive with webhdfs on secure HA cluster fails with un kown host exception Key: HDFS-6077 URL: https://issues.apache.org/jira/browse/HDFS-6077 Project: Hado

[jira] [Commented] (HDFS-6038) JournalNode hardcodes NameNodeLayoutVersion in the edit log file

2014-03-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13924388#comment-13924388 ] Hadoop QA commented on HDFS-6038: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-6068) Disallow snapshot names that are also invalid directory names

2014-03-07 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13924354#comment-13924354 ] Tsz Wo Nicholas Sze commented on HDFS-6068: --- The new isValidSnapshotName(..) meth

[jira] [Updated] (HDFS-6038) JournalNode hardcodes NameNodeLayoutVersion in the edit log file

2014-03-07 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-6038: -- Component/s: (was: ha) (was: hdfs-client)

[jira] [Commented] (HDFS-6076) SimulatedDataSet should not create DatanodeRegistration with namenode layout version and type

2014-03-07 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13924350#comment-13924350 ] Arpit Agarwal commented on HDFS-6076: - +1 for the patch. > SimulatedDataSet should not

[jira] [Updated] (HDFS-6038) JournalNode hardcodes NameNodeLayoutVersion in the edit log file

2014-03-07 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6038: Attachment: HDFS-6038.007.patch Added an extra check for writing length. > JournalNode hardcodes NameNodeLa

[jira] [Updated] (HDFS-6076) SimulatedDataSet should not create DatanodeRegistration with namenode layout version and type

2014-03-07 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-6076: -- Status: Patch Available (was: Open) > SimulatedDataSet should not create DatanodeRegist

[jira] [Updated] (HDFS-6076) SimulatedDataSet should not create DatanodeRegistration with namenode layout version and type

2014-03-07 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-6076: -- Component/s: test > SimulatedDataSet should not create DatanodeRegistration with namenod

[jira] [Updated] (HDFS-6076) SimulatedDataSet should not create DatanodeRegistration with namenode layout version and type

2014-03-07 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-6076: -- Attachment: h6076_20140307.patch h6076_20140307.patch: 1st patch. > SimulatedDataSet sh

[jira] [Created] (HDFS-6076) SimulatedDataSet should not create DatanodeRegistration with namenode layout version and type

2014-03-07 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-6076: - Summary: SimulatedDataSet should not create DatanodeRegistration with namenode layout version and type Key: HDFS-6076 URL: https://issues.apache.org/jira/browse/HDFS-607

[jira] [Resolved] (HDFS-5986) Capture the number of blocks pending deletion on namenode webUI

2014-03-07 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth resolved HDFS-5986. - Resolution: Fixed Fix Version/s: 2.4.0 3.0.0 Hadoop Flags: Reviewed

[jira] [Commented] (HDFS-5986) Capture the number of blocks pending deletion on namenode webUI

2014-03-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13924259#comment-13924259 ] Hudson commented on HDFS-5986: -- SUCCESS: Integrated in Hadoop-trunk-Commit #5283 (See [https:

[jira] [Updated] (HDFS-5986) Capture the number of blocks pending deletion on namenode webUI

2014-03-07 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-5986: Attachment: HDFS-5986-screenshot.png Thanks, Haohui. Here is a screenshot. I'll commit this. > Ca

[jira] [Updated] (HDFS-6038) JournalNode hardcodes NameNodeLayoutVersion in the edit log file

2014-03-07 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6038: Attachment: HDFS-6038.006.patch Update the patch to fix the javadoc warning and unit test failure. > Journa

[jira] [Updated] (HDFS-5986) Capture the number of blocks pending deletion on namenode webUI

2014-03-07 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-5986: Status: Open (was: Patch Available) > Capture the number of blocks pending deletion on namenode web

[jira] [Commented] (HDFS-6075) Introducing "non-replication mode"

2014-03-07 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13924197#comment-13924197 ] Todd Lipcon commented on HDFS-6075: --- Might be worth having it be an integer config rather

[jira] [Commented] (HDFS-5638) FileContext API for ACLs.

2014-03-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13924182#comment-13924182 ] Hadoop QA commented on HDFS-5638: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-5196) Provide more snapshot information in WebUI

2014-03-07 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13924184#comment-13924184 ] Haohui Mai commented on HDFS-5196: -- {code} + public String getSnapshottableDirs() throws

[jira] [Commented] (HDFS-5986) Capture the number of blocks pending deletion on namenode webUI

2014-03-07 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13924181#comment-13924181 ] Haohui Mai commented on HDFS-5986: -- Looks good to me. +1. Can you post a screenshot for a

[jira] [Commented] (HDFS-6066) logGenerationStamp is not needed to reduce editlog size

2014-03-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13924115#comment-13924115 ] Hadoop QA commented on HDFS-6066: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-6070) Cleanup use of ReadStatistics in DFSInputStream

2014-03-07 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13924103#comment-13924103 ] Colin Patrick McCabe commented on HDFS-6070: +1 > Cleanup use of ReadStatistic

[jira] [Created] (HDFS-6075) Introducing "non-replication mode"

2014-03-07 Thread Adam Kawa (JIRA)
Adam Kawa created HDFS-6075: --- Summary: Introducing "non-replication mode" Key: HDFS-6075 URL: https://issues.apache.org/jira/browse/HDFS-6075 Project: Hadoop HDFS Issue Type: New Feature

[jira] [Commented] (HDFS-5950) The DFSClient and DataNode should use shared memory segments to communicate short-circuit information

2014-03-07 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13924046#comment-13924046 ] Chris Nauroth commented on HDFS-5950: - It's starting to look like the restricted permis

[jira] [Commented] (HDFS-5986) Capture the number of blocks pending deletion on namenode webUI

2014-03-07 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13924029#comment-13924029 ] Chris Nauroth commented on HDFS-5986: - The failure in {{TestCacheDirectives}} is unrela

[jira] [Updated] (HDFS-5638) FileContext API for ACLs.

2014-03-07 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-5638: Attachment: HDFS-5638.patch Updated patch with FilterFs failure fix > FileContext API for ACLs. > -

[jira] [Commented] (HDFS-6066) logGenerationStamp is not needed to reduce editlog size

2014-03-07 Thread chenping (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13923951#comment-13923951 ] chenping commented on HDFS-6066: @Uma Maheswara Rao G Yes, StandbyNN can also get the gs fr

[jira] [Updated] (HDFS-6066) logGenerationStamp is not needed to reduce editlog size

2014-03-07 Thread chenping (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenping updated HDFS-6066: --- Attachment: HDFS-6066-trunk.1.patch change the path where the patch created。 > logGenerationStamp is not need

[jira] [Commented] (HDFS-5638) FileContext API for ACLs.

2014-03-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13923886#comment-13923886 ] Hadoop QA commented on HDFS-5638: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-5196) Provide more snapshot information in WebUI

2014-03-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13923860#comment-13923860 ] Hadoop QA commented on HDFS-5196: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-6068) Disallow snapshot names that are also invalid directory names

2014-03-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13923857#comment-13923857 ] Hadoop QA commented on HDFS-6068: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-6068) Disallow snapshot names that are also invalid directory names

2014-03-07 Thread sathish (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sathish updated HDFS-6068: -- Attachment: HDFS-6068-0002.patch Test case Failures are handeled as part of second patch Please review the patch

[jira] [Commented] (HDFS-6068) Disallow snapshot names that are also invalid directory names

2014-03-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13923771#comment-13923771 ] Hadoop QA commented on HDFS-6068: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-5638) FileContext API for ACLs.

2014-03-07 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-5638: Target Version/s: 3.0.0 (was: HDFS ACLs (HDFS-4685)) Status: Patch Available (was: Op

[jira] [Updated] (HDFS-5638) FileContext API for ACLs.

2014-03-07 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-5638: Attachment: HDFS-5638.patch Hi [~cnauroth], Thanks for looking into patch. Here is the latest patc

[jira] [Commented] (HDFS-6074) Under replicated blocks with ONE replica should get replication priority over blocks with more than one replica.

2014-03-07 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13923744#comment-13923744 ] Steve Loughran commented on HDFS-6074: -- I think we do that already: [[https://github.

[jira] [Commented] (HDFS-5986) Capture the number of blocks pending deletion on namenode webUI

2014-03-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13923742#comment-13923742 ] Hadoop QA commented on HDFS-5986: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-6038) JournalNode hardcodes NameNodeLayoutVersion in the edit log file

2014-03-07 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13923725#comment-13923725 ] Jing Zhao commented on HDFS-6038: - bq. DataOutputBuffer.writeInt can be simplified as below

[jira] [Updated] (HDFS-5196) Provide more snapshot information in WebUI

2014-03-07 Thread Shinichi Yamashita (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shinichi Yamashita updated HDFS-5196: - Status: Patch Available (was: Open) > Provide more snapshot information in WebUI > --

[jira] [Updated] (HDFS-5196) Provide more snapshot information in WebUI

2014-03-07 Thread Shinichi Yamashita (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shinichi Yamashita updated HDFS-5196: - Attachment: HDFS-5196.patch I attach a patch file for new Web UI. > Provide more snapshot

[jira] [Commented] (HDFS-5723) Append failed FINALIZED replica should not be accepted as valid when that block is underconstruction

2014-03-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13923719#comment-13923719 ] Hadoop QA commented on HDFS-5723: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6038) JournalNode hardcodes NameNodeLayoutVersion in the edit log file

2014-03-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13923673#comment-13923673 ] Hadoop QA commented on HDFS-6038: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-6066) logGenerationStamp is not needed to reduce editlog size

2014-03-07 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13923672#comment-13923672 ] Uma Maheswara Rao G commented on HDFS-6066: --- I remember we done this change part