[jira] [Commented] (HDFS-4590) Add more Unit Test Case for HDFS-3701 HDFS Miss Final Block Reading when File is Open for Write

2013-04-10 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13627550#comment-13627550 ] Suresh Srinivas commented on HDFS-4590: --- Did you delete the old patch?

[jira] [Updated] (HDFS-3295) Mismatch in number of bytes already moved and number of bytes being moved in balancer report

2013-04-10 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J updated HDFS-3295: -- Fix Version/s: (was: 0.24.0) > Mismatch in number of bytes already moved and number of bytes being moved

[jira] [Commented] (HDFS-4590) Add more Unit Test Case for HDFS-3701 HDFS Miss Final Block Reading when File is Open for Write

2013-04-10 Thread Huned Lokhandwala (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13627554#comment-13627554 ] Huned Lokhandwala commented on HDFS-4590: - Hi Suresh, Yes, I deleted the old patch,

[jira] [Commented] (HDFS-4590) Add more Unit Test Case for HDFS-3701 HDFS Miss Final Block Reading when File is Open for Write

2013-04-10 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13627562#comment-13627562 ] Suresh Srinivas commented on HDFS-4590: --- If you delete the old patch, the comments I

[jira] [Commented] (HDFS-2576) Namenode should have a favored nodes hint to enable clients to have control over block placement.

2013-04-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13627567#comment-13627567 ] Hadoop QA commented on HDFS-2576: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-4660) Duplicated checksum on DN in a recovered pipeline

2013-04-10 Thread PengZhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13627573#comment-13627573 ] PengZhang commented on HDFS-4660: - #Call hflush to ensure that all DNs have the full length

[jira] [Created] (HDFS-4681) TestBlocksWithNotEnoughRacks#testCorruptBlockRereplicatedAcrossRacks fails using IBM java

2013-04-10 Thread Tian Hong Wang (JIRA)
Tian Hong Wang created HDFS-4681: Summary: TestBlocksWithNotEnoughRacks#testCorruptBlockRereplicatedAcrossRacks fails using IBM java Key: HDFS-4681 URL: https://issues.apache.org/jira/browse/HDFS-4681

[jira] [Updated] (HDFS-4681) TestBlocksWithNotEnoughRacks#testCorruptBlockRereplicatedAcrossRacks fails using IBM java

2013-04-10 Thread Tian Hong Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tian Hong Wang updated HDFS-4681: - Description: TestBlocksWithNotEnoughRacks unit test fails with the following error message: --

[jira] [Updated] (HDFS-4681) TestBlocksWithNotEnoughRacks#testCorruptBlockRereplicatedAcrossRacks fails using IBM java

2013-04-10 Thread Tian Hong Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tian Hong Wang updated HDFS-4681: - Attachment: HDFS-4681.patch > TestBlocksWithNotEnoughRacks#testCorruptBlockRereplicatedAcrossR

[jira] [Commented] (HDFS-4681) TestBlocksWithNotEnoughRacks#testCorruptBlockRereplicatedAcrossRacks fails using IBM java

2013-04-10 Thread Tian Hong Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13627580#comment-13627580 ] Tian Hong Wang commented on HDFS-4681: -- The root cause is that the unit test code uses

[jira] [Updated] (HDFS-4681) TestBlocksWithNotEnoughRacks#testCorruptBlockRereplicatedAcrossRacks fails using IBM java

2013-04-10 Thread Tian Hong Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tian Hong Wang updated HDFS-4681: - Status: Patch Available (was: Open) > TestBlocksWithNotEnoughRacks#testCorruptBlockRereplicat

[jira] [Commented] (HDFS-4681) TestBlocksWithNotEnoughRacks#testCorruptBlockRereplicatedAcrossRacks fails using IBM java

2013-04-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13627633#comment-13627633 ] Hadoop QA commented on HDFS-4681: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-4674) TestBPOfferService fails on Windows due to failure parsing datanode data directory as URI

2013-04-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13627666#comment-13627666 ] Hudson commented on HDFS-4674: -- Integrated in Hadoop-Yarn-trunk #179 (See [https://builds.apa

[jira] [Commented] (HDFS-4643) Fix flakiness in TestQuorumJournalManager

2013-04-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13627667#comment-13627667 ] Hudson commented on HDFS-4643: -- Integrated in Hadoop-Yarn-trunk #179 (See [https://builds.apa

[jira] [Commented] (HDFS-4676) TestHDFSFileSystemContract should set MiniDFSCluster variable to null to free up memory

2013-04-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13627671#comment-13627671 ] Hudson commented on HDFS-4676: -- Integrated in Hadoop-Yarn-trunk #179 (See [https://builds.apa

[jira] [Commented] (HDFS-4669) TestBlockPoolManager fails using IBM java

2013-04-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13627672#comment-13627672 ] Hudson commented on HDFS-4669: -- Integrated in Hadoop-Yarn-trunk #179 (See [https://builds.apa

[jira] [Created] (HDFS-4682) getting error while configuring the hadoop

2013-04-10 Thread murali (JIRA)
murali created HDFS-4682: Summary: getting error while configuring the hadoop Key: HDFS-4682 URL: https://issues.apache.org/jira/browse/HDFS-4682 Project: Hadoop HDFS Issue Type: Bug Compon

[jira] [Commented] (HDFS-4679) Namenode operation checks should be done in a consistent manner

2013-04-10 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13627689#comment-13627689 ] Harsh J commented on HDFS-4679: --- bq. Was there any reason why FSNamesystem#setTimes() write o

[jira] [Resolved] (HDFS-4682) getting error while configuring the hadoop

2013-04-10 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HDFS-4682. -- Resolution: Invalid closing as invalid, see http://wiki.apache.org/hadoop/InvalidJiraIssues

[jira] [Commented] (HDFS-4680) Audit logging of client names

2013-04-10 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13627694#comment-13627694 ] Steve Loughran commented on HDFS-4680: -- Rather than client name, I'd recommend a workf

[jira] [Commented] (HDFS-4670) Style Hadoop HDFS web ui's with Twitter's bootstrap.

2013-04-10 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13627695#comment-13627695 ] Steve Loughran commented on HDFS-4670: -- has anyone reviewed this on android and apple

[jira] [Commented] (HDFS-4643) Fix flakiness in TestQuorumJournalManager

2013-04-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13627756#comment-13627756 ] Hudson commented on HDFS-4643: -- Integrated in Hadoop-Hdfs-trunk #1368 (See [https://builds.ap

[jira] [Commented] (HDFS-4676) TestHDFSFileSystemContract should set MiniDFSCluster variable to null to free up memory

2013-04-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13627760#comment-13627760 ] Hudson commented on HDFS-4676: -- Integrated in Hadoop-Hdfs-trunk #1368 (See [https://builds.ap

[jira] [Commented] (HDFS-4674) TestBPOfferService fails on Windows due to failure parsing datanode data directory as URI

2013-04-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13627755#comment-13627755 ] Hudson commented on HDFS-4674: -- Integrated in Hadoop-Hdfs-trunk #1368 (See [https://builds.ap

[jira] [Commented] (HDFS-4669) TestBlockPoolManager fails using IBM java

2013-04-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13627761#comment-13627761 ] Hudson commented on HDFS-4669: -- Integrated in Hadoop-Hdfs-trunk #1368 (See [https://builds.ap

[jira] [Commented] (HDFS-4434) Provide a mapping from INodeId to INode

2013-04-10 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13627802#comment-13627802 ] Daryn Sharp commented on HDFS-4434: --- bq. Related work for another Jira - .reserved should

[jira] [Commented] (HDFS-4434) Provide a mapping from INodeId to INode

2013-04-10 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13627806#comment-13627806 ] Daryn Sharp commented on HDFS-4434: --- bq. Note down the road we should do the split in the

[jira] [Commented] (HDFS-4674) TestBPOfferService fails on Windows due to failure parsing datanode data directory as URI

2013-04-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13627810#comment-13627810 ] Hudson commented on HDFS-4674: -- Integrated in Hadoop-Mapreduce-trunk #1395 (See [https://buil

[jira] [Commented] (HDFS-4643) Fix flakiness in TestQuorumJournalManager

2013-04-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13627811#comment-13627811 ] Hudson commented on HDFS-4643: -- Integrated in Hadoop-Mapreduce-trunk #1395 (See [https://buil

[jira] [Commented] (HDFS-4676) TestHDFSFileSystemContract should set MiniDFSCluster variable to null to free up memory

2013-04-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13627815#comment-13627815 ] Hudson commented on HDFS-4676: -- Integrated in Hadoop-Mapreduce-trunk #1395 (See [https://buil

[jira] [Commented] (HDFS-4669) TestBlockPoolManager fails using IBM java

2013-04-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13627816#comment-13627816 ] Hudson commented on HDFS-4669: -- Integrated in Hadoop-Mapreduce-trunk #1395 (See [https://buil

[jira] [Commented] (HDFS-4305) Add a configurable limit on number of blocks per file, and min block size

2013-04-10 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13627856#comment-13627856 ] Kihwal Lee commented on HDFS-4305: -- We had a user who accidentally set the block size to s

[jira] [Commented] (HDFS-4680) Audit logging of client names

2013-04-10 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13627868#comment-13627868 ] Daryn Sharp commented on HDFS-4680: --- I believe modifying the RPC layer and expecting clie

[jira] [Commented] (HDFS-4680) Audit logging of client names

2013-04-10 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13627876#comment-13627876 ] Kihwal Lee commented on HDFS-4680: -- bq. Rather than client name, I'd recommend a workflow

[jira] [Commented] (HDFS-4672) Support tiered storage policies

2013-04-10 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13627889#comment-13627889 ] Chris Nauroth commented on HDFS-4672: - xattrs can also serve as a building block in the

[jira] [Commented] (HDFS-4680) Audit logging of client names

2013-04-10 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13627895#comment-13627895 ] Todd Lipcon commented on HDFS-4680: --- bq. I believe modifying the RPC layer and expecting

[jira] [Updated] (HDFS-4629) Using com.sun.org.apache.xml.internal.serialize.* in XmlEditsVisitor.java is JVM vendor specific. Breaks IBM JAVA

2013-04-10 Thread Amir Sanjar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amir Sanjar updated HDFS-4629: -- Summary: Using com.sun.org.apache.xml.internal.serialize.* in XmlEditsVisitor.java is JVM vendor specifi

[jira] [Commented] (HDFS-4672) Support tiered storage policies

2013-04-10 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13627910#comment-13627910 ] Kihwal Lee commented on HDFS-4672: -- I would like to see a clear real use case to be identi

[jira] [Commented] (HDFS-4680) Audit logging of client names

2013-04-10 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13627916#comment-13627916 ] Daryn Sharp commented on HDFS-4680: --- Would a combination of embedding the clientID in the

[jira] [Commented] (HDFS-4489) Use InodeID as as an identifier of a file in HDFS protocols and APIs

2013-04-10 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13627920#comment-13627920 ] Daryn Sharp commented on HDFS-4489: --- Perhaps ASN.1 encoding the long for the inode id wil

[jira] [Updated] (HDFS-4477) Secondary namenode may retain old tokens

2013-04-10 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-4477: -- Attachment: HDFS-4477.patch Here is a stripped down patch that expires tokens as cancellations. It mimi

[jira] [Commented] (HDFS-4477) Secondary namenode may retain old tokens

2013-04-10 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13627960#comment-13627960 ] Daryn Sharp commented on HDFS-4477: --- Regarding earlier concern about the extra edits: If

[jira] [Created] (HDFS-4683) Per directory trash settings / trash override

2013-04-10 Thread John Vines (JIRA)
John Vines created HDFS-4683: Summary: Per directory trash settings / trash override Key: HDFS-4683 URL: https://issues.apache.org/jira/browse/HDFS-4683 Project: Hadoop HDFS Issue Type: Improveme

[jira] [Commented] (HDFS-4683) Per directory trash settings / trash override

2013-04-10 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13628009#comment-13628009 ] Doug Cutting commented on HDFS-4683: With HADOOP-8689, a client that calls Trash#moveTo

[jira] [Commented] (HDFS-4683) Per directory trash settings / trash override

2013-04-10 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13628017#comment-13628017 ] Colin Patrick McCabe commented on HDFS-4683: bq. A. per directory or user trash

[jira] [Resolved] (HDFS-4683) Per directory trash settings / trash override

2013-04-10 Thread John Vines (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Vines resolved HDFS-4683. -- Resolution: Invalid I could have sworn that was the first thing I tested. Thank you for the quick reply

[jira] [Commented] (HDFS-4305) Add a configurable limit on number of blocks per file, and min block size

2013-04-10 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13628041#comment-13628041 ] Suresh Srinivas commented on HDFS-4305: --- bq. We had a user who accidentally set the b

[jira] [Commented] (HDFS-4434) Provide a mapping from INodeId to INode

2013-04-10 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13628046#comment-13628046 ] Suresh Srinivas commented on HDFS-4434: --- bq. By implementing this feature via special

[jira] [Updated] (HDFS-4590) Add more Unit Test Case for HDFS-3701 HDFS Miss Final Block Reading when File is Open for Write

2013-04-10 Thread Huned Lokhandwala (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huned Lokhandwala updated HDFS-4590: Attachment: HDFS-4590.b1.001_old.patch Hi, I did save a copy of the old patch on my local dr

[jira] [Commented] (HDFS-4489) Use InodeID as as an identifier of a file in HDFS protocols and APIs

2013-04-10 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13628050#comment-13628050 ] Suresh Srinivas commented on HDFS-4489: --- bq. Perhaps ASN.1 encoding the long for the

[jira] [Commented] (HDFS-4489) Use InodeID as as an identifier of a file in HDFS protocols and APIs

2013-04-10 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13628057#comment-13628057 ] Kihwal Lee commented on HDFS-4489: -- bq. With this change, it is expected that NN is alloca

[jira] [Commented] (HDFS-4477) Secondary namenode may retain old tokens

2013-04-10 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13628110#comment-13628110 ] Todd Lipcon commented on HDFS-4477: --- Hey Daryn. I like the approach. Couple quick questio

[jira] [Commented] (HDFS-4680) Audit logging of client names

2013-04-10 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13628149#comment-13628149 ] Todd Lipcon commented on HDFS-4680: --- bq. Would a combination of embedding the clientID in

[jira] [Commented] (HDFS-4477) Secondary namenode may retain old tokens

2013-04-10 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13628153#comment-13628153 ] Daryn Sharp commented on HDFS-4477: --- Yeah, looks like in my quick strip down of the patch

[jira] [Commented] (HDFS-4305) Add a configurable limit on number of blocks per file, and min block size

2013-04-10 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13628154#comment-13628154 ] Todd Lipcon commented on HDFS-4305: --- bq. I am reluctant about this change since this inco

[jira] [Commented] (HDFS-3934) duplicative dfs_hosts entries handled wrong

2013-04-10 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13628171#comment-13628171 ] Todd Lipcon commented on HDFS-3934: --- {code} +this.defaultInfoPort = NetUtils.createSo

[jira] [Commented] (HDFS-4477) Secondary namenode may retain old tokens

2013-04-10 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13628175#comment-13628175 ] Daryn Sharp commented on HDFS-4477: --- I was just thinking, do I really need to test anythi

[jira] [Commented] (HDFS-4477) Secondary namenode may retain old tokens

2013-04-10 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13628180#comment-13628180 ] Todd Lipcon commented on HDFS-4477: --- That's fair, makes sense. I think we even have some

[jira] [Resolved] (HDFS-4673) Renaming file in subdirectory of a snapshotted directory does not work.

2013-04-10 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-4673. - Resolution: Duplicate I am resolving as a duplicate of HDFS-4675. I just verified it is fixed by t

[jira] [Commented] (HDFS-4681) TestBlocksWithNotEnoughRacks#testCorruptBlockRereplicatedAcrossRacks fails using IBM java

2013-04-10 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13628190#comment-13628190 ] Todd Lipcon commented on HDFS-4681: --- It seems like converting random bytes to String is e

[jira] [Commented] (HDFS-4305) Add a configurable limit on number of blocks per file, and min block size

2013-04-10 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13628191#comment-13628191 ] Suresh Srinivas commented on HDFS-4305: --- bq. I don't think it's in the best interest

[jira] [Commented] (HDFS-4489) Use InodeID as as an identifier of a file in HDFS protocols and APIs

2013-04-10 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13628197#comment-13628197 ] Suresh Srinivas commented on HDFS-4489: --- bq. But if you approach from the view point

[jira] [Commented] (HDFS-4305) Add a configurable limit on number of blocks per file, and min block size

2013-04-10 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13628214#comment-13628214 ] Todd Lipcon commented on HDFS-4305: --- I've seen it twice among our customers, sounds like

[jira] [Commented] (HDFS-4489) Use InodeID as as an identifier of a file in HDFS protocols and APIs

2013-04-10 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13628217#comment-13628217 ] Brandon Li commented on HDFS-4489: -- {quote}I am not saying it is a showstopper. I just fel

[jira] [Commented] (HDFS-3934) duplicative dfs_hosts entries handled wrong

2013-04-10 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13628230#comment-13628230 ] Colin Patrick McCabe commented on HDFS-3934: It's true that this does add addit

[jira] [Commented] (HDFS-3934) duplicative dfs_hosts entries handled wrong

2013-04-10 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13628235#comment-13628235 ] Todd Lipcon commented on HDFS-3934: --- Which one's solution #2? This one? {quote} Alternat

[jira] [Created] (HDFS-4684) Snapshot: Use INode id for image serialization

2013-04-10 Thread Tsz Wo (Nicholas), SZE (JIRA)
Tsz Wo (Nicholas), SZE created HDFS-4684: Summary: Snapshot: Use INode id for image serialization Key: HDFS-4684 URL: https://issues.apache.org/jira/browse/HDFS-4684 Project: Hadoop HDFS

[jira] [Updated] (HDFS-4684) Snapshot: Use INode id for image serialization

2013-04-10 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-4684: - Attachment: h4684_20130410.patch h4684_20130410.patch: - uses inode id; - fixes a

[jira] [Commented] (HDFS-4679) Namenode operation checks should be done in a consistent manner

2013-04-10 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13628304#comment-13628304 ] Sanjay Radia commented on HDFS-4679: +1 When reading the patch I noticed that createSym

[jira] [Updated] (HDFS-4684) Snapshot: Use INode id for image serialization

2013-04-10 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-4684: - Attachment: h4684_20130410b.patch h4684_20130410b.patch: use withCount.getId() ins

[jira] [Commented] (HDFS-4684) Snapshot: Use INode id for image serialization

2013-04-10 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13628319#comment-13628319 ] Jing Zhao commented on HDFS-4684: - The patch looks good to me. +1 for the patch.

[jira] [Commented] (HDFS-4672) Support tiered storage policies

2013-04-10 Thread Andrew Purtell (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13628331#comment-13628331 ] Andrew Purtell commented on HDFS-4672: -- bq. I would like to see a clear real use case

[jira] [Resolved] (HDFS-4684) Snapshot: Use INode id for image serialization

2013-04-10 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE resolved HDFS-4684. -- Resolution: Fixed Fix Version/s: Snapshot (HDFS-2802) Hadoop Flags: R

[jira] [Commented] (HDFS-4301) 2NN image transfer timeout problematic

2013-04-10 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13628393#comment-13628393 ] Andrew Wang commented on HDFS-4301: --- I poked at this some, manually setting an artificial

[jira] [Commented] (HDFS-4679) Namenode operation checks should be done in a consistent manner

2013-04-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13628395#comment-13628395 ] Hudson commented on HDFS-4679: -- Integrated in Hadoop-trunk-Commit #3589 (See [https://builds.

[jira] [Commented] (HDFS-4679) Namenode operation checks should be done in a consistent manner

2013-04-10 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13628400#comment-13628400 ] Andrew Wang commented on HDFS-4679: --- bq. I noticed that createSymlink does not check isVa

[jira] [Commented] (HDFS-4672) Support tiered storage policies

2013-04-10 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13628468#comment-13628468 ] Sanjay Radia commented on HDFS-4672: The granularity of where the policies can be place

[jira] [Commented] (HDFS-4434) Provide a mapping from INodeId to INode

2013-04-10 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13628486#comment-13628486 ] Sanjay Radia commented on HDFS-4434: +1 with the following feedback * I would like to

[jira] [Commented] (HDFS-4672) Support tiered storage policies

2013-04-10 Thread Andrew Purtell (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13628490#comment-13628490 ] Andrew Purtell commented on HDFS-4672: -- bq. The granularity of where the policies can

[jira] [Updated] (HDFS-4679) Namenode operation checks should be done in a consistent manner

2013-04-10 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-4679: -- Resolution: Fixed Fix Version/s: 2.0.5-beta Hadoop Flags: Reviewed Status:

[jira] [Updated] (HDFS-3934) duplicative dfs_hosts entries handled wrong

2013-04-10 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3934: --- Attachment: HDFS-3934.005.patch here is a new version that is smarter about DNS resolu

[jira] [Commented] (HDFS-4339) Persist inode id in fsimage and editlog

2013-04-10 Thread Fengdong Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13628536#comment-13628536 ] Fengdong Yu commented on HDFS-4339: --- HDFS-4654 should be closed as this was fixed.

[jira] [Commented] (HDFS-3934) duplicative dfs_hosts entries handled wrong

2013-04-10 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13628553#comment-13628553 ] Todd Lipcon commented on HDFS-3934: --- Quick notes on the patch: - Why are you using the v

[jira] [Updated] (HDFS-4675) Fix rename across snapshottable directories

2013-04-10 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-4675: Attachment: HDFS-4675.002.patch Update the patch: 1. Include the fix from HDFS-4673 which fixes the scenario

[jira] [Updated] (HDFS-4678) libhdfs casts Japanese character incorrectly to Java API

2013-04-10 Thread Jiqiu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiqiu updated HDFS-4678: Priority: Minor (was: Critical) > libhdfs casts Japanese character incorrectly to Java API >

[jira] [Resolved] (HDFS-4654) FileNotFoundException: ID mismatch

2013-04-10 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li resolved HDFS-4654. -- Resolution: Not A Problem Assignee: Brandon Li Given HDFS-4339 has been committed. This JIRA is no

[jira] [Updated] (HDFS-3934) duplicative dfs_hosts entries handled wrong

2013-04-10 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3934: --- Attachment: HDFS-3934.006.patch * use immutablemap * reduce synchronization

[jira] [Commented] (HDFS-4339) Persist inode id in fsimage and editlog

2013-04-10 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13628621#comment-13628621 ] Brandon Li commented on HDFS-4339: -- @Fengdong, thanks, just resolved HDFS-4654.

[jira] [Commented] (HDFS-3934) duplicative dfs_hosts entries handled wrong

2013-04-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13628626#comment-13628626 ] Hadoop QA commented on HDFS-3934: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-4681) TestBlocksWithNotEnoughRacks#testCorruptBlockRereplicatedAcrossRacks fails using IBM java

2013-04-10 Thread Tian Hong Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tian Hong Wang updated HDFS-4681: - Assignee: Tian Hong Wang Status: Open (was: Patch Available) > TestBlocksWithNotEnoughR

[jira] [Updated] (HDFS-4681) TestBlocksWithNotEnoughRacks#testCorruptBlockRereplicatedAcrossRacks fails using IBM java

2013-04-10 Thread Tian Hong Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tian Hong Wang updated HDFS-4681: - Attachment: HDFS-4681-v1.patch > TestBlocksWithNotEnoughRacks#testCorruptBlockRereplicatedAcro

[jira] [Updated] (HDFS-4681) TestBlocksWithNotEnoughRacks#testCorruptBlockRereplicatedAcrossRacks fails using IBM java

2013-04-10 Thread Tian Hong Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tian Hong Wang updated HDFS-4681: - Status: Patch Available (was: Open) > TestBlocksWithNotEnoughRacks#testCorruptBlockRereplicat

[jira] [Commented] (HDFS-4681) TestBlocksWithNotEnoughRacks#testCorruptBlockRereplicatedAcrossRacks fails using IBM java

2013-04-10 Thread Tian Hong Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13628663#comment-13628663 ] Tian Hong Wang commented on HDFS-4681: -- Sure, Todd, add a utility to DFSTestUtil which