[jira] [Commented] (HDFS-7564) NFS gateway dynamically reload UID/GID mapping file /etc/nfs.map

2015-01-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14267543#comment-14267543 ] Hudson commented on HDFS-7564: -- FAILURE: Integrated in Hadoop-Yarn-trunk #800 (See

[jira] [Commented] (HDFS-7564) NFS gateway dynamically reload UID/GID mapping file /etc/nfs.map

2015-01-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14267661#comment-14267661 ] Hudson commented on HDFS-7564: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1998 (See

[jira] [Commented] (HDFS-7564) NFS gateway dynamically reload UID/GID mapping file /etc/nfs.map

2015-01-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14267537#comment-14267537 ] Hudson commented on HDFS-7564: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #66 (See

[jira] [Created] (HDFS-7592) A bug in BlocksMap that cause NameNode memory leak.

2015-01-07 Thread JichengSong (JIRA)
JichengSong created HDFS-7592: - Summary: A bug in BlocksMap that cause NameNode memory leak. Key: HDFS-7592 URL: https://issues.apache.org/jira/browse/HDFS-7592 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-4681) TestBlocksWithNotEnoughRacks#testCorruptBlockRereplicatedAcrossRacks fails using IBM java

2015-01-07 Thread Ayappan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayappan updated HDFS-4681: -- Affects Version/s: (was: 2.5.1) (was: 2.4.1) (was:

[jira] [Updated] (HDFS-4681) TestBlocksWithNotEnoughRacks#testCorruptBlockRereplicatedAcrossRacks fails using IBM java

2015-01-07 Thread Ayappan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayappan updated HDFS-4681: -- Target Version/s: (was: 2.1.0-beta, 2.6.0)

[jira] [Updated] (HDFS-2219) Fsck should work with fully qualified file paths.

2015-01-07 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-2219: -- Component/s: tools Assignee: Tsz Wo Nicholas Sze Fsck should work with fully

[jira] [Updated] (HDFS-7592) A bug in BlocksMap that cause NameNode memory leak.

2015-01-07 Thread JichengSong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JichengSong updated HDFS-7592: -- Attachment: blocksmap-2015-01-08.patch We fixed the bug as followsing patch. A bug in BlocksMap that

[jira] [Updated] (HDFS-7592) A bug in BlocksMap that cause NameNode memory leak.

2015-01-07 Thread JichengSong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JichengSong updated HDFS-7592: -- Description: In our HDFS production environment, NameNode FGC frequently after running for 2 months, we

[jira] [Updated] (HDFS-7589) Break the dependency between libnative_mini_dfs and libhdfs

2015-01-07 Thread Zhanwei Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhanwei Wang updated HDFS-7589: --- Target Version/s: 3.0.0, trunk-win Status: Patch Available (was: In Progress) Break

[jira] [Commented] (HDFS-3296) Running libhdfs tests in mac fails

2015-01-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268792#comment-14268792 ] Hadoop QA commented on HDFS-3296: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-7592) A bug in BlocksMap that cause NameNode memory leak.

2015-01-07 Thread JichengSong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JichengSong updated HDFS-7592: -- Labels: BlocksMap MemoryLeak (was: MemoryLeak) A bug in BlocksMap that cause NameNode memory leak.

[jira] [Updated] (HDFS-7592) A bug in BlocksMap that cause NameNode memory leak.

2015-01-07 Thread JichengSong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JichengSong updated HDFS-7592: -- Labels: MemoryLeak (was: ) A bug in BlocksMap that cause NameNode memory leak.

[jira] [Updated] (HDFS-4681) TestBlocksWithNotEnoughRacks#testCorruptBlockRereplicatedAcrossRacks fails using IBM java

2015-01-07 Thread Ayappan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayappan updated HDFS-4681: -- Assignee: Suresh Srinivas (was: Ayappan) TestBlocksWithNotEnoughRacks#testCorruptBlockRereplicatedAcrossRacks

[jira] [Updated] (HDFS-7589) Break the dependency between libnative_mini_dfs and libhdfs

2015-01-07 Thread Zhanwei Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhanwei Wang updated HDFS-7589: --- Target Version/s: 3.0.0 (was: 3.0.0, trunk-win) Break the dependency between libnative_mini_dfs and

[jira] [Commented] (HDFS-7589) Break the dependency between libnative_mini_dfs and libhdfs

2015-01-07 Thread Zhanwei Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268768#comment-14268768 ] Zhanwei Wang commented on HDFS-7589: hi [~crisnack] Would you please help me to verify

[jira] [Commented] (HDFS-4681) TestBlocksWithNotEnoughRacks#testCorruptBlockRereplicatedAcrossRacks fails using IBM java

2015-01-07 Thread Ayappan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268889#comment-14268889 ] Ayappan commented on HDFS-4681: --- Any update on this ?

[jira] [Commented] (HDFS-7589) Break the dependency between libnative_mini_dfs and libhdfs

2015-01-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268879#comment-14268879 ] Hadoop QA commented on HDFS-7589: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7589) Break the dependency between libnative_mini_dfs and libhdfs

2015-01-07 Thread Zhanwei Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268880#comment-14268880 ] Zhanwei Wang commented on HDFS-7589: Hi [~crisnack] and [~cnauroth] Sorry, I make

[jira] [Updated] (HDFS-4681) TestBlocksWithNotEnoughRacks#testCorruptBlockRereplicatedAcrossRacks fails using IBM java

2015-01-07 Thread Ayappan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayappan updated HDFS-4681: -- Fix Version/s: (was: 2.4.1) (was: 2.0.3-alpha)

[jira] [Updated] (HDFS-7592) A bug in BlocksMap that cause NameNode memory leak.

2015-01-07 Thread JichengSong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JichengSong updated HDFS-7592: -- Labels: BlocksMap leak memory (was: BlocksMap MemoryLeak) A bug in BlocksMap that cause NameNode

[jira] [Commented] (HDFS-7589) Break the dependency between libnative_mini_dfs and libhdfs

2015-01-07 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268439#comment-14268439 ] Chris Nauroth commented on HDFS-7589: - Hello [~wangzw]. This looks mostly good. Thank

[jira] [Created] (HDFS-7590) Stabilize and document getBlockLocation API in WebHDFS

2015-01-07 Thread Jakob Homan (JIRA)
Jakob Homan created HDFS-7590: - Summary: Stabilize and document getBlockLocation API in WebHDFS Key: HDFS-7590 URL: https://issues.apache.org/jira/browse/HDFS-7590 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-7561) TestFetchImage should write fetched-image-dir under target.

2015-01-07 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-7561: -- Resolution: Fixed Fix Version/s: 2.7.0 Status: Resolved (was: Patch

[jira] [Commented] (HDFS-7561) TestFetchImage should write fetched-image-dir under target.

2015-01-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268557#comment-14268557 ] Hudson commented on HDFS-7561: -- FAILURE: Integrated in Hadoop-trunk-Commit #6824 (See

[jira] [Resolved] (HDFS-1213) Implement an Apache Commons VFS Driver for HDFS

2015-01-07 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth resolved HDFS-1213. - Resolution: Not a Problem There is now an HDFS provider implemented in the Apache Commons VFS

[jira] [Commented] (HDFS-7467) Provide storage tier information for a directory via fsck

2015-01-07 Thread Benoy Antony (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268598#comment-14268598 ] Benoy Antony commented on HDFS-7467: {quote} If a file does not satisfies the specified

[jira] [Updated] (HDFS-3296) Running libhdfs tests in mac fails

2015-01-07 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-3296: Component/s: libhdfs Target Version/s: 2.7.0 Assignee: Chris Nauroth Running

[jira] [Updated] (HDFS-3296) Running libhdfs tests in mac fails

2015-01-07 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-3296: Attachment: HDFS-3296.001.patch This is almost working in current trunk, as long as we set

[jira] [Updated] (HDFS-3296) Running libhdfs tests in mac fails

2015-01-07 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-3296: Status: Patch Available (was: Open) Running libhdfs tests in mac fails

[jira] [Created] (HDFS-7591) hdfs classpath command should support same options as hadoop classpath.

2015-01-07 Thread Chris Nauroth (JIRA)
Chris Nauroth created HDFS-7591: --- Summary: hdfs classpath command should support same options as hadoop classpath. Key: HDFS-7591 URL: https://issues.apache.org/jira/browse/HDFS-7591 Project: Hadoop

[jira] [Updated] (HDFS-7591) hdfs classpath command should support same options as hadoop classpath.

2015-01-07 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-7591: Description: HADOOP-10903 enhanced the {{hadoop classpath}} command to support optional

[jira] [Updated] (HDFS-7591) hdfs classpath command should support same options as hadoop classpath.

2015-01-07 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-7591: Priority: Minor (was: Major) hdfs classpath command should support same options as hadoop

[jira] [Commented] (HDFS-7591) hdfs classpath command should support same options as hadoop classpath.

2015-01-07 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268629#comment-14268629 ] Chris Nauroth commented on HDFS-7591: - Thanks to [~aw] for reporting it to me. This

[jira] [Commented] (HDFS-7553) fix the TestDFSUpgradeWithHA due to BindException

2015-01-07 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268218#comment-14268218 ] Chris Nauroth commented on HDFS-7553: - Hi [~xieliang007]. If I understand correctly,

[jira] [Commented] (HDFS-5631) Expose interfaces required by FsDatasetSpi implementations

2015-01-07 Thread Joe Pallas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268147#comment-14268147 ] Joe Pallas commented on HDFS-5631: -- Yes, the ExternalDatasetImpl would need to be updated

[jira] [Commented] (HDFS-7564) NFS gateway dynamically reload UID/GID mapping file /etc/nfs.map

2015-01-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14267709#comment-14267709 ] Hudson commented on HDFS-7564: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #67 (See

[jira] [Updated] (HDFS-7411) Refactor and improve decommissioning logic into DecommissionManager

2015-01-07 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-7411: -- Attachment: hdfs-7411.006.patch Refactor and improve decommissioning logic into DecommissionManager

[jira] [Commented] (HDFS-7411) Refactor and improve decommissioning logic into DecommissionManager

2015-01-07 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268306#comment-14268306 ] Andrew Wang commented on HDFS-7411: --- Thanks for the reviews Colin and Ming, new patch up.

[jira] [Commented] (HDFS-7579) Improve log reporting during block report rpc failure

2015-01-07 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268329#comment-14268329 ] Chris Nauroth commented on HDFS-7579: - Hi [~clamb]. This is a good idea. Thanks for

[jira] [Commented] (HDFS-7548) Corrupt block reporting delayed until datablock scanner thread detects it

2015-01-07 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268347#comment-14268347 ] Nathan Roberts commented on HDFS-7548: -- I think we need to handle the

[jira] [Commented] (HDFS-7579) Improve log reporting during block report rpc failure

2015-01-07 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268364#comment-14268364 ] Arpit Agarwal commented on HDFS-7579: - Thank you for the heads up Chris. I agree that

[jira] [Commented] (HDFS-7467) Provide storage tier information for a directory via fsck

2015-01-07 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268661#comment-14268661 ] Tsz Wo Nicholas Sze commented on HDFS-7467: --- I think the fsck output can have two

[jira] [Commented] (HDFS-1213) Implement an Apache Commons VFS Driver for HDFS

2015-01-07 Thread Dave Marion (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268685#comment-14268685 ] Dave Marion commented on HDFS-1213: --- FWIW, the current HDFS provider in Commons VFS is

[jira] [Commented] (HDFS-7056) Snapshot support for truncate

2015-01-07 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268692#comment-14268692 ] Konstantin Shvachko commented on HDFS-7056: --- The latest build was actually

[jira] [Updated] (HDFS-7589) Break the dependency between libnative_mini_dfs and libhdfs

2015-01-07 Thread Zhanwei Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhanwei Wang updated HDFS-7589: --- Attachment: HDFS-7589.002.patch Break the dependency between libnative_mini_dfs and libhdfs

[jira] [Commented] (HDFS-7589) Break the dependency between libnative_mini_dfs and libhdfs

2015-01-07 Thread Zhanwei Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268751#comment-14268751 ] Zhanwei Wang commented on HDFS-7589: Hi [~crisnack] In new patch, I moved the

[jira] [Commented] (HDFS-7564) NFS gateway dynamically reload UID/GID mapping file /etc/nfs.map

2015-01-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14267745#comment-14267745 ] Hudson commented on HDFS-7564: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2017 (See

[jira] [Commented] (HDFS-7453) Namenode does not recognize block is missing on a datanode

2015-01-07 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14267992#comment-14267992 ] Chris Nauroth commented on HDFS-7453: - Hi [~dmitrybugaychenko]. Thank you for the

[jira] [Commented] (HDFS-7453) Namenode does not recognize block is missing on a datanode

2015-01-07 Thread Jasper Hafkenscheid (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14267999#comment-14267999 ] Jasper Hafkenscheid commented on HDFS-7453: --- Hi, We have a cluster with bad

[jira] [Commented] (HDFS-7564) NFS gateway dynamically reload UID/GID mapping file /etc/nfs.map

2015-01-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14267681#comment-14267681 ] Hudson commented on HDFS-7564: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk-Java8 #63 (See

[jira] [Commented] (HDFS-1195) Offer rate limits for replicating data

2015-01-07 Thread Cosmin Lehene (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14267740#comment-14267740 ] Cosmin Lehene commented on HDFS-1195: - [~kevinweil] is this still valid? Offer rate

[jira] [Commented] (HDFS-1312) Re-balance disks within a Datanode

2015-01-07 Thread Dave Marion (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14267925#comment-14267925 ] Dave Marion commented on HDFS-1312: --- Note that as of 2.6.0 the layout has changed on the