[jira] [Commented] (HDFS-7411) Refactor and improve decommissioning logic into DecommissionManager

2015-03-06 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14351449#comment-14351449 ] Chris Douglas commented on HDFS-7411: - Looked through the patch; it addresses the feedb

[jira] [Updated] (HDFS-7838) Expose truncate API for libhdfs

2015-03-06 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7838: - Attachment: HDFS-7838.002.patch Thanks Colin for review, update the patch to address your comments. {quote} Also,

[jira] [Created] (HDFS-7902) Expose truncate API for libwebhdfs

2015-03-06 Thread Yi Liu (JIRA)
Yi Liu created HDFS-7902: Summary: Expose truncate API for libwebhdfs Key: HDFS-7902 URL: https://issues.apache.org/jira/browse/HDFS-7902 Project: Hadoop HDFS Issue Type: Improvement Compon

[jira] [Updated] (HDFS-7312) Update DistCp v1 to optionally not use tmp location (branch-1 only)

2015-03-06 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-7312: Labels: (was: reviewed) > Update DistCp v1 to optionally not use tmp location (branch-1 only) > ---

[jira] [Updated] (HDFS-7312) Update DistCp v1 to optionally not use tmp location (branch-1 only)

2015-03-06 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-7312: Hadoop Flags: Reviewed > Update DistCp v1 to optionally not use tmp location (branch-1 only) > --

[jira] [Updated] (HDFS-7312) Update DistCp v1 to optionally not use tmp location (branch-1 only)

2015-03-06 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-7312: Labels: reviewed (was: ) > Update DistCp v1 to optionally not use tmp location (branch-1 only) > ---

[jira] [Commented] (HDFS-7844) Create an off-heap hash table implementation

2015-03-06 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14351384#comment-14351384 ] stack commented on HDFS-7844: - Late to the game. Patch is great. Creative. All comments can b

[jira] [Commented] (HDFS-6450) Support non-positional hedged reads in HDFS

2015-03-06 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14351346#comment-14351346 ] Zhe Zhang commented on HDFS-6450: - Thanks for the suggestion Colin. Hedged pread is already

[jira] [Commented] (HDFS-5796) The file system browser in the namenode UI requires SPNEGO.

2015-03-06 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14351319#comment-14351319 ] Allen Wittenauer commented on HDFS-5796: (And, just to make clear the impact, this

[jira] [Updated] (HDFS-7877) Support maintenance state for datanodes

2015-03-06 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-7877: -- Attachment: HDFS-7877.patch Supportmaintenancestatefordatanodes.pdf Here are the initial design d

[jira] [Commented] (HDFS-7886) TestFileTruncate#testTruncateWithDataNodesRestart runs timeout sometimes

2015-03-06 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14351313#comment-14351313 ] Konstantin Shvachko commented on HDFS-7886: --- More things that we've been looking

[jira] [Comment Edited] (HDFS-5796) The file system browser in the namenode UI requires SPNEGO.

2015-03-06 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14351307#comment-14351307 ] Allen Wittenauer edited comment on HDFS-5796 at 3/7/15 1:53 AM: -

[jira] [Commented] (HDFS-5796) The file system browser in the namenode UI requires SPNEGO.

2015-03-06 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14351307#comment-14351307 ] Allen Wittenauer commented on HDFS-5796: bq. when security is enabled, WebHDFS by d

[jira] [Commented] (HDFS-7854) Separate class DataStreamer out of DFSOutputStream

2015-03-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14351298#comment-14351298 ] Hadoop QA commented on HDFS-7854: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7844) Create an off-heap hash table implementation

2015-03-06 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14351290#comment-14351290 ] Colin Patrick McCabe commented on HDFS-7844: thanks, Charles. I think we can c

[jira] [Commented] (HDFS-7844) Create an off-heap hash table implementation

2015-03-06 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14351282#comment-14351282 ] Charles Lamb commented on HDFS-7844: Thanks Colin, +1, I'll file a follow up jira for t

[jira] [Commented] (HDFS-7758) Retire FsDatasetSpi#getVolumes() and use FsDatasetSpi#getVolumeRefs() instead

2015-03-06 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14351259#comment-14351259 ] Lei (Eddy) Xu commented on HDFS-7758: - [~jpallas] What I am going to do is something li

[jira] [Commented] (HDFS-7758) Retire FsDatasetSpi#getVolumes() and use FsDatasetSpi#getVolumeRefs() instead

2015-03-06 Thread Joe Pallas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14351249#comment-14351249 ] Joe Pallas commented on HDFS-7758: -- [~cmccabe], is findbugs actually smart enough to figur

[jira] [Commented] (HDFS-7782) Read a striping layout file from client side

2015-03-06 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14351243#comment-14351243 ] Zhe Zhang commented on HDFS-7782: - I realized that the current {{DFSInputStream}} non-posit

[jira] [Commented] (HDFS-7816) Unable to open webhdfs paths with "+"

2015-03-06 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14351229#comment-14351229 ] Haohui Mai commented on HDFS-7816: -- {code} + throws IOException { +URI uri; +

[jira] [Updated] (HDFS-7853) Erasure coding: extend LocatedBlocks to support reading from striped files

2015-03-06 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-7853: Attachment: HDFS-7853.002.patch Update the patch: # simplify BlockInfoStripedUC by removing the index array #

[jira] [Commented] (HDFS-7722) DataNode#checkDiskError should also remove Storage when error is found.

2015-03-06 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14351218#comment-14351218 ] Lei (Eddy) Xu commented on HDFS-7722: - [~cmccabe] Thanks for the review. I will make a

[jira] [Commented] (HDFS-7816) Unable to open webhdfs paths with "+"

2015-03-06 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14351208#comment-14351208 ] Haohui Mai commented on HDFS-7816: -- Discussed with [~vinodkv] offline. we can go back to t

[jira] [Commented] (HDFS-7816) Unable to open webhdfs paths with "+"

2015-03-06 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14351192#comment-14351192 ] Vinod Kumar Vavilapalli commented on HDFS-7816: --- I may be being completely na

[jira] [Commented] (HDFS-7722) DataNode#checkDiskError should also remove Storage when error is found.

2015-03-06 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14351167#comment-14351167 ] Chris Nauroth commented on HDFS-7722: - [~eddyxu], sorry I haven't had a chance to dig i

[jira] [Commented] (HDFS-7844) Create an off-heap hash table implementation

2015-03-06 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14351163#comment-14351163 ] Charles Lamb commented on HDFS-7844: I applied your latest patch and set breakpoints at

[jira] [Commented] (HDFS-5796) The file system browser in the namenode UI requires SPNEGO.

2015-03-06 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14351156#comment-14351156 ] Vinod Kumar Vavilapalli commented on HDFS-5796: --- Hey everyone, I've been try

[jira] [Commented] (HDFS-7722) DataNode#checkDiskError should also remove Storage when error is found.

2015-03-06 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14351152#comment-14351152 ] Colin Patrick McCabe commented on HDFS-7722: Eddy and I had an offline discussi

[jira] [Commented] (HDFS-6488) Support HDFS superuser in NFSv3 gateway

2015-03-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14351138#comment-14351138 ] Hudson commented on HDFS-6488: -- SUCCESS: Integrated in Hadoop-trunk-Commit #7277 (See [https:

[jira] [Commented] (HDFS-7844) Create an off-heap hash table implementation

2015-03-06 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14351122#comment-14351122 ] Colin Patrick McCabe commented on HDFS-7844: bq. Several lines bust the 80 char

[jira] [Updated] (HDFS-7844) Create an off-heap hash table implementation

2015-03-06 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7844: --- Attachment: HDFS-7844-scl.003.patch > Create an off-heap hash table implementation > --

[jira] [Comment Edited] (HDFS-6488) Support HDFS superuser in NFSv3 gateway

2015-03-06 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14351115#comment-14351115 ] Brandon Li edited comment on HDFS-6488 at 3/6/15 11:28 PM: --- Thank

[jira] [Commented] (HDFS-7818) OffsetParam should return the default value instead of throwing NPE when the value is unspecified

2015-03-06 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14351118#comment-14351118 ] Eric Payne commented on HDFS-7818: -- Thank you [~wheat9] > OffsetParam should return the d

[jira] [Updated] (HDFS-6488) Support HDFS superuser in NFSv3 gateway

2015-03-06 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-6488: - Fix Version/s: 2.7.0 > Support HDFS superuser in NFSv3 gateway > --- >

[jira] [Updated] (HDFS-6488) Support HDFS superuser in NFSv3 gateway

2015-03-06 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-6488: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) > Support

[jira] [Commented] (HDFS-6488) Support HDFS superuser in NFSv3 gateway

2015-03-06 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14351115#comment-14351115 ] Brandon Li commented on HDFS-6488: -- Thank you, Stephen, Colin and Jing. I've updated the t

[jira] [Updated] (HDFS-6488) HDFS superuser unable to access user's Trash files using NFSv3 mount

2015-03-06 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-6488: - Issue Type: New Feature (was: Bug) > HDFS superuser unable to access user's Trash files using NFSv3 mount

[jira] [Updated] (HDFS-6488) Support HDFS superuser in NFSv3 gateway

2015-03-06 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-6488: - Summary: Support HDFS superuser in NFSv3 gateway (was: HDFS superuser unable to access user's Trash files

[jira] [Commented] (HDFS-6488) HDFS superuser unable to access user's Trash files using NFSv3 mount

2015-03-06 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14351099#comment-14351099 ] Jing Zhao commented on HDFS-6488: - I think it should be ok to use a configuration prop to s

[jira] [Commented] (HDFS-7893) Update the POM to create a separate hdfs-client jar

2015-03-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14351094#comment-14351094 ] Hadoop QA commented on HDFS-7893: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-7893) Update the POM to create a separate hdfs-client jar

2015-03-06 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-7893: - Attachment: HDFS-7893.001.patch > Update the POM to create a separate hdfs-client jar > ---

[jira] [Commented] (HDFS-7844) Create an off-heap hash table implementation

2015-03-06 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14351073#comment-14351073 ] Charles Lamb commented on HDFS-7844: [~cmccabe], This is a nice piece of work! Here a

[jira] [Commented] (HDFS-7857) Incomplete information in WARN message caused user confusion

2015-03-06 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14351061#comment-14351061 ] Jing Zhao commented on HDFS-7857: - +1. Thanks for the improvement, [~yzhangal]! > Incomple

[jira] [Commented] (HDFS-7758) Retire FsDatasetSpi#getVolumes() and use FsDatasetSpi#getVolumeRefs() instead

2015-03-06 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14351058#comment-14351058 ] Colin Patrick McCabe commented on HDFS-7758: {code} /** * Returns a list o

[jira] [Commented] (HDFS-7857) Incomplete information in WARN message caused user confusion

2015-03-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14351047#comment-14351047 ] Hadoop QA commented on HDFS-7857: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7818) OffsetParam should return the default value instead of throwing NPE when the value is unspecified

2015-03-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14351045#comment-14351045 ] Hudson commented on HDFS-7818: -- FAILURE: Integrated in Hadoop-trunk-Commit #7275 (See [https:

[jira] [Updated] (HDFS-7818) OffsetParam should return the default value instead of throwing NPE when the value is unspecified

2015-03-06 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-7818: - Resolution: Fixed Fix Version/s: 2.7.0 Hadoop Flags: Reviewed Status: Resolved (was:

[jira] [Updated] (HDFS-7818) OffsetParam should return the default value instead of throwing NPE when the value is unspecified

2015-03-06 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-7818: - Summary: OffsetParam should return the default value instead of throwing NPE when the value is unspecified

[jira] [Commented] (HDFS-7818) DataNode throws NPE if the WebHdfs URL does not contain the offset parameter

2015-03-06 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14351024#comment-14351024 ] Haohui Mai commented on HDFS-7818: -- +1. I'm committing this. > DataNode throws NPE if the

[jira] [Commented] (HDFS-7853) Erasure coding: extend LocatedBlocks to support reading from striped files

2015-03-06 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14351020#comment-14351020 ] Zhe Zhang commented on HDFS-7853: - Thanks for the fix Jing! The PoC test now works stably.

[jira] [Updated] (HDFS-7285) Erasure Coding Support inside HDFS

2015-03-06 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-7285: Attachment: HDFS-7285-initial-PoC.patch This is the patch from trunk that was used in the PoC test. It demons

[jira] [Commented] (HDFS-7818) DataNode throws NPE if the WebHdfs URL does not contain the offset parameter

2015-03-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14351008#comment-14351008 ] Hadoop QA commented on HDFS-7818: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-6200) Create a separate jar for hdfs-client

2015-03-06 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14350995#comment-14350995 ] Haohui Mai commented on HDFS-6200: -- Here is the list of dependency when I run {{mvn depend

[jira] [Updated] (HDFS-7844) Create an off-heap hash table implementation

2015-03-06 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7844: --- Attachment: HDFS-7844-scl.002.patch > Create an off-heap hash table implementation > --

[jira] [Commented] (HDFS-6695) Investigate using Java 7's nonblocking file I/O in BlockReaderLocal to implement read timeouts

2015-03-06 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14350939#comment-14350939 ] Colin Patrick McCabe commented on HDFS-6695: And sending an {{Interrupt}} to a

[jira] [Commented] (HDFS-6658) Namenode memory optimization - Block replicas list

2015-03-06 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14350936#comment-14350936 ] Colin Patrick McCabe commented on HDFS-6658: [~clamb] and I have been discussin

[jira] [Commented] (HDFS-7857) Incomplete information in WARN message caused user confusion

2015-03-06 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14350928#comment-14350928 ] Yongjun Zhang commented on HDFS-7857: - Hi [~jingzhao], I submitted patch 001, would yo

[jira] [Updated] (HDFS-7857) Incomplete information in WARN message caused user confusion

2015-03-06 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-7857: Status: Patch Available (was: Open) > Incomplete information in WARN message caused user confusion >

[jira] [Updated] (HDFS-7857) Incomplete information in WARN message caused user confusion

2015-03-06 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-7857: Attachment: HDFS-7857.001.patch > Incomplete information in WARN message caused user confusion >

[jira] [Commented] (HDFS-7836) BlockManager Scalability Improvements

2015-03-06 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14350878#comment-14350878 ] Colin Patrick McCabe commented on HDFS-7836: I don't think the block map size i

[jira] [Commented] (HDFS-6450) Support non-positional hedged reads in HDFS

2015-03-06 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14350869#comment-14350869 ] Colin Patrick McCabe commented on HDFS-6450: I think it would be possible to su

[jira] [Commented] (HDFS-7844) Create an off-heap hash table implementation

2015-03-06 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14350828#comment-14350828 ] Colin Patrick McCabe commented on HDFS-7844: bq. Open addressing (probing) is u

[jira] [Commented] (HDFS-7875) Improve log message when wrong value configured for dfs.datanode.failed.volumes.tolerated

2015-03-06 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14350793#comment-14350793 ] Allen Wittenauer commented on HDFS-7875: Let's put a space in between the . and Val

[jira] [Commented] (HDFS-6200) Create a separate jar for hdfs-client

2015-03-06 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14350786#comment-14350786 ] Alejandro Abdelnur commented on HDFS-6200: -- Haohui, Could you please list the act

[jira] [Comment Edited] (HDFS-6200) Create a separate jar for hdfs-client

2015-03-06 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14350783#comment-14350783 ] Haohui Mai edited comment on HDFS-6200 at 3/6/15 7:41 PM: -- Thanks

[jira] [Commented] (HDFS-6200) Create a separate jar for hdfs-client

2015-03-06 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14350783#comment-14350783 ] Haohui Mai commented on HDFS-6200: -- Thanks touch. Just to clarify -- I'm not trashing the

[jira] [Commented] (HDFS-6200) Create a separate jar for hdfs-client

2015-03-06 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14350774#comment-14350774 ] Alejandro Abdelnur commented on HDFS-6200: -- Haohui, Doing what hadoop-client won

[jira] [Commented] (HDFS-7893) Update the POM to create a separate hdfs-client jar

2015-03-06 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14350759#comment-14350759 ] Jing Zhao commented on HDFS-7893: - The patch looks good to me. Some comments: # maybe we sh

[jira] [Commented] (HDFS-7435) PB encoding of block reports is very inefficient

2015-03-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14350769#comment-14350769 ] Hadoop QA commented on HDFS-7435: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-6200) Create a separate jar for hdfs-client

2015-03-06 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14350765#comment-14350765 ] Haohui Mai commented on HDFS-6200: -- bq. Placing hadoop-hdfs-client as a dependency of hado

[jira] [Comment Edited] (HDFS-6200) Create a separate jar for hdfs-client

2015-03-06 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14350765#comment-14350765 ] Haohui Mai edited comment on HDFS-6200 at 3/6/15 7:27 PM: -- bq. Pla

[jira] [Commented] (HDFS-7854) Separate class DataStreamer out of DFSOutputStream

2015-03-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14350764#comment-14350764 ] Hadoop QA commented on HDFS-7854: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7261) storageMap is accessed without synchronization in DatanodeDescriptor#updateHeartbeatState()

2015-03-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14350760#comment-14350760 ] Hadoop QA commented on HDFS-7261: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7885) Datanode should not trust the generation stamp provided by client

2015-03-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14350732#comment-14350732 ] Hudson commented on HDFS-7885: -- SUCCESS: Integrated in Hadoop-trunk-Commit #7271 (See [https:

[jira] [Commented] (HDFS-7894) Rolling upgrade readiness is not updated in jmx until query command is issued.

2015-03-06 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14350728#comment-14350728 ] Kihwal Lee commented on HDFS-7894: -- It won't work because of {{checkSuperuserPrivilege()}}

[jira] [Commented] (HDFS-7886) TestFileTruncate#testTruncateWithDataNodesRestart runs timeout sometimes

2015-03-06 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14350718#comment-14350718 ] Konstantin Shvachko commented on HDFS-7886: --- Forgot to mention 3. We should keep

[jira] [Updated] (HDFS-7885) Datanode should not trust the generation stamp provided by client

2015-03-06 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-7885: Resolution: Fixed Fix Version/s: 2.7.0 Hadoop Flags: Reviewed Status: Resolved (was: P

[jira] [Commented] (HDFS-7885) Datanode should not trust the generation stamp provided by client

2015-03-06 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14350712#comment-14350712 ] Jing Zhao commented on HDFS-7885: - The latest patch looks good to me. The failed tests shou

[jira] [Commented] (HDFS-6200) Create a separate jar for hdfs-client

2015-03-06 Thread Sean Busbey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14350711#comment-14350711 ] Sean Busbey commented on HDFS-6200: --- As I mentioned earlier, the dependencies your client

[jira] [Comment Edited] (HDFS-6200) Create a separate jar for hdfs-client

2015-03-06 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14350684#comment-14350684 ] Haohui Mai edited comment on HDFS-6200 at 3/6/15 6:45 PM: -- bq. For

[jira] [Commented] (HDFS-7896) HDFS Slow disk detection

2015-03-06 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14350697#comment-14350697 ] Chris Nauroth commented on HDFS-7896: - bq. Chris Nauroth recently added failed volume r

[jira] [Commented] (HDFS-7886) TestFileTruncate#testTruncateWithDataNodesRestart runs timeout sometimes

2015-03-06 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14350686#comment-14350686 ] Konstantin Shvachko commented on HDFS-7886: --- I traced the latest failure with Pla

[jira] [Commented] (HDFS-6200) Create a separate jar for hdfs-client

2015-03-06 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14350684#comment-14350684 ] Haohui Mai commented on HDFS-6200: -- bq. For one, we don't have to worry about what depende

[jira] [Commented] (HDFS-7885) Datanode should not trust the generation stamp provided by client

2015-03-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14350651#comment-14350651 ] Hadoop QA commented on HDFS-7885: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Resolved] (HDFS-7901) Fix findbug warning in org.apache.hadoop.hdfs.web.resources.OffsetParam.getOffset()

2015-03-06 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula resolved HDFS-7901. Resolution: Duplicate > Fix findbug warning in > org.apache.hadoop.hdfs.web.resource

[jira] [Created] (HDFS-7901) Fix findbug warning in org.apache.hadoop.hdfs.web.resources.OffsetParam.getOffset()

2015-03-06 Thread Brahma Reddy Battula (JIRA)
Brahma Reddy Battula created HDFS-7901: -- Summary: Fix findbug warning in org.apache.hadoop.hdfs.web.resources.OffsetParam.getOffset() Key: HDFS-7901 URL: https://issues.apache.org/jira/browse/HDFS-7901

[jira] [Commented] (HDFS-7818) DataNode throws NPE if the WebHdfs URL does not contain the offset parameter

2015-03-06 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14350491#comment-14350491 ] Brahma Reddy Battula commented on HDFS-7818: can I close HDFS-7901..? Please le

[jira] [Commented] (HDFS-7855) Separate class Packet from DFSOutputStream

2015-03-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14350465#comment-14350465 ] Hudson commented on HDFS-7855: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2074 (See [htt

[jira] [Commented] (HDFS-7818) DataNode throws NPE if the WebHdfs URL does not contain the offset parameter

2015-03-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14350453#comment-14350453 ] Hadoop QA commented on HDFS-7818: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7433) Optimize performance of DatanodeManager's node map

2015-03-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14350444#comment-14350444 ] Hadoop QA commented on HDFS-7433: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7433) Optimize performance of DatanodeManager's node map

2015-03-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14350430#comment-14350430 ] Hadoop QA commented on HDFS-7433: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7855) Separate class Packet from DFSOutputStream

2015-03-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14350427#comment-14350427 ] Hudson commented on HDFS-7855: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #124 (See

[jira] [Updated] (HDFS-7818) DataNode throws NPE if the WebHdfs URL does not contain the offset parameter

2015-03-06 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated HDFS-7818: - Attachment: HDFS-7818.v5.txt Fixing findbugs warning and updating patch to v5. > DataNode throws NPE if th

[jira] [Commented] (HDFS-7855) Separate class Packet from DFSOutputStream

2015-03-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14350412#comment-14350412 ] Hudson commented on HDFS-7855: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2056 (See [https://

[jira] [Commented] (HDFS-7433) Optimize performance of DatanodeManager's node map

2015-03-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14350415#comment-14350415 ] Hadoop QA commented on HDFS-7433: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7855) Separate class Packet from DFSOutputStream

2015-03-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14350408#comment-14350408 ] Hudson commented on HDFS-7855: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #115 (See [htt

[jira] [Commented] (HDFS-6806) HDFS Rolling upgrade document should mention the versions available

2015-03-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14350403#comment-14350403 ] Hadoop QA commented on HDFS-6806: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-7818) DataNode throws NPE if the WebHdfs URL does not contain the offset parameter

2015-03-06 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated HDFS-7818: - Priority: Blocker (was: Critical) Target Version/s: 2.7.0 Marking as a blocker since this is a

[jira] [Commented] (HDFS-6200) Create a separate jar for hdfs-client

2015-03-06 Thread Sean Busbey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14350369#comment-14350369 ] Sean Busbey commented on HDFS-6200: --- The dependencies you bring with you are an integral

[jira] [Commented] (HDFS-7855) Separate class Packet from DFSOutputStream

2015-03-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14350305#comment-14350305 ] Hudson commented on HDFS-7855: -- FAILURE: Integrated in Hadoop-Yarn-trunk #858 (See [https://b

  1   2   >