[jira] [Updated] (HDFS-10204) Use HadoopIllegalArgumentException replace IllegalArgumentException in hadoop-hdfs

2016-03-23 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Yiqun updated HDFS-10204: - Attachment: HDFS-10204.001.patch Attach a initial patch. Almost {{IllegalArgumentException}} has been repl

[jira] [Updated] (HDFS-10204) Use HadoopIllegalArgumentException replace IllegalArgumentException in hadoop-hdfs

2016-03-23 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Yiqun updated HDFS-10204: - Status: Patch Available (was: Open) > Use HadoopIllegalArgumentException replace IllegalArgumentException

[jira] [Updated] (HDFS-10204) Use HadoopIllegalArgumentException replace IllegalArgumentException in hadoop-hdfs

2016-03-23 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Yiqun updated HDFS-10204: - Issue Type: Sub-task (was: Bug) Parent: HDFS-1151 > Use HadoopIllegalArgumentException replace Il

[jira] [Created] (HDFS-10204) Use HadoopIllegalArgumentException replace IllegalArgumentException in hadoop-hdfs

2016-03-23 Thread Lin Yiqun (JIRA)
Lin Yiqun created HDFS-10204: Summary: Use HadoopIllegalArgumentException replace IllegalArgumentException in hadoop-hdfs Key: HDFS-10204 URL: https://issues.apache.org/jira/browse/HDFS-10204 Project: Had

[jira] [Commented] (HDFS-10203) Excessive topology lookup for large number of client machines in namenode

2016-03-23 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15209837#comment-15209837 ] Ming Ma commented on HDFS-10203: Couple ideas we talked about: * Use {{TableMapping}} or

[jira] [Updated] (HDFS-10196) Ozone : Enable better error reporting for failed commands in ozone shell

2016-03-23 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-10196: - Hadoop Flags: Reviewed +1 for patch v002 pending another pre-commit run. > Ozone : Enable better

[jira] [Created] (HDFS-10203) Excessive topology lookup for large number of client machines in namenode

2016-03-23 Thread Ming Ma (JIRA)
Ming Ma created HDFS-10203: -- Summary: Excessive topology lookup for large number of client machines in namenode Key: HDFS-10203 URL: https://issues.apache.org/jira/browse/HDFS-10203 Project: Hadoop HDFS

[jira] [Commented] (HDFS-10195) Ozone: Add container persistence

2016-03-23 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15209803#comment-15209803 ] Chris Nauroth commented on HDFS-10195: -- [~anu], thank you for the detailed comment.

[jira] [Commented] (HDFS-10195) Ozone: Add container persistence

2016-03-23 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15209751#comment-15209751 ] Anu Engineer commented on HDFS-10195: - [~cnauroth] and [~jingzhao] Thanks for the revi

[jira] [Commented] (HDFS-8915) TestFSNamesystem.testFSLockGetWaiterCount fails intermittently in jenkins

2016-03-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15209747#comment-15209747 ] Hadoop QA commented on HDFS-8915: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HDFS-9616) libhdfs++ Add runtime hooks to allow a client application to add low level monitoring and tests.

2016-03-23 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9616: -- Resolution: Fixed Status: Resolved (was: Patch Available) > libhdfs++ Add runtime hooks

[jira] [Commented] (HDFS-9616) libhdfs++ Add runtime hooks to allow a client application to add low level monitoring and tests.

2016-03-23 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15209718#comment-15209718 ] James Clampffer commented on HDFS-9616: --- I committed this to HDFS-8707. Thanks [~bob

[jira] [Updated] (HDFS-6489) DFS Used space is not correct computed on frequent append operations

2016-03-23 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-6489: -- Status: Open (was: Patch Available) > DFS Used space is not correct computed on frequent append operatio

[jira] [Updated] (HDFS-10196) Ozone : Enable better error reporting for failed commands in ozone shell

2016-03-23 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-10196: Attachment: HDFS-10196-HDFS-7240.002.patch [~cnauroth] Thanks for the review comments. It is a good

[jira] [Updated] (HDFS-10197) TestFsDatasetCache failing intermittently due to timeout

2016-03-23 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Yiqun updated HDFS-10197: - Attachment: HDFS-10197.002.patch > TestFsDatasetCache failing intermittently due to timeout >

[jira] [Commented] (HDFS-10197) TestFsDatasetCache failing intermittently due to timeout

2016-03-23 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15209669#comment-15209669 ] Lin Yiqun commented on HDFS-10197: -- Thanks [~andrew.wang] for comments. {quote} However,

[jira] [Commented] (HDFS-964) hdfs-default.xml shouldn't use hadoop.tmp.dir for dfs.data.dir (0.20 and lower) / dfs.datanode.dir (0.21 and up)

2016-03-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15209664#comment-15209664 ] Allen Wittenauer commented on HDFS-964: --- I closed it because a) I opened it, so my j

[jira] [Commented] (HDFS-964) hdfs-default.xml shouldn't use hadoop.tmp.dir for dfs.data.dir (0.20 and lower) / dfs.datanode.dir (0.21 and up)

2016-03-23 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15209651#comment-15209651 ] Yongjun Zhang commented on HDFS-964: HI [~aw], would you please share your thoughts abou

[jira] [Updated] (HDFS-9939) Increase DecompressorStream skip buffer size

2016-03-23 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-9939: - Fix Version/s: 2.8.0 Status: Patch Available (was: Open) > Increase DecompressorStream skip buf

[jira] [Updated] (HDFS-9939) Increase DecompressorStream skip buffer size

2016-03-23 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-9939: - Attachment: HDFS-9939.001.patch Patch 001: * Set skip buffer size to 2048 (MAX_SKIP_BUFFER_SIZE) * Move Fak

[jira] [Updated] (HDFS-10202) ozone : Add key commands to CLI

2016-03-23 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-10202: Attachment: HDFS-10202-HDFS-7240.001.patch > ozone : Add key commands to CLI > -

[jira] [Updated] (HDFS-10202) ozone : Add key commands to CLI

2016-03-23 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-10202: Status: Patch Available (was: Open) > ozone : Add key commands to CLI > ---

[jira] [Created] (HDFS-10202) ozone : Add key commands to CLI

2016-03-23 Thread Anu Engineer (JIRA)
Anu Engineer created HDFS-10202: --- Summary: ozone : Add key commands to CLI Key: HDFS-10202 URL: https://issues.apache.org/jira/browse/HDFS-10202 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Updated] (HDFS-9573) SnapshotDiffReport$DiffReportEntry$hashCode should use type field

2016-03-23 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-9573: - Resolution: Won't Fix Status: Resolved (was: Patch Available) It is recommended for hashCode and e

[jira] [Commented] (HDFS-7661) [umbrella] support hflush and hsync for erasure coded files

2016-03-23 Thread GAO Rui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15209581#comment-15209581 ] GAO Rui commented on HDFS-7661: --- [~liuml07], thanks for uploading the new design doc [^HDFS-

[jira] [Commented] (HDFS-9633) Test SnapshotDiffReport file path corner cases

2016-03-23 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15209577#comment-15209577 ] John Zhuge commented on HDFS-9633: -- No, I am not trying fix any problem, just adding more

[jira] [Commented] (HDFS-9633) Test SnapshotDiffReport file path corner cases

2016-03-23 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15209574#comment-15209574 ] Yongjun Zhang commented on HDFS-9633: - Hi [~jzhuge], Thanks for reporting and working

[jira] [Commented] (HDFS-8915) TestFSNamesystem.testFSLockGetWaiterCount fails intermittently in jenkins

2016-03-23 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15209557#comment-15209557 ] Mingliang Liu commented on HDFS-8915: - Comparing with little sleep, I'm in favor of a {

[jira] [Updated] (HDFS-10175) add per-operation stats to FileSystem.Statistics

2016-03-23 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10175: - Attachment: HDFS-10175.002.patch Hi [~cmccabe], would you kindly review the patch? I'm not sure I

[jira] [Commented] (HDFS-9349) Support reconfiguring fs.protected.directories without NN restart

2016-03-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15209508#comment-15209508 ] Hadoop QA commented on HDFS-9349: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9427) HDFS should not default to ephemeral ports

2016-03-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15209499#comment-15209499 ] Hadoop QA commented on HDFS-9427: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-10195) Ozone: Add container persistence

2016-03-23 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15209434#comment-15209434 ] Jing Zhao commented on HDFS-10195: -- Thanks a lot for the great work, [~anu]. Besides Chri

[jira] [Commented] (HDFS-10196) Ozone : Enable better error reporting for failed commands in ozone shell

2016-03-23 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15209428#comment-15209428 ] Chris Nauroth commented on HDFS-10196: -- Hi [~anu]. This is a good idea, but since we

[jira] [Commented] (HDFS-10195) Ozone: Add container persistence

2016-03-23 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15209422#comment-15209422 ] Chris Nauroth commented on HDFS-10195: -- Hello [~anu]. Thank you for sharing this pat

[jira] [Updated] (HDFS-8496) Calling stopWriter() with FSDatasetImpl lock held may block other threads

2016-03-23 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-8496: - Summary: Calling stopWriter() with FSDatasetImpl lock held may block other threads (was: Should not call s

[jira] [Commented] (HDFS-9118) Add logging system for libdhfs++

2016-03-23 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15209270#comment-15209270 ] James Clampffer commented on HDFS-9118: --- Thanks for the reviews Bob. I'll open a jir

[jira] [Updated] (HDFS-9118) Add logging system for libdhfs++

2016-03-23 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9118: -- Resolution: Fixed Status: Resolved (was: Patch Available) > Add logging system for libdh

[jira] [Commented] (HDFS-10197) TestFsDatasetCache failing intermittently due to timeout

2016-03-23 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15209237#comment-15209237 ] Andrew Wang commented on HDFS-10197: Thanks for filing this JIRA [~linyiqun]! I think

[jira] [Commented] (HDFS-9118) Add logging system for libdhfs++

2016-03-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15209231#comment-15209231 ] Hadoop QA commented on HDFS-9118: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9118) Add logging system for libdhfs++

2016-03-23 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15209202#comment-15209202 ] Bob Hansen commented on HDFS-9118: -- +1. Looks good. Can you file a new Jira and referenc

[jira] [Commented] (HDFS-3702) Add an option for NOT writing the blocks locally if there is a datanode on the same box as the client

2016-03-23 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15209177#comment-15209177 ] stack commented on HDFS-3702: - I skimmed #9 patch. Seems good to me other than issues [~szetszw

[jira] [Commented] (HDFS-9349) Support reconfiguring fs.protected.directories without NN restart

2016-03-23 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15209172#comment-15209172 ] Xiaobing Zhou commented on HDFS-9349: - Patch V006 should fix the problems you mentioned

[jira] [Updated] (HDFS-9349) Support reconfiguring fs.protected.directories without NN restart

2016-03-23 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9349: Attachment: HDFS-9349-HDFS-9000.006.patch > Support reconfiguring fs.protected.directories without NN

[jira] [Commented] (HDFS-3702) Add an option for NOT writing the blocks locally if there is a datanode on the same box as the client

2016-03-23 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15209164#comment-15209164 ] stack commented on HDFS-3702: - bq. stack, let's add a boolean noLoaclWrite to DistributedFileSy

[jira] [Commented] (HDFS-10200) Docs for WebHDFS still describe GETDELEGATIONTOKENS operation

2016-03-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15209106#comment-15209106 ] Hudson commented on HDFS-10200: --- FAILURE: Integrated in Hadoop-trunk-Commit #9491 (See [htt

[jira] [Commented] (HDFS-10199) Unit tests TestCopyFiles, TestDistCh, TestLogalyzer under org.apache.hadoop.tools are failing

2016-03-23 Thread Tibor Kiss (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15209087#comment-15209087 ] Tibor Kiss commented on HDFS-10199: --- Thanks [~arpitagarwal] & [~cnauroth] ! > Unit test

[jira] [Updated] (HDFS-9118) Add logging system for libdhfs++

2016-03-23 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9118: -- Attachment: HDFS-9118.HDFS-8707.004.patch New patch incorporating nearly all of [~bobhansen]'s in

[jira] [Commented] (HDFS-6489) DFS Used space is not correct computed on frequent append operations

2016-03-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15209074#comment-15209074 ] Hadoop QA commented on HDFS-6489: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9616) libhdfs++ Add runtime hooks to allow a client application to add low level monitoring and tests.

2016-03-23 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15209063#comment-15209063 ] James Clampffer commented on HDFS-9616: --- Looks good to me, +1 > libhdfs++ Add runtim

[jira] [Updated] (HDFS-10200) Docs for WebHDFS still describe GETDELEGATIONTOKENS operation

2016-03-23 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10200: --- Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch Available) Push

[jira] [Commented] (HDFS-3702) Add an option for NOT writing the blocks locally if there is a datanode on the same box as the client

2016-03-23 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15209038#comment-15209038 ] Tsz Wo Nicholas Sze commented on HDFS-3702: --- BTW, I am at the airport now and goi

[jira] [Commented] (HDFS-10200) Docs for WebHDFS still describe GETDELEGATIONTOKENS operation

2016-03-23 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15209036#comment-15209036 ] Andrew Wang commented on HDFS-10200: LGTM, will commit shortly. > Docs for WebHDFS st

[jira] [Commented] (HDFS-3702) Add an option for NOT writing the blocks locally if there is a datanode on the same box as the client

2016-03-23 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15209035#comment-15209035 ] Tsz Wo Nicholas Sze commented on HDFS-3702: --- Also, it seems that there are no tes

[jira] [Commented] (HDFS-3702) Add an option for NOT writing the blocks locally if there is a datanode on the same box as the client

2016-03-23 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15209031#comment-15209031 ] Tsz Wo Nicholas Sze commented on HDFS-3702: --- [~stack], let's add a boolean noLoac

[jira] [Updated] (HDFS-10199) Unit tests TestCopyFiles, TestDistCh, TestLogalyzer under org.apache.hadoop.tools are failing

2016-03-23 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-10199: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available)

[jira] [Updated] (HDFS-10201) Implement undo log in parity datanode for hflush operations

2016-03-23 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10201: - Description: According to the current design doc for hflush support in erasure coding (see [HDFS-

[jira] [Commented] (HDFS-9427) HDFS should not default to ephemeral ports

2016-03-23 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15208967#comment-15208967 ] Xiaobing Zhou commented on HDFS-9427: - [~arpiagariu] here is the new mappings to keep 9

[jira] [Updated] (HDFS-9427) HDFS should not default to ephemeral ports

2016-03-23 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9427: Attachment: HDFS-9427.004.patch > HDFS should not default to ephemeral ports > --

[jira] [Commented] (HDFS-10193) fuse_dfs segfaults if uid cannot be resolved to a username

2016-03-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15208935#comment-15208935 ] Hudson commented on HDFS-10193: --- FAILURE: Integrated in Hadoop-trunk-Commit #9490 (See [htt

[jira] [Commented] (HDFS-10200) Docs for WebHDFS still describe GETDELEGATIONTOKENS operation

2016-03-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15208930#comment-15208930 ] Hadoop QA commented on HDFS-10200: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vot

[jira] [Updated] (HDFS-10193) fuse_dfs segfaults if uid cannot be resolved to a username

2016-03-23 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-10193: Resolution: Fixed Assignee: John Thiltges Fix Version/s: 2.8

[jira] [Updated] (HDFS-10193) fuse_dfs segfaults if uid cannot be resolved to a username

2016-03-23 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-10193: Tags: (was: fuse_dfs) > fuse_dfs segfaults if uid cannot be resolved to a username

[jira] [Commented] (HDFS-10193) fuse_dfs segfaults if uid cannot be resolved to a username

2016-03-23 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15208914#comment-15208914 ] Colin Patrick McCabe commented on HDFS-10193: - +1. Thanks, [~jthiltges]. > f

[jira] [Commented] (HDFS-10199) Unit tests TestCopyFiles, TestDistCh, TestLogalyzer under org.apache.hadoop.tools are failing

2016-03-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15208897#comment-15208897 ] Hadoop QA commented on HDFS-10199: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vot

[jira] [Created] (HDFS-10201) Implement undo log in parity datanode for hflush operations

2016-03-23 Thread Mingliang Liu (JIRA)
Mingliang Liu created HDFS-10201: Summary: Implement undo log in parity datanode for hflush operations Key: HDFS-10201 URL: https://issues.apache.org/jira/browse/HDFS-10201 Project: Hadoop HDFS

[jira] [Commented] (HDFS-3702) Add an option for NOT writing the blocks locally if there is a datanode on the same box as the client

2016-03-23 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15208850#comment-15208850 ] Lei (Eddy) Xu commented on HDFS-3702: - Test failures are not related. I ran all failure

[jira] [Updated] (HDFS-7661) [umbrella] support hflush and hsync for erasure coded files

2016-03-23 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-7661: Attachment: (was: HDFS-EC-file-flush-sync-design-version2.2.pdf) > [umbrella] support hflush and

[jira] [Updated] (HDFS-7661) [umbrella] support hflush and hsync for erasure coded files

2016-03-23 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-7661: Attachment: HDFS-EC-file-flush-sync-design-v20160323.pdf > [umbrella] support hflush and hsync for er

[jira] [Updated] (HDFS-10200) Docs for WebHDFS still describe GETDELEGATIONTOKENS operation

2016-03-23 Thread Wellington Chevreuil (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wellington Chevreuil updated HDFS-10200: Status: Patch Available (was: Open) > Docs for WebHDFS still describe GETDELEGATION

[jira] [Updated] (HDFS-10200) Docs for WebHDFS still describe GETDELEGATIONTOKENS operation

2016-03-23 Thread Wellington Chevreuil (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wellington Chevreuil updated HDFS-10200: Attachment: HDFS-10200.patch Attaching a patch that removed GETDELEGATIONTOKENS rela

[jira] [Commented] (HDFS-10200) Docs for WebHDFS still describe GETDELEGATIONTOKENS operation

2016-03-23 Thread Wellington Chevreuil (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15208783#comment-15208783 ] Wellington Chevreuil commented on HDFS-10200: - Docs for WebHDFS still describe

[jira] [Created] (HDFS-10200) Docs for WebHDFS still describe GETDELEGATIONTOKENS operation

2016-03-23 Thread Wellington Chevreuil (JIRA)
Wellington Chevreuil created HDFS-10200: --- Summary: Docs for WebHDFS still describe GETDELEGATIONTOKENS operation Key: HDFS-10200 URL: https://issues.apache.org/jira/browse/HDFS-10200 Project: Ha

[jira] [Commented] (HDFS-9118) Add logging system for libdhfs++

2016-03-23 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15208701#comment-15208701 ] James Clampffer commented on HDFS-9118: --- Didn't see you had more comments above my la

[jira] [Commented] (HDFS-10199) Unit tests TestCopyFiles, TestDistCh, TestLogalyzer under org.apache.hadoop.tools are failing

2016-03-23 Thread Tibor Kiss (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15208655#comment-15208655 ] Tibor Kiss commented on HDFS-10199: --- Thanks [~arpitagarwal], just renamed & uploaded the

[jira] [Updated] (HDFS-10199) Unit tests TestCopyFiles, TestDistCh, TestLogalyzer under org.apache.hadoop.tools are failing

2016-03-23 Thread Tibor Kiss (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tibor Kiss updated HDFS-10199: -- Attachment: HDFS-10199-branch-2.01.patch > Unit tests TestCopyFiles, TestDistCh, TestLogalyzer under >

[jira] [Commented] (HDFS-9118) Add logging system for libdhfs++

2016-03-23 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15208612#comment-15208612 ] James Clampffer commented on HDFS-9118: --- bq. Before we commit it, do you think we sho

[jira] [Updated] (HDFS-6489) DFS Used space is not correct computed on frequent append operations

2016-03-23 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-6489: -- Status: Patch Available (was: Open) > DFS Used space is not correct computed on frequent append operatio

[jira] [Updated] (HDFS-6489) DFS Used space is not correct computed on frequent append operations

2016-03-23 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-6489: -- Affects Version/s: 2.7.2 > DFS Used space is not correct computed on frequent append operations > ---

[jira] [Updated] (HDFS-6489) DFS Used space is not correct computed on frequent append operations

2016-03-23 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-6489: -- Attachment: HDFS-6489.001.patch > DFS Used space is not correct computed on frequent append operations >

[jira] [Commented] (HDFS-6489) DFS Used space is not correct computed on frequent append operations

2016-03-23 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15208606#comment-15208606 ] Weiwei Yang commented on HDFS-6489: --- I have a patch to fix this issue. The idea is during

[jira] [Commented] (HDFS-10199) Unit tests TestCopyFiles, TestDistCh, TestLogalyzer under org.apache.hadoop.tools are failing

2016-03-23 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15208541#comment-15208541 ] Arpit Agarwal commented on HDFS-10199: -- Thanks for the patch [~tibor.k...@gmail.com].

[jira] [Updated] (HDFS-10199) Unit tests TestCopyFiles, TestDistCh, TestLogalyzer under org.apache.hadoop.tools are failing

2016-03-23 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-10199: - Assignee: Tibor Kiss > Unit tests TestCopyFiles, TestDistCh, TestLogalyzer under > org.apache.had

[jira] [Commented] (HDFS-10193) fuse_dfs segfaults if uid cannot be resolved to a username

2016-03-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15208515#comment-15208515 ] Hadoop QA commented on HDFS-10193: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-10193) fuse_dfs segfaults if uid cannot be resolved to a username

2016-03-23 Thread John Thiltges (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Thiltges updated HDFS-10193: - Status: Patch Available (was: Open) > fuse_dfs segfaults if uid cannot be resolved to a username

[jira] [Updated] (HDFS-10199) Unit tests TestCopyFiles, TestDistCh, TestLogalyzer under org.apache.hadoop.tools are failing

2016-03-23 Thread Tibor Kiss (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tibor Kiss updated HDFS-10199: -- Status: Patch Available (was: Open) > Unit tests TestCopyFiles, TestDistCh, TestLogalyzer under > org.

[jira] [Commented] (HDFS-10199) Unit tests TestCopyFiles, TestDistCh, TestLogalyzer under org.apache.hadoop.tools are failing

2016-03-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15208438#comment-15208438 ] Hadoop QA commented on HDFS-10199: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-10199) Unit tests TestCopyFiles, TestDistCh, TestLogalyzer under org.apache.hadoop.tools are failing

2016-03-23 Thread Tibor Kiss (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15208426#comment-15208426 ] Tibor Kiss commented on HDFS-10199: --- Attached a trivial fix. > Unit tests TestCopyFiles

[jira] [Created] (HDFS-10199) Unit tests TestCopyFiles, TestDistCh, TestLogalyzer under org.apache.hadoop.tools are failing

2016-03-23 Thread Tibor Kiss (JIRA)
Tibor Kiss created HDFS-10199: - Summary: Unit tests TestCopyFiles, TestDistCh, TestLogalyzer under org.apache.hadoop.tools are failing Key: HDFS-10199 URL: https://issues.apache.org/jira/browse/HDFS-10199

[jira] [Updated] (HDFS-10199) Unit tests TestCopyFiles, TestDistCh, TestLogalyzer under org.apache.hadoop.tools are failing

2016-03-23 Thread Tibor Kiss (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tibor Kiss updated HDFS-10199: -- Attachment: HDFS-10199.01.patch > Unit tests TestCopyFiles, TestDistCh, TestLogalyzer under > org.apach

[jira] [Commented] (HDFS-9118) Add logging system for libdhfs++

2016-03-23 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15208411#comment-15208411 ] Bob Hansen commented on HDFS-9118: -- Before we commit it, do you think we should add a __FI

[jira] [Updated] (HDFS-9909) Can't read file after hdfs restart

2016-03-23 Thread Bogdan Raducanu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bogdan Raducanu updated HDFS-9909: -- Priority: Critical (was: Major) > Can't read file after hdfs restart > -

[jira] [Updated] (HDFS-9909) Can't read file after hdfs restart

2016-03-23 Thread Bogdan Raducanu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bogdan Raducanu updated HDFS-9909: -- Component/s: namenode > Can't read file after hdfs restart > -- >

[jira] [Commented] (HDFS-9847) HDFS configuration without time unit name should accept friendly time units

2016-03-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15208299#comment-15208299 ] Hadoop QA commented on HDFS-9847: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-10197) TestFsDatasetCache failing intermittently due to timeout

2016-03-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15208289#comment-15208289 ] Hadoop QA commented on HDFS-10197: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-9820) Improve distcp to support efficient restore to an earlier snapshot

2016-03-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15208273#comment-15208273 ] Hadoop QA commented on HDFS-9820: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-3702) Add an option for NOT writing the blocks locally if there is a datanode on the same box as the client

2016-03-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15208169#comment-15208169 ] Hadoop QA commented on HDFS-3702: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Assigned] (HDFS-6489) DFS Used space is not correct computed on frequent append operations

2016-03-23 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang reassigned HDFS-6489: - Assignee: Weiwei Yang > DFS Used space is not correct computed on frequent append operations > ---

[jira] [Commented] (HDFS-9820) Improve distcp to support efficient restore to an earlier snapshot

2016-03-23 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15208006#comment-15208006 ] Yongjun Zhang commented on HDFS-9820: - Hi [~jingzhao] and [~yufeigu], I just attached

[jira] [Updated] (HDFS-9820) Improve distcp to support efficient restore to an earlier snapshot

2016-03-23 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-9820: Attachment: HDFS-9820.002.patch > Improve distcp to support efficient restore to an earlier snapshot