[jira] [Updated] (HDFS-9613) Minor improvement and clean up in distcp

2016-01-05 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-9613: Attachment: HDFS-9613-v2.patch Updated the patch and refined the logic per my understanding. If checksum opt

[jira] [Updated] (HDFS-9613) Some improvement and clean up in distcp

2016-01-05 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-9613: Summary: Some improvement and clean up in distcp (was: Minor improvement and clean up in distcp) > Some imp

[jira] [Created] (HDFS-9614) If the path contains '\ t' character, can not be deleted from the command line

2016-01-05 Thread tangshangwen (JIRA)
tangshangwen created HDFS-9614: -- Summary: If the path contains '\ t' character, can not be deleted from the command line Key: HDFS-9614 URL: https://issues.apache.org/jira/browse/HDFS-9614 Project: Hadoo

[jira] [Updated] (HDFS-9522) Cleanup o.a.h.hdfs.protocol.SnapshotDiffReport

2016-01-05 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-9522: - Attachment: HDFS-9522-002.patch A slight enhancement to patch 001. Add unit test testDiffReportWithDeleteCr

[jira] [Updated] (HDFS-8430) Erasure coding: compute file checksum for stripe files

2016-01-05 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-8430: Summary: Erasure coding: compute file checksum for stripe files (was: Erasure coding: update DFSClient.getFi

[jira] [Updated] (HDFS-9614) If the path contains '\r' character, can not be deleted from the command line

2016-01-05 Thread tangshangwen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] tangshangwen updated HDFS-9614: --- Description: In our cluster, I found that some users create directory contains '\r' character, cause w

[jira] [Updated] (HDFS-9614) If the path contains '\r' character, can not be deleted from the command line

2016-01-05 Thread tangshangwen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] tangshangwen updated HDFS-9614: --- Summary: If the path contains '\r' character, can not be deleted from the command line (was: If the pa

[jira] [Commented] (HDFS-9455) In distcp, Invalid Argument Error thrown in case of filesystem operation failure

2016-01-05 Thread Archana T (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15082670#comment-15082670 ] Archana T commented on HDFS-9455: - Hi [~daisuke.kobayashi] I got the issue in OpenSource 2.

[jira] [Commented] (HDFS-9613) Some improvement and clean up in distcp

2016-01-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15082688#comment-15082688 ] Hadoop QA commented on HDFS-9613: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9576) HTrace: collect path/offset/length information on read and write operations

2016-01-05 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15082697#comment-15082697 ] Masatake Iwasaki commented on HDFS-9576: Thanks for working on this, [~zhz]. I trie

[jira] [Updated] (HDFS-9603) Erasure Coding: Use ErasureCoder to encode/decode a block group

2016-01-05 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li updated HDFS-9603: - Attachment: HDFS-9603.2.patch Update patch to address Kai's comments. > Erasure Coding: Use ErasureCoder to encode

[jira] [Updated] (HDFS-9455) In distcp, Invalid Argument Error thrown in case of filesystem operation failure

2016-01-05 Thread Daisuke Kobayashi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daisuke Kobayashi updated HDFS-9455: Component/s: security > In distcp, Invalid Argument Error thrown in case of filesystem operat

[jira] [Commented] (HDFS-9455) In distcp, Invalid Argument Error thrown in case of filesystem operation failure

2016-01-05 Thread Daisuke Kobayashi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15082774#comment-15082774 ] Daisuke Kobayashi commented on HDFS-9455: - I see, [~archanat]. When using normal we

[jira] [Commented] (HDFS-9455) In distcp, Invalid Argument Error thrown in case of filesystem operation failure

2016-01-05 Thread Daisuke Kobayashi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15082781#comment-15082781 ] Daisuke Kobayashi commented on HDFS-9455: - [~yzhangal], can you double check this p

[jira] [Commented] (HDFS-9607) Advance Hadoop Architecture (AHA) - HDFS

2016-01-05 Thread Dinesh S. Atreya (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15082848#comment-15082848 ] Dinesh S. Atreya commented on HDFS-9607: Regarding below, we want to be clear from

[jira] [Commented] (HDFS-9603) Erasure Coding: Use ErasureCoder to encode/decode a block group

2016-01-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15082849#comment-15082849 ] Hadoop QA commented on HDFS-9603: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9607) Advance Hadoop Architecture (AHA) - HDFS

2016-01-05 Thread Dinesh S. Atreya (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15082865#comment-15082865 ] Dinesh S. Atreya commented on HDFS-9607: A configuration parameter {{dfs.support.wr

[jira] [Updated] (HDFS-9603) Erasure Coding: Use ErasureCoder to encode/decode a block group

2016-01-05 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li updated HDFS-9603: - Attachment: HDFS-9603.3.patch Fix checkstyle. > Erasure Coding: Use ErasureCoder to encode/decode a block group >

[jira] [Commented] (HDFS-9614) If the path contains '\r' character, can not be deleted from the command line

2016-01-05 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15082895#comment-15082895 ] Steve Loughran commented on HDFS-9614: -- have you tried escaping the wildcard? {code} h

[jira] [Commented] (HDFS-9522) Cleanup o.a.h.hdfs.protocol.SnapshotDiffReport

2016-01-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15082945#comment-15082945 ] Hadoop QA commented on HDFS-9522: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9614) If the path contains '\r' character, can not be deleted from the command line

2016-01-05 Thread tangshangwen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15082946#comment-15082946 ] tangshangwen commented on HDFS-9614: This is my test {noformat} $hdfs dfs -ls /user/had

[jira] [Commented] (HDFS-9603) Erasure Coding: Use ErasureCoder to encode/decode a block group

2016-01-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15082996#comment-15082996 ] Hadoop QA commented on HDFS-9603: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9614) If the path contains '\r' character, can not be deleted from the command line

2016-01-05 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15083056#comment-15083056 ] Daniel Templeton commented on HDFS-9614: This was actually one of the puzzlers in m

[jira] [Commented] (HDFS-9607) Advance Hadoop Architecture (AHA) - HDFS

2016-01-05 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15083066#comment-15083066 ] Steve Loughran commented on HDFS-9607: -- > I believe currently HDFS is not POSIX compli

[jira] [Commented] (HDFS-8346) libwebhdfs build fails during link due to unresolved external symbols.

2016-01-05 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15083155#comment-15083155 ] Kihwal Lee commented on HDFS-8346: -- The immediate goal will be to make the precommit work.

[jira] [Commented] (HDFS-9047) deprecate libwebhdfs in branch-2; remove from trunk

2016-01-05 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15083175#comment-15083175 ] Kihwal Lee commented on HDFS-9047: -- libwebhdfs build has been broken in 2.6 and 2.7 for a

[jira] [Commented] (HDFS-8999) Namenode need not wait for {{blockReceived}} for the last block before completing a file.

2016-01-05 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15083176#comment-15083176 ] Tsz Wo Nicholas Sze commented on HDFS-8999: --- > Is it strange? If we gonna do this

[jira] [Commented] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

2016-01-05 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15083185#comment-15083185 ] Tsz Wo Nicholas Sze commented on HDFS-8578: --- [~vinayrpet] and [~ctrezzo], thanks

[jira] [Commented] (HDFS-8346) libwebhdfs build fails during link due to unresolved external symbols.

2016-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15083199#comment-15083199 ] Junping Du commented on HDFS-8346: -- Ok. Thanks for pushing it, [~kihwal]! > libwebhdfs bu

[jira] [Commented] (HDFS-8346) libwebhdfs build fails during link due to unresolved external symbols.

2016-01-05 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15083183#comment-15083183 ] Kihwal Lee commented on HDFS-8346: -- I felt it needs more discussion, so left a comment in

[jira] [Commented] (HDFS-9047) deprecate libwebhdfs in branch-2; remove from trunk

2016-01-05 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15083313#comment-15083313 ] Chris Nauroth commented on HDFS-9047: - I remain +1 for a full removal of libwebhdfs fro

[jira] [Updated] (HDFS-8999) Namenode need not wait for {{blockReceived}} for the last block before completing a file.

2016-01-05 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8999: -- Attachment: h8999_20160106.patch h8999_20160106.patch: - When closing a file with the las

[jira] [Updated] (HDFS-9612) DistCp worker threads are not terminated after jobs are done.

2016-01-05 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9612: -- Status: Patch Available (was: Open) > DistCp worker threads are not terminated after jobs are do

[jira] [Updated] (HDFS-9612) DistCp worker threads are not terminated after jobs are done.

2016-01-05 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9612: -- Attachment: HDFS-9612.003.patch Rev03: # Added another (more complex) test case; also, make sure

[jira] [Commented] (HDFS-9047) deprecate libwebhdfs in branch-2; remove from trunk

2016-01-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15083336#comment-15083336 ] Allen Wittenauer commented on HDFS-9047: It's probably worthwhile pointing out that

[jira] [Updated] (HDFS-9611) DiskBalancer : Replace htrace json imports with jackson

2016-01-05 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-9611: Resolution: Fixed Hadoop Flags: Reviewed Target Version/s: (was: HDFS-1312)

[jira] [Commented] (HDFS-9612) DistCp worker threads are not terminated after jobs are done.

2016-01-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15083384#comment-15083384 ] Hadoop QA commented on HDFS-9612: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9455) In distcp, Invalid Argument Error thrown in case of filesystem operation failure

2016-01-05 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15083400#comment-15083400 ] Yongjun Zhang commented on HDFS-9455: - Hi Guys, Thanks for reporting the issue and the

[jira] [Commented] (HDFS-9047) deprecate libwebhdfs in branch-2; remove from trunk

2016-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15083445#comment-15083445 ] Junping Du commented on HDFS-9047: -- >From the discussion above (and HDFS-8346), I don't th

[jira] [Commented] (HDFS-9574) Reduce client failures during datanode restart

2016-01-05 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15083463#comment-15083463 ] Daryn Sharp commented on HDFS-9574: --- Might consider checking if the bp is registered in {

[jira] [Commented] (HDFS-9576) HTrace: collect path/offset/length information on read and write operations

2016-01-05 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15083539#comment-15083539 ] Zhe Zhang commented on HDFS-9576: - Good point [~iwasakims]! I should have traced the write

[jira] [Commented] (HDFS-8999) Namenode need not wait for {{blockReceived}} for the last block before completing a file.

2016-01-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15083624#comment-15083624 ] Hadoop QA commented on HDFS-8999: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HDFS-9576) HTrace: collect path/offset/length information on read and write operations

2016-01-05 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9576: Attachment: HDFS-9576.02.patch Attaching new patch to include returned length in read trace scope. It's a li

[jira] [Created] (HDFS-9615) Fix variable name typo in DFSConfigKeys#DFS_NAMENODE_MISSING_CHECKPOINT_PERIODS_BEFORE_SHUTDONW_DEFAULT

2016-01-05 Thread Ray Chiang (JIRA)
Ray Chiang created HDFS-9615: Summary: Fix variable name typo in DFSConfigKeys#DFS_NAMENODE_MISSING_CHECKPOINT_PERIODS_BEFORE_SHUTDONW_DEFAULT Key: HDFS-9615 URL: https://issues.apache.org/jira/browse/HDFS-9615

[jira] [Updated] (HDFS-9615) Fix variable name typo in DFSConfigKeys#DFS_NAMENODE_MISSING_CHECKPOINT_PERIODS_BEFORE_SHUTDONW_DEFAULT

2016-01-05 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated HDFS-9615: - Attachment: HDFS-9615.001.patch > Fix variable name typo in > DFSConfigKeys#DFS_NAMENODE_MISSING_CHECKPOIN

[jira] [Updated] (HDFS-9615) Fix variable name typo in DFSConfigKeys#DFS_NAMENODE_MISSING_CHECKPOINT_PERIODS_BEFORE_SHUTDONW_DEFAULT

2016-01-05 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated HDFS-9615: - Status: Patch Available (was: Open) Submit for testing > Fix variable name typo in > DFSConfigKeys#DFS_N

[jira] [Commented] (HDFS-9469) DiskBalancer : Add Planner

2016-01-05 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15083666#comment-15083666 ] Arpit Agarwal commented on HDFS-9469: - Thanks [~anu]. The v5 patch lgtm. The checkstyle

[jira] [Updated] (HDFS-8356) Document missing properties in hdfs-default.xml

2016-01-05 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated HDFS-8356: - Attachment: HDFS-8356.003.patch Submit for testing > Document missing properties in hdfs-default.xml > ---

[jira] [Updated] (HDFS-8356) Document missing properties in hdfs-default.xml

2016-01-05 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated HDFS-8356: - Status: Patch Available (was: Open) > Document missing properties in hdfs-default.xml > --

[jira] [Commented] (HDFS-9325) Allow the location of hadoop source tree resources to be passed to CMake during a build.

2016-01-05 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15083677#comment-15083677 ] James Clampffer commented on HDFS-9325: --- Thanks for the clarification. Everything lo

[jira] [Commented] (HDFS-9576) HTrace: collect path/offset/length information on read and write operations

2016-01-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15083681#comment-15083681 ] Hadoop QA commented on HDFS-9576: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9330) Reconfigure DN deleting duplicate replica on the fly

2016-01-05 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15083704#comment-15083704 ] Arpit Agarwal commented on HDFS-9330: - Hi [~xiaobingo], looks like the patch needs to b

[jira] [Commented] (HDFS-9615) Fix variable name typo in DFSConfigKeys#DFS_NAMENODE_MISSING_CHECKPOINT_PERIODS_BEFORE_SHUTDONW_DEFAULT

2016-01-05 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15083709#comment-15083709 ] Arpit Agarwal commented on HDFS-9615: - +1 pending Jenkins. > Fix variable name typo in

[jira] [Commented] (HDFS-9498) Move code that tracks orphan blocks to BlockManagerSafeMode

2016-01-05 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15083740#comment-15083740 ] Arpit Agarwal commented on HDFS-9498: - Hi [~liuml07], is this new call to fix a pre-exi

[jira] [Commented] (HDFS-8286) Scaling out the namespace using KV store

2016-01-05 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15083750#comment-15083750 ] Haohui Mai commented on HDFS-8286: -- I have pushed the prototype that corresponds to my [Ha

[jira] [Commented] (HDFS-9465) No header files in mvn package

2016-01-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15083756#comment-15083756 ] Allen Wittenauer commented on HDFS-9465: bq. How does the Apache Hadoop community d

[jira] [Updated] (HDFS-9325) Allow the location of hadoop source tree resources to be passed to CMake during a build.

2016-01-05 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9325: -- Resolution: Fixed Status: Resolved (was: Patch Available) Committed to HDFS-8707. Thank

[jira] [Commented] (HDFS-9498) Move code that tracks orphan blocks to BlockManagerSafeMode

2016-01-05 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15083787#comment-15083787 ] Arpit Agarwal commented on HDFS-9498: - Also nitpick: the new orphan block terminology s

[jira] [Commented] (HDFS-9498) Move code that tracks orphan blocks to BlockManagerSafeMode

2016-01-05 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15083799#comment-15083799 ] Mingliang Liu commented on HDFS-9498: - Thanks [~arpitagarwal] for your comment. Suppos

[jira] [Commented] (HDFS-9498) Move code that tracks orphan blocks to BlockManagerSafeMode

2016-01-05 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15083800#comment-15083800 ] Mingliang Liu commented on HDFS-9498: - Good suggestion. I'll update the patch. > Move

[jira] [Commented] (HDFS-9047) deprecate libwebhdfs in branch-2; remove from trunk

2016-01-05 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15083801#comment-15083801 ] Haohui Mai commented on HDFS-9047: -- The fact that the code does not build out-of-the-box f

[jira] [Updated] (HDFS-9525) hadoop utilities need to support provided delegation tokens

2016-01-05 Thread HeeSoo Kim (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] HeeSoo Kim updated HDFS-9525: - Attachment: HDFS-9525.branch-2.008.patch Patch for branch-2. > hadoop utilities need to support provided d

[jira] [Assigned] (HDFS-9047) deprecate libwebhdfs in branch-2; remove from trunk

2016-01-05 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai reassigned HDFS-9047: Assignee: Haohui Mai > deprecate libwebhdfs in branch-2; remove from trunk > ---

[jira] [Updated] (HDFS-9047) deprecate libwebhdfs in branch-2; remove from trunk

2016-01-05 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9047: - Attachment: HDFS-9047.000.patch > deprecate libwebhdfs in branch-2; remove from trunk > ---

[jira] [Updated] (HDFS-9047) deprecate libwebhdfs in branch-2; remove from trunk

2016-01-05 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9047: - Status: Patch Available (was: Open) > deprecate libwebhdfs in branch-2; remove from trunk > --

[jira] [Updated] (HDFS-9609) libhfds++: Allow seek to EOF

2016-01-05 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9609: -- Status: Patch Available (was: Open) > libhfds++: Allow seek to EOF > ---

[jira] [Commented] (HDFS-9609) libhfds++: Allow seek to EOF

2016-01-05 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15083820#comment-15083820 ] James Clampffer commented on HDFS-9609: --- Thanks for catching this [~bobthansen]. Loo

[jira] [Commented] (HDFS-9525) hadoop utilities need to support provided delegation tokens

2016-01-05 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15083836#comment-15083836 ] Haohui Mai commented on HDFS-9525: -- Does it make more sense to extend `HADOOP_TOKEN_FILE_L

[jira] [Commented] (HDFS-9610) cmake tests don't fail when they should?

2016-01-05 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15083849#comment-15083849 ] James Clampffer commented on HDFS-9610: --- Wow, thanks for reporting this [~aw]. Was t

[jira] [Updated] (HDFS-9498) Move code that tracks orphan blocks to BlockManagerSafeMode

2016-01-05 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9498: Target Version/s: 3.0.0 (was: 2.8.0) > Move code that tracks orphan blocks to BlockManagerSafeMode >

[jira] [Updated] (HDFS-9498) Move code that tracks orphan blocks to BlockManagerSafeMode

2016-01-05 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9498: Description: [HDFS-4015] counts and reports orphaned blocks {{numberOfBytesInFutureBlocks}} in safe

[jira] [Updated] (HDFS-9612) DistCp worker threads are not terminated after jobs are done.

2016-01-05 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9612: -- Attachment: HDFS-9612.004.patch Rev04: replace commons.logging with slf4j. > DistCp worker threa

[jira] [Commented] (HDFS-7779) Improve the HDFS Web UI browser to allow chowning / chgrp and setting replication

2016-01-05 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15083864#comment-15083864 ] Haohui Mai commented on HDFS-7779: -- +1. Committing it shortly. > Improve the HDFS Web UI

[jira] [Updated] (HDFS-7779) Support changing ownership, group and replication in HDFS Web UI

2016-01-05 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-7779: - Summary: Support changing ownership, group and replication in HDFS Web UI (was: Improve the HDFS Web UI br

[jira] [Commented] (HDFS-9047) deprecate libwebhdfs in branch-2; remove from trunk

2016-01-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15083866#comment-15083866 ] Hadoop QA commented on HDFS-9047: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9525) hadoop utilities need to support provided delegation tokens

2016-01-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15083877#comment-15083877 ] Allen Wittenauer commented on HDFS-9525: bq. Does it make more sense to extend `HAD

[jira] [Updated] (HDFS-7779) Support changing ownership, group and replication in HDFS Web UI

2016-01-05 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-7779: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved (was:

[jira] [Commented] (HDFS-9498) Move code that tracks orphan blocks to BlockManagerSafeMode

2016-01-05 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15083883#comment-15083883 ] Arpit Agarwal commented on HDFS-9498: - Thanks for the clarification [~liuml07]. bq. Su

[jira] [Commented] (HDFS-9525) hadoop utilities need to support provided delegation tokens

2016-01-05 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15083881#comment-15083881 ] Haohui Mai commented on HDFS-9525: -- bq. No. It's extremely useful to be able to do this fr

[jira] [Commented] (HDFS-9605) "tab-datanode-volume-failures" is missing from explorer.html

2016-01-05 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15083896#comment-15083896 ] Haohui Mai commented on HDFS-9605: -- +1. Will commit shortly. > "tab-datanode-volume-failu

[jira] [Updated] (HDFS-9605) Add links to failed volumes to explorer.html in HDFS Web UI

2016-01-05 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9605: - Summary: Add links to failed volumes to explorer.html in HDFS Web UI (was: "tab-datanode-volume-failures"

[jira] [Commented] (HDFS-9610) cmake tests don't fail when they should?

2016-01-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15083913#comment-15083913 ] Allen Wittenauer commented on HDFS-9610: When I hit it, yes, it was. Let me see if

[jira] [Updated] (HDFS-9605) Add links to failed volumes to explorer.html in HDFS Web UI

2016-01-05 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9605: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved (was:

[jira] [Comment Edited] (HDFS-9605) Add links to failed volumes to explorer.html in HDFS Web UI

2016-01-05 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15083914#comment-15083914 ] Haohui Mai edited comment on HDFS-9605 at 1/5/16 9:56 PM: -- I've co

[jira] [Comment Edited] (HDFS-7779) Support changing ownership, group and replication in HDFS Web UI

2016-01-05 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15083875#comment-15083875 ] Haohui Mai edited comment on HDFS-7779 at 1/5/16 9:57 PM: -- I've co

[jira] [Commented] (HDFS-9525) hadoop utilities need to support provided delegation tokens

2016-01-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15083924#comment-15083924 ] Allen Wittenauer commented on HDFS-9525: Oozie was just an example. If I'm firing

[jira] [Commented] (HDFS-9047) deprecate libwebhdfs in branch-2; remove from trunk

2016-01-05 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15083926#comment-15083926 ] Jing Zhao commented on HDFS-9047: - +1 on removing libwebhdfs from trunk and branch-2. The 0

[jira] [Commented] (HDFS-9612) DistCp worker threads are not terminated after jobs are done.

2016-01-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15083934#comment-15083934 ] Hadoop QA commented on HDFS-9612: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9498) Move code that tracks orphan blocks to BlockManagerSafeMode

2016-01-05 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15083943#comment-15083943 ] Mingliang Liu commented on HDFS-9498: - Thanks for the further discussion. I should wro

[jira] [Commented] (HDFS-9609) libhfds++: Allow seek to EOF

2016-01-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15083944#comment-15083944 ] Hadoop QA commented on HDFS-9609: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-7779) Support changing ownership, group and replication in HDFS Web UI

2016-01-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15083955#comment-15083955 ] Hudson commented on HDFS-7779: -- FAILURE: Integrated in Hadoop-trunk-Commit #9051 (See [https:

[jira] [Commented] (HDFS-9605) Add links to failed volumes to explorer.html in HDFS Web UI

2016-01-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15083956#comment-15083956 ] Hudson commented on HDFS-9605: -- FAILURE: Integrated in Hadoop-trunk-Commit #9051 (See [https:

[jira] [Commented] (HDFS-9613) Some improvement and clean up in distcp

2016-01-05 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15083958#comment-15083958 ] Jing Zhao commented on HDFS-9613: - Thanks for the improvement, Kai. One question about the

[jira] [Commented] (HDFS-9498) Move code that tracks orphan blocks to BlockManagerSafeMode

2016-01-05 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15083965#comment-15083965 ] Arpit Agarwal commented on HDFS-9498: - Okay that makes sense. I missed the side effect

[jira] [Updated] (HDFS-9498) Move code that tracks orphan blocks to BlockManagerSafeMode

2016-01-05 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9498: Attachment: HDFS-9498.004.patch The v4 patch addresses [~arpitagarwal]'s comments. Specially, * rep

[jira] [Commented] (HDFS-9498) Move code that tracks orphan blocks to BlockManagerSafeMode

2016-01-05 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15084004#comment-15084004 ] Arpit Agarwal commented on HDFS-9498: - Thanks for the updated patch [~liuml07]. +1 from

[jira] [Commented] (HDFS-9047) deprecate libwebhdfs in branch-2; remove from trunk

2016-01-05 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15084009#comment-15084009 ] Haohui Mai commented on HDFS-9047: -- [~cmccabe], does it look good to you? I plan to commi

[jira] [Commented] (HDFS-7661) Erasure coding: support hflush and hsync

2016-01-05 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15084008#comment-15084008 ] Zhe Zhang commented on HDFS-7661: - bq. 2. flush at Flush point 2.1.1, PIB1 and PIB2 were up

[jira] [Commented] (HDFS-9615) Fix variable name typo in DFSConfigKeys#DFS_NAMENODE_MISSING_CHECKPOINT_PERIODS_BEFORE_SHUTDONW_DEFAULT

2016-01-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15084020#comment-15084020 ] Hadoop QA commented on HDFS-9615: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Created] (HDFS-9616) libhdfs++ Add runtime hooks to allow a client application to add low level monitoring and tests.

2016-01-05 Thread James Clampffer (JIRA)
James Clampffer created HDFS-9616: - Summary: libhdfs++ Add runtime hooks to allow a client application to add low level monitoring and tests. Key: HDFS-9616 URL: https://issues.apache.org/jira/browse/HDFS-9616

  1   2   >