[jira] [Commented] (HDFS-5042) Completed files lost after power failure

2014-10-03 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14158416#comment-14158416 ] Luke Lu commented on HDFS-5042: --- The write barrier support, as I understand it, is strictly u

[jira] [Commented] (HDFS-5042) Completed files lost after power failure

2014-10-03 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14158209#comment-14158209 ] Luke Lu commented on HDFS-5042: --- We actually reproduce the problem (pretty easily: a couple t

[jira] [Commented] (HDFS-5042) Completed files lost after power failure

2014-10-02 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14156876#comment-14156876 ] Luke Lu commented on HDFS-5042: --- We've also reproduced the data loss (though with less freque

[jira] [Commented] (HDFS-7122) Very poor distribution of replication copies

2014-09-29 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14152052#comment-14152052 ] Luke Lu commented on HDFS-7122: --- Created HADOOP-11152 to track the investigation of a better

[jira] [Commented] (HDFS-7122) Very poor distribution of replication copies

2014-09-29 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14151998#comment-14151998 ] Luke Lu commented on HDFS-7122: --- Looks like a straight-forward revert of the ThreadLocal rand

[jira] [Updated] (HDFS-7122) Very poor distribution of replication copies

2014-09-29 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Lu updated HDFS-7122: -- Status: Patch Available (was: Open) > Very poor distribution of replication copies > ---

[jira] [Issue Comment Deleted] (HDFS-5042) Completed files lost after power failure

2014-09-25 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Lu updated HDFS-5042: -- Comment: was deleted (was: Looks like this is the most compelling reason to use XFS, where "*all* transactions p

[jira] [Commented] (HDFS-4901) Site Scripting and Phishing Through Frames in browseDirectory.jsp

2014-02-05 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13892361#comment-13892361 ] Luke Lu commented on HDFS-4901: --- [~vivganes]: no problem, feel free to assign it to yourself,

[jira] [Commented] (HDFS-4901) Site Scripting and Phishing Through Frames in browseDirectory.jsp

2014-02-05 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13892319#comment-13892319 ] Luke Lu commented on HDFS-4901: --- [~vivganes]: You might not want to work on this, but this is

[jira] [Reopened] (HDFS-4901) Site Scripting and Phishing Through Frames in browseDirectory.jsp

2014-02-05 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Lu reopened HDFS-4901: --- Assignee: (was: Vivek Ganesan) > Site Scripting and Phishing Through Frames in browseDirectory.jsp > ---

[jira] [Commented] (HDFS-5333) Improvement of current HDFS Web UI

2013-11-05 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13814070#comment-13814070 ] Luke Lu commented on HDFS-5333: --- Auto-redirect from the index page is nice. A link to alterna

[jira] [Updated] (HDFS-4901) Site Scripting and Phishing Through Frames in browseDirectory.jsp

2013-11-04 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Lu updated HDFS-4901: -- Priority: Blocker (was: Major) Target Version/s: 1.3.0 Blocker for the next 1.x release. > Site Sc

[jira] [Updated] (HDFS-4901) Site Scripting and Phishing Through Frames in browseDirectory.jsp

2013-11-04 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Lu updated HDFS-4901: -- Description: It is possible to steal or manipulate customer session and cookies, which might be used to i

[jira] [Commented] (HDFS-5333) Improvement of current HDFS Web UI

2013-11-04 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13813406#comment-13813406 ] Luke Lu commented on HDFS-5333: --- bq. and at the same time we provide the access for the old w

[jira] [Commented] (HDFS-5333) Improvement of current HDFS Web UI

2013-11-04 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13813273#comment-13813273 ] Luke Lu commented on HDFS-5333: --- Things like HDFS-4901 (which is fixed by HDFS-4162 in trunk)

[jira] [Commented] (HDFS-4901) Site Scripting and Phishing Through Frames in browseDirectory.jsp

2013-11-04 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13813209#comment-13813209 ] Luke Lu commented on HDFS-4901: --- Looks like the issue only Hadoop 1.x. We should simply backp

[jira] [Commented] (HDFS-4901) Site Scripting and Phishing Through Frames in browseDirectory.jsp

2013-10-30 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13809648#comment-13809648 ] Luke Lu commented on HDFS-4901: --- Thanks Jeff for reporting the bug and Vivek for working on i

[jira] [Commented] (HDFS-5333) Improvement of current HDFS Web UI

2013-10-30 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13809324#comment-13809324 ] Luke Lu commented on HDFS-5333: --- bq. For example, an attacker can exploit HDFS-4901 to inject

[jira] [Commented] (HDFS-5333) Improvement of current HDFS Web UI

2013-10-29 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13808598#comment-13808598 ] Luke Lu commented on HDFS-5333: --- bq. Image fetching is one of many possible attack windows wi

[jira] [Commented] (HDFS-5333) Improvement of current HDFS Web UI

2013-10-29 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13808279#comment-13808279 ] Luke Lu commented on HDFS-5333: --- bq. You'll need to defend against it no matter what UI you'r

[jira] [Commented] (HDFS-5333) Improvement of current HDFS Web UI

2013-10-29 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13807757#comment-13807757 ] Luke Lu commented on HDFS-5333: --- bq. Commodity browsers enforce Same-Origin Policy to defend

[jira] [Commented] (HDFS-5333) Improvement of current HDFS Web UI

2013-10-25 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13805457#comment-13805457 ] Luke Lu commented on HDFS-5333: --- I have concerns with this client-side js only approach, whic

[jira] [Commented] (HDFS-4885) Update verifyBlockPlacement() API in BlockPlacementPolicy

2013-10-18 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13799324#comment-13799324 ] Luke Lu commented on HDFS-4885: --- Nicholas suggested offline that we simply pass in the replic

[jira] [Commented] (HDFS-5042) Completed files lost after power failure

2013-10-16 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13796509#comment-13796509 ] Luke Lu commented on HDFS-5042: --- Looks like this is the most compelling reason to use XFS, wh

[jira] [Commented] (HDFS-5130) Add test for snapshot related FsShell and DFSAdmin commands

2013-10-15 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13795510#comment-13795510 ] Luke Lu commented on HDFS-5130: --- lgtm. +1. > Add test for snapshot related FsShell and DFSAd

[jira] [Commented] (HDFS-5267) Remove volatile from LightWeightHashSet

2013-10-11 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13793270#comment-13793270 ] Luke Lu commented on HDFS-5267: --- Oops, I assumed the jira number in the patch file name was c

[jira] [Updated] (HDFS-5267) Remove volatile from LightWeightHashSet

2013-10-11 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Lu updated HDFS-5267: -- Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Committed to t

[jira] [Updated] (HDFS-5267) Remove volatile from LightWeightHashSet

2013-10-11 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Lu updated HDFS-5267: -- Fix Version/s: 2.3.0 Summary: Remove volatile from LightWeightHashSet (was: LightWeight*Set modificat

[jira] [Updated] (HDFS-5267) LightWeight*Set modification cleanup

2013-10-09 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Lu updated HDFS-5267: -- Description: LightWeight*Set is not supposed to be thread-safe and there is no point to use volatile for mo

[jira] [Commented] (HDFS-5267) Modification field in LightWeightHashSet and LightWeightLinkedSet should't be volatile which cause wrong expectation on thread-safe visibility

2013-10-09 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13790860#comment-13790860 ] Luke Lu commented on HDFS-5267: --- The patch lgtm. +1. > Modification field in LightWeightHash

[jira] [Commented] (HDFS-4885) Update verifyBlockPlacement() API in BlockPlacementPolicy

2013-10-02 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13783772#comment-13783772 ] Luke Lu commented on HDFS-4885: --- The v3 patch looks reasonable to me. We can deal with the ac

[jira] [Commented] (HDFS-4885) Update verifyBlockPlacement() API in BlockPlacementPolicy

2013-10-01 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13783405#comment-13783405 ] Luke Lu commented on HDFS-4885: --- I posted the comment before refreshing to see the v2 patch,

[jira] [Updated] (HDFS-4885) Update verifyBlockPlacement() API in BlockPlacementPolicy

2013-10-01 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Lu updated HDFS-4885: -- Target Version/s: 2.3.0 (was: 3.0.0, 2.1.2-beta) > Update verifyBlockPlacement() API in BlockPlacementPolicy >

[jira] [Commented] (HDFS-4885) Update verifyBlockPlacement() API in BlockPlacementPolicy

2013-10-01 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13783163#comment-13783163 ] Luke Lu commented on HDFS-4885: --- {{BlockPlacementStatus}} impls should just override toString

[jira] [Commented] (HDFS-4273) Problem in DFSInputStream read retry logic may cause early failure

2013-09-30 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13782326#comment-13782326 ] Luke Lu commented on HDFS-4273: --- Looks like the patch has gone stale... > Problem in DFSInpu

[jira] [Commented] (HDFS-4885) Update verifyBlockPlacement() API in BlockPlacementPolicy

2013-09-30 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13782099#comment-13782099 ] Luke Lu commented on HDFS-4885: --- I think this API change is problematic for several reasons:

[jira] [Commented] (HDFS-5191) revisit zero-copy API in FSDataInputStream to make it more intuitive

2013-09-12 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13765705#comment-13765705 ] Luke Lu commented on HDFS-5191: --- The overhead of using varargs seems excessive (up to 30x tim

[jira] [Commented] (HDFS-4953) enable HDFS local reads via mmap

2013-09-10 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13763474#comment-13763474 ] Luke Lu commented on HDFS-4953: --- The external ByteBuffer "factory/cache/pool" idea is worth e

[jira] [Resolved] (HDFS-2268) Remove unused paranamer processing

2013-08-13 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Lu resolved HDFS-2268. --- Resolution: Fixed > Remove unused paranamer processing > -- > >

[jira] [Commented] (HDFS-5004) Add additional JMX bean for NameNode status data

2013-07-19 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13713520#comment-13713520 ] Luke Lu commented on HDFS-5004: --- You might want to change the stability to "Evolving" for the

[jira] [Resolved] (HDFS-4907) want to integrate oracle nosql to hadoop 1.0.3

2013-06-15 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Lu resolved HDFS-4907. --- Resolution: Invalid Please use the mailing list to ask integration questions. > want to integ

[jira] [Resolved] (HDFS-4665) Move TestNetworkTopologyWithNodeGroup to Common

2013-04-04 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Lu resolved HDFS-4665. --- Resolution: Fixed Fix Version/s: 3.0.0 +1. Committed to trunk. Thanks Junping! > Move

[jira] [Created] (HDFS-4665) Move TestNetworkTopologyWithNodeGroup to Common

2013-04-03 Thread Luke Lu (JIRA)
Luke Lu created HDFS-4665: - Summary: Move TestNetworkTopologyWithNodeGroup to Common Key: HDFS-4665 URL: https://issues.apache.org/jira/browse/HDFS-4665 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Commented] (HDFS-4652) Node with one topology layer should be handled as fault topology when NodeGroup layer is enabled

2013-04-01 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13619306#comment-13619306 ] Luke Lu commented on HDFS-4652: --- The patches lgtm. +1. Will commit shortly.

[jira] [Commented] (HDFS-4273) Problem in DFSInputStream read retry logic may cause early failure

2012-12-19 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13536839#comment-13536839 ] Luke Lu commented on HDFS-4273: --- HBase definitely uses the positional read API (at least sinc

[jira] [Created] (HDFS-4313) MiniDFSCluster throws NPE if umask is more permissive than 022

2012-12-14 Thread Luke Lu (JIRA)
Luke Lu created HDFS-4313: - Summary: MiniDFSCluster throws NPE if umask is more permissive than 022 Key: HDFS-4313 URL: https://issues.apache.org/jira/browse/HDFS-4313 Project: Hadoop HDFS Issue Typ

[jira] [Commented] (HDFS-4292) Sanity check not correct in RemoteBlockReader2.newBlockReader

2012-12-10 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13528114#comment-13528114 ] Luke Lu commented on HDFS-4292: --- Nice catch Binglin! +1. Todd do you want to take a look?

[jira] [Commented] (HDFS-3979) Fix hsync semantics

2012-11-09 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13494379#comment-13494379 ] Luke Lu commented on HDFS-3979: --- bq. So the test you're looking for is starting 3 DNs, and th

[jira] [Commented] (HDFS-3979) Fix hsync and hflush semantics.

2012-11-05 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13490887#comment-13490887 ] Luke Lu commented on HDFS-3979: --- bq. I think it will decrease the performance for non-sync wr

[jira] [Commented] (HDFS-3979) Fix hsync and hflush semantics.

2012-11-02 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13489609#comment-13489609 ] Luke Lu commented on HDFS-3979: --- The patch lgtm, even though it lacks tests for failure cases

[jira] [Commented] (HDFS-3979) Fix hsync and hflush semantics.

2012-10-04 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13469978#comment-13469978 ] Luke Lu commented on HDFS-3979: --- bq. Why API4 is needed for HBase? Many configuration manage

[jira] [Commented] (HDFS-3979) Fix hsync and hflush semantics.

2012-10-04 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13469725#comment-13469725 ] Luke Lu commented on HDFS-3979: --- bq. It should be eliminated with this patch. When there is w

[jira] [Commented] (HDFS-3979) Fix hsync and hflush semantics.

2012-10-04 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13469628#comment-13469628 ] Luke Lu commented on HDFS-3979: --- bq. You don't think the existing pipeline tests cover the fa

[jira] [Commented] (HDFS-3979) Fix hsync and hflush semantics.

2012-10-01 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13467292#comment-13467292 ] Luke Lu commented on HDFS-3979: --- bq. Do we want the change? I do think that the change is re

[jira] [Commented] (HDFS-3979) Fix hsync and hflush semantics.

2012-09-26 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13464402#comment-13464402 ] Luke Lu commented on HDFS-3979: --- TestHSync only tests the success code path, which makes me a

[jira] [Commented] (HDFS-744) Support hsync in HDFS

2012-09-25 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13462578#comment-13462578 ] Luke Lu commented on HDFS-744: -- I think that it's important enough to clarify: bq. When hsync

[jira] [Commented] (HDFS-1590) Decommissioning never ends when node to decommission has blocks that are under-replicated and cannot be replicated to the expected level of replication

2012-09-19 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13458926#comment-13458926 ] Luke Lu commented on HDFS-1590: --- This has become a FEI (Frequently Encountered Issue) for new

[jira] [Commented] (HDFS-3540) Further improvement on recovery mode and edit log toleration in branch-1

2012-08-30 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13444890#comment-13444890 ] Luke Lu commented on HDFS-3540: --- It seems to me that recovery mode and edit log toleration se

[jira] [Updated] (HDFS-3521) Allow namenode to tolerate edit log corruption

2012-07-11 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Lu updated HDFS-3521: -- Fix Version/s: (was: 1.1.0) > Allow namenode to tolerate edit log corruption > -

[jira] [Commented] (HDFS-3521) Allow namenode to tolerate edit log corruption

2012-07-11 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13412325#comment-13412325 ] Luke Lu commented on HDFS-3521: --- Is this targeted for 1.1? Looks like it's only in branch-1 a

[jira] [Updated] (HDFS-3521) Allow namenode to tolerate edit log corruption

2012-06-19 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Lu updated HDFS-3521: -- Fix Version/s: (was: 1.2.0) 1.1.0 > Allow namenode to tolerate edit log corruption >

[jira] [Resolved] (HDFS-1810) Remove duplicate jar entries from common

2011-08-19 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Lu resolved HDFS-1810. --- Resolution: Duplicate Fix Version/s: 0.23.0 This is now being done via mavenization. > Remove duplicat

[jira] [Created] (HDFS-2268) Remove unused paranamer processing

2011-08-17 Thread Luke Lu (JIRA)
Remove unused paranamer processing -- Key: HDFS-2268 URL: https://issues.apache.org/jira/browse/HDFS-2268 Project: Hadoop HDFS Issue Type: Improvement Affects Versions: 0.23.0 Reporter: Luke Lu

[jira] [Updated] (HDFS-1776) Bug in Concat code

2011-08-12 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Lu updated HDFS-1776: -- Resolution: Fixed Hadoop Flags: [Reviewed] Status: Resolved (was: Patch Available) > Bug in Con

[jira] [Commented] (HDFS-1922) Recurring failure in TestJMXGet.testNameNode since build 477 on May 11

2011-05-19 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13036326#comment-13036326 ] Luke Lu commented on HDFS-1922: --- The only difference between the new behavior and metrics v1

[jira] [Commented] (HDFS-1922) Recurring failure in TestJMXGet.testNameNode since build 477 on May 11

2011-05-18 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13035979#comment-13035979 ] Luke Lu commented on HDFS-1922: --- bq. This seems like an incompatible change. Yes. It's an in

[jira] [Commented] (HDFS-1922) Recurring failure in TestJMXGet.testNameNode since build 477 on May 11

2011-05-18 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13035978#comment-13035978 ] Luke Lu commented on HDFS-1922: --- If the properties file is missing, the metrics system would

[jira] [Updated] (HDFS-1922) Recurring failure in TestJMXGet.testNameNode since build 477 on May 11

2011-05-18 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Lu updated HDFS-1922: -- Attachment: hdfs-1922-conf-v1.patch Patch v1 to copy the metrics properties to test classpath. I thought the tes

[jira] [Updated] (HDFS-1922) Recurring failure in TestJMXGet.testNameNode since build 477 on May 11

2011-05-18 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Lu updated HDFS-1922: -- Status: Patch Available (was: Reopened) > Recurring failure in TestJMXGet.testNameNode since build 477 on May 1

[jira] [Assigned] (HDFS-1922) Recurring failure in TestJMXGet.testNameNode since build 477 on May 11

2011-05-18 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Lu reassigned HDFS-1922: - Assignee: Luke Lu > Recurring failure in TestJMXGet.testNameNode since build 477 on May 11 > -

[jira] [Commented] (HDFS-1922) Recurring failure in TestJMXGet.testNameNode since build 477 on May 11

2011-05-18 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13035588#comment-13035588 ] Luke Lu commented on HDFS-1922: --- bq. HDFS-1117 was committed but TestJMXGet is still failing;

[jira] [Resolved] (HDFS-1922) Recurring failure in TestJMXGet.testNameNode since build 477 on May 11

2011-05-16 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Lu resolved HDFS-1922. --- Resolution: Fixed Fix Version/s: 0.23.0 > Recurring failure in TestJMXGet.testNameNode since build 477

[jira] [Commented] (HDFS-1117) HDFS portion of HADOOP-6728 (ovehaul metrics framework)

2011-05-16 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13034166#comment-13034166 ] Luke Lu commented on HDFS-1117: --- The patch contains: {noformat} +System.out.println("SUR

[jira] [Commented] (HDFS-1917) Clean up duplication of dependent jar files

2011-05-12 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13032644#comment-13032644 ] Luke Lu commented on HDFS-1917: --- Though I understand the goal is to separate the hdfs only de

[jira] Commented: (HDFS-1758) Web UI JSP pages thread safety issue

2011-03-16 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13007617#comment-13007617 ] Luke Lu commented on HDFS-1758: --- bq. 3. Our new web framework makes this type errors impossib

[jira] Commented: (HDFS-1758) Web UI JSP pages thread safety issue

2011-03-15 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13007318#comment-13007318 ] Luke Lu commented on HDFS-1758: --- 1. Setting isThreadSafe=false will cause these JSPs to be co

[jira] Updated: (HDFS-1543) Reduce dev. cycle time by moving system testing artifacts from default build and push to maven for HDFS

2010-12-20 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Lu updated HDFS-1543: -- Attachment: hdfs-1543-trunk-v2.patch v2 patch only address the mvn-install refactor, as fi test issue can be wor

[jira] Commented: (HDFS-1543) Reduce dev. cycle time by moving system testing artifacts from default build and push to maven for HDFS

2010-12-20 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12973314#action_12973314 ] Luke Lu commented on HDFS-1543: --- Cos, see [my comment|https://issues.apache.org/jira/browse/H

[jira] Updated: (HDFS-1544) Ivy resolve force mode should be turned off by default

2010-12-17 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Lu updated HDFS-1544: -- Attachment: hdfs-1544-trunk-v2.patch v2 patch for "force-resolve". > Ivy resolve force mode should be turned o

[jira] Updated: (HDFS-1544) Ivy resolve force mode should be turned off by default

2010-12-17 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Lu updated HDFS-1544: -- Status: Patch Available (was: Open) > Ivy resolve force mode should be turned off by default >

[jira] Updated: (HDFS-1544) Ivy resolve force mode should be turned off by default

2010-12-17 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Lu updated HDFS-1544: -- Attachment: hdfs-1544-trunk-v1.patch > Ivy resolve force mode should be turned off by default >

[jira] Created: (HDFS-1544) Ivy resolve force mode should be turned off by default

2010-12-17 Thread Luke Lu (JIRA)
Ivy resolve force mode should be turned off by default -- Key: HDFS-1544 URL: https://issues.apache.org/jira/browse/HDFS-1544 Project: Hadoop HDFS Issue Type: Bug Reporter: Luke

[jira] Updated: (HDFS-1543) Remove fault injection artifacts from the default build and push to maven for HDFS

2010-12-17 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Lu updated HDFS-1543: -- Fix Version/s: 0.22.0 Status: Patch Available (was: Open) > Remove fault injection artifacts from th

[jira] Assigned: (HDFS-1543) Remove fault injection artifacts from the default build and push to maven for HDFS

2010-12-17 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Lu reassigned HDFS-1543: - Assignee: Luke Lu > Remove fault injection artifacts from the default build and push to maven for > HDFS

[jira] Updated: (HDFS-1543) Remove fault injection artifacts from the default build and push to maven for HDFS

2010-12-17 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Lu updated HDFS-1543: -- Attachment: hdfs-1543-trunk-v1.patch patch v1: * mvn-install no longer install si test artifacts * mvn-si-insta

[jira] Commented: (HDFS-1355) ant veryclean (clean-cache) doesn't clean enough

2010-09-02 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12905603#action_12905603 ] Luke Lu commented on HDFS-1355: --- Test patch results. Javadoc warning is unrelated to this chan

[jira] Updated: (HDFS-1355) ant veryclean (clean-cache) doesn't clean enough

2010-09-02 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Lu updated HDFS-1355: -- Status: Open (was: Patch Available) > ant veryclean (clean-cache) doesn't clean enough > --

[jira] Updated: (HDFS-1355) ant veryclean (clean-cache) doesn't clean enough

2010-09-02 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Lu updated HDFS-1355: -- Status: Patch Available (was: Open) Hudson's back. Give it a little nudge. > ant veryclean (clean-cache) doesn

[jira] Commented: (HDFS-1352) Fix jsvc.location

2010-08-26 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12902950#action_12902950 ] Luke Lu commented on HDFS-1352: --- Note, since the build failure is caused by an external change

[jira] Commented: (HDFS-1355) ant veryclean (clean-cache) doesn't clean enough

2010-08-25 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12902736#action_12902736 ] Luke Lu commented on HDFS-1355: --- Looks like without HDFS-1352, trunk wouldn't build and test p

[jira] Updated: (HDFS-1355) ant veryclean (clean-cache) doesn't clean enough

2010-08-25 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Lu updated HDFS-1355: -- Status: Patch Available (was: Open) > ant veryclean (clean-cache) doesn't clean enough > --

[jira] Updated: (HDFS-1355) ant veryclean (clean-cache) doesn't clean enough

2010-08-25 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Lu updated HDFS-1355: -- Attachment: hdfs-1355-trunk-v1.patch Verified on OS X Leopard and Linux (rhel5). > ant veryclean (clean-cache)

[jira] Created: (HDFS-1355) ant veryclean (clean-cache) doesn't clean enough

2010-08-25 Thread Luke Lu (JIRA)
ant veryclean (clean-cache) doesn't clean enough Key: HDFS-1355 URL: https://issues.apache.org/jira/browse/HDFS-1355 Project: Hadoop HDFS Issue Type: Bug Components: build Affect

[jira] Updated: (HDFS-1101) TestDiskError.testLocalDirs() fails

2010-06-11 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Lu updated HDFS-1101: -- Attachment: hdfs-1101-y20s-v1-d1.patch Somehow missed half of the fixes for the y20s patch. > TestDiskError.tes

[jira] Updated: (HDFS-1101) TestDiskError.testLocalDirs() fails

2010-06-04 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Lu updated HDFS-1101: -- Attachment: hdfs-1101-y20s-v1.patch TestDiskError would fail in testLocalDirs due to "incompatible namespaceIDs"

[jira] Created: (HDFS-1117) HDFS portion of HADOOP-6728 (ovehaul metrics framework)

2010-04-28 Thread Luke Lu (JIRA)
HDFS portion of HADOOP-6728 (ovehaul metrics framework) --- Key: HDFS-1117 URL: https://issues.apache.org/jira/browse/HDFS-1117 Project: Hadoop HDFS Issue Type: Improvement Affects Vers

[jira] Assigned: (HDFS-1117) HDFS portion of HADOOP-6728 (ovehaul metrics framework)

2010-04-28 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Lu reassigned HDFS-1117: - Assignee: Luke Lu > HDFS portion of HADOOP-6728 (ovehaul metrics framework) >

[jira] Updated: (HDFS-997) DataNode local directories should have narrow permissions

2010-03-29 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Lu updated HDFS-997: - Status: Patch Available (was: Open) > DataNode local directories should have narrow permissions >

[jira] Updated: (HDFS-997) DataNode local directories should have narrow permissions

2010-03-29 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Lu updated HDFS-997: - Status: Open (was: Patch Available) > DataNode local directories should have narrow permissions >

[jira] Assigned: (HDFS-997) DataNode local directories should have narrow permissions

2010-03-29 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Lu reassigned HDFS-997: Assignee: Luke Lu (was: Arun C Murthy) > DataNode local directories should have narrow permissions > ---

  1   2   >