[jira] [Updated] (HDFS-5486) Fix TestNameNodeMetrics

2013-11-08 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-5486: - Attachment: HDFS-5486-demo.patch Fix TestNameNodeMetrics --- Key:

[jira] [Commented] (HDFS-5486) Fix TestNameNodeMetrics

2013-11-08 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13817900#comment-13817900 ] Junping Du commented on HDFS-5486: -- Hi Arpit, as discussed in HDFS-5481, the left part of

[jira] [Created] (HDFS-5479) Fix test failures in Balancer.

2013-11-07 Thread Junping Du (JIRA)
Junping Du created HDFS-5479: Summary: Fix test failures in Balancer. Key: HDFS-5479 URL: https://issues.apache.org/jira/browse/HDFS-5479 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Commented] (HDFS-5439) Fix TestPendingReplication

2013-11-06 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13814688#comment-13814688 ] Junping Du commented on HDFS-5439: -- Thanks Arpit for explanation. Patch looks good to me.

[jira] [Commented] (HDFS-5462) Fail to compile in Branch HDFS-2832 with COMPILATION ERROR

2013-11-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13813736#comment-13813736 ] Junping Du commented on HDFS-5462: -- Hi Wenwu, this should be some warnings instead of an

[jira] [Commented] (HDFS-5439) Fix TestPendingReplication

2013-11-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13814587#comment-13814587 ] Junping Du commented on HDFS-5439: -- Hi Arpit, do you mean targets in PendingBlockInfo? I

[jira] [Commented] (HDFS-5439) Fix TestPendingReplication

2013-11-04 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13813587#comment-13813587 ] Junping Du commented on HDFS-5439: -- Thanks Arpit for reply! Yes.

[jira] [Commented] (HDFS-5439) Fix TestPendingReplication

2013-11-04 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13813639#comment-13813639 ] Junping Du commented on HDFS-5439: -- Ok. I have a patch to fix StorageReceivedDeletedBlocks

[jira] [Updated] (HDFS-5439) Fix TestPendingReplication

2013-11-04 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-5439: - Attachment: HDFS-5439-demo1.patch Ok. In demo1 patch, fix following issues: 1. Using storageID instead of

[jira] [Commented] (HDFS-5439) Fix TestPendingReplication

2013-11-04 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13813666#comment-13813666 ] Junping Du commented on HDFS-5439: -- Hi Arpit, please help to review the patch and

[jira] [Assigned] (HDFS-5439) Fix TestPendingReplication

2013-11-04 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du reassigned HDFS-5439: Assignee: Arpit Agarwal (was: Junping Du) Fix TestPendingReplication --

[jira] [Commented] (HDFS-4901) Site Scripting and Phishing Through Frames in browseDirectory.jsp

2013-11-04 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13813708#comment-13813708 ] Junping Du commented on HDFS-4901: -- I think the answer is probably no. Basically, you

[jira] [Commented] (HDFS-5439) Fix TestPendingReplications

2013-11-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=1385#comment-1385 ] Junping Du commented on HDFS-5439: -- The direct issue is need to set some thread sleep time

[jira] [Assigned] (HDFS-5439) Fix TestPendingReplications

2013-10-30 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du reassigned HDFS-5439: Assignee: Junping Du Fix TestPendingReplications ---

[jira] [Created] (HDFS-5435) Fix file append without setting storageIDs

2013-10-28 Thread Junping Du (JIRA)
Junping Du created HDFS-5435: Summary: Fix file append without setting storageIDs Key: HDFS-5435 URL: https://issues.apache.org/jira/browse/HDFS-5435 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Updated] (HDFS-5435) Fix file append without setting storageIDs

2013-10-28 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-5435: - Attachment: HDFS-5435.patch Fix file append without setting storageIDs

[jira] [Commented] (HDFS-5435) Fix file append without setting storageIDs

2013-10-28 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13806923#comment-13806923 ] Junping Du commented on HDFS-5435: -- Verify it fix several failures in append related unit

[jira] [Commented] (HDFS-5435) File append fails to initialize storageIDs

2013-10-28 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13807153#comment-13807153 ] Junping Du commented on HDFS-5435: -- Thanks Arpit and Nicholas for quickly response and

[jira] [Updated] (HDFS-2832) Enable support for heterogeneous storages in HDFS

2013-10-28 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-2832: - Attachment: h2832_20131028b.patch The Jenkins failed to run through result, rename the patch and submit

[jira] [Created] (HDFS-5426) Fix NPE in PBHelper

2013-10-25 Thread Junping Du (JIRA)
Junping Du created HDFS-5426: Summary: Fix NPE in PBHelper Key: HDFS-5426 URL: https://issues.apache.org/jira/browse/HDFS-5426 Project: Hadoop HDFS Issue Type: Sub-task Affects Versions:

[jira] [Updated] (HDFS-5426) Fix NPE in PBHelper

2013-10-25 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-5426: - Attachment: HDFS-5426.patch Fix NPE in PBHelper --- Key: HDFS-5426

[jira] [Commented] (HDFS-5426) Fix NPE in PBHelper

2013-10-25 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13805138#comment-13805138 ] Junping Du commented on HDFS-5426: -- Verify all failed tests in TestPBHelper are fixed by

[jira] [Commented] (HDFS-5426) Fix NPE in PBHelper

2013-10-25 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13805477#comment-13805477 ] Junping Du commented on HDFS-5426: -- Ok. Let's mark it as duplicated. Thanks! Fix NPE in

[jira] [Resolved] (HDFS-5426) Fix NPE in PBHelper

2013-10-25 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du resolved HDFS-5426. -- Resolution: Duplicate Fix NPE in PBHelper --- Key: HDFS-5426

[jira] [Commented] (HDFS-5417) Fix storage IDs in PBHelper and UpgradeUtilities

2013-10-25 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13805479#comment-13805479 ] Junping Du commented on HDFS-5417: -- +1. Patch looks good. Fix storage IDs in PBHelper

[jira] [Commented] (HDFS-4885) Update verifyBlockPlacement() API in BlockPlacementPolicy

2013-10-21 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13801057#comment-13801057 ] Junping Du commented on HDFS-4885: -- Thanks Nicholas for review and re-launch jenkins

[jira] [Commented] (HDFS-4885) Update verifyBlockPlacement() API in BlockPlacementPolicy

2013-10-21 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13801342#comment-13801342 ] Junping Du commented on HDFS-4885: -- Thanks Nicholas for review and comments! Yes. it seems

[jira] [Commented] (HDFS-4885) Update verifyBlockPlacement() API in BlockPlacementPolicy

2013-10-18 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13799358#comment-13799358 ] Junping Du commented on HDFS-4885: -- Thanks Luke and Nicholas for comments! bq. More

[jira] [Commented] (HDFS-4885) Update verifyBlockPlacement() API in BlockPlacementPolicy

2013-10-18 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13799381#comment-13799381 ] Junping Du commented on HDFS-4885: -- Sorry. the return value should be changed to

[jira] [Commented] (HDFS-4376) Fix several race conditions in Balancer and resolve intermittent timeout of TestBalancerWithNodeGroup

2013-10-18 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13799402#comment-13799402 ] Junping Du commented on HDFS-4376: -- Hi [~sureshms], In our offline meet yesterday, you

[jira] [Updated] (HDFS-4885) Update verifyBlockPlacement() API in BlockPlacementPolicy

2013-10-18 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-4885: - Attachment: HDFS-4885-v4.patch Address above review comments in v4 patch. Update verifyBlockPlacement()

[jira] [Commented] (HDFS-4885) Update verifyBlockPlacement() API in BlockPlacementPolicy

2013-10-18 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13799651#comment-13799651 ] Junping Du commented on HDFS-4885: -- Thanks Nicholas for carefully review. All comments

[jira] [Updated] (HDFS-4885) Update verifyBlockPlacement() API in BlockPlacementPolicy

2013-10-18 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-4885: - Attachment: HDFS-4885-v5.patch Update verifyBlockPlacement() API in BlockPlacementPolicy

[jira] [Updated] (HDFS-4885) Update verifyBlockPlacement() API in BlockPlacementPolicy

2013-10-18 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-4885: - Attachment: HDFS-4885-v5.1.patch The jenkins result seems to be mismatch with local env and seems weird.

[jira] [Commented] (HDFS-4376) Intermittent timeout of TestBalancerWithNodeGroup

2013-10-16 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13797399#comment-13797399 ] Junping Du commented on HDFS-4376: -- Thanks Nicholas for review! :) Intermittent timeout

[jira] [Commented] (HDFS-4376) Intermittent timeout of TestBalancerWithNodeGroup

2013-10-16 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13797439#comment-13797439 ] Junping Du commented on HDFS-4376: -- Thanks Nicholas, I want to update title to be

[jira] [Commented] (HDFS-4376) Fix several race conditions in Balancer and resolve intermittent timeout of TestBalancerWithNodeGroup

2013-10-16 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13797464#comment-13797464 ] Junping Du commented on HDFS-4376: -- Thanks Nicholas, done! Fix several race conditions

[jira] [Updated] (HDFS-4376) Fix several race conditions in Balancer and resolve intermittent timeout of TestBalancerWithNodeGroup

2013-10-16 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-4376: - Summary: Fix several race conditions in Balancer and resolve intermittent timeout of

[jira] [Updated] (HDFS-4376) Intermittent timeout of TestBalancerWithNodeGroup

2013-10-15 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-4376: - Status: Patch Available (was: Open) Intermittent timeout of TestBalancerWithNodeGroup

[jira] [Commented] (HDFS-4376) Intermittent timeout of TestBalancerWithNodeGroup

2013-10-15 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13796438#comment-13796438 ] Junping Du commented on HDFS-4376: -- In v3 patch: - fix a bug involved in v2 patch -

[jira] [Commented] (HDFS-5267) Remove volatile from LightWeightHashSet

2013-10-11 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13792502#comment-13792502 ] Junping Du commented on HDFS-5267: -- Thanks for review, Luke! :) Remove volatile from

[jira] [Updated] (HDFS-4376) Intermittent timeout of TestBalancerWithNodeGroup

2013-10-11 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-4376: - Attachment: HDFS-4376-v2.patch Intermittent timeout of TestBalancerWithNodeGroup

[jira] [Commented] (HDFS-4376) Intermittent timeout of TestBalancerWithNodeGroup

2013-10-11 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13793209#comment-13793209 ] Junping Du commented on HDFS-4376: -- Nice catch. Nicholas! Yes, We should make it private

[jira] [Commented] (HDFS-4376) Intermittent timeout of TestBalancerWithNodeGroup

2013-10-11 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13793229#comment-13793229 ] Junping Du commented on HDFS-4376: -- The new patch seems not work or involve new deadlock.

[jira] [Updated] (HDFS-4376) Intermittent timeout of TestBalancerWithNodeGroup

2013-10-11 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-4376: - Status: Open (was: Patch Available) Intermittent timeout of TestBalancerWithNodeGroup

[jira] [Commented] (HDFS-4894) Multiple Replica Placement Policies support in one HDFS cluster

2013-10-10 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13792294#comment-13792294 ] Junping Du commented on HDFS-4894: -- One interesting feature in Google's Spanner is that

[jira] [Commented] (HDFS-4376) Intermittent timeout of TestBalancerWithNodeGroup

2013-10-09 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13790168#comment-13790168 ] Junping Du commented on HDFS-4376: -- Hi, can anyone help to review this? I guess we don't

[jira] [Updated] (HDFS-5267) Modification field in LightWeightHashSet and LightWeightLinkedSet should't be volatile which cause wrong expectation on thread-safe visibility

2013-10-07 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-5267: - Priority: Minor (was: Major) Modification field in LightWeightHashSet and LightWeightLinkedSet should't

[jira] [Updated] (HDFS-4376) Intermittent timeout of TestBalancerWithNodeGroup

2013-10-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-4376: - Attachment: BalancerTest-HDFS-4376-v1.tar.gz Test 50 times iterations on TestBalancerWithNodeGroup, all

[jira] [Updated] (HDFS-4376) Intermittent timeout of TestBalancerWithNodeGroup

2013-10-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-4376: - Attachment: HDFS-4376-v1.patch Upload v1 patch and submit it. Intermittent timeout of

[jira] [Updated] (HDFS-4376) Intermittent timeout of TestBalancerWithNodeGroup

2013-10-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-4376: - Target Version/s: 1.3.0, 2.1.2-beta (was: 2.1.0-beta, 1.3.0) Status: Patch Available (was:

[jira] [Updated] (HDFS-4376) Intermittent timeout of TestBalancerWithNodeGroup

2013-10-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-4376: - Priority: Major (was: Minor) Intermittent timeout of TestBalancerWithNodeGroup

[jira] [Commented] (HDFS-4376) Intermittent timeout of TestBalancerWithNodeGroup

2013-10-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13787204#comment-13787204 ] Junping Du commented on HDFS-4376: -- There is race condition in

[jira] [Commented] (HDFS-5178) DataTransferProtocol changes for supporting mutiple storages per DN

2013-10-04 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13786169#comment-13786169 ] Junping Du commented on HDFS-5178: -- The test failure on TestDataTransferProtocol seems

[jira] [Updated] (HDFS-5267) Modification field in LightWeightHashSet and LightWeightLinkedSet should't be volatile which cause wrong expectation on thread-safe visibility

2013-10-04 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-5267: - Attachment: HDFS-5267.patch Rename the patch to the correct name HDFS-5267.patch Modification field in

[jira] [Commented] (HDFS-4885) Update verifyBlockPlacement() API in BlockPlacementPolicy

2013-10-02 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13783798#comment-13783798 ] Junping Du commented on HDFS-4885: -- Thanks Luke for review and suggestions. Hi [~szetszwo]

[jira] [Updated] (HDFS-4885) Update verifyBlockPlacement() API in BlockPlacementPolicy

2013-10-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-4885: - Attachment: HDFS-4885-v2.patch Update verifyBlockPlacement() API in BlockPlacementPolicy

[jira] [Updated] (HDFS-4885) Update verifyBlockPlacement() API in BlockPlacementPolicy

2013-10-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-4885: - Status: Open (was: Patch Available) Update verifyBlockPlacement() API in BlockPlacementPolicy

[jira] [Updated] (HDFS-4885) Update verifyBlockPlacement() API in BlockPlacementPolicy

2013-10-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-4885: - Target Version/s: 3.0.0, 2.1.2-beta (was: 3.0.0) Status: Patch Available (was: Open)

[jira] [Commented] (HDFS-4885) Update verifyBlockPlacement() API in BlockPlacementPolicy

2013-10-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13783528#comment-13783528 ] Junping Du commented on HDFS-4885: -- Thanks Luke for review and great comments! bq. I'd use

[jira] [Updated] (HDFS-4885) Update verifyBlockPlacement() API in BlockPlacementPolicy

2013-10-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-4885: - Attachment: HDFS-4885-v3.patch Address Luke's comments in v3 patch. Update verifyBlockPlacement() API

[jira] [Commented] (HDFS-4885) Update verifyBlockPlacement() API in BlockPlacementPolicy

2013-09-30 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13782414#comment-13782414 ] Junping Du commented on HDFS-4885: -- Thanks Luke for suggestion here. That's definitely

[jira] [Updated] (HDFS-5178) DataTransferProtocol changes for supporting mutiple storages per DN

2013-09-29 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-5178: - Attachment: HDFS-5178-v2.patch Sync up after HDFS-4988 checked in and fix compile issues. Haven't be

[jira] [Moved] (HDFS-5267) LightWeightGSet's modification field should be volatile so that detect changes by other thread in iteration.

2013-09-27 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du moved HADOOP-9980 to HDFS-5267: -- Component/s: (was: util) Fix Version/s: (was: 2.3.0)

[jira] [Updated] (HDFS-5267) Modification field in LightWeightHashSet and LightWeightLinkedSet should't be volatile to get rid of wrong expectation on thread-safe visibility

2013-09-27 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-5267: - Summary: Modification field in LightWeightHashSet and LightWeightLinkedSet should't be volatile to get

[jira] [Updated] (HDFS-5267) Modification field in LightWeightHashSet and LightWeightLinkedSet should't be volatile which cause wrong expectation on thread-safe visibility

2013-09-27 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-5267: - Summary: Modification field in LightWeightHashSet and LightWeightLinkedSet should't be volatile which

[jira] [Updated] (HDFS-5267) Modification field in LightWeightHashSet and LightWeightLinkedSet should't be volatile which cause wrong expectation on thread-safe visibility

2013-09-27 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-5267: - Attachment: HDFS-5276.patch Modification field in LightWeightHashSet and LightWeightLinkedSet

[jira] [Commented] (HDFS-5267) Modification field in LightWeightHashSet and LightWeightLinkedSet should't be volatile which cause wrong expectation on thread-safe visibility

2013-09-27 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13779719#comment-13779719 ] Junping Du commented on HDFS-5267: -- Thanks Chris for confirmation. Already move to HDFS

[jira] [Commented] (HDFS-4988) Datanode must support all the volumes as individual storages

2013-09-27 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13779730#comment-13779730 ] Junping Du commented on HDFS-4988: -- Thanks Arpit for addressing comments in new patch. +1

[jira] [Commented] (HDFS-4988) Datanode must support all the volumes as individual storages

2013-09-26 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13778521#comment-13778521 ] Junping Du commented on HDFS-4988: -- Hi Arpit, as I just mentioned, the following new added

[jira] [Commented] (HDFS-5225) datanode keeps logging the same 'is no longer in the dataset' message over and over again

2013-09-26 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13778534#comment-13778534 ] Junping Du commented on HDFS-5225: -- Hi [~ozawa], thanks for the patch! Besides fixing test

[jira] [Commented] (HDFS-5222) Move block schedule information from DatanodeDescriptor to DatanodeStorageInfo

2013-09-25 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13777668#comment-13777668 ] Junping Du commented on HDFS-5222: -- Ok. Thanks Nicholas for confirmation. I agree it

[jira] [Updated] (HDFS-5178) DataTransferProtocol changes for supporting mutiple storages per DN

2013-09-25 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-5178: - Attachment: HDFS-5178-v1.patch Attach the first patch to change writeBlock and transferBlock in

[jira] [Commented] (HDFS-5208) Only clear network location cache on specific nodes if invalid NetworkTopology happens

2013-09-25 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13778257#comment-13778257 ] Junping Du commented on HDFS-5208: -- Thanks Colin for review the patch again. The Jenkins

[jira] [Commented] (HDFS-4988) Datanode must support all the volumes as individual storages

2013-09-25 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13778471#comment-13778471 ] Junping Du commented on HDFS-4988: -- Thanks for the patch. Arpit! I haven't finished my

[jira] [Commented] (HDFS-4988) Datanode must support all the volumes as individual storages

2013-09-25 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13778478#comment-13778478 ] Junping Du commented on HDFS-4988: -- For Nicholas' above suggestions: bq. I suggest not to

[jira] [Commented] (HDFS-5237) Get rid of nodes' registration names

2013-09-24 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13776071#comment-13776071 ] Junping Du commented on HDFS-5237: -- Hi Eli and Philip, I think another existing config

[jira] [Updated] (HDFS-5254) Reconfigure DN's topology without restart DN

2013-09-24 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-5254: - Issue Type: New Feature (was: Bug) Reconfigure DN's topology without restart DN

[jira] [Created] (HDFS-5254) Reconfigure DN's topology without restart DN

2013-09-24 Thread Junping Du (JIRA)
Junping Du created HDFS-5254: Summary: Reconfigure DN's topology without restart DN Key: HDFS-5254 URL: https://issues.apache.org/jira/browse/HDFS-5254 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-5208) Only clear network location cache on specific nodes if invalid NetworkTopology happens

2013-09-24 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13776086#comment-13776086 ] Junping Du commented on HDFS-5208: -- Hi Colin, I updated my new comments in HDFS-5237 and

[jira] [Commented] (HDFS-5222) Move block schedule information from DatanodeDescriptor to DatanodeStorageInfo

2013-09-24 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13776104#comment-13776104 ] Junping Du commented on HDFS-5222: -- Hi Nicholas, Thanks for the patch. A couple of

[jira] [Commented] (HDFS-5222) Move block schedule information from DatanodeDescriptor to DatanodeStorageInfo

2013-09-24 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13776291#comment-13776291 ] Junping Du commented on HDFS-5222: -- Thanks Nicholas for addressing these comments. The new

[jira] [Commented] (HDFS-4989) Balancer needs to consider storage type in balancing

2013-09-24 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13776307#comment-13776307 ] Junping Du commented on HDFS-4989: -- Hi [~szetszwo] and [~arpitagarwal], which way you

[jira] [Updated] (HDFS-4989) Balancer needs to consider storage type in balancing

2013-09-24 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-4989: - Description: Balancer needs to balance with in a storage tier. A couple of works: - add an option of

[jira] [Commented] (HDFS-5222) Move block schedule information from DatanodeDescriptor to DatanodeStorageInfo

2013-09-24 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13776380#comment-13776380 ] Junping Du commented on HDFS-5222: -- Nicholas, Thanks for your reminder. I didn't think too

[jira] [Updated] (HDFS-5208) Only clear network location cache on specific nodes if invalid NetworkTopology happens

2013-09-24 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-5208: - Attachment: HDFS-5208-v2.patch Only clear network location cache on specific nodes if invalid

[jira] [Commented] (HDFS-5208) Only clear network location cache on specific nodes if invalid NetworkTopology happens

2013-09-24 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13777004#comment-13777004 ] Junping Du commented on HDFS-5208: -- Thanks Colin for review. v2 patch incorporate your

[jira] [Commented] (HDFS-4989) Balancer needs to consider storage type in balancing

2013-09-22 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13773982#comment-13773982 ] Junping Du commented on HDFS-4989: -- This jira need to add an API of

[jira] [Work started] (HDFS-4989) Balancer needs to consider storage type in balancing

2013-09-22 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-4989 started by Junping Du. Balancer needs to consider storage type in balancing

[jira] [Created] (HDFS-5237) Get rid of nodes' registration names

2013-09-20 Thread Junping Du (JIRA)
Junping Du created HDFS-5237: Summary: Get rid of nodes' registration names Key: HDFS-5237 URL: https://issues.apache.org/jira/browse/HDFS-5237 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-5237) Get rid of nodes' registration names

2013-09-20 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-5237: - Attachment: HDFS-5237.patch Upload the first patch. Get rid of nodes' registration

[jira] [Updated] (HDFS-5237) Get rid of nodes' registration names

2013-09-20 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-5237: - Status: Patch Available (was: Open) Get rid of nodes' registration names

[jira] [Updated] (HDFS-5237) Get rid of nodes' registration names

2013-09-20 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-5237: - Status: Open (was: Patch Available) Get rid of nodes' registration names

[jira] [Commented] (HDFS-5208) Only clear network location cache on specific nodes if invalid NetworkTopology happens

2013-09-20 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13773076#comment-13773076 ] Junping Du commented on HDFS-5208: -- Filed HDFS-5237 to track node registration name issue

[jira] [Updated] (HDFS-5237) Get rid of nodes' registration names

2013-09-20 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-5237: - Assignee: (was: Junping Du) Get rid of nodes' registration names

[jira] [Commented] (HDFS-5225) datanode keeps logging the same 'is no longer in the dataset' message over and over again

2013-09-19 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13771699#comment-13771699 ] Junping Du commented on HDFS-5225: -- Hi Tsuyoshi, I think this fix may also work as this is

[jira] [Commented] (HDFS-4990) Block placement for storage types

2013-09-18 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13770746#comment-13770746 ] Junping Du commented on HDFS-4990: -- +1. Patch looks good to me. Thanks for addressing my

[jira] [Commented] (HDFS-5208) Only clear network location cache on specific nodes if invalid NetworkTopology happens

2013-09-18 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13770910#comment-13770910 ] Junping Du commented on HDFS-5208: -- Hi Colin, I think you are right that DatanodeID is

[jira] [Assigned] (HDFS-5178) DataTransferProtocol changes for supporting mutiple storages per DN

2013-09-18 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du reassigned HDFS-5178: Assignee: Junping Du DataTransferProtocol changes for supporting mutiple storages per DN

[jira] [Commented] (HDFS-5178) DataTransferProtocol changes for supporting mutiple storages per DN

2013-09-18 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13771458#comment-13771458 ] Junping Du commented on HDFS-5178: -- Sure. Thanks for reminder. Arpit!

<    3   4   5   6   7   8   9   10   11   12   >