[jira] [Updated] (HDFS-5481) Fix TestDataNodeVolumeFailure

2013-11-08 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-5481: - Attachment: HDFS-5481.patch Attach a quick patch and verify it fix the test failure of TestDataNodeVolume

[jira] [Created] (HDFS-5481) Fix TestDataNodeVolumeFailure

2013-11-08 Thread Junping Du (JIRA)
Junping Du created HDFS-5481: Summary: Fix TestDataNodeVolumeFailure Key: HDFS-5481 URL: https://issues.apache.org/jira/browse/HDFS-5481 Project: Hadoop HDFS Issue Type: Sub-task Affects Vers

[jira] [Commented] (HDFS-5480) Update Balancer for HDFS-2832

2013-11-08 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13817151#comment-13817151 ] Junping Du commented on HDFS-5480: -- Hi Nicholas, thanks for jira and patch. Do you think t

[jira] [Commented] (HDFS-5479) Fix test failures in Balancer.

2013-11-08 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13817108#comment-13817108 ] Junping Du commented on HDFS-5479: -- Looks like the root cause is simulated capacity is not

[jira] [Created] (HDFS-5479) Fix test failures in Balancer.

2013-11-07 Thread Junping Du (JIRA)
Junping Du created HDFS-5479: Summary: Fix test failures in Balancer. Key: HDFS-5479 URL: https://issues.apache.org/jira/browse/HDFS-5479 Project: Hadoop HDFS Issue Type: Sub-task Compo

[jira] [Commented] (HDFS-5439) Fix TestPendingReplication

2013-11-06 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13814688#comment-13814688 ] Junping Du commented on HDFS-5439: -- Thanks Arpit for explanation. Patch looks good to me.

[jira] [Commented] (HDFS-5439) Fix TestPendingReplication

2013-11-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13814587#comment-13814587 ] Junping Du commented on HDFS-5439: -- Hi Arpit, do you mean targets in PendingBlockInfo? I t

[jira] [Commented] (HDFS-5462) Fail to compile in Branch HDFS-2832 with COMPILATION ERROR

2013-11-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13813736#comment-13813736 ] Junping Du commented on HDFS-5462: -- Hi Wenwu, this should be some warnings instead of an e

[jira] [Commented] (HDFS-4901) Site Scripting and Phishing Through Frames in browseDirectory.jsp

2013-11-04 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13813708#comment-13813708 ] Junping Du commented on HDFS-4901: -- I think the answer is probably no. Basically, you shou

[jira] [Assigned] (HDFS-5439) Fix TestPendingReplication

2013-11-04 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du reassigned HDFS-5439: Assignee: Arpit Agarwal (was: Junping Du) > Fix TestPendingReplication > --

[jira] [Commented] (HDFS-5439) Fix TestPendingReplication

2013-11-04 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13813666#comment-13813666 ] Junping Du commented on HDFS-5439: -- Hi Arpit, please help to review the patch and integrat

[jira] [Updated] (HDFS-5439) Fix TestPendingReplication

2013-11-04 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-5439: - Attachment: HDFS-5439-demo1.patch Ok. In demo1 patch, fix following issues: 1. Using storageID instead of

[jira] [Commented] (HDFS-5439) Fix TestPendingReplication

2013-11-04 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13813639#comment-13813639 ] Junping Du commented on HDFS-5439: -- Ok. I have a patch to fix StorageReceivedDeletedBlocks

[jira] [Commented] (HDFS-5439) Fix TestPendingReplication

2013-11-04 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13813587#comment-13813587 ] Junping Du commented on HDFS-5439: -- Thanks Arpit for reply! Yes. BlockPlacementPolicyDefau

[jira] [Commented] (HDFS-5439) Fix TestPendingReplications

2013-11-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1385#comment-1385 ] Junping Du commented on HDFS-5439: -- The direct issue is need to set some thread sleep time

[jira] [Assigned] (HDFS-5439) Fix TestPendingReplications

2013-10-30 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du reassigned HDFS-5439: Assignee: Junping Du > Fix TestPendingReplications > --- > >

[jira] [Updated] (HDFS-2832) Enable support for heterogeneous storages in HDFS

2013-10-28 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-2832: - Attachment: h2832_20131028b.patch The Jenkins failed to run through result, rename the patch and submit it

[jira] [Commented] (HDFS-5435) File append fails to initialize storageIDs

2013-10-28 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13807153#comment-13807153 ] Junping Du commented on HDFS-5435: -- Thanks Arpit and Nicholas for quickly response and rev

[jira] [Commented] (HDFS-5435) Fix file append without setting storageIDs

2013-10-28 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13806923#comment-13806923 ] Junping Du commented on HDFS-5435: -- Verify it fix several failures in append related unit

[jira] [Updated] (HDFS-5435) Fix file append without setting storageIDs

2013-10-28 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-5435: - Attachment: HDFS-5435.patch > Fix file append without setting storageIDs > ---

[jira] [Created] (HDFS-5435) Fix file append without setting storageIDs

2013-10-28 Thread Junping Du (JIRA)
Junping Du created HDFS-5435: Summary: Fix file append without setting storageIDs Key: HDFS-5435 URL: https://issues.apache.org/jira/browse/HDFS-5435 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Commented] (HDFS-5417) Fix storage IDs in PBHelper and UpgradeUtilities

2013-10-25 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13805479#comment-13805479 ] Junping Du commented on HDFS-5417: -- +1. Patch looks good. > Fix storage IDs in PBHelper a

[jira] [Commented] (HDFS-5426) Fix NPE in PBHelper

2013-10-25 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13805477#comment-13805477 ] Junping Du commented on HDFS-5426: -- Ok. Let's mark it as duplicated. Thanks! > Fix NPE in

[jira] [Resolved] (HDFS-5426) Fix NPE in PBHelper

2013-10-25 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du resolved HDFS-5426. -- Resolution: Duplicate > Fix NPE in PBHelper > --- > > Key: HDFS-5426 >

[jira] [Commented] (HDFS-5426) Fix NPE in PBHelper

2013-10-25 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13805138#comment-13805138 ] Junping Du commented on HDFS-5426: -- Verify all failed tests in TestPBHelper are fixed by t

[jira] [Updated] (HDFS-5426) Fix NPE in PBHelper

2013-10-25 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-5426: - Attachment: HDFS-5426.patch > Fix NPE in PBHelper > --- > > Key: HDFS-5426

[jira] [Created] (HDFS-5426) Fix NPE in PBHelper

2013-10-25 Thread Junping Du (JIRA)
Junping Du created HDFS-5426: Summary: Fix NPE in PBHelper Key: HDFS-5426 URL: https://issues.apache.org/jira/browse/HDFS-5426 Project: Hadoop HDFS Issue Type: Sub-task Affects Versions: Hete

[jira] [Commented] (HDFS-4885) Update verifyBlockPlacement() API in BlockPlacementPolicy

2013-10-21 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13801342#comment-13801342 ] Junping Du commented on HDFS-4885: -- Thanks Nicholas for review and comments! Yes. it seems

[jira] [Commented] (HDFS-4885) Update verifyBlockPlacement() API in BlockPlacementPolicy

2013-10-21 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13801057#comment-13801057 ] Junping Du commented on HDFS-4885: -- Thanks Nicholas for review and re-launch jenkins tests

[jira] [Updated] (HDFS-4885) Update verifyBlockPlacement() API in BlockPlacementPolicy

2013-10-18 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-4885: - Attachment: HDFS-4885-v5.1.patch The jenkins result seems to be mismatch with local env and seems weird. R

[jira] [Commented] (HDFS-4885) Update verifyBlockPlacement() API in BlockPlacementPolicy

2013-10-18 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13799651#comment-13799651 ] Junping Du commented on HDFS-4885: -- Thanks Nicholas for carefully review. All comments her

[jira] [Updated] (HDFS-4885) Update verifyBlockPlacement() API in BlockPlacementPolicy

2013-10-18 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-4885: - Attachment: HDFS-4885-v5.patch > Update verifyBlockPlacement() API in BlockPlacementPolicy > -

[jira] [Updated] (HDFS-4885) Update verifyBlockPlacement() API in BlockPlacementPolicy

2013-10-18 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-4885: - Attachment: HDFS-4885-v4.patch Address above review comments in v4 patch. > Update verifyBlockPlacement()

[jira] [Commented] (HDFS-4376) Fix several race conditions in Balancer and resolve intermittent timeout of TestBalancerWithNodeGroup

2013-10-18 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13799402#comment-13799402 ] Junping Du commented on HDFS-4376: -- Hi [~sureshms], In our offline meet yesterday, you men

[jira] [Commented] (HDFS-4885) Update verifyBlockPlacement() API in BlockPlacementPolicy

2013-10-18 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13799381#comment-13799381 ] Junping Du commented on HDFS-4885: -- Sorry. the return value should be changed to BlockPlac

[jira] [Commented] (HDFS-4885) Update verifyBlockPlacement() API in BlockPlacementPolicy

2013-10-18 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13799358#comment-13799358 ] Junping Du commented on HDFS-4885: -- Thanks Luke and Nicholas for comments! bq. More detail

[jira] [Updated] (HDFS-4376) Fix several race conditions in Balancer and resolve intermittent timeout of TestBalancerWithNodeGroup

2013-10-16 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-4376: - Summary: Fix several race conditions in Balancer and resolve intermittent timeout of TestBalancerWithNode

[jira] [Commented] (HDFS-4376) Fix several race conditions in Balancer and resolve intermittent timeout of TestBalancerWithNodeGroup

2013-10-16 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13797464#comment-13797464 ] Junping Du commented on HDFS-4376: -- Thanks Nicholas, done! > Fix several race conditions

[jira] [Commented] (HDFS-4376) Intermittent timeout of TestBalancerWithNodeGroup

2013-10-16 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13797439#comment-13797439 ] Junping Du commented on HDFS-4376: -- Thanks Nicholas, I want to update title to be somethin

[jira] [Commented] (HDFS-4376) Intermittent timeout of TestBalancerWithNodeGroup

2013-10-16 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13797399#comment-13797399 ] Junping Du commented on HDFS-4376: -- Thanks Nicholas for review! :) > Intermittent timeout

[jira] [Commented] (HDFS-4376) Intermittent timeout of TestBalancerWithNodeGroup

2013-10-15 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13796438#comment-13796438 ] Junping Du commented on HDFS-4376: -- In v3 patch: - fix a bug involved in v2 patch - identi

[jira] [Updated] (HDFS-4376) Intermittent timeout of TestBalancerWithNodeGroup

2013-10-15 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-4376: - Status: Patch Available (was: Open) > Intermittent timeout of TestBalancerWithNodeGroup > ---

[jira] [Updated] (HDFS-4376) Intermittent timeout of TestBalancerWithNodeGroup

2013-10-15 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-4376: - Attachment: HDFS-4376-v3.patch > Intermittent timeout of TestBalancerWithNodeGroup > -

[jira] [Updated] (HDFS-4376) Intermittent timeout of TestBalancerWithNodeGroup

2013-10-11 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-4376: - Status: Open (was: Patch Available) > Intermittent timeout of TestBalancerWithNodeGroup > ---

[jira] [Commented] (HDFS-4376) Intermittent timeout of TestBalancerWithNodeGroup

2013-10-11 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13793229#comment-13793229 ] Junping Du commented on HDFS-4376: -- The new patch seems not work or involve new deadlock.

[jira] [Commented] (HDFS-4376) Intermittent timeout of TestBalancerWithNodeGroup

2013-10-11 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13793209#comment-13793209 ] Junping Du commented on HDFS-4376: -- Nice catch. Nicholas! Yes, We should make it private a

[jira] [Updated] (HDFS-4376) Intermittent timeout of TestBalancerWithNodeGroup

2013-10-11 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-4376: - Attachment: HDFS-4376-v2.patch > Intermittent timeout of TestBalancerWithNodeGroup > -

[jira] [Commented] (HDFS-5267) Remove volatile from LightWeightHashSet

2013-10-11 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13792502#comment-13792502 ] Junping Du commented on HDFS-5267: -- Thanks for review, Luke! :) > Remove volatile from Li

[jira] [Commented] (HDFS-4894) Multiple Replica Placement Policies support in one HDFS cluster

2013-10-10 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13792294#comment-13792294 ] Junping Du commented on HDFS-4894: -- One interesting feature in Google's Spanner is that ap

[jira] [Commented] (HDFS-4376) Intermittent timeout of TestBalancerWithNodeGroup

2013-10-09 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13790168#comment-13790168 ] Junping Du commented on HDFS-4376: -- Hi, can anyone help to review this? I guess we don't w

[jira] [Updated] (HDFS-5267) Modification field in LightWeightHashSet and LightWeightLinkedSet should't be volatile which cause wrong expectation on thread-safe visibility

2013-10-07 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-5267: - Priority: Minor (was: Major) > Modification field in LightWeightHashSet and LightWeightLinkedSet should't

[jira] [Commented] (HDFS-4376) Intermittent timeout of TestBalancerWithNodeGroup

2013-10-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13787204#comment-13787204 ] Junping Du commented on HDFS-4376: -- There is race condition in BalancerDatanode.incSchedul

[jira] [Updated] (HDFS-4376) Intermittent timeout of TestBalancerWithNodeGroup

2013-10-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-4376: - Priority: Major (was: Minor) > Intermittent timeout of TestBalancerWithNodeGroup > --

[jira] [Updated] (HDFS-4376) Intermittent timeout of TestBalancerWithNodeGroup

2013-10-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-4376: - Attachment: HDFS-4376-v1.patch Upload v1 patch and submit it. > Intermittent timeout of TestBalancerWithN

[jira] [Updated] (HDFS-4376) Intermittent timeout of TestBalancerWithNodeGroup

2013-10-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-4376: - Target Version/s: 1.3.0, 2.1.2-beta (was: 2.1.0-beta, 1.3.0) Status: Patch Available (was:

[jira] [Updated] (HDFS-4376) Intermittent timeout of TestBalancerWithNodeGroup

2013-10-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-4376: - Attachment: BalancerTest-HDFS-4376-v1.tar.gz Test 50 times iterations on TestBalancerWithNodeGroup, all is

[jira] [Updated] (HDFS-5267) Modification field in LightWeightHashSet and LightWeightLinkedSet should't be volatile which cause wrong expectation on thread-safe visibility

2013-10-04 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-5267: - Attachment: HDFS-5267.patch Rename the patch to the correct name HDFS-5267.patch > Modification field in

[jira] [Commented] (HDFS-5178) DataTransferProtocol changes for supporting mutiple storages per DN

2013-10-04 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13786169#comment-13786169 ] Junping Du commented on HDFS-5178: -- The test failure on TestDataTransferProtocol seems unr

[jira] [Commented] (HDFS-4885) Update verifyBlockPlacement() API in BlockPlacementPolicy

2013-10-02 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13783798#comment-13783798 ] Junping Du commented on HDFS-4885: -- Thanks Luke for review and suggestions. Hi [~szetszwo]

[jira] [Updated] (HDFS-4885) Update verifyBlockPlacement() API in BlockPlacementPolicy

2013-10-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-4885: - Attachment: HDFS-4885-v3.patch Address Luke's comments in v3 patch. > Update verifyBlockPlacement() API i

[jira] [Commented] (HDFS-4885) Update verifyBlockPlacement() API in BlockPlacementPolicy

2013-10-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13783528#comment-13783528 ] Junping Du commented on HDFS-4885: -- Thanks Luke for review and great comments! bq. I'd use

[jira] [Updated] (HDFS-4885) Update verifyBlockPlacement() API in BlockPlacementPolicy

2013-10-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-4885: - Target Version/s: 3.0.0, 2.1.2-beta (was: 3.0.0) Status: Patch Available (was: Open) Addre

[jira] [Updated] (HDFS-4885) Update verifyBlockPlacement() API in BlockPlacementPolicy

2013-10-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-4885: - Status: Open (was: Patch Available) > Update verifyBlockPlacement() API in BlockPlacementPolicy > ---

[jira] [Updated] (HDFS-4885) Update verifyBlockPlacement() API in BlockPlacementPolicy

2013-10-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-4885: - Attachment: HDFS-4885-v2.patch > Update verifyBlockPlacement() API in BlockPlacementPolicy > -

[jira] [Commented] (HDFS-4885) Update verifyBlockPlacement() API in BlockPlacementPolicy

2013-09-30 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13782414#comment-13782414 ] Junping Du commented on HDFS-4885: -- Thanks Luke for suggestion here. That's definitely muc

[jira] [Work started] (HDFS-5178) DataTransferProtocol changes for supporting mutiple storages per DN

2013-09-29 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-5178 started by Junping Du. > DataTransferProtocol changes for supporting mutiple storages per DN > --

[jira] [Updated] (HDFS-5178) DataTransferProtocol changes for supporting mutiple storages per DN

2013-09-29 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-5178: - Attachment: HDFS-5178-v2.patch Sync up after HDFS-4988 checked in and fix compile issues. Haven't be ready

[jira] [Commented] (HDFS-4988) Datanode must support all the volumes as individual storages

2013-09-26 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13779730#comment-13779730 ] Junping Du commented on HDFS-4988: -- Thanks Arpit for addressing comments in new patch. +1

[jira] [Commented] (HDFS-5267) Modification field in LightWeightHashSet and LightWeightLinkedSet should't be volatile which cause wrong expectation on thread-safe visibility

2013-09-26 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13779719#comment-13779719 ] Junping Du commented on HDFS-5267: -- Thanks Chris for confirmation. Already move to HDFS an

[jira] [Updated] (HDFS-5267) Modification field in LightWeightHashSet and LightWeightLinkedSet should't be volatile which cause wrong expectation on thread-safe visibility

2013-09-26 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-5267: - Attachment: HDFS-5276.patch > Modification field in LightWeightHashSet and LightWeightLinkedSet should

[jira] [Updated] (HDFS-5267) Modification field in LightWeightHashSet and LightWeightLinkedSet should't be volatile which cause wrong expectation on thread-safe visibility

2013-09-26 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-5267: - Summary: Modification field in LightWeightHashSet and LightWeightLinkedSet should't be volatile which caus

[jira] [Updated] (HDFS-5267) Modification field in LightWeightHashSet and LightWeightLinkedSet should't be volatile to get rid of wrong expectation on thread-safe visibility

2013-09-26 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-5267: - Summary: Modification field in LightWeightHashSet and LightWeightLinkedSet should't be volatile to get rid

[jira] [Moved] (HDFS-5267) LightWeightGSet's modification field should be volatile so that detect changes by other thread in iteration.

2013-09-26 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du moved HADOOP-9980 to HDFS-5267: -- Component/s: (was: util) Fix Version/s: (was: 2.3.0)

[jira] [Commented] (HDFS-5225) datanode keeps logging the same 'is no longer in the dataset' message over and over again

2013-09-26 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13778534#comment-13778534 ] Junping Du commented on HDFS-5225: -- Hi [~ozawa], thanks for the patch! Besides fixing test

[jira] [Commented] (HDFS-4988) Datanode must support all the volumes as individual storages

2013-09-25 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13778521#comment-13778521 ] Junping Du commented on HDFS-4988: -- Hi Arpit, as I just mentioned, the following new added

[jira] [Commented] (HDFS-4988) Datanode must support all the volumes as individual storages

2013-09-25 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13778478#comment-13778478 ] Junping Du commented on HDFS-4988: -- For Nicholas' above suggestions: bq. I suggest not to

[jira] [Commented] (HDFS-4988) Datanode must support all the volumes as individual storages

2013-09-25 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13778471#comment-13778471 ] Junping Du commented on HDFS-4988: -- Thanks for the patch. Arpit! I haven't finished my rev

[jira] [Commented] (HDFS-5208) Only clear network location cache on specific nodes if invalid NetworkTopology happens

2013-09-25 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13778257#comment-13778257 ] Junping Du commented on HDFS-5208: -- Thanks Colin for review the patch again. The Jenkins t

[jira] [Updated] (HDFS-5178) DataTransferProtocol changes for supporting mutiple storages per DN

2013-09-25 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-5178: - Attachment: HDFS-5178-v1.patch Attach the first patch to change writeBlock and transferBlock in DataTrans

[jira] [Commented] (HDFS-5222) Move block schedule information from DatanodeDescriptor to DatanodeStorageInfo

2013-09-25 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13777668#comment-13777668 ] Junping Du commented on HDFS-5222: -- Ok. Thanks Nicholas for confirmation. I agree it shoul

[jira] [Commented] (HDFS-5208) Only clear network location cache on specific nodes if invalid NetworkTopology happens

2013-09-24 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13777004#comment-13777004 ] Junping Du commented on HDFS-5208: -- Thanks Colin for review. v2 patch incorporate your com

[jira] [Updated] (HDFS-5208) Only clear network location cache on specific nodes if invalid NetworkTopology happens

2013-09-24 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-5208: - Attachment: HDFS-5208-v2.patch > Only clear network location cache on specific nodes if invalid > Net

[jira] [Commented] (HDFS-5222) Move block schedule information from DatanodeDescriptor to DatanodeStorageInfo

2013-09-24 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13776380#comment-13776380 ] Junping Du commented on HDFS-5222: -- Nicholas, Thanks for your reminder. I didn't think too

[jira] [Updated] (HDFS-4989) Balancer needs to consider storage type in balancing

2013-09-24 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-4989: - Description: Balancer needs to balance with in a storage tier. A couple of works: - add an option of stora

[jira] [Commented] (HDFS-4989) Balancer needs to consider storage type in balancing

2013-09-24 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13776307#comment-13776307 ] Junping Du commented on HDFS-4989: -- Hi [~szetszwo] and [~arpitagarwal], which way you pref

[jira] [Commented] (HDFS-5222) Move block schedule information from DatanodeDescriptor to DatanodeStorageInfo

2013-09-24 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13776291#comment-13776291 ] Junping Du commented on HDFS-5222: -- Thanks Nicholas for addressing these comments. The new

[jira] [Commented] (HDFS-5222) Move block schedule information from DatanodeDescriptor to DatanodeStorageInfo

2013-09-24 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13776104#comment-13776104 ] Junping Du commented on HDFS-5222: -- Hi Nicholas, Thanks for the patch. A couple of comment

[jira] [Commented] (HDFS-5208) Only clear network location cache on specific nodes if invalid NetworkTopology happens

2013-09-24 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13776086#comment-13776086 ] Junping Du commented on HDFS-5208: -- Hi Colin, I updated my new comments in HDFS-5237 and t

[jira] [Created] (HDFS-5254) Reconfigure DN's topology without restart DN

2013-09-24 Thread Junping Du (JIRA)
Junping Du created HDFS-5254: Summary: Reconfigure DN's topology without restart DN Key: HDFS-5254 URL: https://issues.apache.org/jira/browse/HDFS-5254 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-5254) Reconfigure DN's topology without restart DN

2013-09-24 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-5254: - Issue Type: New Feature (was: Bug) > Reconfigure DN's topology without restart DN > -

[jira] [Commented] (HDFS-5237) Get rid of nodes' registration names

2013-09-24 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13776071#comment-13776071 ] Junping Du commented on HDFS-5237: -- Hi Eli and Philip, I think another existing config DF

[jira] [Work started] (HDFS-4989) Balancer needs to consider storage type in balancing

2013-09-21 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-4989 started by Junping Du. > Balancer needs to consider storage type in balancing > > >

[jira] [Commented] (HDFS-4989) Balancer needs to consider storage type in balancing

2013-09-21 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13773982#comment-13773982 ] Junping Du commented on HDFS-4989: -- This jira need to add an API of getDatanodeStorageRepo

[jira] [Updated] (HDFS-5237) Get rid of nodes' registration names

2013-09-20 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-5237: - Assignee: (was: Junping Du) > Get rid of nodes' registration names > -

[jira] [Commented] (HDFS-5208) Only clear network location cache on specific nodes if invalid NetworkTopology happens

2013-09-20 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13773076#comment-13773076 ] Junping Du commented on HDFS-5208: -- Filed HDFS-5237 to track node registration name issue

[jira] [Updated] (HDFS-5237) Get rid of nodes' registration names

2013-09-20 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-5237: - Status: Open (was: Patch Available) > Get rid of nodes' registration names >

[jira] [Updated] (HDFS-5237) Get rid of nodes' registration names

2013-09-20 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-5237: - Status: Patch Available (was: Open) > Get rid of nodes' registration names >

[jira] [Updated] (HDFS-5237) Get rid of nodes' registration names

2013-09-20 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-5237: - Attachment: HDFS-5237.patch Upload the first patch. > Get rid of nodes' registration name

[jira] [Created] (HDFS-5237) Get rid of nodes' registration names

2013-09-20 Thread Junping Du (JIRA)
Junping Du created HDFS-5237: Summary: Get rid of nodes' registration names Key: HDFS-5237 URL: https://issues.apache.org/jira/browse/HDFS-5237 Project: Hadoop HDFS Issue Type: Bug Re

[jira] [Commented] (HDFS-5225) datanode keeps logging the same 'is no longer in the dataset' message over and over again

2013-09-19 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13771699#comment-13771699 ] Junping Du commented on HDFS-5225: -- Hi Tsuyoshi, I think this fix may also work as this is

<    3   4   5   6   7   8   9   10   11   12   >