[
https://issues.apache.org/jira/browse/HDFS-12142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16087565#comment-16087565
]
Kihwal Lee commented on HDFS-12142:
---
The following appears after the files is successfully closed. It
[
https://issues.apache.org/jira/browse/HDFS-12120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16087393#comment-16087393
]
Kihwal Lee commented on HDFS-12120:
---
It sounds fine conceptually
- The variable length block feature is
[
https://issues.apache.org/jira/browse/HDFS-5042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16084148#comment-16084148
]
Kihwal Lee commented on HDFS-5042:
--
bq. Here is the addendum patch to move fsync() out of lock.
It should
[
https://issues.apache.org/jira/browse/HDFS-5042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16082748#comment-16082748
]
Kihwal Lee commented on HDFS-5042:
--
We are seeing significant performance degradation in 2.8 with this
[
https://issues.apache.org/jira/browse/HDFS-11915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16080579#comment-16080579
]
Kihwal Lee commented on HDFS-11915:
---
The approach looks good.
> Sync rbw dir on the first hsync() to
[
https://issues.apache.org/jira/browse/HDFS-11915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kihwal Lee updated HDFS-11915:
--
Description:
As discussed in HDFS-5042, there is a chance to lose blocks on power failure if
rbw file
[
https://issues.apache.org/jira/browse/HDFS-12056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kihwal Lee moved HADOOP-14607 to HDFS-12056:
Affects Version/s: (was: 2.7.3)
2.7.3
[
https://issues.apache.org/jira/browse/HDFS-12008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16063658#comment-16063658
]
Kihwal Lee commented on HDFS-12008:
---
Test failures are not caused by the patch. {{TestFsDatasetImpl}}
[
https://issues.apache.org/jira/browse/HDFS-12040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kihwal Lee updated HDFS-12040:
--
Summary: TestFsDatasetImpl.testCleanShutdownOfVolume fails (was:
[
https://issues.apache.org/jira/browse/HDFS-12040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16063528#comment-16063528
]
Kihwal Lee commented on HDFS-12040:
---
I just ran it on trunk and it failed.
{noformat}
Running
[
https://issues.apache.org/jira/browse/HDFS-11589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kihwal Lee resolved HDFS-11589.
---
Resolution: Duplicate
> Unable to remove dead node after datanode decommission
>
[
https://issues.apache.org/jira/browse/HDFS-12004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16063279#comment-16063279
]
Kihwal Lee commented on HDFS-12004:
---
I thought it was fixed in HDFS-8950.
> Namenode UI continues to
[
https://issues.apache.org/jira/browse/HDFS-12008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kihwal Lee updated HDFS-12008:
--
Attachment: HDFS-12008.v2.trunk.patch
> Improve the available-space block placement policy
>
[
https://issues.apache.org/jira/browse/HDFS-12008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16061277#comment-16061277
]
Kihwal Lee commented on HDFS-12008:
---
branch-2 precommit failure. HADOOP-14146 is still causing problems.
[
https://issues.apache.org/jira/browse/HDFS-12008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kihwal Lee updated HDFS-12008:
--
Attachment: HDFS-12008.v2.branch-2.patch
HDFS-12008.v2.trunk.patch
Attaching new
[
https://issues.apache.org/jira/browse/HDFS-12008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16061156#comment-16061156
]
Kihwal Lee commented on HDFS-12008:
---
I changed the number of nodes from 20 (4 racks) to 100 (10 racks)
[
https://issues.apache.org/jira/browse/HDFS-12008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16060135#comment-16060135
]
Kihwal Lee commented on HDFS-12008:
---
2.8 actually seems fine. If I spread nodes evenly, I get the values
[
https://issues.apache.org/jira/browse/HDFS-12008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16060031#comment-16060031
]
Kihwal Lee commented on HDFS-12008:
---
Hmm. Trunk is doing what's expected. 1) choose a random node. So
[
https://issues.apache.org/jira/browse/HDFS-12008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16060016#comment-16060016
]
Kihwal Lee commented on HDFS-12008:
---
When you set the conf to balance the space all the time (1.0f), the
[
https://issues.apache.org/jira/browse/HDFS-12008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16059989#comment-16059989
]
Kihwal Lee commented on HDFS-12008:
---
This doesn't look right...
[
https://issues.apache.org/jira/browse/HDFS-12008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kihwal Lee updated HDFS-12008:
--
Status: Patch Available (was: Open)
> Improve the available-space block placement policy
>
[
https://issues.apache.org/jira/browse/HDFS-12008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kihwal Lee updated HDFS-12008:
--
Attachment: HDFS-12008.patch
> Improve the available-space block placement policy
>
Kihwal Lee created HDFS-12008:
-
Summary: Improve the available-space block placement policy
Key: HDFS-12008
URL: https://issues.apache.org/jira/browse/HDFS-12008
Project: Hadoop HDFS
Issue Type:
[
https://issues.apache.org/jira/browse/HDFS-12008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kihwal Lee reassigned HDFS-12008:
-
Assignee: Kihwal Lee
> Improve the available-space block placement policy
>
[
https://issues.apache.org/jira/browse/HDFS-11960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kihwal Lee updated HDFS-11960:
--
Resolution: Fixed
Hadoop Flags: Reviewed
Status: Resolved (was: Patch Available)
>
[
https://issues.apache.org/jira/browse/HDFS-11960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kihwal Lee updated HDFS-11960:
--
Fix Version/s: 2.8.2
3.0.0-alpha4
2.9.0
> Successfully closed
[
https://issues.apache.org/jira/browse/HDFS-11960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056111#comment-16056111
]
Kihwal Lee commented on HDFS-11960:
---
HDFS-9754 was needed for the test. Cherry-picked HDFS-9754 and this
[
https://issues.apache.org/jira/browse/HDFS-9754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kihwal Lee updated HDFS-9754:
-
Fix Version/s: 2.8.2
> Avoid unnecessary getBlockCollection calls in BlockManager
>
[
https://issues.apache.org/jira/browse/HDFS-9754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056107#comment-16056107
]
Kihwal Lee commented on HDFS-9754:
--
Cherry-picked to branch-2.8.
> Avoid unnecessary getBlockCollection
[
https://issues.apache.org/jira/browse/HDFS-11960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16055843#comment-16055843
]
Kihwal Lee commented on HDFS-11960:
---
Thanks for the review, Daryn. I've committed this to trunk and
[
https://issues.apache.org/jira/browse/HDFS-11960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kihwal Lee updated HDFS-11960:
--
Attachment: HDFS-11960-v2.branch-2.txt
The branch-2 patch is identical except for the name change from
[
https://issues.apache.org/jira/browse/HDFS-11960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kihwal Lee updated HDFS-11960:
--
Attachment: HDFS-11960-v2.trunk.txt
Added unit test.
> Successfully closed files can stay
[
https://issues.apache.org/jira/browse/HDFS-11742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16049905#comment-16049905
]
Kihwal Lee commented on HDFS-11742:
---
bq. But may be we want to understand more closely at the root cause
[
https://issues.apache.org/jira/browse/HDFS-11960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16045012#comment-16045012
]
Kihwal Lee commented on HDFS-11960:
---
All failed tests were fine when reran.
{noformat}
[
https://issues.apache.org/jira/browse/HDFS-11960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kihwal Lee updated HDFS-11960:
--
Attachment: HDFS-11960.patch
> Successfully closed files can stay under-replicated.
>
[
https://issues.apache.org/jira/browse/HDFS-11960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kihwal Lee updated HDFS-11960:
--
Status: Patch Available (was: Open)
> Successfully closed files can stay under-replicated.
>
[
https://issues.apache.org/jira/browse/HDFS-11960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16044775#comment-16044775
]
Kihwal Lee commented on HDFS-11960:
---
The simplest fix will be not letting {{addBlock()}} remove a
[
https://issues.apache.org/jira/browse/HDFS-11960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16044755#comment-16044755
]
Kihwal Lee commented on HDFS-11960:
---
Details of the step 6).
{{processIncrementalBlockReport()}} calls
[
https://issues.apache.org/jira/browse/HDFS-11960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kihwal Lee updated HDFS-11960:
--
Summary: Successfully closed files can stay under-replicated. (was:
Successfully closed file can stay
[
https://issues.apache.org/jira/browse/HDFS-11960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kihwal Lee reassigned HDFS-11960:
-
Assignee: Kihwal Lee
> Successfully closed file can stay under-replicated.
>
[
https://issues.apache.org/jira/browse/HDFS-11960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kihwal Lee moved HADOOP-14514 to HDFS-11960:
Target Version/s: 2.8.2 (was: 2.8.2)
Key: HDFS-11960
[
https://issues.apache.org/jira/browse/HDFS-11945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16044490#comment-16044490
]
Kihwal Lee commented on HDFS-11945:
---
Thanks, [~liuml07]!
> Internal lease recovery may not be retried
[
https://issues.apache.org/jira/browse/HDFS-11941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043165#comment-16043165
]
Kihwal Lee commented on HDFS-11941:
---
{{recoverLease}} is not necessarily an admin command. It can be
[
https://issues.apache.org/jira/browse/HDFS-11945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kihwal Lee updated HDFS-11945:
--
Attachment: HDFS-11945.trunk.v2.patch
HDFS-11945.branch-2.v2.patch
Attaching updated
[
https://issues.apache.org/jira/browse/HDFS-11945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16041535#comment-16041535
]
Kihwal Lee commented on HDFS-11945:
---
The failed tests all pass when I run them.
{noformat}
[
https://issues.apache.org/jira/browse/HDFS-11945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kihwal Lee updated HDFS-11945:
--
Attachment: HDFS-11945.trunk.patch
> Internal lease recovery may not be retried for a long time
>
[
https://issues.apache.org/jira/browse/HDFS-11945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kihwal Lee updated HDFS-11945:
--
Status: Patch Available (was: Open)
> Internal lease recovery may not be retried for a long time
>
[
https://issues.apache.org/jira/browse/HDFS-11945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kihwal Lee updated HDFS-11945:
--
Attachment: (was: HDFS-11945.trunk.patch)
> Internal lease recovery may not be retried for a long
[
https://issues.apache.org/jira/browse/HDFS-11945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kihwal Lee updated HDFS-11945:
--
Status: Open (was: Patch Available)
> Internal lease recovery may not be retried for a long time
>
[
https://issues.apache.org/jira/browse/HDFS-11945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kihwal Lee updated HDFS-11945:
--
Status: Patch Available (was: Open)
> Internal lease recovery may not be retried for a long time
>
[
https://issues.apache.org/jira/browse/HDFS-11945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kihwal Lee updated HDFS-11945:
--
Attachment: HDFS-11945.trunk.patch
> Internal lease recovery may not be retried for a long time
>
[
https://issues.apache.org/jira/browse/HDFS-11945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16040927#comment-16040927
]
Kihwal Lee edited comment on HDFS-11945 at 6/7/17 3:18 PM:
---
We could change the
[
https://issues.apache.org/jira/browse/HDFS-11945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kihwal Lee reassigned HDFS-11945:
-
Assignee: Kihwal Lee
> Internal lease recovery may not be retried for a long time
>
[
https://issues.apache.org/jira/browse/HDFS-11945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16040927#comment-16040927
]
Kihwal Lee commented on HDFS-11945:
---
We could change the namenode lease holder ID every hour. Normally
Kihwal Lee created HDFS-11945:
-
Summary: Internal lease recovery may not be retried for a long time
Key: HDFS-11945
URL: https://issues.apache.org/jira/browse/HDFS-11945
Project: Hadoop HDFS
[
https://issues.apache.org/jira/browse/HDFS-11797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16039647#comment-16039647
]
Kihwal Lee commented on HDFS-11797:
---
bq. The AIOOBE error was logged without stacktrace in NameNode for
[
https://issues.apache.org/jira/browse/HDFS-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kihwal Lee updated HDFS-10816:
--
Resolution: Fixed
Hadoop Flags: Reviewed
Fix Version/s: 2.8.2
[
https://issues.apache.org/jira/browse/HDFS-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16037486#comment-16037486
]
Kihwal Lee commented on HDFS-10816:
---
+1
> TestComputeInvalidateWork#testDatanodeReRegistration fails
[
https://issues.apache.org/jira/browse/HDFS-11742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16037072#comment-16037072
]
Kihwal Lee commented on HDFS-11742:
---
[
https://issues.apache.org/jira/browse/HDFS-11742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kihwal Lee updated HDFS-11742:
--
Attachment: balancer_fix.png
> Improve balancer usability after HDFS-8818
>
[
https://issues.apache.org/jira/browse/HDFS-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kihwal Lee updated HDFS-10816:
--
Attachment: HDFS-10816.002.patch
Reattaching the trunk patch.
>
[
https://issues.apache.org/jira/browse/HDFS-11856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kihwal Lee updated HDFS-11856:
--
Resolution: Fixed
Hadoop Flags: Reviewed
Fix Version/s: 2.7.4
Status: Resolved
[
https://issues.apache.org/jira/browse/HDFS-11856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16033758#comment-16033758
]
Kihwal Lee commented on HDFS-11856:
---
+1 for the branch-2.7 patch. I've just committed it.
> Ability to
[
https://issues.apache.org/jira/browse/HDFS-5042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kihwal Lee updated HDFS-5042:
-
Fix Version/s: 2.8.2
2.7.4
> Completed files lost after power failure
>
[
https://issues.apache.org/jira/browse/HDFS-5042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16033367#comment-16033367
]
Kihwal Lee commented on HDFS-5042:
--
The patches look good. Now the fix is in branch-2.8 and branch-2.7.
[
https://issues.apache.org/jira/browse/HDFS-11907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16033177#comment-16033177
]
Kihwal Lee commented on HDFS-11907:
---
The {{statfs()}} call is not expensive, but I agree that the
[
https://issues.apache.org/jira/browse/HDFS-11856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16033111#comment-16033111
]
Kihwal Lee commented on HDFS-11856:
---
branch-2/branch-2.8 precommit failure is being handled in
[
https://issues.apache.org/jira/browse/HDFS-11729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kihwal Lee reassigned HDFS-11729:
-
Assignee: Weiwei Yang
> Improve NNStorageRetentionManager failure handling.
>
[
https://issues.apache.org/jira/browse/HDFS-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16033058#comment-16033058
]
Kihwal Lee commented on HDFS-10816:
---
The patch needs to be revised. {{BlockManagerTestUtil}} no longer
[
https://issues.apache.org/jira/browse/HDFS-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kihwal Lee updated HDFS-10816:
--
Comment: was deleted
(was: +1)
> TestComputeInvalidateWork#testDatanodeReRegistration fails due to
[
https://issues.apache.org/jira/browse/HDFS-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16033048#comment-16033048
]
Kihwal Lee commented on HDFS-10816:
---
+1
> TestComputeInvalidateWork#testDatanodeReRegistration fails
[
https://issues.apache.org/jira/browse/HDFS-5042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16031646#comment-16031646
]
Kihwal Lee commented on HDFS-5042:
--
In the 2.8 patch,
{code}
+ * @param fileToSync the file to fsync
+
[
https://issues.apache.org/jira/browse/HDFS-11856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kihwal Lee updated HDFS-11856:
--
Fix Version/s: 2.8.2
2.9.0
> Ability to re-add Upgrading Nodes (remote) to pipeline
[
https://issues.apache.org/jira/browse/HDFS-11856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16031579#comment-16031579
]
Kihwal Lee commented on HDFS-11856:
---
+1 for the branch-2 patch. Need more time to look at the
[
https://issues.apache.org/jira/browse/HDFS-5042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kihwal Lee updated HDFS-5042:
-
Resolution: Fixed
Hadoop Flags: Reviewed
Fix Version/s: 3.0.0-alpha4
2.9.0
[
https://issues.apache.org/jira/browse/HDFS-5042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16031376#comment-16031376
]
Kihwal Lee commented on HDFS-5042:
--
+1 the trunk patch looks good. Also the branch-2 patch looks fine.
>
[
https://issues.apache.org/jira/browse/HDFS-5042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kihwal Lee updated HDFS-5042:
-
Summary: utuvjndvrcdtgddbdvj (was: Completed files lost after power
failure)
> utuvjndvrcdtgddbdvj
>
[
https://issues.apache.org/jira/browse/HDFS-5042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16029789#comment-16029789
]
Kihwal Lee commented on HDFS-5042:
--
+1 on the syncing rbw on the fisrt hsync(). But let's focus on the
[
https://issues.apache.org/jira/browse/HDFS-5042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16026424#comment-16026424
]
Kihwal Lee commented on HDFS-5042:
--
bq. +1 the latest patch looks good.
Hold on.
[
https://issues.apache.org/jira/browse/HDFS-5042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16026416#comment-16026416
]
Kihwal Lee commented on HDFS-5042:
--
+1 the latest patch looks good.
> Completed files lost after power
[
https://issues.apache.org/jira/browse/HDFS-11856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kihwal Lee updated HDFS-11856:
--
Attachment: HDFS-11856-02.branch-2.patch
Reattaching the branch-2 patch with a different name to kick
[
https://issues.apache.org/jira/browse/HDFS-11817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kihwal Lee updated HDFS-11817:
--
Attachment: HDFS-11817.v2.branch-2.8.patch
Attaching what's committed to 2.8 as reference. The
[
https://issues.apache.org/jira/browse/HDFS-11817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kihwal Lee updated HDFS-11817:
--
Resolution: Fixed
Hadoop Flags: Reviewed
Fix Version/s: 2.8.2
[
https://issues.apache.org/jira/browse/HDFS-11856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16025137#comment-16025137
]
Kihwal Lee commented on HDFS-11856:
---
Please provide patch for branch-2 and others.
> Ability to re-add
[
https://issues.apache.org/jira/browse/HDFS-11856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16025132#comment-16025132
]
Kihwal Lee commented on HDFS-11856:
---
+1 the patch looks good.
> Ability to re-add Upgrading Nodes
[
https://issues.apache.org/jira/browse/HDFS-11852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kihwal Lee resolved HDFS-11852.
---
Resolution: Duplicate
> Under-repicated block never completes because of failure in
>
[
https://issues.apache.org/jira/browse/HDFS-11852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16024860#comment-16024860
]
Kihwal Lee commented on HDFS-11852:
---
This issue happens because decommissioning replica is not
[
https://issues.apache.org/jira/browse/HDFS-5042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16023352#comment-16023352
]
Kihwal Lee commented on HDFS-5042:
--
Does it make sense to have {{FileIoProvider#sync()}} to call the new
[
https://issues.apache.org/jira/browse/HDFS-5042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16023307#comment-16023307
]
Kihwal Lee commented on HDFS-5042:
--
bq. Am I missing something here?
Sorry, did not look closely.
>
[
https://issues.apache.org/jira/browse/HDFS-5042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16023167#comment-16023167
]
Kihwal Lee commented on HDFS-5042:
--
{{fsync(File fileToSync)}} will leak file descriptors and other
[
https://issues.apache.org/jira/browse/HDFS-11817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kihwal Lee updated HDFS-11817:
--
Attachment: HDFS-11817.v2.trunk.patch
HDFS-11817.v2.branch-2.patch
> A faulty node can
[
https://issues.apache.org/jira/browse/HDFS-11817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16020252#comment-16020252
]
Kihwal Lee commented on HDFS-11817:
---
In trunk, there already is a logic to weed out null StorageInfo
[
https://issues.apache.org/jira/browse/HDFS-11817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16019886#comment-16019886
]
Kihwal Lee commented on HDFS-11817:
---
Two test failures are real.
{noformat}
[
https://issues.apache.org/jira/browse/HDFS-11817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kihwal Lee updated HDFS-11817:
--
Status: Patch Available (was: Open)
> A faulty node can cause a lease leak and NPE on accessing data
>
[
https://issues.apache.org/jira/browse/HDFS-11817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kihwal Lee updated HDFS-11817:
--
Attachment: HDFS-11817.branch-2.patch
I started the patch for branch-2.8 and branch-2. The trunk
[
https://issues.apache.org/jira/browse/HDFS-5042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16017461#comment-16017461
]
Kihwal Lee commented on HDFS-5042:
--
bq. It seems like Lucene has figured out how to fsync a directory in
[
https://issues.apache.org/jira/browse/HDFS-11817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16016420#comment-16016420
]
Kihwal Lee commented on HDFS-11817:
---
Hi, [~raviprak]. We've seen what you described above. It is not
[
https://issues.apache.org/jira/browse/HDFS-11817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16014703#comment-16014703
]
Kihwal Lee edited comment on HDFS-11817 at 5/18/17 8:24 PM:
*Details of the
[
https://issues.apache.org/jira/browse/HDFS-11817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kihwal Lee updated HDFS-11817:
--
Attachment: hdfs-11817_supplement.txt
Attaching supplemental information including stack traces.
> A
[
https://issues.apache.org/jira/browse/HDFS-11817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16014712#comment-16014712
]
Kihwal Lee commented on HDFS-11817:
---
*Summary:*
The observation of the incident resulted in discovery
501 - 600 of 3718 matches
Mail list logo
