[
https://issues.apache.org/jira/browse/HDFS-15402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17129949#comment-17129949
]
Sean Chow commented on HDFS-15402:
--
My clients use webhdfs put file a lot. I think this issue is not
[
https://issues.apache.org/jira/browse/HDFS-15402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17129949#comment-17129949
]
Sean Chow edited comment on HDFS-15402 at 6/10/20, 2:01 AM:
My clients use
Sean Chow created HDFS-15402:
Summary: Requesting http jmx metrics leads to too much CLOSE-WAIT
on datanode
Key: HDFS-15402
URL: https://issues.apache.org/jira/browse/HDFS-15402
Project: Hadoop HDFS
[
https://issues.apache.org/jira/browse/HDFS-15390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17128236#comment-17128236
]
Sean Chow edited comment on HDFS-15390 at 6/8/20, 12:10 PM:
Hi [~hexiaoqiao]
[
https://issues.apache.org/jira/browse/HDFS-15390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17128236#comment-17128236
]
Sean Chow edited comment on HDFS-15390 at 6/8/20, 12:09 PM:
In fact, I've
[
https://issues.apache.org/jira/browse/HDFS-15390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17128236#comment-17128236
]
Sean Chow commented on HDFS-15390:
--
In fact, I've done some debug and the exception is thrown as below:
[
https://issues.apache.org/jira/browse/HDFS-15390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Chow updated HDFS-15390:
-
Component/s: (was: dfsclient)
> client fails forever when namenode ipaddr changed
>
[
https://issues.apache.org/jira/browse/HDFS-15390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17127515#comment-17127515
]
Sean Chow commented on HDFS-15390:
--
Hi [~ayushtkn] , I've tried written a unit test for this but it's
[
https://issues.apache.org/jira/browse/HDFS-15390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17126638#comment-17126638
]
Sean Chow edited comment on HDFS-15390 at 6/5/20, 2:57 PM:
---
It's easy to
[
https://issues.apache.org/jira/browse/HDFS-15390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17126837#comment-17126837
]
Sean Chow commented on HDFS-15390:
--
Patch attached.
Now we can see the exception is ignored when
[
https://issues.apache.org/jira/browse/HDFS-15390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Chow updated HDFS-15390:
-
Attachment: HDFS-15390.01.patch
> client fails forever when namenode ipaddr changed
>
[
https://issues.apache.org/jira/browse/HDFS-15390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Chow updated HDFS-15390:
-
Description:
For machine replacement, I replace my standby namenode with a new ipaddr and
keep the same
[
https://issues.apache.org/jira/browse/HDFS-15390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17126638#comment-17126638
]
Sean Chow commented on HDFS-15390:
--
There 's two way to fix this:
# When updateAddress is true, do not
[
https://issues.apache.org/jira/browse/HDFS-15390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Chow updated HDFS-15390:
-
Description:
For machine replacement, I replace my standby namenode with a new ipaddr and
keep the same
[
https://issues.apache.org/jira/browse/HDFS-15390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Chow updated HDFS-15390:
-
Description:
For machine replacement, I replace my standby namenode with a new ipaddr and
keep the same
Sean Chow created HDFS-15390:
Summary: client fails forever when namenode ipaddr changed
Key: HDFS-15390
URL: https://issues.apache.org/jira/browse/HDFS-15390
Project: Hadoop HDFS
Issue Type:
[
https://issues.apache.org/jira/browse/HDFS-15048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17082046#comment-17082046
]
Sean Chow commented on HDFS-15048:
--
Hi [~iwasakims] , thanks for this patch for resolving HDFS-14476 .
[
https://issues.apache.org/jira/browse/HDFS-14476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Chow updated HDFS-14476:
-
Fix Version/s: 2.10.1
> lock too long when fix inconsistent blocks between disk and in-memory
>
[
https://issues.apache.org/jira/browse/HDFS-14476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17082042#comment-17082042
]
Sean Chow edited comment on HDFS-14476 at 4/13/20, 4:25 AM:
Sorry for the
[
https://issues.apache.org/jira/browse/HDFS-14476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17082042#comment-17082042
]
Sean Chow commented on HDFS-14476:
--
I think this patch is safe for 3.3.0 as
[
https://issues.apache.org/jira/browse/HDFS-15048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Chow updated HDFS-15048:
-
Fix Version/s: 2.10.1
> Fix findbug in DirectoryScanner
> ---
>
>
[
https://issues.apache.org/jira/browse/HDFS-15048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Chow updated HDFS-15048:
-
Attachment: HDFS-15048-branch-2.10.002.patch
> Fix findbug in DirectoryScanner
>
[
https://issues.apache.org/jira/browse/HDFS-14476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17065398#comment-17065398
]
Sean Chow commented on HDFS-14476:
--
Hi [~weichiu], I can't see why it builds failed. Any chance to merge
[
https://issues.apache.org/jira/browse/HDFS-14476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17034391#comment-17034391
]
Sean Chow commented on HDFS-14476:
--
Hi [~weichiu] , what I can do to make it build pass.
thanks.
>
[
https://issues.apache.org/jira/browse/HDFS-14476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17017759#comment-17017759
]
Sean Chow commented on HDFS-14476:
--
Build failed:(
> lock too long when fix inconsistent blocks between
[
https://issues.apache.org/jira/browse/HDFS-14476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17014921#comment-17014921
]
Sean Chow commented on HDFS-14476:
--
Attach the patch for branch-2: HDFS-14476-branch-2.02.patch
This
[
https://issues.apache.org/jira/browse/HDFS-14476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Chow updated HDFS-14476:
-
Attachment: HDFS-14476-branch-2.02.patch
> lock too long when fix inconsistent blocks between disk and
[
https://issues.apache.org/jira/browse/HDFS-14476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17008662#comment-17008662
]
Sean Chow commented on HDFS-14476:
--
Hi [~weichiu], will you merge this to version 2.8.x and 2.9.x?
[
https://issues.apache.org/jira/browse/HDFS-14751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16920574#comment-16920574
]
Sean Chow edited comment on HDFS-14751 at 9/2/19 2:38 AM:
--
Hi [~leosun08] Shall
[
https://issues.apache.org/jira/browse/HDFS-14751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16920574#comment-16920574
]
Sean Chow commented on HDFS-14751:
--
Shall we just synchronize {{diffs}
{code:java}
void reconcile()
[
https://issues.apache.org/jira/browse/HDFS-14751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16912985#comment-16912985
]
Sean Chow edited comment on HDFS-14751 at 8/22/19 5:30 AM:
---
[~leosun08] Note
[
https://issues.apache.org/jira/browse/HDFS-14751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16912985#comment-16912985
]
Sean Chow edited comment on HDFS-14751 at 8/22/19 5:26 AM:
---
[~leosun08] Note
[
https://issues.apache.org/jira/browse/HDFS-14751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16912985#comment-16912985
]
Sean Chow commented on HDFS-14751:
--
Note that {{reconcile()}} will call {{scan()}} method that may take
[
https://issues.apache.org/jira/browse/HDFS-14476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16908781#comment-16908781
]
Sean Chow commented on HDFS-14476:
--
Hi [~jojochuang] , is that patch ok? And what's the next step to
[
https://issues.apache.org/jira/browse/HDFS-14476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Chow updated HDFS-14476:
-
Attachment: (was: HDFS-14476.01.patch)
> lock too long when fix inconsistent blocks between disk and
[
https://issues.apache.org/jira/browse/HDFS-14476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Chow updated HDFS-14476:
-
Attachment: (was: HDFS-14476-branch-2.01.patch)
> lock too long when fix inconsistent blocks between
[
https://issues.apache.org/jira/browse/HDFS-14476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Chow updated HDFS-14476:
-
Affects Version/s: 3.0.3
Attachment: HDFS-14476-branch-2.01.patch
[
https://issues.apache.org/jira/browse/HDFS-14476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16901864#comment-16901864
]
Sean Chow commented on HDFS-14476:
--
patch updated!
> lock too long when fix inconsistent blocks between
[
https://issues.apache.org/jira/browse/HDFS-14476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Chow updated HDFS-14476:
-
Attachment: HDFS-14476.01.patch
> lock too long when fix inconsistent blocks between disk and in-memory
[
https://issues.apache.org/jira/browse/HDFS-14476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Chow updated HDFS-14476:
-
Attachment: HDFS-14476-branch-2.01.patch
> lock too long when fix inconsistent blocks between disk and
[
https://issues.apache.org/jira/browse/HDFS-14476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16900255#comment-16900255
]
Sean Chow commented on HDFS-14476:
--
Thanks for reviewing. The already added patch works for
[
https://issues.apache.org/jira/browse/HDFS-14476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16900255#comment-16900255
]
Sean Chow edited comment on HDFS-14476 at 8/5/19 5:26 PM:
--
Thanks for reviewing.
[
https://issues.apache.org/jira/browse/HDFS-14536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16880466#comment-16880466
]
Sean Chow commented on HDFS-14536:
--
This patch remove {{ynchronized(dataset)}} from {{scan()}}, and it
[
https://issues.apache.org/jira/browse/HDFS-14536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Chow updated HDFS-14536:
-
Attachment: reconcile-with-removing-synchronized.png
> It's safe to remove synchronized from reconcile
[
https://issues.apache.org/jira/browse/HDFS-14536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Chow updated HDFS-14536:
-
Attachment: reconcile-with-synchronized.png
> It's safe to remove synchronized from reconcile scan
>
[
https://issues.apache.org/jira/browse/HDFS-14536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Chow updated HDFS-14536:
-
Description:
I found all my my request blocked in every 6 hours and use jstack to dump
threads:
[
https://issues.apache.org/jira/browse/HDFS-14536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Chow updated HDFS-14536:
-
Attachment: HDFS-14536.00.patch
> It's safe to remove synchronized from reconcile scan
>
[
https://issues.apache.org/jira/browse/HDFS-14476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16880426#comment-16880426
]
Sean Chow commented on HDFS-14476:
--
I've add a patch here to process inconsistent blocks in map with
[
https://issues.apache.org/jira/browse/HDFS-14476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Chow updated HDFS-14476:
-
Attachment: datanode-with-patch-14476.png
> lock too long when fix inconsistent blocks between disk and
[
https://issues.apache.org/jira/browse/HDFS-14476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Chow updated HDFS-14476:
-
Attachment: HDFS-14476.00.patch
> lock too long when fix inconsistent blocks between disk and in-memory
[
https://issues.apache.org/jira/browse/HDFS-14536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Chow updated HDFS-14536:
-
Description:
I found all my my request blocked in every 6hours and use jstack to dump
threads:
[
https://issues.apache.org/jira/browse/HDFS-14536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Chow updated HDFS-14536:
-
Description:
I found all my my request blocked in every 6 hours and use jstack to dump
threads:
[
https://issues.apache.org/jira/browse/HDFS-14476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Chow updated HDFS-14476:
-
Description:
When directoryScanner have the results of differences between disk and
in-memory blocks.
[
https://issues.apache.org/jira/browse/HDFS-14476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16854448#comment-16854448
]
Sean Chow commented on HDFS-14476:
--
[~jojochuang] I've found out why _every 6hours' scan will have about
Sean Chow created HDFS-14536:
Summary: It's safe to remove synchronized from reconcile scan
Key: HDFS-14536
URL: https://issues.apache.org/jira/browse/HDFS-14536
Project: Hadoop HDFS
Issue Type:
[
https://issues.apache.org/jira/browse/HDFS-14476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16835265#comment-16835265
]
Sean Chow commented on HDFS-14476:
--
[~jojochuang] I'm sure my disk status is ok. I have more than 60
[
https://issues.apache.org/jira/browse/HDFS-14476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Chow updated HDFS-14476:
-
Description:
When directoryScanner have the results of differences between disk and
in-memory blocks.
Sean Chow created HDFS-14476:
Summary: lock too long when fix inconsistent blocks between disk
and in-memory
Key: HDFS-14476
URL: https://issues.apache.org/jira/browse/HDFS-14476
Project: Hadoop HDFS
58 matches
Mail list logo
