Janus Chow created HDFS-17084:
-
Summary: Utilize StringTable for numerable XAttributes
Key: HDFS-17084
URL: https://issues.apache.org/jira/browse/HDFS-17084
Project: Hadoop HDFS
Issue Type: Task
[
https://issues.apache.org/jira/browse/HDFS-17079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Janus Chow resolved HDFS-17079.
---
Resolution: Won't Fix
Found out it's not a bug, the presence of the record indicates true, no need
Janus Chow created HDFS-17079:
-
Summary: Fix inccorect Boolean extraction in
OfflineImageReconstructor
Key: HDFS-17079
URL: https://issues.apache.org/jira/browse/HDFS-17079
Project: Hadoop HDFS
[
https://issues.apache.org/jira/browse/HDFS-16313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Janus Chow resolved HDFS-16313.
---
Resolution: Fixed
> RBF: Add metrics for each sub cluster
> -
>
[
https://issues.apache.org/jira/browse/HDFS-16367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17452230#comment-17452230
]
Janus Chow commented on HDFS-16367:
---
[~ferhui] [~hexiaoqiao] [~tasanuma] Could you help to check the
Janus Chow created HDFS-16367:
-
Summary: Out-sync of socket config between client and DataNode
Key: HDFS-16367
URL: https://issues.apache.org/jira/browse/HDFS-16367
Project: Hadoop HDFS
Issue
Janus Chow created HDFS-16348:
-
Summary: Mark slownode as badnode to recover pipeline
Key: HDFS-16348
URL: https://issues.apache.org/jira/browse/HDFS-16348
Project: Hadoop HDFS
Issue Type:
[
https://issues.apache.org/jira/browse/HDFS-16320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17443351#comment-17443351
]
Janus Chow edited comment on HDFS-16320 at 11/14/21, 2:13 PM:
--
[~hexiaoqiao]
[
https://issues.apache.org/jira/browse/HDFS-16320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17443351#comment-17443351
]
Janus Chow commented on HDFS-16320:
---
{quote}I mean that DataNode has the total information to decide if
[
https://issues.apache.org/jira/browse/HDFS-16320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17443276#comment-17443276
]
Janus Chow commented on HDFS-16320:
---
[~hexiaoqiao] Thank you for the review.
The issue we met is we
[
https://issues.apache.org/jira/browse/HDFS-16320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17443276#comment-17443276
]
Janus Chow edited comment on HDFS-16320 at 11/14/21, 9:41 AM:
--
[~hexiaoqiao]
Janus Chow created HDFS-16320:
-
Summary: Datanode retrieve slownode information from NameNode
Key: HDFS-16320
URL: https://issues.apache.org/jira/browse/HDFS-16320
Project: Hadoop HDFS
Issue
Janus Chow created HDFS-16313:
-
Summary: RBF: Add metrics for each sub cluster
Key: HDFS-16313
URL: https://issues.apache.org/jira/browse/HDFS-16313
Project: Hadoop HDFS
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/HDFS-16313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Janus Chow updated HDFS-16313:
--
Description:
Currently we have metrics to track the operations for Router to all
nameservices, like
Janus Chow created HDFS-16302:
-
Summary: RBF: RouterRpcFairnessPolicyController record requests
handled by each nameservice
Key: HDFS-16302
URL: https://issues.apache.org/jira/browse/HDFS-16302
Project:
Janus Chow created HDFS-16296:
-
Summary: RBF: RouterRpcFairnessPolicyController add denied permits
for each nameservice
Key: HDFS-16296
URL: https://issues.apache.org/jira/browse/HDFS-16296
Project:
[
https://issues.apache.org/jira/browse/HDFS-16275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17433687#comment-17433687
]
Janus Chow commented on HDFS-16275:
---
[~ayushtkn] Thank you for your quick explanation.
In fact, I was
[
https://issues.apache.org/jira/browse/HDFS-16275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17433671#comment-17433671
]
Janus Chow commented on HDFS-16275:
---
[~ayushtkn] Thanks for the comment.
I think we do like to have
Janus Chow created HDFS-16275:
-
Summary: [HDFS] Enable considerLoad for localWrite
Key: HDFS-16275
URL: https://issues.apache.org/jira/browse/HDFS-16275
Project: Hadoop HDFS
Issue Type:
[
https://issues.apache.org/jira/browse/HDFS-13821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17424499#comment-17424499
]
Janus Chow edited comment on HDFS-13821 at 10/6/21, 7:58 AM:
-
The performance
Janus Chow created HDFS-16257:
-
Summary: [HDFS] [RBF] Guava cache performance issue in Router
MountTableResolver
Key: HDFS-16257
URL: https://issues.apache.org/jira/browse/HDFS-16257
Project: Hadoop HDFS
[
https://issues.apache.org/jira/browse/HDFS-13821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17424818#comment-17424818
]
Janus Chow commented on HDFS-13821:
---
Thanks [~elgoiri] for the comment.
{quote}Can you post a PR
[
https://issues.apache.org/jira/browse/HDFS-13821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17424511#comment-17424511
]
Janus Chow commented on HDFS-13821:
---
A comparison of the LocalCacheTest result on local PC would be as
[
https://issues.apache.org/jira/browse/HDFS-13821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17424499#comment-17424499
]
Janus Chow commented on HDFS-13821:
---
The performance bottleneck should be related to the bug mentioned
Janus Chow created HDFS-16221:
-
Summary: RBF: Add usage of refreshCallQueue for Router
Key: HDFS-16221
URL: https://issues.apache.org/jira/browse/HDFS-16221
Project: Hadoop HDFS
Issue Type:
[
https://issues.apache.org/jira/browse/HDFS-16210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17412919#comment-17412919
]
Janus Chow commented on HDFS-16210:
---
[~ferhui] Thanks for the help.
Do I need to create a new ticket to
[
https://issues.apache.org/jira/browse/HDFS-16210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Janus Chow updated HDFS-16210:
--
Summary: RBF: Add the option of refreshCallQueue to RouterAdmin (was: Add
the option of
[
https://issues.apache.org/jira/browse/HDFS-15669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17409398#comment-17409398
]
Janus Chow commented on HDFS-15669:
---
[~ayushtkn] Thanks for the check of this ticket.
It's been quite
Janus Chow created HDFS-16210:
-
Summary: Add the option of refreshCallQueue to RouterAdmin
Key: HDFS-16210
URL: https://issues.apache.org/jira/browse/HDFS-16210
Project: Hadoop HDFS
Issue Type:
Janus Chow created HDFS-16065:
-
Summary: Add metrics to record Router's operations
Key: HDFS-16065
URL: https://issues.apache.org/jira/browse/HDFS-16065
Project: Hadoop HDFS
Issue Type:
Janus Chow created HDFS-15801:
-
Summary: Backport HDFS-14582 to branch-2.10 (Failed to start DN
with ArithmeticException when NULL checksum used)
Key: HDFS-15801
URL: https://issues.apache.org/jira/browse/HDFS-15801
[
https://issues.apache.org/jira/browse/HDFS-15768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17261182#comment-17261182
]
Janus Chow commented on HDFS-15768:
---
Can try to use
[
https://issues.apache.org/jira/browse/HDFS-15768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17261159#comment-17261159
]
Janus Chow commented on HDFS-15768:
---
I think you are raising this ticket because the performance is
[
https://issues.apache.org/jira/browse/HDFS-15768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17261091#comment-17261091
]
Janus Chow commented on HDFS-15768:
---
The default DataNode heartbeat interval is 3s, if the IBR interval
[
https://issues.apache.org/jira/browse/HDFS-15738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17252536#comment-17252536
]
Janus Chow commented on HDFS-15738:
---
Sure and thanks for the reply.
> Forbid the transition to
[
https://issues.apache.org/jira/browse/HDFS-15738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17252422#comment-17252422
]
Janus Chow commented on HDFS-15738:
---
[~ayushtkn] Thanks for the reply. We tried to solve this issue by
[
https://issues.apache.org/jira/browse/HDFS-15738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Janus Chow updated HDFS-15738:
--
Attachment: HDFS-15738.001.patch
Assignee: Janus Chow
Status: Patch Available (was:
Janus Chow created HDFS-15738:
-
Summary: Forbid the transition to Observer state when NameNode is
in StartupSafeMode
Key: HDFS-15738
URL: https://issues.apache.org/jira/browse/HDFS-15738
Project: Hadoop
[
https://issues.apache.org/jira/browse/HDFS-15669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Janus Chow updated HDFS-15669:
--
Description:
In the method of Quota#getQuotaUsage, the result could be different on
different
Janus Chow created HDFS-15669:
-
Summary: [HDFS] [RBF] Incorrect GetQuota caused by different
implementation of HashSet
Key: HDFS-15669
URL: https://issues.apache.org/jira/browse/HDFS-15669
Project:
[
https://issues.apache.org/jira/browse/HDFS-15616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Janus Chow updated HDFS-15616:
--
Attachment: HDFS-15616.003.patch
> Disable Observer NameNode to trigger edit log roll
>
[
https://issues.apache.org/jira/browse/HDFS-15616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Janus Chow updated HDFS-15616:
--
Summary: Disable Observer NameNode to trigger edit log roll (was: [SBN]
Disable Observers to trigger
[
https://issues.apache.org/jira/browse/HDFS-15616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17218211#comment-17218211
]
Janus Chow commented on HDFS-15616:
---
Updated a new patch with unit tests.
> [SBN] Disable Observers to
[
https://issues.apache.org/jira/browse/HDFS-15616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Janus Chow updated HDFS-15616:
--
Attachment: HDFS-15616.002.patch
> [SBN] Disable Observers to trigger edit log roll
>
[
https://issues.apache.org/jira/browse/HDFS-15616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Janus Chow updated HDFS-15616:
--
Summary: [SBN] Disable Observers to trigger edit log roll (was: [SBN]
Disable trigger edit Log Roll
[
https://issues.apache.org/jira/browse/HDFS-15616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Janus Chow updated HDFS-15616:
--
Summary: [SBN] Disable trigger edit Log Roll from Observers (was: [SBN]
Disable trigger edit Log Roll
[
https://issues.apache.org/jira/browse/HDFS-15616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17209953#comment-17209953
]
Janus Chow commented on HDFS-15616:
---
Hi, [~csun] , noticed you made a similar patch for Observer to
[
https://issues.apache.org/jira/browse/HDFS-15616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Janus Chow updated HDFS-15616:
--
Component/s: hdfs
> [SBN] Disable trigger edit Log Roll for Observers
>
[
https://issues.apache.org/jira/browse/HDFS-15616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Janus Chow updated HDFS-15616:
--
Description:
Currently when Observer is transitioned from StandbyState, the editLogTailer
will still
[
https://issues.apache.org/jira/browse/HDFS-15616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17209361#comment-17209361
]
Janus Chow commented on HDFS-15616:
---
Updated a patch to disable edit log roll for Observers.
> [SBN]
[
https://issues.apache.org/jira/browse/HDFS-15616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Janus Chow updated HDFS-15616:
--
Attachment: HDFS-15616.001.patch
> [SBN] Disable trigger edit Log Roll for Observers
>
Janus Chow created HDFS-15616:
-
Summary: [SBN] Disable trigger edit Log Roll for Observers
Key: HDFS-15616
URL: https://issues.apache.org/jira/browse/HDFS-15616
Project: Hadoop HDFS
Issue Type:
[
https://issues.apache.org/jira/browse/HDFS-15579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17198847#comment-17198847
]
Janus Chow commented on HDFS-15579:
---
[~elgoiri] [~ayushtkn] Thanks for the review.
> RBF: The
[
https://issues.apache.org/jira/browse/HDFS-15579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17198754#comment-17198754
]
Janus Chow commented on HDFS-15579:
---
Another random failed unit test, should I create a new patch to
[
https://issues.apache.org/jira/browse/HDFS-15579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Janus Chow updated HDFS-15579:
--
Attachment: HDFS-15579-005.patch
> RBF: The constructor of PathLocation may got some misunderstanding
[
https://issues.apache.org/jira/browse/HDFS-15579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Janus Chow updated HDFS-15579:
--
Attachment: HDFS-15579-004.patch
> RBF: The constructor of PathLocation may got some misunderstanding
[
https://issues.apache.org/jira/browse/HDFS-15579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17198696#comment-17198696
]
Janus Chow commented on HDFS-15579:
---
Got it, resolved the checkstyle issues and added a test in
[
https://issues.apache.org/jira/browse/HDFS-15579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17198406#comment-17198406
]
Janus Chow edited comment on HDFS-15579 at 9/18/20, 3:33 PM:
-
There was no
[
https://issues.apache.org/jira/browse/HDFS-15579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17198406#comment-17198406
]
Janus Chow commented on HDFS-15579:
---
There was no tests for the class of PathLocation. Is it necessary
[
https://issues.apache.org/jira/browse/HDFS-15579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Janus Chow updated HDFS-15579:
--
Attachment: HDFS-15579-003.patch
> RBF: The constructor of PathLocation may got some misunderstanding
[
https://issues.apache.org/jira/browse/HDFS-15579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17198266#comment-17198266
]
Janus Chow commented on HDFS-15579:
---
Thanks a lot, copied from v1.
> RBF: The constructor of
[
https://issues.apache.org/jira/browse/HDFS-15579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17198152#comment-17198152
]
Janus Chow edited comment on HDFS-15579 at 9/18/20, 8:01 AM:
-
-Checked the QA
[
https://issues.apache.org/jira/browse/HDFS-15579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17198152#comment-17198152
]
Janus Chow edited comment on HDFS-15579 at 9/18/20, 7:03 AM:
-
-Checked the QA
[
https://issues.apache.org/jira/browse/HDFS-15579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17198152#comment-17198152
]
Janus Chow commented on HDFS-15579:
---
Checked the QA result was not be related to this patch.
> RBF:
[
https://issues.apache.org/jira/browse/HDFS-15579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Janus Chow updated HDFS-15579:
--
Attachment: HDFS-15579-002.patch
> RBF: The constructor of PathLocation may got some misunderstanding
[
https://issues.apache.org/jira/browse/HDFS-15579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17198072#comment-17198072
]
Janus Chow commented on HDFS-15579:
---
Updated the static function version [^HDFS-15579-002.patch],
[
https://issues.apache.org/jira/browse/HDFS-15579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17197354#comment-17197354
]
Janus Chow commented on HDFS-15579:
---
Uploaded the patch, please have a check.
> RBF: The constructor
[
https://issues.apache.org/jira/browse/HDFS-15579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Janus Chow updated HDFS-15579:
--
Attachment: HDFS-15579-001.patch
> RBF: The constructor of PathLocation may got some misunderstanding
[
https://issues.apache.org/jira/browse/HDFS-15579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17196614#comment-17196614
]
Janus Chow commented on HDFS-15579:
---
There is already some instruction for this constructor.
Janus Chow created HDFS-15579:
-
Summary: RBF: The constructor of PathLocation may got some
misunderstanding
Key: HDFS-15579
URL: https://issues.apache.org/jira/browse/HDFS-15579
Project: Hadoop HDFS
[
https://issues.apache.org/jira/browse/HDFS-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17189015#comment-17189015
]
Janus Chow commented on HDFS-1:
---
Thanks a lot for the clarification.
> RBF: Refresh cacheNS when
[
https://issues.apache.org/jira/browse/HDFS-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17188964#comment-17188964
]
Janus Chow commented on HDFS-1:
---
I wonder why the new Active NN won't trigger the refresh of the
[
https://issues.apache.org/jira/browse/HDFS-13274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17119228#comment-17119228
]
Janus Chow commented on HDFS-13274:
---
It is a big federation cluster, there are many users querying
[
https://issues.apache.org/jira/browse/HDFS-13274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118425#comment-17118425
]
Janus Chow commented on HDFS-13274:
---
Yes, all the routers have similar numbers.
> RBF: Extend
[
https://issues.apache.org/jira/browse/HDFS-13274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118254#comment-17118254
]
Janus Chow commented on HDFS-13274:
---
The mount table is mostly 3 layers deep, and we have 40 mount
[
https://issues.apache.org/jira/browse/HDFS-13274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17117248#comment-17117248
]
Janus Chow commented on HDFS-13274:
---
The stats are as follows:
{code:java}
"GetBlockLocationsNumOps" :
[
https://issues.apache.org/jira/browse/HDFS-13274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17116408#comment-17116408
]
Janus Chow edited comment on HDFS-13274 at 5/26/20, 4:02 AM:
-
Checked the JMX
[
https://issues.apache.org/jira/browse/HDFS-13274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17116408#comment-17116408
]
Janus Chow commented on HDFS-13274:
---
Attached a JMX stat file of detailed activity for port of a
[
https://issues.apache.org/jira/browse/HDFS-13274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17114997#comment-17114997
]
Janus Chow commented on HDFS-13274:
---
By "full stack of the NN", you mean the thread dump? Since there
[
https://issues.apache.org/jira/browse/HDFS-13274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17114850#comment-17114850
]
Janus Chow commented on HDFS-13274:
---
[~elgoiri], we deployed HADOOP-13144 on our cluster and used
80 matches
Mail list logo
