[
https://issues.apache.org/jira/browse/HDFS-15409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17149176#comment-17149176
]
Danil Lipovoy commented on HDFS-15409:
--
I was surprised, but old (current) version shows better
[
https://issues.apache.org/jira/browse/HDFS-15409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17143602#comment-17143602
]
Danil Lipovoy commented on HDFS-15409:
--
About HBase blocks distribution - all tests show the same
[
https://issues.apache.org/jira/browse/HDFS-15409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17141523#comment-17141523
]
Danil Lipovoy edited comment on HDFS-15409 at 6/21/20, 7:42 PM:
Actually
[
https://issues.apache.org/jira/browse/HDFS-15409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17141523#comment-17141523
]
Danil Lipovoy commented on HDFS-15409:
--
Actually this test out of clientShortCircuitNum, because it
[
https://issues.apache.org/jira/browse/HDFS-15409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17141366#comment-17141366
]
Danil Lipovoy edited comment on HDFS-15409 at 6/21/20, 9:39 AM:
I think
[
https://issues.apache.org/jira/browse/HDFS-15409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17141366#comment-17141366
]
Danil Lipovoy edited comment on HDFS-15409 at 6/21/20, 9:38 AM:
I think
[
https://issues.apache.org/jira/browse/HDFS-15409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17141366#comment-17141366
]
Danil Lipovoy edited comment on HDFS-15409 at 6/21/20, 9:35 AM:
I think
[
https://issues.apache.org/jira/browse/HDFS-15409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17141366#comment-17141366
]
Danil Lipovoy commented on HDFS-15409:
--
I think you are absolutely right that the real blockId is
[
https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17110439#comment-17110439
]
Danil Lipovoy commented on HDFS-15202:
--
I'am so sorry, my bad(
> HDFS-client: boost ShortCircuit
[
https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17098310#comment-17098310
]
Danil Lipovoy commented on HDFS-15202:
--
[~leosun08] Thank you!)
> HDFS-client: boost ShortCircuit
[
https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Danil Lipovoy updated HDFS-15202:
-
Comment: was deleted
(was: [~leosun08]
Could you take a look, please?)
> HDFS-client: boost
[
https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17081718#comment-17081718
]
Danil Lipovoy commented on HDFS-15202:
--
[~leosun08]
Could you take a look, please?
> HDFS-client:
[
https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17076149#comment-17076149
]
Danil Lipovoy commented on HDFS-15202:
--
[~leosun08]
Sorry for waiting, was a little bit busy)
I
[
https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17059985#comment-17059985
]
Danil Lipovoy commented on HDFS-15202:
--
[~quanli]
I did 2 tests:
1. Via HBase. It was massive
[
https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17059648#comment-17059648
]
Danil Lipovoy commented on HDFS-15202:
--
>>Yes, you can develop it step by step.
Cool)
>>I think you
[
https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17059638#comment-17059638
]
Danil Lipovoy edited comment on HDFS-15202 at 3/15/20, 12:39 PM:
-
Yes,
[
https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17059638#comment-17059638
]
Danil Lipovoy edited comment on HDFS-15202 at 3/15/20, 12:34 PM:
-
Yes,
[
https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17059638#comment-17059638
]
Danil Lipovoy edited comment on HDFS-15202 at 3/15/20, 12:32 PM:
-
Yes,
[
https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17059638#comment-17059638
]
Danil Lipovoy commented on HDFS-15202:
--
Yes, you are right, there are ways improve performance even
[
https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17059638#comment-17059638
]
Danil Lipovoy edited comment on HDFS-15202 at 3/15/20, 12:31 PM:
-
Yes,
[
https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17058076#comment-17058076
]
Danil Lipovoy edited comment on HDFS-15202 at 3/12/20, 4:57 PM:
[
https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17058076#comment-17058076
]
Danil Lipovoy edited comment on HDFS-15202 at 3/12/20, 4:46 PM:
[
https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17058076#comment-17058076
]
Danil Lipovoy edited comment on HDFS-15202 at 3/12/20, 4:45 PM:
[
https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17058076#comment-17058076
]
Danil Lipovoy edited comment on HDFS-15202 at 3/12/20, 4:42 PM:
[
https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17058076#comment-17058076
]
Danil Lipovoy edited comment on HDFS-15202 at 3/12/20, 4:41 PM:
[
https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17058076#comment-17058076
]
Danil Lipovoy edited comment on HDFS-15202 at 3/12/20, 4:40 PM:
[
https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17058076#comment-17058076
]
Danil Lipovoy edited comment on HDFS-15202 at 3/12/20, 4:40 PM:
[
https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17058076#comment-17058076
]
Danil Lipovoy edited comment on HDFS-15202 at 3/12/20, 4:38 PM:
[
https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17058076#comment-17058076
]
Danil Lipovoy edited comment on HDFS-15202 at 3/12/20, 4:38 PM:
[
https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17058076#comment-17058076
]
Danil Lipovoy edited comment on HDFS-15202 at 3/12/20, 4:37 PM:
[
https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17058076#comment-17058076
]
Danil Lipovoy commented on HDFS-15202:
--
[~leosun08]
Thanks for interest!)
Let me provide more
[
https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Danil Lipovoy updated HDFS-15202:
-
Comment: was deleted
(was: [~weichiu]
ok,
[
https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17054897#comment-17054897
]
Danil Lipovoy edited comment on HDFS-15202 at 3/9/20, 1:32 PM:
---
Done more
[
https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17054902#comment-17054902
]
Danil Lipovoy edited comment on HDFS-15202 at 3/9/20, 12:59 PM:
How to
[
https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17054902#comment-17054902
]
Danil Lipovoy commented on HDFS-15202:
--
How to read the picture: the execution time of 100 thousand
[
https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Danil Lipovoy updated HDFS-15202:
-
Attachment: hdfs_scc_3_test.png
> HDFS-client: boost ShortCircuit Cache
>
[
https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17054897#comment-17054897
]
Danil Lipovoy commented on HDFS-15202:
--
Done more tests. There were test via HBase. More clean just
[
https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Danil Lipovoy updated HDFS-15202:
-
Attachment: HDFS_CPU_full_cycle.png
> HDFS-client: boost ShortCircuit Cache
>
[
https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Danil Lipovoy updated HDFS-15202:
-
Attachment: hdfs_scc_test_full-cycle.png
> HDFS-client: boost ShortCircuit Cache
>
[
https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17054040#comment-17054040
]
Danil Lipovoy commented on HDFS-15202:
--
Here we can see the locks when the cache is only 1.
[
https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Danil Lipovoy updated HDFS-15202:
-
Attachment: locks.png
> HDFS-client: boost ShortCircuit Cache
>
[
https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Danil Lipovoy updated HDFS-15202:
-
Attachment: cpu_SSC2.png
> HDFS-client: boost ShortCircuit Cache
>
[
https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17054022#comment-17054022
]
Danil Lipovoy commented on HDFS-15202:
--
!cpu_SSC2.png!
> HDFS-client: boost ShortCircuit Cache
>
[
https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17054021#comment-17054021
]
Danil Lipovoy edited comment on HDFS-15202 at 3/7/20, 12:33 PM:
Done more
[
https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17054021#comment-17054021
]
Danil Lipovoy commented on HDFS-15202:
--
Done more tests. Moved out generators on others hosts.
And
[
https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Danil Lipovoy updated HDFS-15202:
-
Attachment: requests_SSC.png
cpu_SSC.png
> HDFS-client: boost ShortCircuit Cache
[
https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17054018#comment-17054018
]
Danil Lipovoy commented on HDFS-15202:
--
[~weichiu]
[Done|https://github.com/apache/hadoop/pull/1884]
[
https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Danil Lipovoy updated HDFS-15202:
-
Description:
ТотI want to propose how to improve reading performance HDFS-client. The idea:
[
https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17051452#comment-17051452
]
Danil Lipovoy commented on HDFS-15202:
--
[~weichiu]
ok,
[
https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Danil Lipovoy updated HDFS-15202:
-
Description:
I want to propose how to improve reading performance HDFS-client. The idea:
create
[
https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Danil Lipovoy updated HDFS-15202:
-
Description:
I want to propose how to improve reading performance HDFS-client. The idea:
create
[
https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Danil Lipovoy updated HDFS-15202:
-
Description:
I want to propose how to improve reading performance HDFS-client. The idea:
create
[
https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Danil Lipovoy updated HDFS-15202:
-
Environment:
4 nodes E5-2698 v4 @ 2.20GHz, 700 Gb Mem.
8 RegionServers (2 by host)
8 tables by
[
https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17050472#comment-17050472
]
Danil Lipovoy commented on HDFS-15202:
--
Hi [~weichiu]!
Of course, I am newbe here, don't know how
54 matches
Mail list logo