[
https://issues.apache.org/jira/browse/HDDS-3354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17112591#comment-17112591
]
Bharat Viswanadham edited comment on HDDS-3354 at 5/20/20, 8:38 PM:
--------------------------------------------------------------------
The reason for the inclusion of HDDS-3615 and HDDS-3623 is we identified a few
potential problems, and that is causing slowness as the number of objects
increases in OM. Another reason is as bucket cache is full table cache it will
be in memory, we need some JVM tunings to be set, because without tuning, we
are seeing a lot of GC Pauses happening in OM. (So, this test is like a stress
test, where OM has only millions of buckets in memory, as during design of
cache we have thought a single OM will have a couple of thousands of
volumes/buckets)
JVM settings used for the test
{code:java}
-XX:ParallelGCThreads=8 -XX:+UseConcMarkSweepGC
-XX:CMSInitiatingOccupancyFraction=70 -XX:+CMSParallelRemarkEnabled
-Xloggc:/tmp/gc.log-$(date +'%Y%m%d%H%M') -XX:NewSize=1024m
-XX:MaxNewSize=1024m -Xms8192m -Xmx8192m -XX:+PrintGCDateStamps
{code}
was (Author: bharatviswa):
The reason for the inclusion of HDDS-3615 and HDDS-3623 is we identified a few
potential problems, and that is causing slowness as the number of objects
increases in OM. Another reason is as bucket cache is full table cache it will
be in memory, we need some JVM tunings to be set, because without tuning, we
are seeing a lot of GC Pauses happening in OM. (So, this test is like a stress
test, where OM has only millions of buckets in memory, as during design of
cache we have thought a single OM will have a couple of thousands of
volumes/buckets)
-XX:ParallelGCThreads=8 -XX:+UseConcMarkSweepGC
-XX:CMSInitiatingOccupancyFraction=70 -XX:+CMSParallelRemarkEnabled
-Xloggc:/tmp/gc.log-$(date +'%Y%m%d%H%M') -XX:NewSize=1024m
-XX:MaxNewSize=1024m -Xms8192m -Xmx8192m -XX:+PrintGCDateStamps
> OM HA replay optimization
> -------------------------
>
> Key: HDDS-3354
> URL: https://issues.apache.org/jira/browse/HDDS-3354
> Project: Hadoop Distributed Data Store
> Issue Type: Improvement
> Reporter: Bharat Viswanadham
> Assignee: Bharat Viswanadham
> Priority: Major
> Attachments: OM HA Replay.pdf, Screen Shot 2020-05-20 at 1.28.48
> PM.png
>
>
> This Jira is to improve the OM HA replay scenario.
> Attached the design document which discusses about the proposal and issue in
> detail.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: ozone-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: ozone-issues-h...@hadoop.apache.org
