[
https://issues.apache.org/jira/browse/HDDS-3354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17112590#comment-17112590
]
Bharat Viswanadham commented on HDDS-3354:
------------------------------------------
Hi [~elek]
Perf results:
!Screen Shot 2020-05-20 at 1.28.48 PM.png!
The command used for the test:
$ bin/ozone freon ombg -n=1000000
{quote}But I am fine with this approach, unless it causes significant
performance degradation. And If I understood well this is the case: it
introduce some new IO pressure but also removes a lot of unnecessary queries
which can make the overall picture even better than before.{quote}
Above test results shows not much perf impact with HDDS-3474 and HDDS-3475. The
tests are run on Mac with single SSD and 16GB ram.
{quote} For example: use RocksDB checkpoints and snapshot db together with
Ratis log. {quote}
With this proposal, we want to avoid replay logic in the actual request, as
this will be hard for developer when implementing new API's they need to know
about a case they need to handle replay also for non-idempotent requests.
And also the problem with checkpoints approach is how shall we map last applied
transaction to DB with checkpoint atomically, if any of the steps fails like
checkpoint succeeded, but snapshot file writes failed, then when Om restart, we
shall start from previous snapshot value, so we still need replay code. So, the
proposed solution solves the need of handling replay at request logic level.
> OM HA replay optimization
> -------------------------
>
> Key: HDDS-3354
> URL: https://issues.apache.org/jira/browse/HDDS-3354
> Project: Hadoop Distributed Data Store
> Issue Type: Improvement
> Reporter: Bharat Viswanadham
> Assignee: Bharat Viswanadham
> Priority: Major
> Attachments: OM HA Replay.pdf, Screen Shot 2020-05-20 at 1.28.48
> PM.png
>
>
> This Jira is to improve the OM HA replay scenario.
> Attached the design document which discusses about the proposal and issue in
> detail.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: ozone-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: ozone-issues-h...@hadoop.apache.org
