[
https://issues.apache.org/jira/browse/SENTRY-2249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16525673#comment-16525673
]
kalyan kumar kalvagadda commented on SENTRY-2249:
-------------------------------------------------
*Result's with Option1**:* This approach did not show any improvement. Writes
are stored in the caches till they are committed. Writing the records in
batches did not help as they are are actually persisted in the disk only when
they are committed. Key is to persist them in separate transactions.
*Result's with Option2**:* Initial results are promising. Time to persist the
snapshot came down by 60%. Still working on it.
> Persist HMS Full Snapshot in batches.
> -------------------------------------
>
> Key: SENTRY-2249
> URL: https://issues.apache.org/jira/browse/SENTRY-2249
> Project: Sentry
> Issue Type: Improvement
> Components: Sentry
> Affects Versions: 2.1.0
> Reporter: kalyan kumar kalvagadda
> Assignee: kalyan kumar kalvagadda
> Priority: Major
> Attachments: SENTRY-2249.001.patch
>
>
> Currently each entry in full snapshot of HMS is persisted one entry at a
> time. Instead it could be optimized by persisting the entries in batches. DB
> operations are expensive, reducing the number of database operations should
> help. This would decrease the time to persist the snapshot in to database
> significantly.
> Size of the batch could be configurable.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
