[ https://issues.apache.org/jira/browse/IMPALA-12399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sai Hemanth Gantasala resolved IMPALA-12399. -------------------------------------------- Fix Version/s: Impala 4.4.0 Resolution: Fixed > Pass eventTypeSkipList with OPEN_TXN in NotificationEventRequest to avoid > receiving OPEN_TXN events from HMS > ------------------------------------------------------------------------------------------------------------ > > Key: IMPALA-12399 > URL: https://issues.apache.org/jira/browse/IMPALA-12399 > Project: IMPALA > Issue Type: Improvement > Components: Catalog > Reporter: Venugopal Reddy K > Assignee: Venugopal Reddy K > Priority: Major > Fix For: Impala 4.4.0 > > Time Spent: 20m > Remaining Estimate: 0h > > Notification events like OPEN_TXN are ignored on catalogd > {{{}MetastoreEventsProcessor{}}}. So, we can pass eventTypeSkipList with > OPEN_TXN in NotificationEventRequest while invoking get_next_notification() > to avoid reading such notification messages from HMS and then ignoring on > catalogd. OPEN_TXN event being more frequent(received even upon describe > table operation from beeline), we can significantly reduce unwanted > processing on both HMS and catalogd. Catalogd reads events in batches of > EVENTS_BATCH_SIZE_PER_RPC, skipping such unnecessary events can help catchup > the events faster. -- This message was sent by Atlassian Jira (v8.20.10#820010)