Sai Hemanth Gantasala created IMPALA-11822:
----------------------------------------------
Summary: Optimize the Refresh/Invalidate event processing by
skipping unnecessary events
Key: IMPALA-11822
URL: https://issues.apache.org/jira/browse/IMPALA-11822
Project: IMPALA
Issue Type: Sub-task
Components: Catalog
Reporter: Sai Hemanth Gantasala
Assignee: Sai Hemanth Gantasala
Optimize the Refresh/Invalidate event processing by skipping unnecessary events.
Currently, we process every event as a new event. Consider there are 5 refresh
events of the same table in the event processor queue. We can process the first
refresh event and skip the remaining 4 events by comparing the timestamp of the
refreshed table and event time. This way we can greatly improve the performance
by skipping unnecessary events.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscr...@impala.apache.org
For additional commands, e-mail: issues-all-h...@impala.apache.org
