[ https://issues.apache.org/jira/browse/IMPALA-9716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Thomas Tauber-Marshall resolved IMPALA-9716. -------------------------------------------- Fix Version/s: Impala 4.0 Resolution: Fixed > Add jitter to the exponential backoff in status reporting > --------------------------------------------------------- > > Key: IMPALA-9716 > URL: https://issues.apache.org/jira/browse/IMPALA-9716 > Project: IMPALA > Issue Type: Improvement > Components: Distributed Exec > Affects Versions: Impala 4.0 > Reporter: Thomas Tauber-Marshall > Assignee: Thomas Tauber-Marshall > Priority: Major > Fix For: Impala 4.0 > > > When status reports fail, we use exponential backoff when retrying sending > them. However, currently the backoff is deterministic, leading to a > thundering herd problem where all of the backends for a particular query may > try to report at the same time, the coordinator is overwhelmed and rejects > some of the rpcs, then the backends all backoff by the same amount and retry > sending at the same time, leading the coordinator to be overwhelmed again. > We can help solve this by adding some random jitter to the exponential > backoff time. -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-all-unsubscr...@impala.apache.org For additional commands, e-mail: issues-all-h...@impala.apache.org