Xianqing He has uploaded a new patch set (#7). ( http://gerrit.cloudera.org:8080/19046 )
Change subject: IMPALA-11558: Ensure one Kudu client created (FE) for the specified Kudu master addresses ...................................................................... IMPALA-11558: Ensure one Kudu client created (FE) for the specified Kudu master addresses Creating Kudu clients is very expensive as each will fetch metadata from the Kudu master, so we have to ensure only one Kudu client created for a given Kudu master address. The solution is to ensure KuduUtil.getKuduClient created only one KuduClient for the specified Kudu master addresses by using 'computeIfAbsent' of the ConcurrentHashMap. Testing: - Manually ran a stress test: scan of a Kudu table, 1000 concurrent queries and verified the untracked memory - Added concurrent tests for KuduUtil.getKuduClient - Ran the full set of verifications in Impala Public Jenkins Change-Id: I1003556d3afc8e8216142cac4007a4c99046caeb --- M fe/src/main/java/org/apache/impala/util/KuduUtil.java A fe/src/test/java/org/apache/impala/util/KuduUtilTest.java 2 files changed, 88 insertions(+), 5 deletions(-) git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/46/19046/7 -- To view, visit http://gerrit.cloudera.org:8080/19046 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: newpatchset Gerrit-Change-Id: I1003556d3afc8e8216142cac4007a4c99046caeb Gerrit-Change-Number: 19046 Gerrit-PatchSet: 7 Gerrit-Owner: Xianqing He <hexianqing...@126.com> Gerrit-Reviewer: Impala Public Jenkins <impala-public-jenk...@cloudera.com> Gerrit-Reviewer: Jian Zhang <zjsar...@gmail.com> Gerrit-Reviewer: Wenzhe Zhou <wz...@cloudera.com> Gerrit-Reviewer: Xiang Yang <yx91...@126.com> Gerrit-Reviewer: Xianqing He <hexianqing...@126.com>
