Tianyi Wang has uploaded a new patch set (#3). Change subject: IMPALA-5932: Improve transitive closure computation performance in FE ......................................................................
IMPALA-5932: Improve transitive closure computation performance in FE This patch implements the Floyd-Warshall algorithm for the transitive closure computation for the value transfer graph, replacing the existing N^4 brute force algorithm. The performance improvement depends on the size and structure of the value transfer graph. On a random graph with 800 slots and 2800 edges it is 43X faster itself. And the "Equivalence classes computed" event in the runtime profile becomes 21X faster. This computation is covered by the existing tests, which verifies the equivalency of the new and the old value transfer graphs. Change-Id: Idb00e3c1f904e60ae25567a52b4bf0809a84c6b3 --- M fe/src/main/java/org/apache/impala/analysis/Analyzer.java 1 file changed, 7 insertions(+), 16 deletions(-) git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/98/8098/3 -- To view, visit http://gerrit.cloudera.org:8080/8098 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-MessageType: newpatchset Gerrit-Change-Id: Idb00e3c1f904e60ae25567a52b4bf0809a84c6b3 Gerrit-PatchSet: 3 Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-Owner: Tianyi Wang <tw...@cloudera.com> Gerrit-Reviewer: Alex Behm <alex.b...@cloudera.com> Gerrit-Reviewer: Tianyi Wang <tw...@cloudera.com>