----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/33251/#review81444 -----------------------------------------------------------
Ship it! Ship It! - Xuefu Zhang On April 23, 2015, 11:22 p.m., Jimmy Xiang wrote: > > ----------------------------------------------------------- > This is an automatically generated e-mail. To reply, visit: > https://reviews.apache.org/r/33251/ > ----------------------------------------------------------- > > (Updated April 23, 2015, 11:22 p.m.) > > > Review request for hive, Chao Sun, Szehon Ho, and Xuefu Zhang. > > > Bugs: HIVE-10302 > https://issues.apache.org/jira/browse/HIVE-10302 > > > Repository: hive-git > > > Description > ------- > > Cached the small table containter so that mapjoin tasks can use it if the > task is executed on the same Spark executor. > The cache is released right before the next job after the mapjoin job is done. > > > Diffs > ----- > > ql/src/java/org/apache/hadoop/hive/ql/exec/spark/HashTableLoader.java > fe108c4 > > ql/src/java/org/apache/hadoop/hive/ql/exec/spark/HivePairFlatMapFunction.java > 2f137f9 > ql/src/java/org/apache/hadoop/hive/ql/exec/spark/SmallTableCache.java > PRE-CREATION > ql/src/java/org/apache/hadoop/hive/ql/exec/spark/SparkUtilities.java > 72ab913 > > Diff: https://reviews.apache.org/r/33251/diff/ > > > Testing > ------- > > Ran several queries in live cluster. ptest pending. > > > Thanks, > > Jimmy Xiang > >
