http://git-wip-us.apache.org/repos/asf/hive/blob/6f7ded6e/ql/src/test/results/clientpositive/llap/vectorized_dynamic_partition_pruning.q.out ---------------------------------------------------------------------- diff --git a/ql/src/test/results/clientpositive/llap/vectorized_dynamic_partition_pruning.q.out b/ql/src/test/results/clientpositive/llap/vectorized_dynamic_partition_pruning.q.out index 2464076..63121a9 100644 --- a/ql/src/test/results/clientpositive/llap/vectorized_dynamic_partition_pruning.q.out +++ b/ql/src/test/results/clientpositive/llap/vectorized_dynamic_partition_pruning.q.out @@ -248,10 +248,10 @@ STAGE PLANS: outputColumnNames: _col0 Statistics: Num rows: 1 Data size: 188 Basic stats: COMPLETE Column stats: NONE Dynamic Partitioning Event Operator + Target column: ds (string) Target Input: srcpart Partition key expr: ds Statistics: Num rows: 1 Data size: 188 Basic stats: COMPLETE Column stats: NONE - Target column: ds Target Vertex: Map 1 Execution mode: vectorized, llap Reducer 2 @@ -503,10 +503,10 @@ STAGE PLANS: outputColumnNames: _col0 Statistics: Num rows: 1 Data size: 188 Basic stats: COMPLETE Column stats: NONE Dynamic Partitioning Event Operator + Target column: ds (string) Target Input: srcpart Partition key expr: ds Statistics: Num rows: 1 Data size: 188 Basic stats: COMPLETE Column stats: NONE - Target column: ds Target Vertex: Map 1 Execution mode: vectorized, llap Map 6 @@ -537,10 +537,10 @@ STAGE PLANS: outputColumnNames: _col0 Statistics: Num rows: 1 Data size: 172 Basic stats: COMPLETE Column stats: NONE Dynamic Partitioning Event Operator + Target column: hr (string) Target Input: srcpart Partition key expr: hr Statistics: Num rows: 1 Data size: 172 Basic stats: COMPLETE Column stats: NONE - Target column: hr Target Vertex: Map 1 Execution mode: vectorized, llap Reducer 2 @@ -849,10 +849,10 @@ STAGE PLANS: outputColumnNames: _col0 Statistics: Num rows: 1 Data size: 360 Basic stats: COMPLETE Column stats: NONE Dynamic Partitioning Event Operator + Target column: ds (string) Target Input: srcpart Partition key expr: ds Statistics: Num rows: 1 Data size: 360 Basic stats: COMPLETE Column stats: NONE - Target column: ds Target Vertex: Map 1 Select Operator expressions: _col2 (type: string) @@ -864,10 +864,10 @@ STAGE PLANS: outputColumnNames: _col0 Statistics: Num rows: 1 Data size: 360 Basic stats: COMPLETE Column stats: NONE Dynamic Partitioning Event Operator + Target column: hr (string) Target Input: srcpart Partition key expr: hr Statistics: Num rows: 1 Data size: 360 Basic stats: COMPLETE Column stats: NONE - Target column: hr Target Vertex: Map 1 Execution mode: vectorized, llap Reducer 2 @@ -1114,10 +1114,10 @@ STAGE PLANS: outputColumnNames: _col0 Statistics: Num rows: 1 Data size: 188 Basic stats: COMPLETE Column stats: NONE Dynamic Partitioning Event Operator + Target column: ds (string) Target Input: srcpart Partition key expr: ds Statistics: Num rows: 1 Data size: 188 Basic stats: COMPLETE Column stats: NONE - Target column: ds Target Vertex: Map 1 Execution mode: vectorized, llap Reducer 2 @@ -1362,10 +1362,10 @@ STAGE PLANS: outputColumnNames: _col0 Statistics: Num rows: 1 Data size: 94 Basic stats: COMPLETE Column stats: NONE Dynamic Partitioning Event Operator + Target column: hr (string) Target Input: srcpart Partition key expr: UDFToDouble(hr) Statistics: Num rows: 1 Data size: 94 Basic stats: COMPLETE Column stats: NONE - Target column: hr Target Vertex: Map 1 Execution mode: vectorized, llap Reducer 2 @@ -1488,10 +1488,10 @@ STAGE PLANS: outputColumnNames: _col0 Statistics: Num rows: 1 Data size: 94 Basic stats: COMPLETE Column stats: NONE Dynamic Partitioning Event Operator + Target column: hr (string) Target Input: srcpart Partition key expr: (UDFToDouble(hr) * 2.0) Statistics: Num rows: 1 Data size: 94 Basic stats: COMPLETE Column stats: NONE - Target column: hr Target Vertex: Map 1 Execution mode: vectorized, llap Reducer 2 @@ -1849,10 +1849,10 @@ STAGE PLANS: outputColumnNames: _col0 Statistics: Num rows: 1 Data size: 94 Basic stats: COMPLETE Column stats: NONE Dynamic Partitioning Event Operator + Target column: hr (string) Target Input: srcpart Partition key expr: UDFToString((UDFToDouble(hr) * 2.0)) Statistics: Num rows: 1 Data size: 94 Basic stats: COMPLETE Column stats: NONE - Target column: hr Target Vertex: Map 1 Execution mode: vectorized, llap Reducer 2 @@ -2041,10 +2041,10 @@ STAGE PLANS: outputColumnNames: _col0 Statistics: Num rows: 500 Data size: 5312 Basic stats: COMPLETE Column stats: NONE Dynamic Partitioning Event Operator + Target column: ds (string) Target Input: srcpart Partition key expr: ds Statistics: Num rows: 500 Data size: 5312 Basic stats: COMPLETE Column stats: NONE - Target column: ds Target Vertex: Map 1 Stage: Stage-0 @@ -2262,10 +2262,10 @@ STAGE PLANS: outputColumnNames: _col0 Statistics: Num rows: 1 Data size: 360 Basic stats: COMPLETE Column stats: NONE Dynamic Partitioning Event Operator + Target column: ds (string) Target Input: srcpart Partition key expr: ds Statistics: Num rows: 1 Data size: 360 Basic stats: COMPLETE Column stats: NONE - Target column: ds Target Vertex: Map 1 Select Operator expressions: _col2 (type: string) @@ -2277,10 +2277,10 @@ STAGE PLANS: outputColumnNames: _col0 Statistics: Num rows: 1 Data size: 360 Basic stats: COMPLETE Column stats: NONE Dynamic Partitioning Event Operator + Target column: hr (string) Target Input: srcpart Partition key expr: hr Statistics: Num rows: 1 Data size: 360 Basic stats: COMPLETE Column stats: NONE - Target column: hr Target Vertex: Map 1 Execution mode: vectorized, llap Reducer 2 @@ -2405,10 +2405,10 @@ STAGE PLANS: outputColumnNames: _col0 Statistics: Num rows: 1 Data size: 188 Basic stats: COMPLETE Column stats: NONE Dynamic Partitioning Event Operator + Target column: ds (string) Target Input: srcpart Partition key expr: ds Statistics: Num rows: 1 Data size: 188 Basic stats: COMPLETE Column stats: NONE - Target column: ds Target Vertex: Map 1 Execution mode: vectorized, llap Reducer 2 @@ -2496,10 +2496,10 @@ STAGE PLANS: outputColumnNames: _col0 Statistics: Num rows: 1 Data size: 188 Basic stats: COMPLETE Column stats: NONE Dynamic Partitioning Event Operator + Target column: ds (string) Target Input: srcpart Partition key expr: ds Statistics: Num rows: 1 Data size: 188 Basic stats: COMPLETE Column stats: NONE - Target column: ds Target Vertex: Map 4 Execution mode: vectorized, llap Map 4 @@ -2619,10 +2619,10 @@ STAGE PLANS: outputColumnNames: _col0 Statistics: Num rows: 1 Data size: 188 Basic stats: COMPLETE Column stats: NONE Dynamic Partitioning Event Operator + Target column: ds (string) Target Input: srcpart Partition key expr: ds Statistics: Num rows: 1 Data size: 188 Basic stats: COMPLETE Column stats: NONE - Target column: ds Target Vertex: Map 1 Execution mode: vectorized, llap Reducer 2 @@ -2730,10 +2730,10 @@ STAGE PLANS: outputColumnNames: _col0 Statistics: Num rows: 1 Data size: 188 Basic stats: COMPLETE Column stats: NONE Dynamic Partitioning Event Operator + Target column: ds (string) Target Input: srcpart Partition key expr: ds Statistics: Num rows: 1 Data size: 188 Basic stats: COMPLETE Column stats: NONE - Target column: ds Target Vertex: Map 1 Execution mode: vectorized, llap Map 6 @@ -3112,10 +3112,10 @@ STAGE PLANS: outputColumnNames: _col0 Statistics: Num rows: 2 Data size: 168 Basic stats: COMPLETE Column stats: NONE Dynamic Partitioning Event Operator + Target column: ds (string) Target Input: srcpart Partition key expr: ds Statistics: Num rows: 2 Data size: 168 Basic stats: COMPLETE Column stats: NONE - Target column: ds Target Vertex: Map 1 Reducer 8 Execution mode: vectorized, uber @@ -3148,10 +3148,10 @@ STAGE PLANS: outputColumnNames: _col0 Statistics: Num rows: 2 Data size: 168 Basic stats: COMPLETE Column stats: NONE Dynamic Partitioning Event Operator + Target column: ds (string) Target Input: srcpart Partition key expr: ds Statistics: Num rows: 2 Data size: 168 Basic stats: COMPLETE Column stats: NONE - Target column: ds Target Vertex: Map 1 Union 6 Vertex: Union 6 @@ -3318,10 +3318,10 @@ STAGE PLANS: outputColumnNames: _col0 Statistics: Num rows: 2 Data size: 168 Basic stats: COMPLETE Column stats: NONE Dynamic Partitioning Event Operator + Target column: ds (string) Target Input: srcpart Partition key expr: ds Statistics: Num rows: 2 Data size: 168 Basic stats: COMPLETE Column stats: NONE - Target column: ds Target Vertex: Map 1 Reducer 8 Execution mode: vectorized, uber @@ -3354,10 +3354,10 @@ STAGE PLANS: outputColumnNames: _col0 Statistics: Num rows: 2 Data size: 168 Basic stats: COMPLETE Column stats: NONE Dynamic Partitioning Event Operator + Target column: ds (string) Target Input: srcpart Partition key expr: ds Statistics: Num rows: 2 Data size: 168 Basic stats: COMPLETE Column stats: NONE - Target column: ds Target Vertex: Map 1 Union 6 Vertex: Union 6 @@ -3508,10 +3508,10 @@ STAGE PLANS: outputColumnNames: _col0 Statistics: Num rows: 2 Data size: 168 Basic stats: COMPLETE Column stats: NONE Dynamic Partitioning Event Operator + Target column: ds (string) Target Input: srcpart Partition key expr: ds Statistics: Num rows: 2 Data size: 168 Basic stats: COMPLETE Column stats: NONE - Target column: ds Target Vertex: Map 1 Select Operator expressions: _col0 (type: string) @@ -3523,10 +3523,10 @@ STAGE PLANS: outputColumnNames: _col0 Statistics: Num rows: 2 Data size: 168 Basic stats: COMPLETE Column stats: NONE Dynamic Partitioning Event Operator + Target column: ds (string) Target Input: srcpart Partition key expr: ds Statistics: Num rows: 2 Data size: 168 Basic stats: COMPLETE Column stats: NONE - Target column: ds Target Vertex: Map 5 Reducer 2 Execution mode: vectorized, uber @@ -3603,10 +3603,10 @@ STAGE PLANS: outputColumnNames: _col0 Statistics: Num rows: 2 Data size: 168 Basic stats: COMPLETE Column stats: NONE Dynamic Partitioning Event Operator + Target column: ds (string) Target Input: srcpart Partition key expr: ds Statistics: Num rows: 2 Data size: 168 Basic stats: COMPLETE Column stats: NONE - Target column: ds Target Vertex: Map 1 Select Operator expressions: _col0 (type: string) @@ -3618,10 +3618,10 @@ STAGE PLANS: outputColumnNames: _col0 Statistics: Num rows: 2 Data size: 168 Basic stats: COMPLETE Column stats: NONE Dynamic Partitioning Event Operator + Target column: ds (string) Target Input: srcpart Partition key expr: ds Statistics: Num rows: 2 Data size: 168 Basic stats: COMPLETE Column stats: NONE - Target column: ds Target Vertex: Map 5 Union 3 Vertex: Union 3 @@ -3730,10 +3730,10 @@ STAGE PLANS: outputColumnNames: _col0 Statistics: Num rows: 1 Data size: 188 Basic stats: COMPLETE Column stats: NONE Dynamic Partitioning Event Operator + Target column: ds (string) Target Input: srcpart Partition key expr: ds Statistics: Num rows: 1 Data size: 188 Basic stats: COMPLETE Column stats: NONE - Target column: ds Target Vertex: Map 1 Execution mode: vectorized, llap Reducer 2 @@ -3878,10 +3878,10 @@ STAGE PLANS: outputColumnNames: _col0 Statistics: Num rows: 1 Data size: 188 Basic stats: COMPLETE Column stats: NONE Dynamic Partitioning Event Operator + Target column: ds (string) Target Input: srcpart Partition key expr: ds Statistics: Num rows: 1 Data size: 188 Basic stats: COMPLETE Column stats: NONE - Target column: ds Target Vertex: Map 1 Execution mode: vectorized, llap Map 4 @@ -3912,10 +3912,10 @@ STAGE PLANS: outputColumnNames: _col0 Statistics: Num rows: 1 Data size: 172 Basic stats: COMPLETE Column stats: NONE Dynamic Partitioning Event Operator + Target column: hr (string) Target Input: srcpart Partition key expr: hr Statistics: Num rows: 1 Data size: 172 Basic stats: COMPLETE Column stats: NONE - Target column: hr Target Vertex: Map 1 Execution mode: vectorized, llap Reducer 2 @@ -4049,10 +4049,10 @@ STAGE PLANS: outputColumnNames: _col0 Statistics: Num rows: 1 Data size: 360 Basic stats: COMPLETE Column stats: NONE Dynamic Partitioning Event Operator + Target column: ds (string) Target Input: srcpart Partition key expr: ds Statistics: Num rows: 1 Data size: 360 Basic stats: COMPLETE Column stats: NONE - Target column: ds Target Vertex: Map 1 Select Operator expressions: _col2 (type: string) @@ -4064,10 +4064,10 @@ STAGE PLANS: outputColumnNames: _col0 Statistics: Num rows: 1 Data size: 360 Basic stats: COMPLETE Column stats: NONE Dynamic Partitioning Event Operator + Target column: hr (string) Target Input: srcpart Partition key expr: hr Statistics: Num rows: 1 Data size: 360 Basic stats: COMPLETE Column stats: NONE - Target column: hr Target Vertex: Map 1 Execution mode: vectorized, llap Reducer 2 @@ -4198,10 +4198,10 @@ STAGE PLANS: outputColumnNames: _col0 Statistics: Num rows: 1 Data size: 188 Basic stats: COMPLETE Column stats: NONE Dynamic Partitioning Event Operator + Target column: ds (string) Target Input: srcpart Partition key expr: ds Statistics: Num rows: 1 Data size: 188 Basic stats: COMPLETE Column stats: NONE - Target column: ds Target Vertex: Map 1 Execution mode: vectorized, llap Reducer 2 @@ -4308,10 +4308,10 @@ STAGE PLANS: outputColumnNames: _col0 Statistics: Num rows: 1 Data size: 94 Basic stats: COMPLETE Column stats: NONE Dynamic Partitioning Event Operator + Target column: hr (string) Target Input: srcpart Partition key expr: UDFToDouble(hr) Statistics: Num rows: 1 Data size: 94 Basic stats: COMPLETE Column stats: NONE - Target column: hr Target Vertex: Map 1 Execution mode: vectorized, llap Reducer 2 @@ -4429,10 +4429,10 @@ STAGE PLANS: outputColumnNames: _col0 Statistics: Num rows: 1 Data size: 94 Basic stats: COMPLETE Column stats: NONE Dynamic Partitioning Event Operator + Target column: hr (string) Target Input: srcpart Partition key expr: (UDFToDouble(hr) * 2.0) Statistics: Num rows: 1 Data size: 94 Basic stats: COMPLETE Column stats: NONE - Target column: hr Target Vertex: Map 1 Execution mode: vectorized, llap Reducer 2 @@ -4699,10 +4699,10 @@ STAGE PLANS: outputColumnNames: _col0 Statistics: Num rows: 1 Data size: 188 Basic stats: COMPLETE Column stats: NONE Dynamic Partitioning Event Operator + Target column: ds (string) Target Input: srcpart Partition key expr: ds Statistics: Num rows: 1 Data size: 188 Basic stats: COMPLETE Column stats: NONE - Target column: ds Target Vertex: Map 1 Execution mode: vectorized, llap Reducer 2 @@ -4988,10 +4988,10 @@ STAGE PLANS: outputColumnNames: _col0 Statistics: Num rows: 1 Data size: 188 Basic stats: COMPLETE Column stats: NONE Dynamic Partitioning Event Operator + Target column: ds (string) Target Input: srcpart Partition key expr: ds Statistics: Num rows: 1 Data size: 188 Basic stats: COMPLETE Column stats: NONE - Target column: ds Target Vertex: Map 1 Execution mode: vectorized, llap Map 4 @@ -5315,10 +5315,10 @@ STAGE PLANS: outputColumnNames: _col0 Statistics: Num rows: 2 Data size: 168 Basic stats: COMPLETE Column stats: NONE Dynamic Partitioning Event Operator + Target column: ds (string) Target Input: srcpart Partition key expr: ds Statistics: Num rows: 2 Data size: 168 Basic stats: COMPLETE Column stats: NONE - Target column: ds Target Vertex: Map 1 Reducer 7 Execution mode: vectorized, uber @@ -5351,10 +5351,10 @@ STAGE PLANS: outputColumnNames: _col0 Statistics: Num rows: 2 Data size: 168 Basic stats: COMPLETE Column stats: NONE Dynamic Partitioning Event Operator + Target column: ds (string) Target Input: srcpart Partition key expr: ds Statistics: Num rows: 2 Data size: 168 Basic stats: COMPLETE Column stats: NONE - Target column: ds Target Vertex: Map 1 Union 5 Vertex: Union 5 @@ -5493,10 +5493,10 @@ STAGE PLANS: outputColumnNames: _col0 Statistics: Num rows: 2 Data size: 720 Basic stats: COMPLETE Column stats: NONE Dynamic Partitioning Event Operator + Target column: ds (string) Target Input: srcpart_orc Partition key expr: ds Statistics: Num rows: 2 Data size: 720 Basic stats: COMPLETE Column stats: NONE - Target column: ds Target Vertex: Map 1 Select Operator expressions: UDFToDouble(_col2) (type: double) @@ -5508,10 +5508,10 @@ STAGE PLANS: outputColumnNames: _col0 Statistics: Num rows: 2 Data size: 720 Basic stats: COMPLETE Column stats: NONE Dynamic Partitioning Event Operator + Target column: hr (int) Target Input: srcpart_orc Partition key expr: UDFToDouble(hr) Statistics: Num rows: 2 Data size: 720 Basic stats: COMPLETE Column stats: NONE - Target column: hr Target Vertex: Map 1 Execution mode: llap Reducer 2
http://git-wip-us.apache.org/repos/asf/hive/blob/6f7ded6e/ql/src/test/results/clientpositive/tez/bucket_map_join_tez1.q.out ---------------------------------------------------------------------- diff --git a/ql/src/test/results/clientpositive/tez/bucket_map_join_tez1.q.out b/ql/src/test/results/clientpositive/tez/bucket_map_join_tez1.q.out index 9582334..36f4eb7 100644 --- a/ql/src/test/results/clientpositive/tez/bucket_map_join_tez1.q.out +++ b/ql/src/test/results/clientpositive/tez/bucket_map_join_tez1.q.out @@ -1423,10 +1423,10 @@ STAGE PLANS: outputColumnNames: _col0 Statistics: Num rows: 242 Data size: 2566 Basic stats: COMPLETE Column stats: NONE Dynamic Partitioning Event Operator + Target column: ds (string) Target Input: b Partition key expr: ds Statistics: Num rows: 242 Data size: 2566 Basic stats: COMPLETE Column stats: NONE - Target column: ds Target Vertex: Map 2 Map 2 Map Operator Tree: http://git-wip-us.apache.org/repos/asf/hive/blob/6f7ded6e/ql/src/test/results/clientpositive/tez/dynamic_partition_pruning.q.out ---------------------------------------------------------------------- diff --git a/ql/src/test/results/clientpositive/tez/dynamic_partition_pruning.q.out b/ql/src/test/results/clientpositive/tez/dynamic_partition_pruning.q.out index caa4398..58ab2c0 100644 --- a/ql/src/test/results/clientpositive/tez/dynamic_partition_pruning.q.out +++ b/ql/src/test/results/clientpositive/tez/dynamic_partition_pruning.q.out @@ -245,10 +245,10 @@ STAGE PLANS: outputColumnNames: _col0 Statistics: Num rows: 1 Data size: 21 Basic stats: COMPLETE Column stats: NONE Dynamic Partitioning Event Operator + Target column: ds (string) Target Input: srcpart Partition key expr: ds Statistics: Num rows: 1 Data size: 21 Basic stats: COMPLETE Column stats: NONE - Target column: ds Target Vertex: Map 1 Reducer 2 Reduce Operator Tree: @@ -428,6 +428,237 @@ POSTHOOK: Input: default@srcpart@ds=2008-04-08/hr=11 POSTHOOK: Input: default@srcpart@ds=2008-04-08/hr=12 #### A masked pattern was here #### 1000 +PREHOOK: query: -- single column, single key, udf with typechange +EXPLAIN select count(*) from srcpart join srcpart_date on (day(srcpart.ds) = day(srcpart_date.ds)) where srcpart_date.`date` = '2008-04-08' +PREHOOK: type: QUERY +POSTHOOK: query: -- single column, single key, udf with typechange +EXPLAIN select count(*) from srcpart join srcpart_date on (day(srcpart.ds) = day(srcpart_date.ds)) where srcpart_date.`date` = '2008-04-08' +POSTHOOK: type: QUERY +STAGE DEPENDENCIES: + Stage-1 is a root stage + Stage-0 depends on stages: Stage-1 + +STAGE PLANS: + Stage: Stage-1 + Tez + Edges: + Reducer 2 <- Map 1 (SIMPLE_EDGE), Map 4 (SIMPLE_EDGE) + Reducer 3 <- Reducer 2 (SIMPLE_EDGE) +#### A masked pattern was here #### + Vertices: + Map 1 + Map Operator Tree: + TableScan + alias: srcpart + filterExpr: ds is not null (type: boolean) + Statistics: Num rows: 2000 Data size: 21248 Basic stats: COMPLETE Column stats: NONE + Select Operator + expressions: ds (type: string) + outputColumnNames: _col0 + Statistics: Num rows: 2000 Data size: 21248 Basic stats: COMPLETE Column stats: NONE + Reduce Output Operator + key expressions: day(_col0) (type: int) + sort order: + + Map-reduce partition columns: day(_col0) (type: int) + Statistics: Num rows: 2000 Data size: 21248 Basic stats: COMPLETE Column stats: NONE + Map 4 + Map Operator Tree: + TableScan + alias: srcpart_date + filterExpr: ((date = '2008-04-08') and ds is not null) (type: boolean) + Statistics: Num rows: 2 Data size: 42 Basic stats: COMPLETE Column stats: NONE + Filter Operator + predicate: ((date = '2008-04-08') and ds is not null) (type: boolean) + Statistics: Num rows: 1 Data size: 21 Basic stats: COMPLETE Column stats: NONE + Select Operator + expressions: ds (type: string) + outputColumnNames: _col0 + Statistics: Num rows: 1 Data size: 21 Basic stats: COMPLETE Column stats: NONE + Reduce Output Operator + key expressions: day(_col0) (type: int) + sort order: + + Map-reduce partition columns: day(_col0) (type: int) + Statistics: Num rows: 1 Data size: 21 Basic stats: COMPLETE Column stats: NONE + Select Operator + expressions: day(_col0) (type: int) + outputColumnNames: _col0 + Statistics: Num rows: 1 Data size: 21 Basic stats: COMPLETE Column stats: NONE + Group By Operator + keys: _col0 (type: int) + mode: hash + outputColumnNames: _col0 + Statistics: Num rows: 1 Data size: 21 Basic stats: COMPLETE Column stats: NONE + Dynamic Partitioning Event Operator + Target column: ds (string) + Target Input: srcpart + Partition key expr: day(ds) + Statistics: Num rows: 1 Data size: 21 Basic stats: COMPLETE Column stats: NONE + Target Vertex: Map 1 + Reducer 2 + Reduce Operator Tree: + Merge Join Operator + condition map: + Inner Join 0 to 1 + keys: + 0 day(_col0) (type: int) + 1 day(_col0) (type: int) + Statistics: Num rows: 2200 Data size: 23372 Basic stats: COMPLETE Column stats: NONE + Group By Operator + aggregations: count() + mode: hash + outputColumnNames: _col0 + Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: NONE + Reduce Output Operator + sort order: + Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: NONE + value expressions: _col0 (type: bigint) + Reducer 3 + Reduce Operator Tree: + Group By Operator + aggregations: count(VALUE._col0) + mode: mergepartial + outputColumnNames: _col0 + Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: NONE + File Output Operator + compressed: false + Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: NONE + table: + input format: org.apache.hadoop.mapred.TextInputFormat + output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat + serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe + + Stage: Stage-0 + Fetch Operator + limit: -1 + Processor Tree: + ListSink + +PREHOOK: query: select count(*) from srcpart join srcpart_date on (day(srcpart.ds) = day(srcpart_date.ds)) where srcpart_date.`date` = '2008-04-08' +PREHOOK: type: QUERY +PREHOOK: Input: default@srcpart +PREHOOK: Input: default@srcpart@ds=2008-04-08/hr=11 +PREHOOK: Input: default@srcpart@ds=2008-04-08/hr=12 +PREHOOK: Input: default@srcpart@ds=2008-04-09/hr=11 +PREHOOK: Input: default@srcpart@ds=2008-04-09/hr=12 +PREHOOK: Input: default@srcpart_date +#### A masked pattern was here #### +POSTHOOK: query: select count(*) from srcpart join srcpart_date on (day(srcpart.ds) = day(srcpart_date.ds)) where srcpart_date.`date` = '2008-04-08' +POSTHOOK: type: QUERY +POSTHOOK: Input: default@srcpart +POSTHOOK: Input: default@srcpart@ds=2008-04-08/hr=11 +POSTHOOK: Input: default@srcpart@ds=2008-04-08/hr=12 +POSTHOOK: Input: default@srcpart@ds=2008-04-09/hr=11 +POSTHOOK: Input: default@srcpart@ds=2008-04-09/hr=12 +POSTHOOK: Input: default@srcpart_date +#### A masked pattern was here #### +1000 +PREHOOK: query: EXPLAIN select count(*) from srcpart join srcpart_date on (day(srcpart.ds) = day(srcpart_date.ds)) where srcpart_date.`date` = '2008-04-08' +PREHOOK: type: QUERY +POSTHOOK: query: EXPLAIN select count(*) from srcpart join srcpart_date on (day(srcpart.ds) = day(srcpart_date.ds)) where srcpart_date.`date` = '2008-04-08' +POSTHOOK: type: QUERY +STAGE DEPENDENCIES: + Stage-1 is a root stage + Stage-0 depends on stages: Stage-1 + +STAGE PLANS: + Stage: Stage-1 + Tez + Edges: + Reducer 2 <- Map 1 (SIMPLE_EDGE), Map 4 (SIMPLE_EDGE) + Reducer 3 <- Reducer 2 (SIMPLE_EDGE) +#### A masked pattern was here #### + Vertices: + Map 1 + Map Operator Tree: + TableScan + alias: srcpart + filterExpr: ds is not null (type: boolean) + Statistics: Num rows: 2000 Data size: 21248 Basic stats: COMPLETE Column stats: NONE + Select Operator + expressions: ds (type: string) + outputColumnNames: _col0 + Statistics: Num rows: 2000 Data size: 21248 Basic stats: COMPLETE Column stats: NONE + Reduce Output Operator + key expressions: day(_col0) (type: int) + sort order: + + Map-reduce partition columns: day(_col0) (type: int) + Statistics: Num rows: 2000 Data size: 21248 Basic stats: COMPLETE Column stats: NONE + Map 4 + Map Operator Tree: + TableScan + alias: srcpart_date + filterExpr: ((date = '2008-04-08') and ds is not null) (type: boolean) + Statistics: Num rows: 2 Data size: 42 Basic stats: COMPLETE Column stats: NONE + Filter Operator + predicate: ((date = '2008-04-08') and ds is not null) (type: boolean) + Statistics: Num rows: 1 Data size: 21 Basic stats: COMPLETE Column stats: NONE + Select Operator + expressions: ds (type: string) + outputColumnNames: _col0 + Statistics: Num rows: 1 Data size: 21 Basic stats: COMPLETE Column stats: NONE + Reduce Output Operator + key expressions: day(_col0) (type: int) + sort order: + + Map-reduce partition columns: day(_col0) (type: int) + Statistics: Num rows: 1 Data size: 21 Basic stats: COMPLETE Column stats: NONE + Reducer 2 + Reduce Operator Tree: + Merge Join Operator + condition map: + Inner Join 0 to 1 + keys: + 0 day(_col0) (type: int) + 1 day(_col0) (type: int) + Statistics: Num rows: 2200 Data size: 23372 Basic stats: COMPLETE Column stats: NONE + Group By Operator + aggregations: count() + mode: hash + outputColumnNames: _col0 + Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: NONE + Reduce Output Operator + sort order: + Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: NONE + value expressions: _col0 (type: bigint) + Reducer 3 + Reduce Operator Tree: + Group By Operator + aggregations: count(VALUE._col0) + mode: mergepartial + outputColumnNames: _col0 + Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: NONE + File Output Operator + compressed: false + Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: NONE + table: + input format: org.apache.hadoop.mapred.TextInputFormat + output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat + serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe + + Stage: Stage-0 + Fetch Operator + limit: -1 + Processor Tree: + ListSink + +PREHOOK: query: select count(*) from srcpart join srcpart_date on (day(srcpart.ds) = day(srcpart_date.ds)) where srcpart_date.`date` = '2008-04-08' +PREHOOK: type: QUERY +PREHOOK: Input: default@srcpart +PREHOOK: Input: default@srcpart@ds=2008-04-08/hr=11 +PREHOOK: Input: default@srcpart@ds=2008-04-08/hr=12 +PREHOOK: Input: default@srcpart@ds=2008-04-09/hr=11 +PREHOOK: Input: default@srcpart@ds=2008-04-09/hr=12 +PREHOOK: Input: default@srcpart_date +#### A masked pattern was here #### +POSTHOOK: query: select count(*) from srcpart join srcpart_date on (day(srcpart.ds) = day(srcpart_date.ds)) where srcpart_date.`date` = '2008-04-08' +POSTHOOK: type: QUERY +POSTHOOK: Input: default@srcpart +POSTHOOK: Input: default@srcpart@ds=2008-04-08/hr=11 +POSTHOOK: Input: default@srcpart@ds=2008-04-08/hr=12 +POSTHOOK: Input: default@srcpart@ds=2008-04-09/hr=11 +POSTHOOK: Input: default@srcpart@ds=2008-04-09/hr=12 +POSTHOOK: Input: default@srcpart_date +#### A masked pattern was here #### +1000 PREHOOK: query: -- multiple sources, single key EXPLAIN select count(*) from srcpart join srcpart_date on (srcpart.ds = srcpart_date.ds) join srcpart_hour on (srcpart.hr = srcpart_hour.hr) where srcpart_date.`date` = '2008-04-08' and srcpart_hour.hour = 11 @@ -492,10 +723,10 @@ STAGE PLANS: outputColumnNames: _col0 Statistics: Num rows: 1 Data size: 21 Basic stats: COMPLETE Column stats: NONE Dynamic Partitioning Event Operator + Target column: ds (string) Target Input: srcpart Partition key expr: ds Statistics: Num rows: 1 Data size: 21 Basic stats: COMPLETE Column stats: NONE - Target column: ds Target Vertex: Map 1 Map 6 Map Operator Tree: @@ -525,10 +756,10 @@ STAGE PLANS: outputColumnNames: _col0 Statistics: Num rows: 1 Data size: 5 Basic stats: COMPLETE Column stats: NONE Dynamic Partitioning Event Operator + Target column: hr (string) Target Input: srcpart Partition key expr: hr Statistics: Num rows: 1 Data size: 5 Basic stats: COMPLETE Column stats: NONE - Target column: hr Target Vertex: Map 1 Reducer 2 Reduce Operator Tree: @@ -826,10 +1057,10 @@ STAGE PLANS: outputColumnNames: _col0 Statistics: Num rows: 1 Data size: 27 Basic stats: COMPLETE Column stats: NONE Dynamic Partitioning Event Operator + Target column: ds (string) Target Input: srcpart Partition key expr: ds Statistics: Num rows: 1 Data size: 27 Basic stats: COMPLETE Column stats: NONE - Target column: ds Target Vertex: Map 1 Select Operator expressions: _col2 (type: string) @@ -841,10 +1072,10 @@ STAGE PLANS: outputColumnNames: _col0 Statistics: Num rows: 1 Data size: 27 Basic stats: COMPLETE Column stats: NONE Dynamic Partitioning Event Operator + Target column: hr (string) Target Input: srcpart Partition key expr: hr Statistics: Num rows: 1 Data size: 27 Basic stats: COMPLETE Column stats: NONE - Target column: hr Target Vertex: Map 1 Reducer 2 Reduce Operator Tree: @@ -1083,10 +1314,10 @@ STAGE PLANS: outputColumnNames: _col0 Statistics: Num rows: 1 Data size: 21 Basic stats: COMPLETE Column stats: NONE Dynamic Partitioning Event Operator + Target column: ds (string) Target Input: srcpart Partition key expr: ds Statistics: Num rows: 1 Data size: 21 Basic stats: COMPLETE Column stats: NONE - Target column: ds Target Vertex: Map 1 Reducer 2 Reduce Operator Tree: @@ -1323,10 +1554,10 @@ STAGE PLANS: outputColumnNames: _col0 Statistics: Num rows: 1 Data size: 7 Basic stats: COMPLETE Column stats: NONE Dynamic Partitioning Event Operator + Target column: hr (string) Target Input: srcpart Partition key expr: UDFToDouble(hr) Statistics: Num rows: 1 Data size: 7 Basic stats: COMPLETE Column stats: NONE - Target column: hr Target Vertex: Map 1 Reducer 2 Reduce Operator Tree: @@ -1445,10 +1676,10 @@ STAGE PLANS: outputColumnNames: _col0 Statistics: Num rows: 1 Data size: 7 Basic stats: COMPLETE Column stats: NONE Dynamic Partitioning Event Operator + Target column: hr (string) Target Input: srcpart Partition key expr: (UDFToDouble(hr) * 2.0) Statistics: Num rows: 1 Data size: 7 Basic stats: COMPLETE Column stats: NONE - Target column: hr Target Vertex: Map 1 Reducer 2 Reduce Operator Tree: @@ -1794,10 +2025,10 @@ STAGE PLANS: outputColumnNames: _col0 Statistics: Num rows: 1 Data size: 7 Basic stats: COMPLETE Column stats: NONE Dynamic Partitioning Event Operator + Target column: hr (string) Target Input: srcpart Partition key expr: UDFToString((UDFToDouble(hr) * 2.0)) Statistics: Num rows: 1 Data size: 7 Basic stats: COMPLETE Column stats: NONE - Target column: hr Target Vertex: Map 1 Reducer 2 Reduce Operator Tree: @@ -1978,10 +2209,10 @@ STAGE PLANS: outputColumnNames: _col0 Statistics: Num rows: 500 Data size: 5312 Basic stats: COMPLETE Column stats: NONE Dynamic Partitioning Event Operator + Target column: ds (string) Target Input: srcpart Partition key expr: ds Statistics: Num rows: 500 Data size: 5312 Basic stats: COMPLETE Column stats: NONE - Target column: ds Target Vertex: Map 1 Stage: Stage-0 @@ -2194,10 +2425,10 @@ STAGE PLANS: outputColumnNames: _col0 Statistics: Num rows: 1 Data size: 27 Basic stats: COMPLETE Column stats: NONE Dynamic Partitioning Event Operator + Target column: ds (string) Target Input: srcpart Partition key expr: ds Statistics: Num rows: 1 Data size: 27 Basic stats: COMPLETE Column stats: NONE - Target column: ds Target Vertex: Map 1 Select Operator expressions: _col2 (type: string) @@ -2209,10 +2440,10 @@ STAGE PLANS: outputColumnNames: _col0 Statistics: Num rows: 1 Data size: 27 Basic stats: COMPLETE Column stats: NONE Dynamic Partitioning Event Operator + Target column: hr (string) Target Input: srcpart Partition key expr: hr Statistics: Num rows: 1 Data size: 27 Basic stats: COMPLETE Column stats: NONE - Target column: hr Target Vertex: Map 1 Reducer 2 Reduce Operator Tree: @@ -2333,10 +2564,10 @@ STAGE PLANS: outputColumnNames: _col0 Statistics: Num rows: 1 Data size: 21 Basic stats: COMPLETE Column stats: NONE Dynamic Partitioning Event Operator + Target column: ds (string) Target Input: srcpart Partition key expr: ds Statistics: Num rows: 1 Data size: 21 Basic stats: COMPLETE Column stats: NONE - Target column: ds Target Vertex: Map 1 Reducer 2 Reduce Operator Tree: @@ -2421,10 +2652,10 @@ STAGE PLANS: outputColumnNames: _col0 Statistics: Num rows: 1 Data size: 21 Basic stats: COMPLETE Column stats: NONE Dynamic Partitioning Event Operator + Target column: ds (string) Target Input: srcpart Partition key expr: ds Statistics: Num rows: 1 Data size: 21 Basic stats: COMPLETE Column stats: NONE - Target column: ds Target Vertex: Map 4 Map 4 Map Operator Tree: @@ -2539,10 +2770,10 @@ STAGE PLANS: outputColumnNames: _col0 Statistics: Num rows: 1 Data size: 21 Basic stats: COMPLETE Column stats: NONE Dynamic Partitioning Event Operator + Target column: ds (string) Target Input: srcpart Partition key expr: ds Statistics: Num rows: 1 Data size: 21 Basic stats: COMPLETE Column stats: NONE - Target column: ds Target Vertex: Map 1 Reducer 2 Reduce Operator Tree: @@ -2646,10 +2877,10 @@ STAGE PLANS: outputColumnNames: _col0 Statistics: Num rows: 1 Data size: 21 Basic stats: COMPLETE Column stats: NONE Dynamic Partitioning Event Operator + Target column: ds (string) Target Input: srcpart Partition key expr: ds Statistics: Num rows: 1 Data size: 21 Basic stats: COMPLETE Column stats: NONE - Target column: ds Target Vertex: Map 1 Map 6 Map Operator Tree: @@ -3011,10 +3242,10 @@ STAGE PLANS: outputColumnNames: _col0 Statistics: Num rows: 2 Data size: 168 Basic stats: COMPLETE Column stats: NONE Dynamic Partitioning Event Operator + Target column: ds (string) Target Input: srcpart Partition key expr: ds Statistics: Num rows: 2 Data size: 168 Basic stats: COMPLETE Column stats: NONE - Target column: ds Target Vertex: Map 1 Reducer 8 Reduce Operator Tree: @@ -3046,10 +3277,10 @@ STAGE PLANS: outputColumnNames: _col0 Statistics: Num rows: 2 Data size: 168 Basic stats: COMPLETE Column stats: NONE Dynamic Partitioning Event Operator + Target column: ds (string) Target Input: srcpart Partition key expr: ds Statistics: Num rows: 2 Data size: 168 Basic stats: COMPLETE Column stats: NONE - Target column: ds Target Vertex: Map 1 Union 6 Vertex: Union 6 @@ -3210,10 +3441,10 @@ STAGE PLANS: outputColumnNames: _col0 Statistics: Num rows: 2 Data size: 168 Basic stats: COMPLETE Column stats: NONE Dynamic Partitioning Event Operator + Target column: ds (string) Target Input: srcpart Partition key expr: ds Statistics: Num rows: 2 Data size: 168 Basic stats: COMPLETE Column stats: NONE - Target column: ds Target Vertex: Map 1 Reducer 8 Reduce Operator Tree: @@ -3245,10 +3476,10 @@ STAGE PLANS: outputColumnNames: _col0 Statistics: Num rows: 2 Data size: 168 Basic stats: COMPLETE Column stats: NONE Dynamic Partitioning Event Operator + Target column: ds (string) Target Input: srcpart Partition key expr: ds Statistics: Num rows: 2 Data size: 168 Basic stats: COMPLETE Column stats: NONE - Target column: ds Target Vertex: Map 1 Union 6 Vertex: Union 6 @@ -3394,10 +3625,10 @@ STAGE PLANS: outputColumnNames: _col0 Statistics: Num rows: 2 Data size: 168 Basic stats: COMPLETE Column stats: NONE Dynamic Partitioning Event Operator + Target column: ds (string) Target Input: srcpart Partition key expr: ds Statistics: Num rows: 2 Data size: 168 Basic stats: COMPLETE Column stats: NONE - Target column: ds Target Vertex: Map 1 Select Operator expressions: _col0 (type: string) @@ -3409,10 +3640,10 @@ STAGE PLANS: outputColumnNames: _col0 Statistics: Num rows: 2 Data size: 168 Basic stats: COMPLETE Column stats: NONE Dynamic Partitioning Event Operator + Target column: ds (string) Target Input: srcpart Partition key expr: ds Statistics: Num rows: 2 Data size: 168 Basic stats: COMPLETE Column stats: NONE - Target column: ds Target Vertex: Map 5 Reducer 2 Reduce Operator Tree: @@ -3485,10 +3716,10 @@ STAGE PLANS: outputColumnNames: _col0 Statistics: Num rows: 2 Data size: 168 Basic stats: COMPLETE Column stats: NONE Dynamic Partitioning Event Operator + Target column: ds (string) Target Input: srcpart Partition key expr: ds Statistics: Num rows: 2 Data size: 168 Basic stats: COMPLETE Column stats: NONE - Target column: ds Target Vertex: Map 1 Select Operator expressions: _col0 (type: string) @@ -3500,10 +3731,10 @@ STAGE PLANS: outputColumnNames: _col0 Statistics: Num rows: 2 Data size: 168 Basic stats: COMPLETE Column stats: NONE Dynamic Partitioning Event Operator + Target column: ds (string) Target Input: srcpart Partition key expr: ds Statistics: Num rows: 2 Data size: 168 Basic stats: COMPLETE Column stats: NONE - Target column: ds Target Vertex: Map 5 Union 3 Vertex: Union 3 @@ -3611,10 +3842,10 @@ STAGE PLANS: outputColumnNames: _col0 Statistics: Num rows: 1 Data size: 21 Basic stats: COMPLETE Column stats: NONE Dynamic Partitioning Event Operator + Target column: ds (string) Target Input: srcpart Partition key expr: ds Statistics: Num rows: 1 Data size: 21 Basic stats: COMPLETE Column stats: NONE - Target column: ds Target Vertex: Map 1 Reducer 2 Reduce Operator Tree: @@ -3669,6 +3900,126 @@ POSTHOOK: Input: default@srcpart@ds=2008-04-08/hr=11 POSTHOOK: Input: default@srcpart@ds=2008-04-08/hr=12 #### A masked pattern was here #### 1000 +PREHOOK: query: -- single column, single key, udf with typechange +EXPLAIN select count(*) from srcpart join srcpart_date on (day(srcpart.ds) = day(srcpart_date.ds)) where srcpart_date.`date` = '2008-04-08' +PREHOOK: type: QUERY +POSTHOOK: query: -- single column, single key, udf with typechange +EXPLAIN select count(*) from srcpart join srcpart_date on (day(srcpart.ds) = day(srcpart_date.ds)) where srcpart_date.`date` = '2008-04-08' +POSTHOOK: type: QUERY +STAGE DEPENDENCIES: + Stage-1 is a root stage + Stage-0 depends on stages: Stage-1 + +STAGE PLANS: + Stage: Stage-1 + Tez + Edges: + Map 1 <- Map 3 (BROADCAST_EDGE) + Reducer 2 <- Map 1 (SIMPLE_EDGE) +#### A masked pattern was here #### + Vertices: + Map 1 + Map Operator Tree: + TableScan + alias: srcpart + filterExpr: ds is not null (type: boolean) + Statistics: Num rows: 2000 Data size: 21248 Basic stats: COMPLETE Column stats: NONE + Select Operator + expressions: ds (type: string) + outputColumnNames: _col0 + Statistics: Num rows: 2000 Data size: 21248 Basic stats: COMPLETE Column stats: NONE + Map Join Operator + condition map: + Inner Join 0 to 1 + keys: + 0 day(_col0) (type: int) + 1 day(_col0) (type: int) + input vertices: + 1 Map 3 + Statistics: Num rows: 2200 Data size: 23372 Basic stats: COMPLETE Column stats: NONE + HybridGraceHashJoin: true + Group By Operator + aggregations: count() + mode: hash + outputColumnNames: _col0 + Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: NONE + Reduce Output Operator + sort order: + Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: NONE + value expressions: _col0 (type: bigint) + Map 3 + Map Operator Tree: + TableScan + alias: srcpart_date + filterExpr: ((date = '2008-04-08') and ds is not null) (type: boolean) + Statistics: Num rows: 2 Data size: 42 Basic stats: COMPLETE Column stats: NONE + Filter Operator + predicate: ((date = '2008-04-08') and ds is not null) (type: boolean) + Statistics: Num rows: 1 Data size: 21 Basic stats: COMPLETE Column stats: NONE + Select Operator + expressions: ds (type: string) + outputColumnNames: _col0 + Statistics: Num rows: 1 Data size: 21 Basic stats: COMPLETE Column stats: NONE + Reduce Output Operator + key expressions: day(_col0) (type: int) + sort order: + + Map-reduce partition columns: day(_col0) (type: int) + Statistics: Num rows: 1 Data size: 21 Basic stats: COMPLETE Column stats: NONE + Select Operator + expressions: day(_col0) (type: int) + outputColumnNames: _col0 + Statistics: Num rows: 1 Data size: 21 Basic stats: COMPLETE Column stats: NONE + Group By Operator + keys: _col0 (type: int) + mode: hash + outputColumnNames: _col0 + Statistics: Num rows: 1 Data size: 21 Basic stats: COMPLETE Column stats: NONE + Dynamic Partitioning Event Operator + Target column: ds (string) + Target Input: srcpart + Partition key expr: day(ds) + Statistics: Num rows: 1 Data size: 21 Basic stats: COMPLETE Column stats: NONE + Target Vertex: Map 1 + Reducer 2 + Reduce Operator Tree: + Group By Operator + aggregations: count(VALUE._col0) + mode: mergepartial + outputColumnNames: _col0 + Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: NONE + File Output Operator + compressed: false + Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: NONE + table: + input format: org.apache.hadoop.mapred.TextInputFormat + output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat + serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe + + Stage: Stage-0 + Fetch Operator + limit: -1 + Processor Tree: + ListSink + +PREHOOK: query: select count(*) from srcpart join srcpart_date on (day(srcpart.ds) = day(srcpart_date.ds)) where srcpart_date.`date` = '2008-04-08' +PREHOOK: type: QUERY +PREHOOK: Input: default@srcpart +PREHOOK: Input: default@srcpart@ds=2008-04-08/hr=11 +PREHOOK: Input: default@srcpart@ds=2008-04-08/hr=12 +PREHOOK: Input: default@srcpart@ds=2008-04-09/hr=11 +PREHOOK: Input: default@srcpart@ds=2008-04-09/hr=12 +PREHOOK: Input: default@srcpart_date +#### A masked pattern was here #### +POSTHOOK: query: select count(*) from srcpart join srcpart_date on (day(srcpart.ds) = day(srcpart_date.ds)) where srcpart_date.`date` = '2008-04-08' +POSTHOOK: type: QUERY +POSTHOOK: Input: default@srcpart +POSTHOOK: Input: default@srcpart@ds=2008-04-08/hr=11 +POSTHOOK: Input: default@srcpart@ds=2008-04-08/hr=12 +POSTHOOK: Input: default@srcpart@ds=2008-04-09/hr=11 +POSTHOOK: Input: default@srcpart@ds=2008-04-09/hr=12 +POSTHOOK: Input: default@srcpart_date +#### A masked pattern was here #### +1000 PREHOOK: query: -- multiple sources, single key EXPLAIN select count(*) from srcpart join srcpart_date on (srcpart.ds = srcpart_date.ds) join srcpart_hour on (srcpart.hr = srcpart_hour.hr) where srcpart_date.`date` = '2008-04-08' and srcpart_hour.hour = 11 @@ -3756,10 +4107,10 @@ STAGE PLANS: outputColumnNames: _col0 Statistics: Num rows: 1 Data size: 21 Basic stats: COMPLETE Column stats: NONE Dynamic Partitioning Event Operator + Target column: ds (string) Target Input: srcpart Partition key expr: ds Statistics: Num rows: 1 Data size: 21 Basic stats: COMPLETE Column stats: NONE - Target column: ds Target Vertex: Map 1 Map 4 Map Operator Tree: @@ -3789,10 +4140,10 @@ STAGE PLANS: outputColumnNames: _col0 Statistics: Num rows: 1 Data size: 5 Basic stats: COMPLETE Column stats: NONE Dynamic Partitioning Event Operator + Target column: hr (string) Target Input: srcpart Partition key expr: hr Statistics: Num rows: 1 Data size: 5 Basic stats: COMPLETE Column stats: NONE - Target column: hr Target Vertex: Map 1 Reducer 2 Reduce Operator Tree: @@ -3923,10 +4274,10 @@ STAGE PLANS: outputColumnNames: _col0 Statistics: Num rows: 1 Data size: 27 Basic stats: COMPLETE Column stats: NONE Dynamic Partitioning Event Operator + Target column: ds (string) Target Input: srcpart Partition key expr: ds Statistics: Num rows: 1 Data size: 27 Basic stats: COMPLETE Column stats: NONE - Target column: ds Target Vertex: Map 1 Select Operator expressions: _col2 (type: string) @@ -3938,10 +4289,10 @@ STAGE PLANS: outputColumnNames: _col0 Statistics: Num rows: 1 Data size: 27 Basic stats: COMPLETE Column stats: NONE Dynamic Partitioning Event Operator + Target column: hr (string) Target Input: srcpart Partition key expr: hr Statistics: Num rows: 1 Data size: 27 Basic stats: COMPLETE Column stats: NONE - Target column: hr Target Vertex: Map 1 Reducer 2 Reduce Operator Tree: @@ -4069,10 +4420,10 @@ STAGE PLANS: outputColumnNames: _col0 Statistics: Num rows: 1 Data size: 21 Basic stats: COMPLETE Column stats: NONE Dynamic Partitioning Event Operator + Target column: ds (string) Target Input: srcpart Partition key expr: ds Statistics: Num rows: 1 Data size: 21 Basic stats: COMPLETE Column stats: NONE - Target column: ds Target Vertex: Map 1 Reducer 2 Reduce Operator Tree: @@ -4176,10 +4527,10 @@ STAGE PLANS: outputColumnNames: _col0 Statistics: Num rows: 1 Data size: 7 Basic stats: COMPLETE Column stats: NONE Dynamic Partitioning Event Operator + Target column: hr (string) Target Input: srcpart Partition key expr: UDFToDouble(hr) Statistics: Num rows: 1 Data size: 7 Basic stats: COMPLETE Column stats: NONE - Target column: hr Target Vertex: Map 1 Reducer 2 Reduce Operator Tree: @@ -4294,10 +4645,10 @@ STAGE PLANS: outputColumnNames: _col0 Statistics: Num rows: 1 Data size: 7 Basic stats: COMPLETE Column stats: NONE Dynamic Partitioning Event Operator + Target column: hr (string) Target Input: srcpart Partition key expr: (UDFToDouble(hr) * 2.0) Statistics: Num rows: 1 Data size: 7 Basic stats: COMPLETE Column stats: NONE - Target column: hr Target Vertex: Map 1 Reducer 2 Reduce Operator Tree: @@ -4557,10 +4908,10 @@ STAGE PLANS: outputColumnNames: _col0 Statistics: Num rows: 1 Data size: 21 Basic stats: COMPLETE Column stats: NONE Dynamic Partitioning Event Operator + Target column: ds (string) Target Input: srcpart Partition key expr: ds Statistics: Num rows: 1 Data size: 21 Basic stats: COMPLETE Column stats: NONE - Target column: ds Target Vertex: Map 1 Reducer 2 Reduce Operator Tree: @@ -4837,10 +5188,10 @@ STAGE PLANS: outputColumnNames: _col0 Statistics: Num rows: 1 Data size: 21 Basic stats: COMPLETE Column stats: NONE Dynamic Partitioning Event Operator + Target column: ds (string) Target Input: srcpart Partition key expr: ds Statistics: Num rows: 1 Data size: 21 Basic stats: COMPLETE Column stats: NONE - Target column: ds Target Vertex: Map 1 Map 4 Map Operator Tree: @@ -5152,10 +5503,10 @@ STAGE PLANS: outputColumnNames: _col0 Statistics: Num rows: 2 Data size: 168 Basic stats: COMPLETE Column stats: NONE Dynamic Partitioning Event Operator + Target column: ds (string) Target Input: srcpart Partition key expr: ds Statistics: Num rows: 2 Data size: 168 Basic stats: COMPLETE Column stats: NONE - Target column: ds Target Vertex: Map 1 Reducer 7 Reduce Operator Tree: @@ -5187,10 +5538,10 @@ STAGE PLANS: outputColumnNames: _col0 Statistics: Num rows: 2 Data size: 168 Basic stats: COMPLETE Column stats: NONE Dynamic Partitioning Event Operator + Target column: ds (string) Target Input: srcpart Partition key expr: ds Statistics: Num rows: 2 Data size: 168 Basic stats: COMPLETE Column stats: NONE - Target column: ds Target Vertex: Map 1 Union 5 Vertex: Union 5 @@ -5328,10 +5679,10 @@ STAGE PLANS: outputColumnNames: _col0 Statistics: Num rows: 2 Data size: 54 Basic stats: COMPLETE Column stats: NONE Dynamic Partitioning Event Operator + Target column: ds (string) Target Input: srcpart_orc Partition key expr: ds Statistics: Num rows: 2 Data size: 54 Basic stats: COMPLETE Column stats: NONE - Target column: ds Target Vertex: Map 1 Select Operator expressions: UDFToDouble(_col2) (type: double) @@ -5343,10 +5694,10 @@ STAGE PLANS: outputColumnNames: _col0 Statistics: Num rows: 2 Data size: 54 Basic stats: COMPLETE Column stats: NONE Dynamic Partitioning Event Operator + Target column: hr (int) Target Input: srcpart_orc Partition key expr: UDFToDouble(hr) Statistics: Num rows: 2 Data size: 54 Basic stats: COMPLETE Column stats: NONE - Target column: hr Target Vertex: Map 1 Reducer 2 Reduce Operator Tree: http://git-wip-us.apache.org/repos/asf/hive/blob/6f7ded6e/ql/src/test/results/clientpositive/tez/dynamic_partition_pruning_2.q.out ---------------------------------------------------------------------- diff --git a/ql/src/test/results/clientpositive/tez/dynamic_partition_pruning_2.q.out b/ql/src/test/results/clientpositive/tez/dynamic_partition_pruning_2.q.out index bc5638c..0d8e2bd 100644 --- a/ql/src/test/results/clientpositive/tez/dynamic_partition_pruning_2.q.out +++ b/ql/src/test/results/clientpositive/tez/dynamic_partition_pruning_2.q.out @@ -226,10 +226,10 @@ STAGE PLANS: outputColumnNames: _col0 Statistics: Num rows: 1 Data size: 5 Basic stats: COMPLETE Column stats: NONE Dynamic Partitioning Event Operator + Target column: dim_shops_id (int) Target Input: agg Partition key expr: dim_shops_id Statistics: Num rows: 1 Data size: 5 Basic stats: COMPLETE Column stats: NONE - Target column: dim_shops_id Target Vertex: Map 1 Reducer 2 Reduce Operator Tree: @@ -752,10 +752,10 @@ STAGE PLANS: outputColumnNames: _col0 Statistics: Num rows: 1 Data size: 5 Basic stats: COMPLETE Column stats: NONE Dynamic Partitioning Event Operator + Target column: dim_shops_id (int) Target Input: agg Partition key expr: dim_shops_id Statistics: Num rows: 1 Data size: 5 Basic stats: COMPLETE Column stats: NONE - Target column: dim_shops_id Target Vertex: Map 1 Reducer 2 Reduce Operator Tree: @@ -900,10 +900,10 @@ STAGE PLANS: outputColumnNames: _col0 Statistics: Num rows: 1 Data size: 5 Basic stats: COMPLETE Column stats: NONE Dynamic Partitioning Event Operator + Target column: dim_shops_id (int) Target Input: agg_01 Partition key expr: dim_shops_id Statistics: Num rows: 1 Data size: 5 Basic stats: COMPLETE Column stats: NONE - Target column: dim_shops_id Target Vertex: Map 1 Map 4 Map Operator Tree: @@ -961,10 +961,10 @@ STAGE PLANS: outputColumnNames: _col0 Statistics: Num rows: 1 Data size: 5 Basic stats: COMPLETE Column stats: NONE Dynamic Partitioning Event Operator + Target column: dim_shops_id (int) Target Input: agg_01 Partition key expr: dim_shops_id Statistics: Num rows: 1 Data size: 5 Basic stats: COMPLETE Column stats: NONE - Target column: dim_shops_id Target Vertex: Map 4 Union 2 Vertex: Union 2 http://git-wip-us.apache.org/repos/asf/hive/blob/6f7ded6e/ql/src/test/results/clientpositive/tez/metadataonly1.q.out ---------------------------------------------------------------------- diff --git a/ql/src/test/results/clientpositive/tez/metadataonly1.q.out b/ql/src/test/results/clientpositive/tez/metadataonly1.q.out index 4ef71f8..37408e1 100644 --- a/ql/src/test/results/clientpositive/tez/metadataonly1.q.out +++ b/ql/src/test/results/clientpositive/tez/metadataonly1.q.out @@ -920,10 +920,10 @@ STAGE PLANS: outputColumnNames: _col0 Statistics: Num rows: 1 Data size: 84 Basic stats: COMPLETE Column stats: NONE Dynamic Partitioning Event Operator + Target column: ds (string) Target Input: a2 Partition key expr: ds Statistics: Num rows: 1 Data size: 84 Basic stats: COMPLETE Column stats: NONE - Target column: ds Target Vertex: Map 1 Stage: Stage-0
