STAGE DEPENDENCIES: Stage-8 is a root stage , consists of Stage-1 Stage-1 Stage-6 depends on stages: Stage-1 , consists of Stage-9, Stage-2 Stage-9 has a backup stage: Stage-2 Stage-5 depends on stages: Stage-9 Stage-2 Stage-0 depends on stages: Stage-5, Stage-2 STAGE PLANS: Stage: Stage-8 Conditional Operator Stage: Stage-1 Map Reduce Map Operator Tree: TableScan alias: t Statistics: Num rows: 19674316 Data size: 77438109612 Basic stats: COMPLETE Column stats: NONE Reduce Output Operator key expressions: ordr_code (type: string), cart_prod_id (type: bigint) sort order: ++ Map-reduce partition columns: ordr_code (type: string), cart_prod_id (type: bigint) Statistics: Num rows: 19674316 Data size: 77438109612 Basic stats: COMPLETE Column stats: NONE value expressions: chanl_id (type: bigint), sessn_id (type: string), gu_id (type: string), city_id (type: string), nav_refer_page_type_id (type: string), nav_refer_page_value (type: string), nav_page_type_id (type: string), nav_page_value (type: string), pltfm_id (type: int), detl_tracker_id (type: string), detl_page_type_id (type: string), detl_page_value (type: string), detl_pm_id (type: bigint), cart_tracker_id (type: string), cart_page_type_id (type: string), cart_page_value (type: string), cart_position_track_id (type: string), cart_pm_id (type: bigint), nav_refer_tpa (type: string), nav_refer_tpa_id (type: string), nav_refer_tpc (type: string), nav_refer_tpi (type: string), nav_tpa_id (type: string), nav_tpa (type: string), nav_tpc (type: string), nav_tpi (type: string), nav_tcdt (type: string), nav_tcd (type: string), detl_tpa_id (type: string), detl_tpa (type: string), detl_tpc (type: string), detl_tpi (type: string), detl_tcdt (type: string), detl_tcd (type: string), cart_tpa_id (type: string), cart_tpa (type: string), cart_tpc (type: string), cart_tpi (type: string), cart_tcdt (type: string), cart_tcd (type: string), detl_refer_page_type_id (type: string), detl_refer_page_value (type: string) TableScan alias: o Statistics: Num rows: 433285 Data size: 57193663 Basic stats: COMPLETE Column stats: NONE Reduce Output Operator key expressions: parnt_ordr_code (type: string), comb_prod_id (type: bigint) sort order: ++ Map-reduce partition columns: parnt_ordr_code (type: string), comb_prod_id (type: bigint) Statistics: Num rows: 433285 Data size: 57193663 Basic stats: COMPLETE Column stats: NONE value expressions: end_user_id (type: bigint), actl_sale_amt (type: double), sale_num (type: bigint) Reduce Operator Tree: Join Operator condition map: Left Outer Join0 to 1 keys: 0 ordr_code (type: string), cart_prod_id (type: bigint) 1 parnt_ordr_code (type: string), comb_prod_id (type: bigint) outputColumnNames: _col1, _col2, _col3, _col5, _col10, _col11, _col15, _col16, _col20, _col28, _col29, _col30, _col31, _col34, _col35, _col36, _col39, _col40, _col45, _col56, _col57, _col58, _col59, _col66, _col67, _col68, _col69, _col72, _col73, _col76, _col77, _col78, _col79, _col82, _col83, _col86, _col87, _col88, _col89, _col92, _col93, _col98, _col99, _col129, _col130, _col133, _col134 Statistics: Num rows: 21641748 Data size: 85181922419 Basic stats: COMPLETE Column stats: NONE File Output Operator compressed: false table: input format: org.apache.hadoop.mapred.SequenceFileInputFormat output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat serde: org.apache.hadoop.hive.serde2.lazybinary.LazyBinarySerDe Stage: Stage-6 Conditional Operator Stage: Stage-9 Map Reduce Local Work Alias -> Map Local Tables: f Fetch Operator limit: -1 Alias -> Map Local Operator Tree: f TableScan alias: f Filter Operator predicate: (first_ordr_date_id = '2015-05-10') (type: boolean) HashTable Sink Operator keys: 0 _col130 (type: bigint) 1 end_user_id (type: bigint) Stage: Stage-5 Map Reduce Map Operator Tree: TableScan Map Join Operator condition map: Left Outer Join0 to 1 keys: 0 _col130 (type: bigint) 1 end_user_id (type: bigint) outputColumnNames: _col1, _col2, _col3, _col5, _col10, _col11, _col15, _col16, _col20, _col28, _col29, _col30, _col31, _col34, _col35, _col36, _col39, _col40, _col45, _col56, _col57, _col58, _col59, _col66, _col67, _col68, _col69, _col72, _col73, _col76, _col77, _col78, _col79, _col82, _col83, _col86, _col87, _col88, _col89, _col92, _col93, _col98, _col99, _col129, _col130, _col133, _col134, _col141 Select Operator expressions: '2015-05-10' (type: string), _col1 (type: bigint), _col20 (type: int), _col5 (type: string), _col2 (type: string), _col3 (type: string), _col10 (type: string), _col11 (type: string), _col56 (type: string), _col57 (type: string), _col58 (type: string), _col59 (type: string), _col15 (type: string), _col16 (type: string), _col66 (type: string), _col67 (type: string), _col68 (type: string), _col69 (type: string), _col72 (type: string), _col73 (type: string), _col98 (type: string), _col99 (type: string), _col28 (type: string), _col29 (type: string), _col30 (type: string), _col31 (type: bigint), _col76 (type: string), _col77 (type: string), _col78 (type: string), _col79 (type: string), _col82 (type: string), _col83 (type: string), CASE WHEN ((length(_col28) > 0)) THEN (_col29) ELSE (_col15) END (type: string), CASE WHEN ((length(_col28) > 0)) THEN (_col30) ELSE (_col16) END (type: string), _col35 (type: string), _col36 (type: string), _col45 (type: bigint), _col86 (type: string), _col87 (type: string), _col88 (type: string), _col89 (type: string), _col92 (type: string), _col93 (type: string), _col34 (type: string), _col40 (type: bigint), _col39 (type: string), _col129 (type: string), _col133 (type: double), _col134 (type: bigint), _col130 (type: bigint), CASE WHEN ((_col141 is not null and (length(_col141) > 0))) THEN (1) ELSE (0) END (type: int) outputColumnNames: _col0, _col1, _col2, _col3, _col4, _col5, _col6, _col7, _col8, _col9, _col10, _col11, _col12, _col13, _col14, _col15, _col16, _col17, _col18, _col19, _col20, _col21, _col22, _col23, _col24, _col25, _col26, _col27, _col28, _col29, _col30, _col31, _col32, _col33, _col34, _col35, _col36, _col37, _col38, _col39, _col40, _col41, _col42, _col43, _col44, _col45, _col46, _col47, _col48, _col49, _col50 File Output Operator compressed: false table: input format: org.apache.hadoop.mapred.TextInputFormat output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe Local Work: Map Reduce Local Work Stage: Stage-2 Map Reduce Map Operator Tree: TableScan Reduce Output Operator key expressions: _col130 (type: bigint) sort order: + Map-reduce partition columns: _col130 (type: bigint) Statistics: Num rows: 21641748 Data size: 85181922419 Basic stats: COMPLETE Column stats: NONE value expressions: _col1 (type: bigint), _col2 (type: string), _col3 (type: string), _col5 (type: string), _col10 (type: string), _col11 (type: string), _col15 (type: string), _col16 (type: string), _col20 (type: int), _col28 (type: string), _col29 (type: string), _col30 (type: string), _col31 (type: bigint), _col34 (type: string), _col35 (type: string), _col36 (type: string), _col39 (type: string), _col40 (type: bigint), _col45 (type: bigint), _col56 (type: string), _col57 (type: string), _col58 (type: string), _col59 (type: string), _col66 (type: string), _col67 (type: string), _col68 (type: string), _col69 (type: string), _col72 (type: string), _col73 (type: string), _col76 (type: string), _col77 (type: string), _col78 (type: string), _col79 (type: string), _col82 (type: string), _col83 (type: string), _col86 (type: string), _col87 (type: string), _col88 (type: string), _col89 (type: string), _col92 (type: string), _col93 (type: string), _col98 (type: string), _col99 (type: string), _col129 (type: string), _col133 (type: double), _col134 (type: bigint) TableScan alias: f Statistics: Num rows: 462833891 Data size: 8331010048 Basic stats: COMPLETE Column stats: NONE Filter Operator predicate: (first_ordr_date_id = '2015-05-10') (type: boolean) Statistics: Num rows: 231416945 Data size: 4165505015 Basic stats: COMPLETE Column stats: NONE Reduce Output Operator key expressions: end_user_id (type: bigint) sort order: + Map-reduce partition columns: end_user_id (type: bigint) Statistics: Num rows: 231416945 Data size: 4165505015 Basic stats: COMPLETE Column stats: NONE Reduce Operator Tree: Join Operator condition map: Left Outer Join0 to 1 keys: 0 _col130 (type: bigint) 1 end_user_id (type: bigint) outputColumnNames: _col1, _col2, _col3, _col5, _col10, _col11, _col15, _col16, _col20, _col28, _col29, _col30, _col31, _col34, _col35, _col36, _col39, _col40, _col45, _col56, _col57, _col58, _col59, _col66, _col67, _col68, _col69, _col72, _col73, _col76, _col77, _col78, _col79, _col82, _col83, _col86, _col87, _col88, _col89, _col92, _col93, _col98, _col99, _col129, _col130, _col133, _col134, _col141 Statistics: Num rows: 254558645 Data size: 4582055615 Basic stats: COMPLETE Column stats: NONE Select Operator expressions: '2015-05-10' (type: string), _col1 (type: bigint), _col20 (type: int), _col5 (type: string), _col2 (type: string), _col3 (type: string), _col10 (type: string), _col11 (type: string), _col56 (type: string), _col57 (type: string), _col58 (type: string), _col59 (type: string), _col15 (type: string), _col16 (type: string), _col66 (type: string), _col67 (type: string), _col68 (type: string), _col69 (type: string), _col72 (type: string), _col73 (type: string), _col98 (type: string), _col99 (type: string), _col28 (type: string), _col29 (type: string), _col30 (type: string), _col31 (type: bigint), _col76 (type: string), _col77 (type: string), _col78 (type: string), _col79 (type: string), _col82 (type: string), _col83 (type: string), CASE WHEN ((length(_col28) > 0)) THEN (_col29) ELSE (_col15) END (type: string), CASE WHEN ((length(_col28) > 0)) THEN (_col30) ELSE (_col16) END (type: string), _col35 (type: string), _col36 (type: string), _col45 (type: bigint), _col86 (type: string), _col87 (type: string), _col88 (type: string), _col89 (type: string), _col92 (type: string), _col93 (type: string), _col34 (type: string), _col40 (type: bigint), _col39 (type: string), _col129 (type: string), _col133 (type: double), _col134 (type: bigint), _col130 (type: bigint), CASE WHEN ((_col141 is not null and (length(_col141) > 0))) THEN (1) ELSE (0) END (type: int) outputColumnNames: _col0, _col1, _col2, _col3, _col4, _col5, _col6, _col7, _col8, _col9, _col10, _col11, _col12, _col13, _col14, _col15, _col16, _col17, _col18, _col19, _col20, _col21, _col22, _col23, _col24, _col25, _col26, _col27, _col28, _col29, _col30, _col31, _col32, _col33, _col34, _col35, _col36, _col37, _col38, _col39, _col40, _col41, _col42, _col43, _col44, _col45, _col46, _col47, _col48, _col49, _col50 Statistics: Num rows: 254558645 Data size: 4582055615 Basic stats: COMPLETE Column stats: NONE File Output Operator compressed: false Statistics: Num rows: 254558645 Data size: 4582055615 Basic stats: COMPLETE Column stats: NONE table: input format: org.apache.hadoop.mapred.TextInputFormat output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe Stage: Stage-0 Fetch Operator limit: -1 Processor Tree: ListSink