[ 
https://issues.apache.org/jira/browse/HIVE-9023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Naveen Gangam updated HIVE-9023:
--------------------------------
    Status: Patch Available  (was: Open)

I tried to post a diff on the review board. DOesnt appear that RB is working. 

The Counter key name was changed to RECORDS_OUT. However, this cannot be a 
single value because a single query could affect multiple tables. So I used the 
tableName as the suffix to the counter key.

For example
from srcTable
insert overwrite table destTable1 select * where key = "value1"
insert overwrite table destTable2 select * where key = "value2"
insert overwrite table destTable3 select * where key = "value3";

The counter key names would be
RECORDS_OUT_destTable1
RECORDS_OUT_destTable2
RECORDS_OUT_destTable3
...

The Hive History then extracts the table name and the number of rows that were 
inserted into this table.

{code}
...
Loading data to table default.destTable2
Loading data to table default.destTable3
Table default.destTable1 stats: [numFiles=1, numRows=0, totalSize=38, 
rawDataSize=0]
Table default.destTable2 stats: [numFiles=1, numRows=0, totalSize=18, 
rawDataSize=0]
Table default.destTable3 stats: [numFiles=1, numRows=0, totalSize=20, 
rawDataSize=0]
3 Rows loaded to destTable1
6 Rows loaded to destTable2
3 Rows loaded to destTable3
...
{code}


> HiveHistoryImpl relies on removed counters to print num rows
> ------------------------------------------------------------
>
>                 Key: HIVE-9023
>                 URL: https://issues.apache.org/jira/browse/HIVE-9023
>             Project: Hive
>          Issue Type: Bug
>          Components: Query Processor
>    Affects Versions: 0.13.1, 0.14.0, 0.13.0, 0.14.1
>            Reporter: Slava Markeyev
>            Assignee: Naveen Gangam
>            Priority: Minor
>              Labels: regression
>         Attachments: HIVE-9023.patch
>
>
> HiveHistoryImpl still relies on the counters that were removed in HIVE-5982 
> to determine the number of rows loaded. This results in regression of 
> functionality. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to