[ 
https://issues.apache.org/jira/browse/HIVE-10938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14577609#comment-14577609
 ] 

Pengcheng Xiong commented on HIVE-10938:
----------------------------------------

[~spena], yes, i can still reproduce that on the current master. You can just 
save the commands in a q file. If you run that with TestCliDriver, you will have
{code}
STAGE DEPENDENCIES:
  Stage-0 is a root stage

STAGE PLANS:
  Stage: Stage-0
    Fetch Operator
      limit: -1
      Processor Tree:
        TableScan
          alias: unencryptedtable
          Statistics: Num rows: 2 Data size: 22 Basic stats: COMPLETE Column 
stats: NONE
          Select Operator
            expressions: key (type: string), value (type: string)
            outputColumnNames: _col0, _col1
            Statistics: Num rows: 2 Data size: 22 Basic stats: COMPLETE Column 
stats: NONE
            ListSink
{code}
This is correct.
However, if you run that with TestEncryptedHDFSCliDriver, you will have
{code}
STAGE DEPENDENCIES:
  Stage-0 is a root stage

STAGE PLANS:
  Stage: Stage-0
    Fetch Operator
      limit: -1
      Processor Tree:
        TableScan
          alias: unencryptedtable
          Statistics: Num rows: 1 Data size: 24 Basic stats: COMPLETE Column 
stats: NONE
          Select Operator
            expressions: key (type: string), value (type: string)
            outputColumnNames: _col0, _col1
            Statistics: Num rows: 1 Data size: 24 Basic stats: COMPLETE Column 
stats: NONE
            ListSink
{code}
This is not correct. If you look into more details, you will find that analyze 
table statement never works. Thanks.

> All the analyze table statements are failing on encryption testing framework
> ----------------------------------------------------------------------------
>
>                 Key: HIVE-10938
>                 URL: https://issues.apache.org/jira/browse/HIVE-10938
>             Project: Hive
>          Issue Type: Bug
>            Reporter: Pengcheng Xiong
>
> To reproduce, in recent q test environment, create a q file
> {code}
> drop table IF EXISTS unencryptedTable;
> create table unencryptedTable(key string, value string);
> insert into table unencryptedTable values
>     ('501', 'val_501'),
>     ('502', 'val_502');
> analyze table unencryptedTable compute statistics;
> explain select * from unencryptedTable;
> {code}
> Then run with TestEncryptedHDFSCliDriver.
> analyze table will generate a MapRed task and a StatsTask. The MapRed task 
> will fail silently without generating the stats, e.g., numRows for the table. 
> And the following StatsTask can not read any results. This will fail not only 
> for encrypted tables but also non-encrypted one as shown above.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to