Quanlong Huang has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/21445 )

Change subject: IMPALA-13102: Normalize invalid column stats from HMS
......................................................................


Patch Set 3:

(1 comment)

http://gerrit.cloudera.org:8080/#/c/21445/1/tests/metadata/test_compute_stats.py
File tests/metadata/test_compute_stats.py:

http://gerrit.cloudera.org:8080/#/c/21445/1/tests/metadata/test_compute_stats.py@474
PS1, Line 474: client.update_table_column_sta
> Added an assertion to check the result (bool).
I can also see warning logs like this:

W0523 08:23:22.166049 24028 ColumnStats.java:549] 
c543d8cfe8844a49:bad5133f00000000] Invalid numDVs of column name: -400. 
Normalized to -1.
W0523 08:23:22.166126 24028 ColumnStats.java:549] 
c543d8cfe8844a49:bad5133f00000000] Invalid numNulls of column name: -300. 
Normalized to -1.
W0523 08:23:22.166178 24028 ColumnStats.java:549] 
c543d8cfe8844a49:bad5133f00000000] Invalid maxSize of column name: -100. 
Normalized to -1.
W0523 08:23:22.166267 24028 ColumnStats.java:557] 
c543d8cfe8844a49:bad5133f00000000] Invalid avgSize of column name: -200.0. 
Normalized to -1.



--
To view, visit http://gerrit.cloudera.org:8080/21445
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: If6216e3d6e73a529a9b3a8c0ea9d22727ab43f1a
Gerrit-Change-Number: 21445
Gerrit-PatchSet: 3
Gerrit-Owner: Quanlong Huang <huangquanl...@gmail.com>
Gerrit-Reviewer: Csaba Ringhofer <csringho...@cloudera.com>
Gerrit-Reviewer: Impala Public Jenkins <impala-public-jenk...@cloudera.com>
Gerrit-Reviewer: Quanlong Huang <huangquanl...@gmail.com>
Gerrit-Comment-Date: Thu, 23 May 2024 01:42:39 +0000
Gerrit-HasComments: Yes

Reply via email to