[
https://issues.apache.org/jira/browse/IMPALA-8197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17254246#comment-17254246
]
Joe McDonnell commented on IMPALA-8197:
---------------------------------------
[https://github.com/apache/impala/commit/97a6a3c8077affd5a181054d706cc7f30aecca91]
added some hive parquet compatibility tests in
custom_cluster/test_hive_parquet_codec_interop.py.
[~csringhofer] Can we resolve this Jira or were there further tests that you
had in mind?
> Validate Parquet files written by Impala using Parquet-mr
> ----------------------------------------------------------
>
> Key: IMPALA-8197
> URL: https://issues.apache.org/jira/browse/IMPALA-8197
> Project: IMPALA
> Issue Type: Test
> Components: Infrastructure
> Reporter: Csaba Ringhofer
> Priority: Major
> Labels: parquet
>
> Currently most of the insert tests write with Impala and also read back the
> values with Impala to check they were written correctly. Some bugs can be
> missed this way if both Impala's reader and writer logic are consistently
> wrong. Reading the values back with a Parquet-mr based tool like
> parquet-tool or Hive would help to catch such bugs.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscr...@impala.apache.org
For additional commands, e-mail: issues-all-h...@impala.apache.org
