Vihang Karajgaonkar created HIVE-17875:
------------------------------------------
Summary: Vectorization support for complex types breaks parquet
vectorization
Key: HIVE-17875
URL: https://issues.apache.org/jira/browse/HIVE-17875
Project: Hive
Issue Type: Bug
Components: Vectorization
Reporter: Vihang Karajgaonkar
Assignee: Vihang Karajgaonkar
HIVE-16589 introduced support for complex types for vectorized execution. It
introduces two new configs {{hive.vectorized.complex.types.enabled}} and
{{hive.vectorized.groupby.complex.types.enabled}} which default to true and
control whether {{Vectorizer}} creates a vectorized execution plan for queries
using complex types. Since Parquet fileformat does not support vectorization
for complex types yet, any query running on parquet tables with complex types
current fails with a RuntimeException complaining that the complex type is not
supported. We should improve the logic in Vectorizer to check if the
FileinputFormat supports complex types and if not it should not vectorize the
query plan.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
