[
https://issues.apache.org/jira/browse/HIVE-8740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Prasanth J updated HIVE-8740:
-----------------------------
Description: Sorted dynamic partition optimization looks for partition
columns from the operator above FileSinkOperator. As per hive convention it
expects partition columns at the last. But with HIVE-8585 equality filters on
partition columns gets folded to constant. The column pruner then prunes the
constant expression as they don't reference any columns. This in some cases
will yield unexpected results (throw ArrayIndexOutOfBounds exception) with
sorted dynamic partition insert optimization. In such cases we don't really
need sorted dynamic partition optimization. (was: Sorted dynamic partition
optimization looks for partition columns from the operator above
FileSinkOperator. As per hive convention it expects partition columns at the
last. But with HIVE-8585 equality filters on partition columns gets folded to
constant. The column pruner then prunes the constant expression as they don't
reference any columns. This in some cases will yield unexpected results (throw
ArrayIndexOutOfBounds exception) with sorted dynamic partition insert
optimization. In such we don't really need sorted dynamic partition
optimization.)
> Sorted dynamic partition does not work correctly with constant folding
> ----------------------------------------------------------------------
>
> Key: HIVE-8740
> URL: https://issues.apache.org/jira/browse/HIVE-8740
> Project: Hive
> Issue Type: Bug
> Affects Versions: 0.14.0
> Reporter: Prasanth J
> Assignee: Prasanth J
> Attachments: HIVE-8740.1.patch, HIVE-8740.2.patch
>
>
> Sorted dynamic partition optimization looks for partition columns from the
> operator above FileSinkOperator. As per hive convention it expects partition
> columns at the last. But with HIVE-8585 equality filters on partition columns
> gets folded to constant. The column pruner then prunes the constant
> expression as they don't reference any columns. This in some cases will yield
> unexpected results (throw ArrayIndexOutOfBounds exception) with sorted
> dynamic partition insert optimization. In such cases we don't really need
> sorted dynamic partition optimization.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
