[jira] [Created] (HIVE-22235) CommandProcessorResponse should not be an exception
Miklos Gergely created HIVE-22235: - Summary: CommandProcessorResponse should not be an exception Key: HIVE-22235 URL: https://issues.apache.org/jira/browse/HIVE-22235 Project: Hive Issue Type: Sub-task Components: Hive Reporter: Miklos Gergely Assignee: Miklos Gergely Fix For: 4.0.0 The CommandProcessorResponse class extends Exception. This may be convenient, but it is wrong, as a response is not an exception. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-22236) Fail to create View selecting View containing NOT IN subquery
Zoltan Matyus created HIVE-22236:
Summary: Fail to create View selecting View containing NOT IN
subquery
Key: HIVE-22236
URL: https://issues.apache.org/jira/browse/HIVE-22236
Project: Hive
Issue Type: Bug
Reporter: Zoltan Matyus
Assignee: Zoltan Matyus
* Given a complicated view with a select statement that has subquery containing
"{{NOT IN}}"
* Hive fails to create a simple view as {{SELECT * FROM complicated_view}}
* (with CBO disabled).
The unparse replacements of the complicated view will be applied to the text of
the simple view, resulting in {{IllegalArgumentException: replace: range
invalid}} exceptions from {{org.antlr.runtime.TokenRewriteStream.replace}}.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (HIVE-22237) Show operator id in non-user explain
Zoltan Haindrich created HIVE-22237: --- Summary: Show operator id in non-user explain Key: HIVE-22237 URL: https://issues.apache.org/jira/browse/HIVE-22237 Project: Hive Issue Type: Improvement Reporter: Zoltan Haindrich -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-22238) PK/FK selectivity estimation underscales estimations
Zoltan Haindrich created HIVE-22238: --- Summary: PK/FK selectivity estimation underscales estimations Key: HIVE-22238 URL: https://issues.apache.org/jira/browse/HIVE-22238 Project: Hive Issue Type: Bug Reporter: Zoltan Haindrich Assignee: Zoltan Haindrich at [this point|https://github.com/apache/hive/blob/5098d155a1e6a164253f5fa98755273bc34085df/ql/src/java/org/apache/hadoop/hive/ql/optimizer/stats/annotation/StatsRulesProcFactory.java#L2182] the parent operators rownum is scaled according to pkfkselectivity however [pkfkselectivity is computed|https://github.com/apache/hive/blob/5098d155a1e6a164253f5fa98755273bc34085df/ql/src/java/org/apache/hadoop/hive/ql/optimizer/stats/annotation/StatsRulesProcFactory.java#L2157] on a whole subtree. Scaling it by that amount will count in estimation already used when parentstats was calculated...so depending on the number of upstream joins - this may lead to severe underestimations -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-22239) Scale data size using column value ranges
Jesus Camacho Rodriguez created HIVE-22239: -- Summary: Scale data size using column value ranges Key: HIVE-22239 URL: https://issues.apache.org/jira/browse/HIVE-22239 Project: Hive Issue Type: Improvement Components: Physical Optimizer Reporter: Jesus Camacho Rodriguez Assignee: Jesus Camacho Rodriguez Currently, min/max values for columns are only used to determine whether a certain range filter falls out of range and thus filters all rows or none at all. If it does not, we just use a heuristic that the condition will filter 1/3 of the input rows. Instead of using that heuristic, we can use another one that assumes that data will be uniformly distributed across that range, and calculate the selectivity for the condition accordingly. This patch also includes the propagation of min/max column values from statistics to the optimizer for timestamp type. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-22240) Function percentile_cont fails when array parameter passed
Krisztian Kasa created HIVE-22240:
-
Summary: Function percentile_cont fails when array parameter passed
Key: HIVE-22240
URL: https://issues.apache.org/jira/browse/HIVE-22240
Project: Hive
Issue Type: Bug
Reporter: Krisztian Kasa
Assignee: Krisztian Kasa
Fix For: 4.0.0
{code}
SELECT
percentile_cont(array(0.2, 0.5, 0.9)) WITHIN GROUP (ORDER BY value)
FROM t_test;
{code}
hive.log:
{code}
2019-09-24T21:00:43,203 ERROR [LocalJobRunner Map Task Executor #0]
mr.ExecMapper: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime
Error while processing row
at
org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:573)
at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.map(ExecMapper.java:148)
at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54)
at
org.apache.hadoop.hive.ql.exec.mr.ExecMapRunner.run(ExecMapRunner.java:37)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:465)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:349)
at
org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:271)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException:
java.lang.ClassCastException: java.util.ArrayList cannot be cast to
org.apache.hadoop.hive.serde2.io.HiveDecimalWritable
at
org.apache.hadoop.hive.ql.exec.GroupByOperator.process(GroupByOperator.java:793)
at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:888)
at
org.apache.hadoop.hive.ql.exec.SelectOperator.process(SelectOperator.java:95)
at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:888)
at
org.apache.hadoop.hive.ql.exec.TableScanOperator.process(TableScanOperator.java:128)
at
org.apache.hadoop.hive.ql.exec.MapOperator$MapOpCtx.forward(MapOperator.java:152)
at
org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:552)
... 11 more
Caused by: java.lang.ClassCastException: java.util.ArrayList cannot be cast to
org.apache.hadoop.hive.serde2.io.HiveDecimalWritable
at
org.apache.hadoop.hive.ql.udf.generic.GenericUDAFPercentileCont$PercentileContEvaluator.iterate(GenericUDAFPercentileCont.java:259)
at
org.apache.hadoop.hive.ql.udf.generic.GenericUDAFEvaluator.aggregate(GenericUDAFEvaluator.java:214)
at
org.apache.hadoop.hive.ql.exec.GroupByOperator.updateAggregations(GroupByOperator.java:639)
at
org.apache.hadoop.hive.ql.exec.GroupByOperator.processHashAggr(GroupByOperator.java:814)
at
org.apache.hadoop.hive.ql.exec.GroupByOperator.processKey(GroupByOperator.java:720)
at
org.apache.hadoop.hive.ql.exec.GroupByOperator.process(GroupByOperator.java:788)
... 17 more
{code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (HIVE-22241) Implement UDF to convert a date/timestamp from Gregorian-Julian hybrid calendar to proleptic Gregorian calendar
Jesus Camacho Rodriguez created HIVE-22241: -- Summary: Implement UDF to convert a date/timestamp from Gregorian-Julian hybrid calendar to proleptic Gregorian calendar Key: HIVE-22241 URL: https://issues.apache.org/jira/browse/HIVE-22241 Project: Hive Issue Type: Improvement Components: UDF Reporter: Jesus Camacho Rodriguez Assignee: Jesus Camacho Rodriguez UDF that converts a date/timestamp from *Gregorian-Julian hybrid* calendar, i.e., calendar that supports both the Julian and Gregorian calendar systems with the support of a single discontinuity, which corresponds by default to the Gregorian date when the Gregorian calendar was instituted, to *proleptic Gregorian calendar* (ISO 8601 standard), which is produced by extending the Gregorian calendar backward to dates preceding its official introduction in 1582. -- This message was sent by Atlassian Jira (v8.3.4#803005)
