[jira] [Created] (HIVE-16800) Hive Metastore configuration with Mysql

[Vigneshwaran (JIRA)]

Vigneshwaran created HIVE-16800:
---

 Summary: Hive Metastore configuration with Mysql
 Key: HIVE-16800
 URL: https://issues.apache.org/jira/browse/HIVE-16800
 Project: Hive
  Issue Type: Bug
Affects Versions: 1.2.2
Reporter: Vigneshwaran


I'm trying to configure MySql as metastore in Hive 1.2.2 by following the link 
https://dzone.com/articles/how-configure-mysql-metastore, but when I'm trying 
to run hive after all the step I'm getting the below errors:

Exception in thread "main" java.lang.RuntimeException: 
java.lang.RuntimeException: Unable to instantiate 
org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient

Caused by: java.lang.RuntimeException: Unable to instantiate 
org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
at 
org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1523)
Caused by: java.lang.reflect.InvocationTargetException
Caused by: javax.jdo.JDOFatalUserException: Exception thrown setting 
persistence propertiesNestedThrowables:



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Created] (HIVE-16799) Control the max number of task for a stage in a spark job

[Xuefu Zhang (JIRA)]

Xuefu Zhang created HIVE-16799:
--

 Summary: Control the max number of task for a stage in a spark job
 Key: HIVE-16799
 URL: https://issues.apache.org/jira/browse/HIVE-16799
 Project: Hive
  Issue Type: Improvement
Reporter: Xuefu Zhang
Assignee: Xuefu Zhang


HIVE-16552 gives admin an option to control the maximum number of tasks a Spark 
job may have. However, this may not be sufficient as this tends to penalize 
jobs that have many stages while favoring jobs that has fewer stages. Ideally, 
we should also limit the number of tasks in a stage, which is closer to the 
maximum number of mappers or reducers in a MR job.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Created] (HIVE-16798) Flaky test query14.q

[Pengcheng Xiong (JIRA)]

Pengcheng Xiong created HIVE-16798:
--

 Summary: Flaky test query14.q
 Key: HIVE-16798
 URL: https://issues.apache.org/jira/browse/HIVE-16798
 Project: Hive
  Issue Type: Sub-task
Reporter: Pengcheng Xiong
Assignee: Pengcheng Xiong






--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Review Request 59697: Fix HiveFilterAggregateTransposeRule when filter is always false

[pengcheng xiong]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/59697/
---

Review request for hive and Ashutosh Chauhan.


Repository: hive-git


Description
---

hive-16775


Diffs
-

  
ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/rules/HiveFilterAggregateTransposeRule.java
 0e5c7313b6 
  ql/src/test/queries/clientpositive/filter_aggr.q PRE-CREATION 
  ql/src/test/queries/clientpositive/perf/query4.q PRE-CREATION 
  ql/src/test/queries/clientpositive/perf/query74.q PRE-CREATION 
  ql/src/test/results/clientpositive/filter_aggr.q.out PRE-CREATION 
  ql/src/test/results/clientpositive/perf/query4.q.out PRE-CREATION 
  ql/src/test/results/clientpositive/perf/query74.q.out PRE-CREATION 


Diff: https://reviews.apache.org/r/59697/diff/1/


Testing
---


Thanks,

pengcheng xiong

[jira] [Created] (HIVE-16797) Support a new rule RemoveUnionBranchRule

[Pengcheng Xiong (JIRA)]

Pengcheng Xiong created HIVE-16797:
--

 Summary: Support a new rule RemoveUnionBranchRule
 Key: HIVE-16797
 URL: https://issues.apache.org/jira/browse/HIVE-16797
 Project: Hive
  Issue Type: Bug
Reporter: Pengcheng Xiong
Assignee: Pengcheng Xiong


in query4.q, we can see that it creates a CTE with union all of 3 branches. 
Then it is going to do a 3 way self-join of the CTE with predicates. The 
predicates actually specifies only one of the branch in CTE to participate in 
the join. Thus, in some cases, e.g.,
{code}
   /- filter(false) -TS0 
union all  - filter(false) -TS1
   \-TS2
{code}
we can cut the branches of TS0 and TS1. The union becomes only TS2.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Re: Review Request 59468: Optimize a combination of avg(), sum(), count(distinct) etc

[Ashutosh Chauhan]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/59468/#review176486
---




ql/src/test/results/clientpositive/perf/query16.q.out
Lines 3-5 (original), 3-5 (patched)


yes.. you are correct. My bad.


- Ashutosh Chauhan


On May 27, 2017, 2:20 a.m., pengcheng xiong wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/59468/
> ---
> 
> (Updated May 27, 2017, 2:20 a.m.)
> 
> 
> Review request for hive, Ashutosh Chauhan and Gopal V.
> 
> 
> Repository: hive-git
> 
> 
> Description
> ---
> 
> HIVE-16654
> 
> 
> Diffs
> -
> 
>   common/src/java/org/apache/hadoop/hive/conf/HiveConf.java 2dfc8b6f89 
>   itests/src/test/resources/testconfiguration.properties 47a13c93b9 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/Operator.java 8b04cd44fa 
>   
> ql/src/java/org/apache/hadoop/hive/ql/optimizer/CountDistinctRewriteProc.java 
> PRE-CREATION 
>   ql/src/java/org/apache/hadoop/hive/ql/optimizer/Optimizer.java 7dace9076f 
>   ql/src/java/org/apache/hadoop/hive/ql/plan/GroupByDesc.java 38a9ef2af1 
>   ql/src/test/queries/clientpositive/count_dist_rewrite.q PRE-CREATION 
>   ql/src/test/results/clientpositive/count_dist_rewrite.q.out PRE-CREATION 
>   ql/src/test/results/clientpositive/groupby_sort_11.q.out 2b3bf4a07a 
>   ql/src/test/results/clientpositive/llap/count_dist_rewrite.q.out 
> PRE-CREATION 
>   ql/src/test/results/clientpositive/nullgroup4.q.out e5a814 
>   ql/src/test/results/clientpositive/perf/query16.q.out cf90c0c162 
>   ql/src/test/results/clientpositive/perf/query28.q.out 78129cf68b 
>   ql/src/test/results/clientpositive/perf/query94.q.out 836b16bf9f 
>   ql/src/test/results/clientpositive/perf/query95.q.out fa94d0842b 
>   ql/src/test/results/clientpositive/udf_count.q.out f60ad0485e 
> 
> 
> Diff: https://reviews.apache.org/r/59468/diff/3/
> 
> 
> Testing
> ---
> 
> 
> Thanks,
> 
> pengcheng xiong
> 
>