[jira] [Created] (HIVE-12898) Hive should support ORC block skipping on nested fields

2016-01-21 Thread Michael Haeusler (JIRA) 
Michael Haeusler created HIVE-12898:
---

 Summary: Hive should support ORC block skipping on nested fields
 Key: HIVE-12898
 URL: https://issues.apache.org/jira/browse/HIVE-12898
 Project: Hive
  Issue Type: Improvement
  Components: ORC
Affects Versions: 1.2.1, 0.14.0
Reporter: Michael Haeusler


Hive supports predicate pushdown (block skipping) for ORC tables only on 
top-level fields. Hive should also support block skipping on nested fields 
(within structs).


Example top-level: the following query selects 0 rows, using a predicate on 
top-level column foo. We also see 0 INPUT_RECORDS in the summary:

{code:sql}
SET hive.tez.exec.print.summary=true;
CREATE TABLE t_toplevel STORED AS ORC AS SELECT 23 AS foo;
SELECT * FROM t_toplevel WHERE foo=42 ORDER BY foo;

[...]
VERTICES TOTAL_TASKS  FAILED_ATTEMPTS KILLED_TASKS DURATION_SECONDS
CPU_TIME_MILLIS GC_TIME_MILLIS  INPUT_RECORDS   OUTPUT_RECORDS
Map 1  100 1.22 
 2,640102  00
{code}


Example nested: the following query also selects 0 rows, but using a predicate 
on nested column foo.bar. Unfortunately we see 1 INPUT_RECORDS in the summary:
{code:sql}
SET hive.tez.exec.print.summary=true;
CREATE TABLE t_nested STORED AS ORC AS SELECT NAMED_STRUCT('bar', 23) AS foo;
SELECT * FROM t_nested WHERE foo.bar=42 ORDER BY foo;

[...]
VERTICES TOTAL_TASKS  FAILED_ATTEMPTS KILLED_TASKS DURATION_SECONDS
CPU_TIME_MILLIS GC_TIME_MILLIS  INPUT_RECORDS   OUTPUT_RECORDS
Map 1  100 3.66 
 5,210 68  10
{code}




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: Review Request 41928: HIVE-12777: Add capability to restore session

2016-01-21 Thread Rajat Khandelwal 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/41928/
---

(Updated Jan. 21, 2016, 7:09 p.m.)


Review request for hive.


Bugs: HIVE-12777
https://issues.apache.org/jira/browse/HIVE-12777


Repository: hive-git


Description
---

Extensions using Hive session handles should be able to restore the hive 
session from the handle. 

Apache Lens depends on a fork of hive and that fork has such a capability. 

Relevant commit: 
https://github.com/InMobi/hive/commit/931fe9116161a18952c082c14223ad6745fefe00#diff-0acb35f7cab7492f522b0c40ce3ce1be


Diffs (updated)
-

  service/src/java/org/apache/hive/service/cli/CLIService.java 
0d5ae1e491bdcf98a12f5eef7b35f23c7b9dfc00 
  service/src/java/org/apache/hive/service/cli/SessionHandle.java 
4e4f0211de09408168c8da669626fb49f3db364c 
  service/src/java/org/apache/hive/service/cli/session/HiveSessionImpl.java 
3c5700bd114f6b792df10df23e57dad9b9e689f6 
  
service/src/java/org/apache/hive/service/cli/session/HiveSessionImplwithUGI.java
 c56d97afc969ea57810e9b3222b20e086e847d67 
  service/src/java/org/apache/hive/service/cli/session/SessionManager.java 
de18f1d93502704e7a8fbb8d31d93bd770c4d232 
  service/src/test/org/apache/hive/service/cli/CLIServiceRestoreTest.java 
PRE-CREATION 

Diff: https://reviews.apache.org/r/41928/diff/


Testing
---


Thanks,

Rajat Khandelwal

[jira] [Created] (HIVE-12899) Bring query optimization time down

2016-01-21 Thread Jesus Camacho Rodriguez (JIRA) 
Jesus Camacho Rodriguez created HIVE-12899:
--

 Summary: Bring query optimization time down
 Key: HIVE-12899
 URL: https://issues.apache.org/jira/browse/HIVE-12899
 Project: Hive
  Issue Type: Improvement
  Components: CBO, Logical Optimizer, Physical Optimizer
Affects Versions: 2.1.0
Reporter: Jesus Camacho Rodriguez
Assignee: Jesus Camacho Rodriguez


Umbrella JIRA to track the effort to bring optimization time of queries down.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (HIVE-12900) Disable Hive ColumnPruner optimizer when CBO has optimized the plan

2016-01-21 Thread Jesus Camacho Rodriguez (JIRA) 
Jesus Camacho Rodriguez created HIVE-12900:
--

 Summary: Disable Hive ColumnPruner optimizer when CBO has 
optimized the plan
 Key: HIVE-12900
 URL: https://issues.apache.org/jira/browse/HIVE-12900
 Project: Hive
  Issue Type: Sub-task
Affects Versions: 2.1.0
Reporter: Jesus Camacho Rodriguez
Assignee: Jesus Camacho Rodriguez






--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (HIVE-12901) Incorrect result from select '\\' like '\\%'

2016-01-21 Thread Chaoyu Tang (JIRA) 
Chaoyu Tang created HIVE-12901:
--

 Summary: Incorrect result from select '\\' like '\\%'
 Key: HIVE-12901
 URL: https://issues.apache.org/jira/browse/HIVE-12901
 Project: Hive
  Issue Type: Bug
  Components: Query Processor
Affects Versions: 1.2.1
Reporter: Chaoyu Tang


The query returns false. Actually MySQL also returns 0 which I do not think it 
right.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: Review Request 42322: HIVE-12864

2016-01-21 Thread Jesús Camacho Rodríguez 


> On Jan. 20, 2016, 10:45 p.m., pengcheng xiong wrote:
> > ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java, line 
> > 11188
> > 
> >
> > The patch looks good to me +1. Just one small thing and it is up to you 
> > to modify it or not. Although Stack works here, with the same time/space 
> > complexity, I would prefer a simple Queue. First dequeue the head, then 
> > enqueue the children from left to right. Right now a Stack is used and the 
> > children are pushed right to left...

If we used a Queue, the traversal would be different: it would be level by 
level (similar to BFS). Observe that currently it is similar to DFS.

Could you +1 in the JIRA issue? Thanks!


- Jesús


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/42322/#review115506
---


On Jan. 14, 2016, 9:23 p.m., Jesús Camacho Rodríguez wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/42322/
> ---
> 
> (Updated Jan. 14, 2016, 9:23 p.m.)
> 
> 
> Review request for hive, Ashutosh Chauhan and John Pullokkaran.
> 
> 
> Bugs: HIVE-12864
> https://issues.apache.org/jira/browse/HIVE-12864
> 
> 
> Repository: hive-git
> 
> 
> Description
> ---
> 
> StackOverflowError parsing queries with very large predicates
> 
> 
> Diffs
> -
> 
>   ql/src/java/org/apache/hadoop/hive/ql/parse/ASTNode.java 
> 8400ee8cb21e9d8896c9b4f3b50058ed2cb6d983 
>   ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java 
> c38699dc80a3e9bee1f5298ef28870aa373d90d3 
>   ql/src/java/org/apache/hadoop/hive/ql/parse/SubQueryUtils.java 
> 362a285a8499d82064aa1ae84d811a8700cd3199 
> 
> Diff: https://reviews.apache.org/r/42322/diff/
> 
> 
> Testing
> ---
> 
> 
> Thanks,
> 
> Jesús Camacho Rodríguez
> 
>

[jira] [Created] (HIVE-12902) Refactor TxnHandler to be an interface

2016-01-21 Thread Alan Gates (JIRA) 
Alan Gates created HIVE-12902:
-

 Summary: Refactor TxnHandler to be an interface
 Key: HIVE-12902
 URL: https://issues.apache.org/jira/browse/HIVE-12902
 Project: Hive
  Issue Type: Improvement
  Components: Metastore, Transactions
Affects Versions: 2.0.0
Reporter: Alan Gates
Assignee: Alan Gates


TxnHandler (and it's extender CompactionTxnHandler) implement the transaction 
functionality in the metastore.  These need to be re-factored as interfaces so 
that we can have a separate implementation for the HBase metastore.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (HIVE-12903) Add ability to run HBase metastore in test mode along with RDBMS

2016-01-21 Thread Alan Gates (JIRA) 
Alan Gates created HIVE-12903:
-

 Summary: Add ability to run HBase metastore in test mode along 
with RDBMS
 Key: HIVE-12903
 URL: https://issues.apache.org/jira/browse/HIVE-12903
 Project: Hive
  Issue Type: Improvement
  Components: HBase Metastore, Metastore
Affects Versions: 2.0.0
Reporter: Alan Gates
Assignee: Daniel Dai






--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (HIVE-12904) LLAP: deadlock in task scheduling

2016-01-21 Thread Sergey Shelukhin (JIRA) 
Sergey Shelukhin created HIVE-12904:
---

 Summary: LLAP: deadlock in task scheduling
 Key: HIVE-12904
 URL: https://issues.apache.org/jira/browse/HIVE-12904
 Project: Hive
  Issue Type: Bug
Reporter: Hui Zheng


{noformat}
Thread 34107: (state = BLOCKED)
 - 
org.apache.hadoop.hive.llap.daemon.impl.TaskExecutorService$TaskWrapper.isInWaitQueue()
 @bci=0, line=690 (Compiled frame)
 - 
org.apache.hadoop.hive.llap.daemon.impl.TaskExecutorService.finishableStateUpdated(org.apache.hadoop.hive.llap.daemon.impl.TaskExecutorService$TaskWrapper,
 boolean) @bci=8, line=485 (Compiled frame)
 - 
org.apache.hadoop.hive.llap.daemon.impl.TaskExecutorService.access$1500(org.apache.hadoop.hive.llap.daemon.impl.TaskExecutorService,
 org.apache.hadoop.hive.llap.daemon.impl.TaskExecutorService$TaskWrapper, 
boolean) @bci=3, line=78 (Compiled frame)
 - 
org.apache.hadoop.hive.llap.daemon.impl.TaskExecutorService$TaskWrapper.finishableStateUpdated(boolean)
 @bci=27, line=733 (Compiled frame)
 - 
org.apache.hadoop.hive.llap.daemon.impl.QueryInfo$FinishableStateTracker.sourceStateUpdated(java.lang.String)
 @bci=76, line=210 (Compiled frame)
 - 
org.apache.hadoop.hive.llap.daemon.impl.QueryInfo.sourceStateUpdated(java.lang.String)
 @bci=5, line=164 (Compiled frame)
 - 
org.apache.hadoop.hive.llap.daemon.impl.QueryTracker.registerSourceStateChange(java.lang.String,
 java.lang.String, 
org.apache.hadoop.hive.llap.daemon.rpc.LlapDaemonProtocolProtos$SourceStateProto)
 @bci=34, line=228 (Compiled frame)
 - 
org.apache.hadoop.hive.llap.daemon.impl.ContainerRunnerImpl.sourceStateUpdated(org.apache.hadoop.hive.llap.daemon.rpc.LlapDaemonProtocolProtos$SourceStateUpdatedRequestProto)
 @bci=47, line=255 (Compiled frame)
 - 
org.apache.hadoop.hive.llap.daemon.impl.LlapDaemon.sourceStateUpdated(org.apache.hadoop.hive.llap.daemon.rpc.LlapDaemonProtocolProtos$SourceStateUpdatedRequestProto)
 @bci=5, line=328 (Compiled frame)
 - 
org.apache.hadoop.hive.llap.daemon.impl.LlapDaemonProtocolServerImpl.sourceStateUpdated(com.google.protobuf.RpcController,
 
org.apache.hadoop.hive.llap.daemon.rpc.LlapDaemonProtocolProtos$SourceStateUpdatedRequestProto)
 @bci=5, line=105 (Compiled frame)
 - 
org.apache.hadoop.hive.llap.daemon.rpc.LlapDaemonProtocolProtos$LlapDaemonProtocol$2.callBlockingMethod(com.google.protobuf.Descriptors$MethodDescriptor,
 com.google.protobuf.RpcController, com.google.protobuf.Message) @bci=80, 
line=13067 (Compiled frame)
 - 
org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(org.apache.hadoop.ipc.RPC$Server,
 java.lang.String, org.apache.hadoop.io.Writable, long) @bci=246, line=616 
(Compiled frame)
 - org.apache.hadoop.ipc.RPC$Server.call(org.apache.hadoop.ipc.RPC$RpcKind, 
java.lang.String, org.apache.hadoop.io.Writable, long) @bci=9, line=969 
(Compiled frame)
 - org.apache.hadoop.ipc.Server$Handler$1.run() @bci=38, line=2151 (Compiled 
frame)
 - org.apache.hadoop.ipc.Server$Handler$1.run() @bci=1, line=2147 (Compiled 
frame)
 - 
java.security.AccessController.doPrivileged(java.security.PrivilegedExceptionAction,
 java.security.AccessControlContext) @bci=0 (Compiled frame)
 - javax.security.auth.Subject.doAs(javax.security.auth.Subject, 
java.security.PrivilegedExceptionAction) @bci=42, line=422 (Compiled frame)
 - 
org.apache.hadoop.security.UserGroupInformation.doAs(java.security.PrivilegedExceptionAction)
 @bci=14, line=1657 (Compiled frame)
 - org.apache.hadoop.ipc.Server$Handler.run() @bci=315, line=2145 (Interpreted 
frame)


and 


Thread 34500: (state = BLOCKED)
 - 
org.apache.hadoop.hive.llap.daemon.impl.QueryInfo$FinishableStateTracker.unregisterForUpdates(org.apache.hadoop.hive.llap.daemon.FinishableStateUpdateHandler)
 @bci=0, line=195 (Compiled frame)
 - 
org.apache.hadoop.hive.llap.daemon.impl.QueryInfo.unregisterFinishableStateUpdate(org.apache.hadoop.hive.llap.daemon.FinishableStateUpdateHandler)
 @bci=5, line=160 (Compiled frame)
 - 
org.apache.hadoop.hive.llap.daemon.impl.QueryFragmentInfo.unregisterForFinishableStateUpdates(org.apache.hadoop.hive.llap.daemon.FinishableStateUpdateHandler)
 @bci=5, line=143 (Compiled frame)
 - 
org.apache.hadoop.hive.llap.daemon.impl.TaskExecutorService$TaskWrapper.maybeUnregisterForFinishedStateNotifications()
 @bci=20, line=681 (Compiled frame)
 - 
org.apache.hadoop.hive.llap.daemon.impl.TaskExecutorService$InternalCompletionListener.onSuccess(org.apache.tez.runtime.task.TaskRunner2Result)
 @bci=32, line=548 (Compiled frame)
 - 
org.apache.hadoop.hive.llap.daemon.impl.TaskExecutorService$InternalCompletionListener.onSuccess(java.lang.Object)
 @bci=5, line=535 (Compiled frame)
 - com.google.common.util.concurrent.Futures$4.run() @bci=55, line=1149 
(Compiled frame)
 - 
java.util.concurrent.ThreadPoolExecutor.runWorker(java.util.concurrent.ThreadPoolExecutor$Worker)
 @bci=95, line=1142 (Compiled frame)
 - java.util.concurrent.ThreadPoolExecutor$Wo

[jira] [Created] (HIVE-12905) Issue with mapjoin in tez under certain conditions

2016-01-21 Thread Vikram Dixit K (JIRA) 
Vikram Dixit K created HIVE-12905:
-

 Summary: Issue with mapjoin in tez under certain conditions
 Key: HIVE-12905
 URL: https://issues.apache.org/jira/browse/HIVE-12905
 Project: Hive
  Issue Type: Bug
  Components: Tez
Affects Versions: 1.2.1, 1.0.1, 2.0.0
Reporter: Vikram Dixit K
Assignee: Vikram Dixit K


In a specific case where we have an outer join followed by another join on the 
same key and the non-outer side of the outer join is empty, hive-on-tez 
produces incorrect results.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: January Hive User Group Meeting

2016-01-21 Thread Xuefu Zhang 
For those who cannot attend in person, here is the webex info:

https://cloudera.webex.com/meet/xzhang
1-650-479-3208  Call-in toll number (US/Canada)
623 810 662 (access code)

Thanks,
Xuefu

On Wed, Jan 20, 2016 at 9:45 AM, Xuefu Zhang  wrote:

> Hi all,
>
> As a reminder, the meeting will be held tomorrow as scheduled. Please
> refer to the meetup page[1] for details. Looking forward to meeting you all!
>
> Thanks,
> Xuefu
>
> [1] http://www.meetup.com/Hive-User-Group-Meeting/events/227463783/
>
> On Wed, Dec 16, 2015 at 3:38 PM, Xuefu Zhang  wrote:
>
>> Dear Hive users and developers,
>>
>> Hive community is considering a user group meeting[1] January 21, 2016
>> at Cloudera facility in Palo Alto, CA. This will be a great opportunity
>> for vast users and developers to find out what's happening in the
>> community and share each other's experience with Hive. Therefore, I'd urge
>> you to attend the meetup. Please RSVP and the list will be closed a few
>> days ahead of the event.
>>
>> At the same time, I'd like to solicit light talks (15 minutes max) from
>> users and developers. If you have a proposal, please let me or Thejas know.
>> Your participation is greatly appreciated.
>>
>> Sincerely,
>> Xuefu
>>
>> [1] http://www.meetup.com/Hive-User-Group-Meeting/events/227463783/
>>
>
>

Re: Review Request 42190: HIVE-12478

2016-01-21 Thread Jesús Camacho Rodríguez 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/42190/
---

(Updated Jan. 21, 2016, 10:45 p.m.)


Review request for hive and John Pullokkaran.


Bugs: HIVE-12478
https://issues.apache.org/jira/browse/HIVE-12478


Repository: hive-git


Description
---

Improve Hive/Calcite Trasitive Predicate inference


Diffs (updated)
-

  ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/HiveCalciteUtil.java 
4825a617876374085b6fac1192ba1531ec916bce 
  
ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/HiveHepPlannerContext.java
 ad79aeec2fbc0454ab1ccc608944752d01324dca 
  
ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/HiveVolcanoPlannerContext.java
 8859fc268666cef1be283a9179aa0beb7ef1bdeb 
  
ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/cost/HiveCostModel.java 
d15d885d2348d666df069228a93d6c5f914c79df 
  
ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/cost/HiveVolcanoPlanner.java
 8610edc5ddc00d523610fb29f5e504c3e876a542 
  
ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/reloperators/HiveJoin.java
 27b1e76a104dc961cb4bce554602d90b3aa867e0 
  
ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/reloperators/HiveSemiJoin.java
 35586768c2c2b81e4213495632e4457dd3d70443 
  
ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/reloperators/HiveUnion.java
 8b57b3504c407b8a1e73d48ea240c4ec7558b327 
  
ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/rules/HiveJoinAddNotNullRule.java
 de880ce26f1e172288f700c8566fbe71f42af115 
  
ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/rules/HiveJoinPushTransitivePredicatesRule.java
 703c8c6dbdfa281443cbcf7b08de2266697da8a9 
  
ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/rules/HivePreFilteringRule.java
 d37fc0e08d5e41b29539a990e6638385c1135eec 
  
ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/rules/HiveRulesRegistry.java
 18a065e87e1ec266bf28b4ccfe10a1f863f847c2 
  ql/src/java/org/apache/hadoop/hive/ql/parse/CalcitePlanner.java 
3fefbd710c4bb81d5f746cd91889b532b0a6029f 
  
ql/src/test/org/apache/hadoop/hive/ql/optimizer/calcite/TestCBORuleFiredOnlyOnce.java
 f1d8d1de00e9de7fa9ffea7d3aa2400e5073ac9c 
  ql/src/test/results/clientpositive/annotate_stats_join.q.out 
7fc754d5712d5f05efc943b66d3c829d47312d19 
  ql/src/test/results/clientpositive/annotate_stats_join_pkfk.q.out 
f13643e8db57cc0a85b2626c37437fd030f72029 
  ql/src/test/results/clientpositive/annotate_stats_select.q.out 
b158d8567f6cc02d990d175e93996239aba0c5ed 
  ql/src/test/results/clientpositive/auto_join12.q.out 
8ef3664764d04f53f3685d8f66dc4a353776a488 
  ql/src/test/results/clientpositive/auto_join16.q.out 
c1da6d2968697d304311044d358f1af267dc6e60 
  ql/src/test/results/clientpositive/auto_join_reordering_values.q.out 
59aa738c779d50a760e1b0d36e4ce83295b0d70f 
  ql/src/test/results/clientpositive/auto_join_without_localtask.q.out 
d40b1655e27fa70efc8dbf0475c688f6e2b3608f 
  ql/src/test/results/clientpositive/auto_sortmerge_join_6.q.out 
cb87f761be7c58ecc6435bb0a9b0e96c46a36828 
  ql/src/test/results/clientpositive/bucket_map_join_spark4.q.out 
4abdab53b5562dc129a2d9a73c63cf44d066c05e 
  ql/src/test/results/clientpositive/bucketizedhiveinputformat.q.out 
cfb95be72b32a354faeddc79dc52bc29c7593a2b 
  ql/src/test/results/clientpositive/bucketsortoptimize_insert_6.q.out 
a7ad04c7208f8e8486e79c1e749184e5b532a1fc 
  ql/src/test/results/clientpositive/cast1.q.out 
48a0c14031ef38dd5b4df7efa718a4d6ce04bc94 
  ql/src/test/results/clientpositive/cbo_const.q.out 
adc5232a67b2243dd5f09acaf1f7c49baea5daad 
  ql/src/test/results/clientpositive/cbo_rp_cross_product_check_2.q.out 
f1707eb4146c55338500c1fcaf4ff7199750250f 
  ql/src/test/results/clientpositive/cbo_rp_lineage2.q.out 
1b2a2ab1af5992753c37d053942ecb2ebf775921 
  ql/src/test/results/clientpositive/constprog_partitioner.q.out 
08c0aebafe1644a5adbec6a56879b39617bfbf69 
  ql/src/test/results/clientpositive/correlationoptimizer1.q.out 
38764d6b127bd1aba1efa5800b16c0c1e387a310 
  ql/src/test/results/clientpositive/correlationoptimizer10.q.out 
6bac698155221be4b0cb5b0bb3b2cdbfec5236ea 
  ql/src/test/results/clientpositive/correlationoptimizer13.q.out 
61b7bcb675a80dc3267365c65545e107ecbe12d2 
  ql/src/test/results/clientpositive/correlationoptimizer8.q.out 
368a1147d404ae9aab18a64618abf8ed7b3f7189 
  ql/src/test/results/clientpositive/correlationoptimizer9.q.out 
104a97afbb6657255a027ff6d51101f6963c2358 
  ql/src/test/results/clientpositive/cross_product_check_1.q.out 
05eb270a292ecd9fe03db77511a7e2a08a28204c 
  ql/src/test/results/clientpositive/cross_product_check_2.q.out 
a36560f23c1801f0bf988fa4e08dcf49376d8577 
  ql/src/test/results/clientpositive/dynamic_rdd_cache.q.out 
743865e073e1768f7f6234fde35ad2e56d8babe9 
  ql/src/test/results/clientpositive/filter_cond_pushdown.q.out 
5e0edbc9efb442467c4998021ac1ecfb9d07579d 
  ql

Re: Review Request 42521: HIVE-12867 : Semantic Exception Error Msg should be with in the range of "10000 to 19999"

2016-01-21 Thread Hari Sankar Sivarama Subramaniyan 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/42521/
---

(Updated Jan. 21, 2016, 11:08 p.m.)


Review request for hive and John Pullokkaran.


Repository: hive-git


Description
---

Semantic Exception Error Msg should be with in the range of "1 to 1"


Diffs (updated)
-

  ql/src/java/org/apache/hadoop/hive/ql/ErrorMsg.java 6a62592 
  ql/src/java/org/apache/hadoop/hive/ql/parse/BaseSemanticAnalyzer.java 8a9411a 
  ql/src/java/org/apache/hadoop/hive/ql/parse/DDLSemanticAnalyzer.java 141c2e6 
  ql/src/java/org/apache/hadoop/hive/ql/parse/EximUtil.java 179f9c2 
  ql/src/java/org/apache/hadoop/hive/ql/parse/ExportSemanticAnalyzer.java 
ff385d0 
  ql/src/java/org/apache/hadoop/hive/ql/parse/ImportSemanticAnalyzer.java 
88c4b95 
  ql/src/java/org/apache/hadoop/hive/ql/parse/TaskCompiler.java a8f9f50 
  ql/src/java/org/apache/hadoop/hive/ql/plan/CreateTableDesc.java 3f38f74 

Diff: https://reviews.apache.org/r/42521/diff/


Testing
---

Precommit build runs


Thanks,

Hari Sankar Sivarama Subramaniyan

[jira] [Created] (HIVE-12906) Backport to branch-1 -- HIVE-12894 Detect whether ORC is reading from ACID table correctly for Schema Evolution

2016-01-21 Thread Matt McCline (JIRA) 
Matt McCline created HIVE-12906:
---

 Summary: Backport to branch-1 -- HIVE-12894 Detect whether ORC is 
reading from ACID table correctly for Schema Evolution
 Key: HIVE-12906
 URL: https://issues.apache.org/jira/browse/HIVE-12906
 Project: Hive
  Issue Type: Bug
  Components: ORC
Reporter: Matt McCline
Assignee: Matt McCline
Priority: Critical






--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Review Request 42626: CBO: Calcite Operator To Hive Operator (Calcite Return Path): MiniTezCliDriver.vector_join_filters.q failure

2016-01-21 Thread Hari Sankar Sivarama Subramaniyan 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/42626/
---

Review request for hive, Jesús Camacho Rodríguez and John Pullokkaran.


Repository: hive-git


Description
---

Please see the jira.


Diffs
-

  
ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/rules/HiveRelFieldTrimmer.java
 f677f68 

Diff: https://reviews.apache.org/r/42626/diff/


Testing
---

Precommit runs


Thanks,

Hari Sankar Sivarama Subramaniyan

Re: Review Request 42626: CBO: Calcite Operator To Hive Operator (Calcite Return Path): MiniTezCliDriver.vector_join_filters.q failure

2016-01-21 Thread Hari Sankar Sivarama Subramaniyan 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/42626/
---

(Updated Jan. 22, 2016, 12:27 a.m.)


Review request for hive, Jesús Camacho Rodríguez and John Pullokkaran.


Repository: hive-git


Description (updated)
---

Please see the jira https://issues.apache.org/jira/browse/HIVE-12802


Diffs
-

  
ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/rules/HiveRelFieldTrimmer.java
 f677f68 

Diff: https://reviews.apache.org/r/42626/diff/


Testing
---

Precommit runs


Thanks,

Hari Sankar Sivarama Subramaniyan

[jira] [Created] (HIVE-12907) Improve dynamic partition loading - II

2016-01-21 Thread Ashutosh Chauhan (JIRA) 
Ashutosh Chauhan created HIVE-12907:
---

 Summary: Improve dynamic partition loading - II
 Key: HIVE-12907
 URL: https://issues.apache.org/jira/browse/HIVE-12907
 Project: Hive
  Issue Type: Improvement
  Components: Query Processor
Reporter: Ashutosh Chauhan
Assignee: Ashutosh Chauhan


Remove unnecessary calls to metastore.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: Review Request 42521: HIVE-12867 : Semantic Exception Error Msg should be with in the range of "10000 to 19999"

2016-01-21 Thread John Pullokkaran 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/42521/#review115755
---

Ship it!


Ship It!

- John Pullokkaran


On Jan. 21, 2016, 11:08 p.m., Hari Sankar Sivarama Subramaniyan wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/42521/
> ---
> 
> (Updated Jan. 21, 2016, 11:08 p.m.)
> 
> 
> Review request for hive and John Pullokkaran.
> 
> 
> Repository: hive-git
> 
> 
> Description
> ---
> 
> Semantic Exception Error Msg should be with in the range of "1 to 1"
> 
> 
> Diffs
> -
> 
>   ql/src/java/org/apache/hadoop/hive/ql/ErrorMsg.java 6a62592 
>   ql/src/java/org/apache/hadoop/hive/ql/parse/BaseSemanticAnalyzer.java 
> 8a9411a 
>   ql/src/java/org/apache/hadoop/hive/ql/parse/DDLSemanticAnalyzer.java 
> 141c2e6 
>   ql/src/java/org/apache/hadoop/hive/ql/parse/EximUtil.java 179f9c2 
>   ql/src/java/org/apache/hadoop/hive/ql/parse/ExportSemanticAnalyzer.java 
> ff385d0 
>   ql/src/java/org/apache/hadoop/hive/ql/parse/ImportSemanticAnalyzer.java 
> 88c4b95 
>   ql/src/java/org/apache/hadoop/hive/ql/parse/TaskCompiler.java a8f9f50 
>   ql/src/java/org/apache/hadoop/hive/ql/plan/CreateTableDesc.java 3f38f74 
> 
> Diff: https://reviews.apache.org/r/42521/diff/
> 
> 
> Testing
> ---
> 
> Precommit build runs
> 
> 
> Thanks,
> 
> Hari Sankar Sivarama Subramaniyan
> 
>

[jira] [Created] (HIVE-12908) Improve dynamic partition loading III

2016-01-21 Thread Ashutosh Chauhan (JIRA) 
Ashutosh Chauhan created HIVE-12908:
---

 Summary: Improve dynamic partition loading III
 Key: HIVE-12908
 URL: https://issues.apache.org/jira/browse/HIVE-12908
 Project: Hive
  Issue Type: Improvement
  Components: Query Processor
Reporter: Ashutosh Chauhan
Assignee: Ashutosh Chauhan


Remove unnecessary Namenode calls.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (HIVE-12909) Some encryption q-tests fail because trash is disabled in encryption_with_trash.q

2016-01-21 Thread JIRA 
Sergio Peña created HIVE-12909:
--

 Summary: Some encryption q-tests fail because trash is disabled in 
encryption_with_trash.q
 Key: HIVE-12909
 URL: https://issues.apache.org/jira/browse/HIVE-12909
 Project: Hive
  Issue Type: Bug
  Components: Hive
Affects Versions: 1.2.1, 2.0.0
Reporter: Sergio Peña
Assignee: Sergio Peña


There are a couple of flaky tests, encryption_drop_partition,q and 
encryption_drop_table.q, that sometimes fail on jenkins because a previous 
q-test, encryption_with_trash.q, is disabling the trash.

Trash is set automatically in QTestUtil.java. I don't remember why it was due 
that way, probably because some issues with other tests.

The best way to fix this is to delete encryption_with_trash.q. This test is not 
necessary and redundant, so it is safe to delete it. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (HIVE-12910) HBaseStore: initial null value of aggregateData can not call compareTo

2016-01-21 Thread Pengcheng Xiong (JIRA) 
Pengcheng Xiong created HIVE-12910:
--

 Summary: HBaseStore: initial null value of aggregateData can not 
call compareTo
 Key: HIVE-12910
 URL: https://issues.apache.org/jira/browse/HIVE-12910
 Project: Hive
  Issue Type: Sub-task
Reporter: Pengcheng Xiong
Assignee: Pengcheng Xiong


L33 in DecimalColumnStatsAggregator. The initial aggregateData is null thus can 
not call compareTo. (will throw NPE)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)