[jira] [Created] (HIVE-13635) HiveServer2 shows stack trace when parsing invalid inputs

2016-04-27 Thread Takuma Wakamori (JIRA) 
Takuma Wakamori created HIVE-13635:
--

 Summary: HiveServer2 shows stack trace when parsing invalid inputs
 Key: HIVE-13635
 URL: https://issues.apache.org/jira/browse/HIVE-13635
 Project: Hive
  Issue Type: Bug
  Components: HiveServer2
Reporter: Takuma Wakamori
Assignee: Takuma Wakamori
Priority: Trivial


HiveServer2 shows stack trace when parsing invalid syntax.

How to reproduce:
{code}
Input:
hostA$ hiveserver2
hostB$ beeline -u jdbc:hive2://localhost:1 -n user -p pass -e "invalid 
syntax;"

Output:
hostA$ NoViableAltException(26@[])  
  
[0/1248]
at 
org.apache.hadoop.hive.ql.parse.HiveParser.statement(HiveParser.java:1108)
at 
org.apache.hadoop.hive.ql.parse.ParseDriver.parse(ParseDriver.java:204)
at 
org.apache.hadoop.hive.ql.parse.ParseDriver.parse(ParseDriver.java:166)
at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:444)
at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:319)
at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:1199)
at org.apache.hadoop.hive.ql.Driver.compileAndRespond(Driver.java:1186)
at 
org.apache.hive.service.cli.operation.SQLOperation.prepare(SQLOperation.java:146)
at 
org.apache.hive.service.cli.operation.SQLOperation.runInternal(SQLOperation.java:218)
...
FAILED: ParseException line 1:0 cannot recognize input near 'invalid' 'syntax' 
''

hostB$ Error: Error while compiling statement: FAILED: ParseException line 1:0 
cannot recognize input near 'invalid' 'syntax' '' (state=42000,code=4)
{code}

This issue is related to the post of Hive developer mailing list:
http://mail-archives.apache.org/mod_mbox/hive-dev/201604.mbox/%3CCAOLfT9AaKZ8Nt77QnvrNcxWrQ_1htaj9C0UOsnN5HheoTzM6DQ%40mail.gmail.com%3E



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: Review Request 46755: JDBC: Support query timeout for jdbc

2016-04-27 Thread Vaibhav Gumashta 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/46755/#review130884
---




jdbc/src/java/org/apache/hive/jdbc/HiveStatement.java (line 345)


Typo (the extra "+")



ql/src/java/org/apache/hadoop/hive/ql/Driver.java (line 1731)


I should probably have a lock around this, or do null check within 
plan.setDone. I think the latter might be more optimized as the Driver overall 
is not thread safe and introducing ad-hoc locks might be a short-sighted 
approach.



ql/src/java/org/apache/hadoop/hive/ql/Driver.java (line 1737)


Should use logger here.



service-rpc/if/TCLIService.thrift (line 461)


Whitespace



service-rpc/if/TCLIService.thrift (line 703)


Whitespace.



service/src/java/org/apache/hive/service/cli/operation/SQLOperation.java (line 
102)


Typo in variable name; change to timeoutExecutor


- Vaibhav Gumashta


On April 27, 2016, 11:14 p.m., Vaibhav Gumashta wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/46755/
> ---
> 
> (Updated April 27, 2016, 11:14 p.m.)
> 
> 
> Review request for hive and Thejas Nair.
> 
> 
> Bugs: HIVE-4924
> https://issues.apache.org/jira/browse/HIVE-4924
> 
> 
> Repository: hive-git
> 
> 
> Description
> ---
> 
> https://issues.apache.org/jira/browse/HIVE-4924
> 
> 
> Diffs
> -
> 
>   itests/hive-unit/src/test/java/org/apache/hive/jdbc/TestJdbcDriver2.java 
> 965627f 
>   
> itests/hive-unit/src/test/java/org/apache/hive/service/cli/session/TestHiveSessionImpl.java
>  4d763d2 
>   jdbc/src/java/org/apache/hive/jdbc/HiveStatement.java 3cc6b74 
>   ql/src/java/org/apache/hadoop/hive/ql/Driver.java dad43fb 
>   ql/src/java/org/apache/hadoop/hive/ql/history/HiveHistoryImpl.java 0234fd9 
>   service-rpc/if/TCLIService.thrift 92bcf77 
>   service-rpc/src/gen/thrift/gen-cpp/TCLIService_types.h 9f937ca 
>   service-rpc/src/gen/thrift/gen-cpp/TCLIService_types.cpp 66f5e8c 
>   
> service-rpc/src/gen/thrift/gen-javabean/org/apache/hive/service/rpc/thrift/TExecuteStatementReq.java
>  2eb4d09 
>   
> service-rpc/src/gen/thrift/gen-javabean/org/apache/hive/service/rpc/thrift/TOperationState.java
>  3fa49b0 
>   service-rpc/src/gen/thrift/gen-php/Types.php 7f1f99f 
>   service-rpc/src/gen/thrift/gen-py/TCLIService/ttypes.py 3bb20b8 
>   service-rpc/src/gen/thrift/gen-rb/t_c_l_i_service_types.rb 7208bae 
>   service/src/java/org/apache/hive/service/cli/CLIService.java 4a83e38 
>   service/src/java/org/apache/hive/service/cli/EmbeddedCLIServiceClient.java 
> 79e0024 
>   service/src/java/org/apache/hive/service/cli/ICLIService.java e4aef96 
>   service/src/java/org/apache/hive/service/cli/OperationState.java 6a67a1d 
>   
> service/src/java/org/apache/hive/service/cli/operation/ExecuteStatementOperation.java
>  b3d9b52 
>   
> service/src/java/org/apache/hive/service/cli/operation/HiveCommandOperation.java
>  f18dc67 
>   
> service/src/java/org/apache/hive/service/cli/operation/MetadataOperation.java 
> 77228fa 
>   service/src/java/org/apache/hive/service/cli/operation/Operation.java 
> 63b1a48 
>   
> service/src/java/org/apache/hive/service/cli/operation/OperationManager.java 
> 52e4b4d 
>   service/src/java/org/apache/hive/service/cli/operation/SQLOperation.java 
> 01dd48c 
>   service/src/java/org/apache/hive/service/cli/session/HiveSession.java 
> 9ea643b 
>   service/src/java/org/apache/hive/service/cli/session/HiveSessionImpl.java 
> 0cfec7a 
>   
> service/src/java/org/apache/hive/service/cli/thrift/RetryingThriftCLIServiceClient.java
>  b2e0e9e 
>   service/src/java/org/apache/hive/service/cli/thrift/ThriftCLIService.java 
> 6ede1d7 
>   
> service/src/java/org/apache/hive/service/cli/thrift/ThriftCLIServiceClient.java
>  098aea6 
>   
> service/src/test/org/apache/hive/service/cli/thrift/ThriftCLIServiceTest.java 
> 1740079 
>   
> service/src/test/org/apache/hive/service/cli/thrift/ThriftCliServiceTestWithCookie.java
>  a1ef1fc 
> 
> Diff: https://reviews.apache.org/r/46755/diff/
> 
> 
> Testing
> ---
> 
> 
> Thanks,
> 
> Vaibhav Gumashta
> 
>

[jira] [Created] (HIVE-13634) Hive-on-Spark performed worse than Hive-on-MR, for queries with external scripts

2016-04-27 Thread Xin Hao (JIRA) 
Xin Hao created HIVE-13634:
--

 Summary: Hive-on-Spark performed worse than Hive-on-MR, for 
queries with external scripts
 Key: HIVE-13634
 URL: https://issues.apache.org/jira/browse/HIVE-13634
 Project: Hive
  Issue Type: Bug
Reporter: Xin Hao


Hive-on-Spark performed worse than Hive-on-MR, for queries with external 
scripts.

For TPCx-BB Q2/Q3/Q4, they are Python Streaming related cases and will call 
external scripts to handle reduce tasks. We found that for these 3 queries 
Hive-on-Spark shows lower performance than Hive-on-MR when processing reduce 
tasks with external (Python) scripts. So ‘Improve HoS performance for queries 
with external scripts’ seems a performance optimization opportunity.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: Review Request 46671: HIVE-13598 : Describe extended table should show the primary keys/foreign keys associated with the table

2016-04-27 Thread Hari Sankar Sivarama Subramaniyan 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/46671/
---

(Updated April 28, 2016, 1:25 a.m.)


Review request for hive and Ashutosh Chauhan.


Repository: hive-git


Description
---

Describe extended table should show the primary keys/foreign keys associated 
with the table


Diffs (updated)
-

  itests/util/src/main/java/org/apache/hadoop/hive/ql/QTestUtil.java a6e8efa 
  metastore/scripts/upgrade/derby/034-HIVE-13076.derby.sql b062c56 
  metastore/scripts/upgrade/derby/hive-schema-2.1.0.derby.sql 1d00499 
  metastore/scripts/upgrade/mssql/019-HIVE-13076.mssql.sql 00ddb73 
  metastore/scripts/upgrade/mssql/hive-schema-2.1.0.mssql.sql 2d9cf76 
  metastore/scripts/upgrade/mysql/034-HIVE-13076.mysql.sql c9a5e1d 
  metastore/scripts/upgrade/mysql/hive-schema-2.1.0.mysql.sql 466e950 
  metastore/scripts/upgrade/oracle/034-HIVE-13076.oracle.sql baf855c 
  metastore/scripts/upgrade/oracle/hive-schema-2.1.0.oracle.sql f57e588 
  metastore/scripts/upgrade/postgres/033-HIVE-13076.postgres.sql ec1fb48 
  metastore/scripts/upgrade/postgres/hive-schema-2.1.0.postgres.sql e209489 
  metastore/src/java/org/apache/hadoop/hive/metastore/MetaStoreDirectSql.java 
744512f 
  metastore/src/java/org/apache/hadoop/hive/metastore/ObjectStore.java f651a13 
  metastore/src/model/org/apache/hadoop/hive/metastore/model/MConstraint.java 
3806e28 
  metastore/src/model/package.jdo b40df39 
  ql/src/java/org/apache/hadoop/hive/ql/exec/DDLTask.java cbeb361 
  ql/src/java/org/apache/hadoop/hive/ql/metadata/ForeignKeyInfo.java 
PRE-CREATION 
  ql/src/java/org/apache/hadoop/hive/ql/metadata/Hive.java ab165f1 
  ql/src/java/org/apache/hadoop/hive/ql/metadata/PrimaryKeyInfo.java 
PRE-CREATION 
  
ql/src/java/org/apache/hadoop/hive/ql/metadata/formatting/JsonMetaDataFormatter.java
 75c2dd9 
  
ql/src/java/org/apache/hadoop/hive/ql/metadata/formatting/MetaDataFormatter.java
 55e1b3b 
  
ql/src/java/org/apache/hadoop/hive/ql/metadata/formatting/TextMetaDataFormatter.java
 b5dc0b4 
  ql/src/test/queries/clientpositive/create_with_constraints.q eef0c64 
  ql/src/test/results/clientpositive/create_with_constraints.q.out 5cf8d83 

Diff: https://reviews.apache.org/r/46671/diff/


Testing
---


Thanks,

Hari Sankar Sivarama Subramaniyan

[jira] [Created] (HIVE-13633) LLAP: better handling of container id, attempt number, fragment number for external clients

2016-04-27 Thread Sergey Shelukhin (JIRA) 
Sergey Shelukhin created HIVE-13633:
---

 Summary: LLAP: better handling of container id, attempt number, 
fragment number for external clients
 Key: HIVE-13633
 URL: https://issues.apache.org/jira/browse/HIVE-13633
 Project: Hive
  Issue Type: Bug
Reporter: Sergey Shelukhin
Assignee: Siddharth Seth


>From the API discussion. We want to make sure that fields coming from external 
>clients that are used by LLAP as various kinds of IDs are handled correctly. 
>Some of the fields may not be practically signable (e.g. attempt number, even 
>we implemented some signing scheme it would just be ugly to re-sign to retry), 
>also someone could just submit the same signed split twice. 
The fields are - fragment number (and various other parts of ID, presumably), 
attempt number, container id, maybe others.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: Review Request 46715: HIVE-13596 HS2 should be able to get UDFs on demand from metastore

2016-04-27 Thread Sergey Shelukhin 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/46715/
---

(Updated April 28, 2016, 12:20 a.m.)


Review request for hive and Jason Dere.


Repository: hive-git


Description
---

see jira


Diffs (updated)
-

  common/src/java/org/apache/hadoop/hive/conf/HiveConf.java 49d748c 
  ql/src/java/org/apache/hadoop/hive/ql/exec/Registry.java d5f4a37 
  ql/src/java/org/apache/hadoop/hive/ql/session/SessionState.java 672df63 

Diff: https://reviews.apache.org/r/46715/diff/


Testing
---


Thanks,

Sergey Shelukhin

[jira] [Created] (HIVE-13632) Hive failing on insert empty array into parquet table

2016-04-27 Thread Yongzhi Chen (JIRA) 
Yongzhi Chen created HIVE-13632:
---

 Summary: Hive failing on insert empty array into parquet table
 Key: HIVE-13632
 URL: https://issues.apache.org/jira/browse/HIVE-13632
 Project: Hive
  Issue Type: Bug
  Components: Serializers/Deserializers
Affects Versions: 1.1.0
Reporter: Yongzhi Chen
Assignee: Yongzhi Chen


The insert will fail with following stack:
{noformat}
by: parquet.io.ParquetEncodingException: empty fields are illegal, the field 
should be ommited completely instead
at 
parquet.io.MessageColumnIO$MessageColumnIORecordConsumer.endField(MessageColumnIO.java:271)
at 
org.apache.hadoop.hive.ql.io.parquet.write.DataWritableWriter$ListDataWriter.write(DataWritableWriter.java:271)
at 
org.apache.hadoop.hive.ql.io.parquet.write.DataWritableWriter$GroupDataWriter.write(DataWritableWriter.java:199)
at 
org.apache.hadoop.hive.ql.io.parquet.write.DataWritableWriter$MessageDataWriter.write(DataWritableWriter.java:215)
at 
org.apache.hadoop.hive.ql.io.parquet.write.DataWritableWriter.write(DataWritableWriter.java:88)
at 
org.apache.hadoop.hive.ql.io.parquet.write.DataWritableWriteSupport.write(DataWritableWriteSupport.java:59)
at 
org.apache.hadoop.hive.ql.io.parquet.write.DataWritableWriteSupport.write(DataWritableWriteSupport.java:31)
at 
parquet.hadoop.InternalParquetRecordWriter.write(InternalParquetRecordWriter.java:116)
at 
parquet.hadoop.ParquetRecordWriter.write(ParquetRecordWriter.java:123)
at parquet.hadoop.ParquetRecordWriter.write(ParquetRecordWriter.java:42)
at 
org.apache.hadoop.hive.ql.io.parquet.write.ParquetRecordWriterWrapper.write(ParquetRecordWriterWrapper.java:111)
at 
org.apache.hadoop.hive.ql.io.parquet.write.ParquetRecordWriterWrapper.write(ParquetRecordWriterWrapper.java:124)
at 
org.apache.hadoop.hive.ql.exec.FileSinkOperator.processOp(FileSinkOperator.java:697)
{noformat}
Reproduce:
{noformat}
create table test_small (
key string,
arrayValues array)
stored as parquet;
insert into table test_small select 'abcd', array() from src limit 1;
{noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Review Request 46755: JDBC: Support query timeout for jdbc

2016-04-27 Thread Vaibhav Gumashta 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/46755/
---

Review request for hive and Thejas Nair.


Bugs: HIVE-4924
https://issues.apache.org/jira/browse/HIVE-4924


Repository: hive-git


Description
---

https://issues.apache.org/jira/browse/HIVE-4924


Diffs
-

  itests/hive-unit/src/test/java/org/apache/hive/jdbc/TestJdbcDriver2.java 
965627f 
  
itests/hive-unit/src/test/java/org/apache/hive/service/cli/session/TestHiveSessionImpl.java
 4d763d2 
  jdbc/src/java/org/apache/hive/jdbc/HiveStatement.java 3cc6b74 
  ql/src/java/org/apache/hadoop/hive/ql/Driver.java dad43fb 
  ql/src/java/org/apache/hadoop/hive/ql/history/HiveHistoryImpl.java 0234fd9 
  service-rpc/if/TCLIService.thrift 92bcf77 
  service-rpc/src/gen/thrift/gen-cpp/TCLIService_types.h 9f937ca 
  service-rpc/src/gen/thrift/gen-cpp/TCLIService_types.cpp 66f5e8c 
  
service-rpc/src/gen/thrift/gen-javabean/org/apache/hive/service/rpc/thrift/TExecuteStatementReq.java
 2eb4d09 
  
service-rpc/src/gen/thrift/gen-javabean/org/apache/hive/service/rpc/thrift/TOperationState.java
 3fa49b0 
  service-rpc/src/gen/thrift/gen-php/Types.php 7f1f99f 
  service-rpc/src/gen/thrift/gen-py/TCLIService/ttypes.py 3bb20b8 
  service-rpc/src/gen/thrift/gen-rb/t_c_l_i_service_types.rb 7208bae 
  service/src/java/org/apache/hive/service/cli/CLIService.java 4a83e38 
  service/src/java/org/apache/hive/service/cli/EmbeddedCLIServiceClient.java 
79e0024 
  service/src/java/org/apache/hive/service/cli/ICLIService.java e4aef96 
  service/src/java/org/apache/hive/service/cli/OperationState.java 6a67a1d 
  
service/src/java/org/apache/hive/service/cli/operation/ExecuteStatementOperation.java
 b3d9b52 
  
service/src/java/org/apache/hive/service/cli/operation/HiveCommandOperation.java
 f18dc67 
  service/src/java/org/apache/hive/service/cli/operation/MetadataOperation.java 
77228fa 
  service/src/java/org/apache/hive/service/cli/operation/Operation.java 63b1a48 
  service/src/java/org/apache/hive/service/cli/operation/OperationManager.java 
52e4b4d 
  service/src/java/org/apache/hive/service/cli/operation/SQLOperation.java 
01dd48c 
  service/src/java/org/apache/hive/service/cli/session/HiveSession.java 9ea643b 
  service/src/java/org/apache/hive/service/cli/session/HiveSessionImpl.java 
0cfec7a 
  
service/src/java/org/apache/hive/service/cli/thrift/RetryingThriftCLIServiceClient.java
 b2e0e9e 
  service/src/java/org/apache/hive/service/cli/thrift/ThriftCLIService.java 
6ede1d7 
  
service/src/java/org/apache/hive/service/cli/thrift/ThriftCLIServiceClient.java 
098aea6 
  service/src/test/org/apache/hive/service/cli/thrift/ThriftCLIServiceTest.java 
1740079 
  
service/src/test/org/apache/hive/service/cli/thrift/ThriftCliServiceTestWithCookie.java
 a1ef1fc 

Diff: https://reviews.apache.org/r/46755/diff/


Testing
---


Thanks,

Vaibhav Gumashta

Re: Review Request 46754: HIVE-13391 add an option to LLAP to use keytab to authenticate to read data

2016-04-27 Thread Sergey Shelukhin 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/46754/#review130862
---




ql/src/java/org/apache/hadoop/hive/ql/exec/tez/MapRecordProcessor.java (line 61)


unneeded


- Sergey Shelukhin


On April 27, 2016, 11:01 p.m., Sergey Shelukhin wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/46754/
> ---
> 
> (Updated April 27, 2016, 11:01 p.m.)
> 
> 
> Review request for hive and Siddharth Seth.
> 
> 
> Repository: hive-git
> 
> 
> Description
> ---
> 
> see JIRA
> 
> 
> Diffs
> -
> 
>   common/src/java/org/apache/hadoop/hive/common/UgiFactory.java PRE-CREATION 
>   common/src/java/org/apache/hadoop/hive/conf/HiveConf.java 5360ed4 
>   
> llap-client/src/java/org/apache/hadoop/hive/llap/registry/ServiceInstanceSet.java
>  73f94f3 
>   
> llap-client/src/java/org/apache/hadoop/hive/llap/registry/impl/LlapZookeeperRegistryImpl.java
>  6af30d4 
>   
> llap-server/src/java/org/apache/hadoop/hive/llap/daemon/impl/ContainerRunnerImpl.java
>  e80fb15 
>   
> llap-server/src/java/org/apache/hadoop/hive/llap/daemon/impl/LlapDaemon.java 
> 33b41e8 
>   
> llap-server/src/java/org/apache/hadoop/hive/llap/daemon/impl/LlapProtocolServerImpl.java
>  e99e689 
>   
> llap-server/src/java/org/apache/hadoop/hive/llap/daemon/impl/TaskRunnerCallable.java
>  2a60123 
>   
> llap-server/src/java/org/apache/hadoop/hive/llap/io/api/impl/LlapIoImpl.java 
> 6a72b4c 
>   
> llap-server/src/java/org/apache/hadoop/hive/llap/io/decode/ColumnVectorProducer.java
>  b3b571d 
>   
> llap-server/src/java/org/apache/hadoop/hive/llap/security/LlapSecurityHelper.java
>  76ba225 
>   
> llap-server/src/java/org/apache/hadoop/hive/llap/security/SecretManager.java 
> 8c7a539 
>   
> llap-server/src/test/org/apache/hadoop/hive/llap/daemon/impl/TaskExecutorTestHelpers.java
>  24f4442 
>   
> llap-server/src/test/org/apache/hadoop/hive/llap/daemon/impl/comparator/TestFirstInFirstOutComparator.java
>  08ee769 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/DagUtils.java 8aca779 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/MapRecordProcessor.java 
> 0584ad8 
> 
> Diff: https://reviews.apache.org/r/46754/diff/
> 
> 
> Testing
> ---
> 
> 
> Thanks,
> 
> Sergey Shelukhin
> 
>

Review Request 46754: HIVE-13391 add an option to LLAP to use keytab to authenticate to read data

2016-04-27 Thread Sergey Shelukhin 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/46754/
---

Review request for hive and Siddharth Seth.


Repository: hive-git


Description
---

see JIRA


Diffs
-

  common/src/java/org/apache/hadoop/hive/common/UgiFactory.java PRE-CREATION 
  common/src/java/org/apache/hadoop/hive/conf/HiveConf.java 5360ed4 
  
llap-client/src/java/org/apache/hadoop/hive/llap/registry/ServiceInstanceSet.java
 73f94f3 
  
llap-client/src/java/org/apache/hadoop/hive/llap/registry/impl/LlapZookeeperRegistryImpl.java
 6af30d4 
  
llap-server/src/java/org/apache/hadoop/hive/llap/daemon/impl/ContainerRunnerImpl.java
 e80fb15 
  llap-server/src/java/org/apache/hadoop/hive/llap/daemon/impl/LlapDaemon.java 
33b41e8 
  
llap-server/src/java/org/apache/hadoop/hive/llap/daemon/impl/LlapProtocolServerImpl.java
 e99e689 
  
llap-server/src/java/org/apache/hadoop/hive/llap/daemon/impl/TaskRunnerCallable.java
 2a60123 
  llap-server/src/java/org/apache/hadoop/hive/llap/io/api/impl/LlapIoImpl.java 
6a72b4c 
  
llap-server/src/java/org/apache/hadoop/hive/llap/io/decode/ColumnVectorProducer.java
 b3b571d 
  
llap-server/src/java/org/apache/hadoop/hive/llap/security/LlapSecurityHelper.java
 76ba225 
  llap-server/src/java/org/apache/hadoop/hive/llap/security/SecretManager.java 
8c7a539 
  
llap-server/src/test/org/apache/hadoop/hive/llap/daemon/impl/TaskExecutorTestHelpers.java
 24f4442 
  
llap-server/src/test/org/apache/hadoop/hive/llap/daemon/impl/comparator/TestFirstInFirstOutComparator.java
 08ee769 
  ql/src/java/org/apache/hadoop/hive/ql/exec/tez/DagUtils.java 8aca779 
  ql/src/java/org/apache/hadoop/hive/ql/exec/tez/MapRecordProcessor.java 
0584ad8 

Diff: https://reviews.apache.org/r/46754/diff/


Testing
---


Thanks,

Sergey Shelukhin

Re: [VOTE] Apache Hive 2.0.1 Release Candidate 0

2016-04-27 Thread Sergey Shelukhin 
RC is invalid. I will publish RC1 in due course...

On 16/4/27, 15:05, "Sergey Shelukhin"  wrote:

>Apache Hive 2.0.1 Release Candidate 0 is available here:
>
>http://home.apache.org/~sershe/hive-2.0.1-rc0/
>
>
>Maven artifacts are available here:
>
>https://repository.apache.org/content/repositories/orgapachehive-1048/
>
>
>Source tag for RC0 (github mirror) is:
>https://github.com/apache/hive/releases/tag/release-2.0.1-rc0
>
>
>Voting will conclude in 72 hours.
>
>Hive PMC Members: Please test and vote.
>
>Thanks.
>
>
>
>

[jira] [Created] (HIVE-13631) Support index in HBase Metastore

2016-04-27 Thread Daniel Dai (JIRA) 
Daniel Dai created HIVE-13631:
-

 Summary: Support index in HBase Metastore
 Key: HIVE-13631
 URL: https://issues.apache.org/jira/browse/HIVE-13631
 Project: Hive
  Issue Type: Improvement
  Components: HBase Metastore
Reporter: Daniel Dai
Assignee: Daniel Dai


Currently all index related methods in HBaseStore is not implemented. We need 
to add those missing methods and index support in hbaseimport tool.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

please withhold commits to Hive branch-2.0

2016-04-27 Thread Sergey Shelukhin 
I’ve just cut the RC0 for Hive 2.0.1 release. Please withhold commits to
Hive branch-2.0 until the release is completed, or the RC is sank.

[VOTE] Apache Hive 2.0.1 Release Candidate 0

2016-04-27 Thread Sergey Shelukhin 
Apache Hive 2.0.1 Release Candidate 0 is available here:

http://home.apache.org/~sershe/hive-2.0.1-rc0/


Maven artifacts are available here:

https://repository.apache.org/content/repositories/orgapachehive-1048/


Source tag for RC0 (github mirror) is:
https://github.com/apache/hive/releases/tag/release-2.0.1-rc0


Voting will conclude in 72 hours.

Hive PMC Members: Please test and vote.

Thanks.

[jira] [Created] (HIVE-13630) missing license headers

2016-04-27 Thread Sergey Shelukhin (JIRA) 
Sergey Shelukhin created HIVE-13630:
---

 Summary: missing license headers
 Key: HIVE-13630
 URL: https://issues.apache.org/jira/browse/HIVE-13630
 Project: Hive
  Issue Type: Bug
Reporter: Sergey Shelukhin
Assignee: Sergey Shelukhin


NO PRECOMMIT TESTS



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: Review Request 46715: HIVE-13596 HS2 should be able to get UDFs on demand from metastore

2016-04-27 Thread Jason Dere 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/46715/#review130835
---




ql/src/java/org/apache/hadoop/hive/ql/exec/Registry.java (line 450)


agreed, this check could probably just use !=



ql/src/java/org/apache/hadoop/hive/ql/exec/Registry.java (line 703)


Given that this is called by getQualifiedFunctionInfoUnderLock(), this 
should already be qualified, right?
Also could use FunctionUtils.getQualifiedFunctionNameParts() which 
basically does this same logic here.



ql/src/java/org/apache/hadoop/hive/ql/exec/Registry.java (line 729)


I think the function also needs to be added to the session registry.
Does it work to use registerPermanentFunction() in place of the code from 
line 721-729? That seems to load the jars and add the UDF to the appropriate 
registries.


- Jason Dere


On April 26, 2016, 11:06 p.m., Sergey Shelukhin wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/46715/
> ---
> 
> (Updated April 26, 2016, 11:06 p.m.)
> 
> 
> Review request for hive and Jason Dere.
> 
> 
> Repository: hive-git
> 
> 
> Description
> ---
> 
> see jira
> 
> 
> Diffs
> -
> 
>   common/src/java/org/apache/hadoop/hive/conf/HiveConf.java bae3999 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/Registry.java d5f4a37 
>   ql/src/java/org/apache/hadoop/hive/ql/session/SessionState.java 672df63 
> 
> Diff: https://reviews.apache.org/r/46715/diff/
> 
> 
> Testing
> ---
> 
> 
> Thanks,
> 
> Sergey Shelukhin
> 
>

[jira] [Created] (HIVE-13629) Expose Merge-File task and Column-Truncate task from DDLTask

2016-04-27 Thread zhihai xu (JIRA) 
zhihai xu created HIVE-13629:


 Summary: Expose Merge-File task and Column-Truncate task from 
DDLTask
 Key: HIVE-13629
 URL: https://issues.apache.org/jira/browse/HIVE-13629
 Project: Hive
  Issue Type: Improvement
  Components: Hive
Affects Versions: 2.0.0
Reporter: zhihai xu
Assignee: zhihai xu


DDLTask will create subtask in mergeFiles and truncateTable to support 
HiveOperation.TRUNCATETABLE, HiveOperation.ALTERTABLE_MERGEFILES and 
HiveOperation.ALTERPARTITION_MERGEFILES.
It will be better to expose the tasks which are created at function mergeFiles 
and truncateTable from class DDLTask to users.




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: recent metastore failures in HiveQA

2016-04-27 Thread Wei Zheng 
Still seeing lots of failing tests with "Connection refused" message.. But 
locally they run fine.

Thanks,
Wei







On 4/12/16, 14:48, "Ashutosh Chauhan"  wrote:

>I can repro locally hang of  TestJdbcWithMiniHS2  and I also saw it hanging
>on recent QA runs:
>http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-7556/failed/TestJdbcWithMiniHS2/
>
>Wondering if you guys have seen this?
>
>Thanks,
>Ashutosh
>
>On Tue, Apr 12, 2016 at 11:28 AM, Szehon Ho  wrote:
>
>> Thanks Thejas for this patch!
>>
>> I'm also going to restart PTest and force recreation of the test slaves
>> based on fresh image to see if it resolves the issue (in case the test
>> slaves are getting too loaded and slow to start HMS in time).  If not then
>> Thejas's patch should tell us a bit more.
>>
>> On Tue, Apr 12, 2016 at 12:35 AM, Thejas Nair 
>> wrote:
>>
>> > Created a patch that should hopefully help in figuring out whats going
>> > on  - https://issues.apache.org/jira/browse/HIVE-13491
>> >
>> >
>> > On Wed, Apr 6, 2016 at 1:56 PM, Szehon Ho  wrote:
>> > > Yea thanks for point it out.  I see it too and am not able to reproduce
>> > it
>> > > locally.  It points to an environment issue, but not aware anything
>> > changed
>> > > with the environment.
>> > >
>> > > Anyone have any ideas?
>> > >
>> > > On Wed, Apr 6, 2016 at 1:29 PM, Sergey Shelukhin <
>> ser...@hortonworks.com
>> > >
>> > > wrote:
>> > >
>> > >> Has anyone else noticed that many tests that involve metastore started
>> > >> failing lately? The failures are sporadic and happen both in the tests
>> > >> that test metastore, and q files that use metastore…
>> > >> The error is always something like
>> > >> java.net.ConnectException: Connection refused
>> > >> at java.net.PlainSocketImpl.socketConnect(Native Method)
>> > >> at
>> > >>
>> >
>> java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339
>> > >> )
>> > >> at
>> > >>
>> >
>> java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.j
>> > >> ava:198)
>> > >> at
>> > >>
>> >
>> java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
>> > >> at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
>> > >> at java.net.Socket.connect(Socket.java:579)
>> > >> at
>> > >>
>> >
>> org.apache.hadoop.hive.metastore.MetaStoreUtils.loopUntilHMSReady(MetaStore
>> > >> Utils.java:1208)
>> > >> at
>> > >>
>> >
>> org.apache.hadoop.hive.metastore.MetaStoreUtils.startMetaStore(MetaStoreUti
>> > >> ls.java:1195)
>> > >> at
>> > >>
>> >
>> org.apache.hadoop.hive.metastore.TestMetaStoreMetrics.before(TestMetaStoreM
>> > >> etrics.java:54)
>> > >>
>> > >> I wonder if someone has insight on whether this is an environment
>> issue,
>> > >> or someone broke something recently, before we investigate more :)
>> > >>
>> > >>
>> > >>
>> >
>>

[jira] [Created] (HIVE-13628) Support for permanent functions - error handling if no restart

2016-04-27 Thread Vikram Dixit K (JIRA) 
Vikram Dixit K created HIVE-13628:
-

 Summary: Support for permanent functions - error handling if no 
restart
 Key: HIVE-13628
 URL: https://issues.apache.org/jira/browse/HIVE-13628
 Project: Hive
  Issue Type: Bug
  Components: llap
Affects Versions: 2.1.0
Reporter: Vikram Dixit K
Assignee: Vikram Dixit K
 Attachments: HIVE-13628.1.patch

Support for permanent functions - error handling if no restart



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (HIVE-13627) When running under LLAP, for regular map joins, throw an error if memory utilization goes above what is allocated to the task

2016-04-27 Thread Vikram Dixit K (JIRA) 
Vikram Dixit K created HIVE-13627:
-

 Summary: When running under LLAP, for regular map joins, throw an 
error if memory utilization goes above what is allocated to the task
 Key: HIVE-13627
 URL: https://issues.apache.org/jira/browse/HIVE-13627
 Project: Hive
  Issue Type: Bug
  Components: llap
Affects Versions: 2.1.0
Reporter: Vikram Dixit K
Assignee: Vikram Dixit K


When running under LLAP, for regular map joins, throw an error if memory 
utilization goes above what is allocated to the task. This way, the rest of the 
dependent tasks can fail sooner.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: Review Request 46690: HIVE-13068

2016-04-27 Thread Jesús Camacho Rodríguez 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/46690/
---

(Updated April 27, 2016, 4:26 p.m.)


Review request for hive and Ashutosh Chauhan.


Bugs: HIVE-13068
https://issues.apache.org/jira/browse/HIVE-13068


Repository: hive-git


Description
---

HIVE-13068


Diffs (updated)
-

  hbase-handler/src/test/results/positive/hbase_ppd_key_range.q.out 
27446b41db80ee98d56a4101a87f76be7f6dea2f 
  hbase-handler/src/test/results/positive/hbase_pushdown.q.out 
a42e36f0132457d22240d3ef4b8a52375a14fe34 
  hbase-handler/src/test/results/positive/ppd_key_ranges.q.out 
34c3b230bd64f4fe9aa92a0e874e0f0a4919d208 
  ql/src/java/org/apache/hadoop/hive/ql/optimizer/NonBlockingOpDeDupProc.java 
37dbe32008685ba22e5dae1e4bfbfe090c5bfe9f 
  ql/src/java/org/apache/hadoop/hive/ql/optimizer/Optimizer.java 
55c71ddd2ab16f2a1c50a704556a1ee9092d0941 
  
ql/src/java/org/apache/hadoop/hive/ql/optimizer/SortedDynPartitionOptimizer.java
 adfbb6705d4cc861167536768e6c74190a8b7ccb 
  ql/src/java/org/apache/hadoop/hive/ql/optimizer/StatsOptimizer.java 
0cfd5298899ea8dd16c073b26546c40de4451271 
  
ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/rules/HiveAggregatePullUpConstantsRule.java
 PRE-CREATION 
  
ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/rules/HiveProjectFilterPullUpConstantsRule.java
 PRE-CREATION 
  
ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/translator/JoinTypeCheckCtx.java
 dccd1d95aec281e3b7e4c38ab569b50d1e0850ab 
  
ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/translator/RexNodeConverter.java
 ee4f4ead6066a29e867cf51582c45d3dc69b1880 
  
ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/translator/SqlFunctionConverter.java
 0b76bffb42d88204f486278a12bbf24d1b7fc274 
  
ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/translator/TypeConverter.java
 2825f7787de4d42e9532bfb2642f4f95ba8f8b83 
  ql/src/java/org/apache/hadoop/hive/ql/parse/CalcitePlanner.java 
8e00e0b140d7d40f25299e10be26c6eaf0231745 
  ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java 
cfe4497684caaa5fb317e87c779733fda8f435e2 
  ql/src/java/org/apache/hadoop/hive/ql/parse/TypeCheckCtx.java 
de1c043cb4914bf39d9086569e6e3cd802ee79dc 
  ql/src/java/org/apache/hadoop/hive/ql/parse/TypeCheckProcFactory.java 
da236d5b6889621097e3403ec7e8783b2704dbc6 
  ql/src/java/org/apache/hadoop/hive/ql/plan/ExprNodeDescUtils.java 
c6f89074457e1ed4e61d52c01d9cc515fe1a6f09 
  ql/src/test/queries/clientpositive/join_view.q 
16b6816f0c8618691ba7a28f4ca467d7526d6e13 
  ql/src/test/results/clientpositive/annotate_stats_filter.q.out 
ba0419e461a5b5649bd7d4c67602b8cb747961ea 
  ql/src/test/results/clientpositive/archive_excludeHadoop20.q.out 
c2b98727d21f4990ae7496a0a8fa9ac16598f4c0 
  ql/src/test/results/clientpositive/archive_multi.q.out 
0ad29d122153bd4adf4d19064188b0c4f94e05ab 
  ql/src/test/results/clientpositive/auto_join8.q.out 
324f95d550add0ead3215bbdd0933ddd6456f9c9 
  ql/src/test/results/clientpositive/bucket_groupby.q.out 
d1414fefd01312510e96391c1180d2ae5e2046a3 
  ql/src/test/results/clientpositive/cbo_rp_join1.q.out 
f3982b8866d44dd0b4c01bf1f75e44c861f85756 
  ql/src/test/results/clientpositive/constantPropWhen.q.out 
650cbc77fc5a0145a5cc7b5ec69ec05a7bd6743d 
  ql/src/test/results/clientpositive/constprog_semijoin.q.out 
35d062d7a534c9cf9705fda44eaf81fa97e92229 
  ql/src/test/results/clientpositive/cp_sel.q.out 
f42ec84dc6f147278da93c33375500a48bb0e008 
  ql/src/test/results/clientpositive/cte_5.q.out 
96a65438f0fe0f5189e0a257c4fd71290bdb0804 
  ql/src/test/results/clientpositive/cte_mat_1.q.out 
b7d5f7d1f6cde1990c56803fc8e7c566dacd1ba8 
  ql/src/test/results/clientpositive/cte_mat_2.q.out 
b7d5f7d1f6cde1990c56803fc8e7c566dacd1ba8 
  ql/src/test/results/clientpositive/dynamic_rdd_cache.q.out 
9a09c4c205f18a1033742bc61c7d624dcf81c0b8 
  ql/src/test/results/clientpositive/dynpart_sort_optimization.q.out 
13383fb41cd3f086f722915dbc5550b25b40f9a0 
  ql/src/test/results/clientpositive/dynpart_sort_optimization2.q.out 
3b24a2e3fb85b1bb2ccfb1456ce00c4e3962eec7 
  ql/src/test/results/clientpositive/filter_cond_pushdown.q.out 
132b590230d2fba13d77a004b5bb5041999fc497 
  ql/src/test/results/clientpositive/fold_case.q.out 
53139da206481bb04db865819c30ec3775452449 
  ql/src/test/results/clientpositive/fold_eq_with_case_when.q.out 
106ad6b836b6c2dbf43e236c488621ef21bae47b 
  ql/src/test/results/clientpositive/fold_when.q.out 
5b684089c0bdfd9be3e05241ac5af22c1f16eca3 
  ql/src/test/results/clientpositive/folder_predicate.q.out 
7fcc1722d87a9e2734b3467fe1a5f320af0a422c 
  ql/src/test/results/clientpositive/groupby_ppd.q.out 
c63acd32a62540a96d22a0d29ac69212e4cb0dee 
  ql/src/test/results/clientpositive/groupby_sort_1_23.q.out 
a6e15ba2edb4a95a6b8a20a979cc673b4b312c7f 
  ql/src/test/results/clientpositive/groupby_sort_skew_1_23.q.out 
38b24a462ac06daf

Fwd: problem in beeline query execution

2016-04-27 Thread Vijay Dubey 
Hi,



I am facing issue to run the query on Hbase link hive table for insert from
beeline as well as from oozie hive2 action.



Exit code: 255

Stack trace: ExitCodeException exitCode=255:

   at org.apache.hadoop.util.Shell.runCommand(Shell.java:576)

   at org.apache.hadoop.util.Shell.run(Shell.java:487)

   at
org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:753)

   at
org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)

   at
org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)

   at
org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)

   at java.util.concurrent.FutureTask.run(FutureTask.java:266)

   at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)

   at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)

   at java.lang.Thread.run(Thread.java:745)





Container exited with a non-zero exit code 255

Failing this attempt. Failing the application.

   at
org.apache.tez.client.TezClient.waitTillReady(TezClient.java:718)

   at
org.apache.hadoop.hive.ql.exec.tez.TezSessionState.open(TezSessionState.java:207)

   at
org.apache.hadoop.hive.ql.exec.tez.TezTask.updateSession(TezTask.java:257)

   at
org.apache.hadoop.hive.ql.exec.tez.TezTask.execute(TezTask.java:140)

   at
org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:160)

   at
org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:89)

   at
org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1655)

   at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1414)

   at
org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1195)

   at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1059)

   at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1054)

   at
org.apache.hive.service.cli.operation.SQLOperation.runQuery(SQLOperation.java:154)

   at
org.apache.hive.service.cli.operation.SQLOperation.access$100(SQLOperation.java:71)

   at
org.apache.hive.service.cli.operation.SQLOperation$1$1.run(SQLOperation.java:206)

   at java.security.AccessController.doPrivileged(Native Method)

   at javax.security.auth.Subject.doAs(Subject.java:422)

   at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)

   at
org.apache.hive.service.cli.operation.SQLOperation$1.run(SQLOperation.java:218)

   at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)

   at java.util.concurrent.FutureTask.run(FutureTask.java:266)

   at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)

   at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)

   at java.lang.Thread.run(Thread.java:745)

Error: Error while processing statement: FAILED: Execution Error, return
code 1 from org.apache.hadoop.hive.ql.exec.tez.TezTask (state=08S01,code=1)




The same error I am getting when I am trying to run the query via oozie
hive2 action and in the detail yarn log I found the other exception.(see
the attachment)







And in the attempt log we have the exception detail







2016-04-27 13:02:23,205 [FATAL] [HistoryEventHandlingThread]
|yarn.YarnUncaughtExceptionHandler|: Thread
Thread[HistoryEventHandlingThread,5,main] threw an Error.  Shutting
down now...

java.lang.NoSuchMethodError:
org.codehaus.jackson.map.ObjectMapper.setSerializationInclusion(Lorg/codehaus/jackson/map/annotate/JsonSerialize$Inclusion;)Lorg/codehaus/jackson/map/ObjectMapper;

   at
org.apache.hadoop.yarn.webapp.YarnJacksonJaxbJsonProvider.configObjectMapper(YarnJacksonJaxbJsonProvider.java:59)

   at
org.apache.hadoop.yarn.webapp.YarnJacksonJaxbJsonProvider.locateMapper(YarnJacksonJaxbJsonProvider.java:52)

   at
org.codehaus.jackson.jaxrs.JacksonJsonProvider.writeTo(JacksonJsonProvider.java:501)

   at
com.sun.jersey.api.client.RequestWriter.writeRequestEntity(RequestWriter.java:300)

   at
com.sun.jersey.client.urlconnection.URLConnectionClientHandler._invoke(URLConnectionClientHandler.java:204)

   at
com.sun.jersey.client.urlconnection.URLConnectionClientHandler.handle(URLConnectionClientHandler.java:147)

   at
org.apache.hadoop.yarn.client.api.impl.TimelineClientImpl$TimelineJerseyRetryFilter$1.run(TimelineClientImpl.java:234)

   at
org.apache.hadoop.yarn.client.api.impl.TimelineClientImpl$TimelineClientConnectionRetry.

[jira] [Created] (HIVE-13626) Unable to cancel certain queries [Spark Branch]

2016-04-27 Thread JIRA 
Zsolt Tóth created HIVE-13626:
-

 Summary: Unable to cancel certain queries [Spark Branch]
 Key: HIVE-13626
 URL: https://issues.apache.org/jira/browse/HIVE-13626
 Project: Hive
  Issue Type: Bug
  Components: Spark
 Environment: CDH5.7 single node docker
Reporter: Zsolt Tóth


To reproduce:
1. Submit a query to Hive through JDBC
2. Cancel (almost) immediately

For the query _SELECT DISTINCT a FROM test_ the Hive log says: 
"java.lang.Exception: Failed to submit Spark work, please retry later" ... 
"Caused by: java.io.IOException: java.lang.InterruptedException". After I call 
close() on the statement and the connection, the application changes to 
FINISHED/SUCCEEDED state (as expected).

However, for the query _SELECT a FROM test order by a_  Hive log says: 
"org.apache.hadoop.hive.ql.metadata.HiveException: Failed to create spark 
client." ... "Caused by: java.lang.RuntimeException: 
java.lang.InterruptedException". Calling close() seems to have no effect, the 
yarn application is stuck in RUNNING state.

If I cancel the second query later (e.g. after 10 secs), the application closes 
with FINISHED/SUCCEEDED (as expected).

Code snippet:
{code:title=Bar.java|borderStyle=solid}
final Statement st = connection.createStatement();
new Thread() {
@Override
public void run() {
sleep(100);
st.cancel();
}
}.start();

ResultSet r = null;
try {
// r = st.executeQuery("SELECT DISTINCT a FROM test");
r = st.executeQuery("SELECT a FROM test order by a");
} catch (SQLException e) {
close(r);
if (st != null) {
st.close();
}
if (connection != null) {
connection.close();
}
}
{code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: Review Request 45733: HIVE-13421: Propagate job progress in operation status

2016-04-27 Thread Rajat Khandelwal 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/45733/
---

(Updated April 27, 2016, 1:11 p.m.)


Review request for hive, Amareshwari Sriramadasu and Szehon Ho.


Bugs: HIVE-13421
https://issues.apache.org/jira/browse/HIVE-13421


Repository: hive-git


Description
---


Diffs (updated)
-

  
itests/hive-unit/src/test/java/org/apache/hive/service/cli/session/TestQueryDisplay.java
 98581e0e09c20b30eafd6aae99068fddf1596d8e 
  ql/src/java/org/apache/hadoop/hive/ql/Driver.java 
dad43fbbab0359711320a5c4656d67fda6fb73f4 
  ql/src/java/org/apache/hadoop/hive/ql/QueryDisplay.java 
d582bc063fc150002a01d63451ae6632fca29ac1 
  ql/src/java/org/apache/hadoop/hive/ql/QueryPlan.java 
ef0923d555ba662b4ed30ef45a3d72760cdfad52 
  ql/src/java/org/apache/hadoop/hive/ql/exec/ConditionalTask.java 
c96c8135a344049e57167559c4d760b876a42ca5 
  ql/src/java/org/apache/hadoop/hive/ql/exec/Task.java 
897af5e8c3e876f7b4f6a7aa5d462f8115a4e238 
  ql/src/java/org/apache/hadoop/hive/ql/exec/mr/ExecDriver.java 
639b0da6c8da2a0eec018ce57c12e21637f1c0de 
  ql/src/java/org/apache/hadoop/hive/ql/exec/mr/HadoopJobExecHelper.java 
760ba6c8f5afb2d3e8c533ffce8be5f73d13a9e2 
  service/src/test/org/apache/hive/service/cli/CLIServiceTest.java 
ff7e9a4e1c1ec61454fed173aaab0c344d1241d4 

Diff: https://reviews.apache.org/r/45733/diff/


Testing
---


Thanks,

Rajat Khandelwal