Re: Review Request 43408: HIVE-13034 : Add jdeb plugin to build debian

2016-02-11 Thread Amareshwari Sriramadasu

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/43408/#review118848
---




packaging/pom.xml (line 92)


Can we move to latest verison 1.5 ?


- Amareshwari Sriramadasu


On Feb. 10, 2016, 6:34 a.m., Arshad Matin wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/43408/
> ---
> 
> (Updated Feb. 10, 2016, 6:34 a.m.)
> 
> 
> Review request for hive.
> 
> 
> Repository: hive-git
> 
> 
> Description
> ---
> 
> HIVE-13034 : Add jdeb plugin to build debian
> 
> 
> Diffs
> -
> 
>   packaging/pom.xml e7feb62 
>   packaging/src/deb/control/control PRE-CREATION 
> 
> Diff: https://reviews.apache.org/r/43408/diff/
> 
> 
> Testing
> ---
> 
> 
> Thanks,
> 
> Arshad Matin
> 
>



Re: Review Request 42134: More information to user on GetOperationStatus in Hive Server2 when query is still executing

2016-02-11 Thread Akshay Goyal

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/42134/
---

(Updated Feb. 11, 2016, 12:35 p.m.)


Review request for hive and Amareshwari Sriramadasu.


Changes
---

Test case fix and review changes.


Bugs: HIVE-4570
https://issues.apache.org/jira/browse/HIVE-4570


Repository: hive-git


Description
---

Driver maintains list of running and runnable tasks although that info is not 
exposed outside. It's kept locally in the driver's execute method. We can add 
Driver.getTaskStatuses() to return status on all tasks (both running and 
runnable). Similarly, start and completion times for operations.

Proposed changes are :

struct TGetOperationStatusResp {
  1: required TStatus status
  2: optional TOperationState operationState

  // If operationState is ERROR_STATE, then the following fields may be set
  // sqlState as defined in the ISO/IEF CLI specification
  3: optional string sqlState

  // Internal error code
  4: optional i32 errorCode

  // Error message
  5: optional string errorMessage

  // List of statuses of sub tasks
  6: optional string taskStatus

  // When was the operation started
  7: optional i64 operationStarted
  // When was the operation completed
  8: optional i64 operationCompleted

}


Diffs (updated)
-

  ql/src/java/org/apache/hadoop/hive/ql/Driver.java 7147a9a 
  ql/src/java/org/apache/hadoop/hive/ql/TaskStatus.java PRE-CREATION 
  ql/src/java/org/apache/hadoop/hive/ql/exec/Task.java 40c89cb 
  ql/src/java/org/apache/hadoop/hive/ql/exec/mr/ExecDriver.java b184b4e 
  service-rpc/if/TCLIService.thrift 0aa9d13 
  service/src/java/org/apache/hive/service/cli/OperationStatus.java e45b828 
  
service/src/java/org/apache/hive/service/cli/operation/GetCatalogsOperation.java
 8868ec1 
  
service/src/java/org/apache/hive/service/cli/operation/GetColumnsOperation.java 
35b6c52 
  
service/src/java/org/apache/hive/service/cli/operation/GetFunctionsOperation.java
 8db2e62 
  
service/src/java/org/apache/hive/service/cli/operation/GetSchemasOperation.java 
d6f6280 
  
service/src/java/org/apache/hive/service/cli/operation/GetTableTypesOperation.java
 a09b39a 
  
service/src/java/org/apache/hive/service/cli/operation/GetTablesOperation.java 
740b851 
  
service/src/java/org/apache/hive/service/cli/operation/GetTypeInfoOperation.java
 2a0fec2 
  
service/src/java/org/apache/hive/service/cli/operation/HiveCommandOperation.java
 f5a9771 
  service/src/java/org/apache/hive/service/cli/operation/Operation.java 22f725c 
  service/src/java/org/apache/hive/service/cli/operation/SQLOperation.java 
100dc6a 
  service/src/java/org/apache/hive/service/cli/thrift/ThriftCLIService.java 
d9a9e3b 
  
service/src/java/org/apache/hive/service/cli/thrift/ThriftCLIServiceClient.java 
5f01165 
  service/src/test/org/apache/hive/service/cli/CLIServiceTest.java e78181a 

Diff: https://reviews.apache.org/r/42134/diff/


Testing
---


Thanks,

Akshay Goyal



[jira] [Created] (HIVE-13042) OrcFiledump runs into an ArrayIndexOutOfBoundsException when running against old versions of ORC files

2016-02-11 Thread Rajesh Balamohan (JIRA)
Rajesh Balamohan created HIVE-13042:
---

 Summary: OrcFiledump runs into an ArrayIndexOutOfBoundsException 
when running against old versions of ORC files
 Key: HIVE-13042
 URL: https://issues.apache.org/jira/browse/HIVE-13042
 Project: Hive
  Issue Type: Bug
Reporter: Rajesh Balamohan


{noformat}
Exception in thread "main" java.lang.IndexOutOfBoundsException: Index: 0
at java.util.Collections$EmptyList.get(Collections.java:3212)
at 
org.apache.hadoop.hive.ql.io.orc.ReaderImpl.getFileVersion(ReaderImpl.java:194)
at 
org.apache.hadoop.hive.ql.io.orc.FileDump.printMetaDataImpl(FileDump.java:289)
at org.apache.hadoop.hive.ql.io.orc.FileDump.printMetaData(FileDump.java:261)
at org.apache.hadoop.hive.ql.io.orc.FileDump.main(FileDump.java:127)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
at org.apache.hadoop.util.RunJar.main(RunJar.java:136)
{noformat}

\cc [~prasanth_j], [~sseth]



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (HIVE-13043) Reload function has no impact to function registry

2016-02-11 Thread Jimmy Xiang (JIRA)
Jimmy Xiang created HIVE-13043:
--

 Summary: Reload function has no impact to function registry
 Key: HIVE-13043
 URL: https://issues.apache.org/jira/browse/HIVE-13043
 Project: Hive
  Issue Type: Bug
Reporter: Jimmy Xiang
Assignee: Jimmy Xiang


With HIVE-2573, users should run "reload function" to refresh cached function 
registry. However, "reload function" has no impact at all. We need to fix this. 
Otherwise, HS2 needs to be restarted to see new global functions.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (HIVE-13044) Enable TLS encryption to HMS backend database

2016-02-11 Thread Aihua Xu (JIRA)
Aihua Xu created HIVE-13044:
---

 Summary: Enable TLS encryption to HMS backend database
 Key: HIVE-13044
 URL: https://issues.apache.org/jira/browse/HIVE-13044
 Project: Hive
  Issue Type: Improvement
  Components: Metastore
Affects Versions: 2.1.0
Reporter: Aihua Xu
Assignee: Aihua Xu


When the database like mysql enables TLS/SSL encryption, we should provide some 
configuration properties like the ones to HS2 to enable that. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


Re: [VOTE] Apache Hive 2.0.0 Release Candidate 3

2016-02-11 Thread Alan Gates

+1, checks sigs, build with fresh maven repo, and did a quick smoke test.

Does the PMC member who votes on the most RC's get a prize?

Alan.


Sergey Shelukhin 
February 9, 2016 at 18:52
Another day, another release candidate... this time fixing the logging
issue.

Apache Hive 2.0.0 Release Candidate 3 is available here:

http://people.apache.org/~sershe/hive-2.0.0-rc3/

Maven artifacts are at

https://repository.apache.org/content/repositories/orgapachehive-1046/


Source tag for RC3 (github mirror) is:
https://github.com/apache/hive/releases/tag/release-2.0.0-rc3


Voting will conclude in 72 hours.

Hive PMC Members: Please test and vote.


Thanks.




Re: [VOTE] Apache Hive 2.0.0 Release Candidate 3

2016-02-11 Thread Sergio Pena
While running some HMS upgrade tests, I found an issue while upgrading
Mysql metastore from 1.2.0 to 2.0.0
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-METASTORE-Test/110/consoleFull

Executing sql test: mysql/upgrade-1.2.0-to-2.0.0.mysql.sql
++ dirname 
/hive/testutils/metastore/../../metastore/scripts/upgrade/mysql/upgrade-1.2.0-to-2.0.0.mysql.sql
+ cd /hive/testutils/metastore/../../metastore/scripts/upgrade/mysql
Executing script:
/hive/testutils/metastore/../../metastore/scripts/upgrade/mysql/upgrade-1.2.0-to-2.0.0.mysql.sql
+ echo 'Executing script:
/hive/testutils/metastore/../../metastore/scripts/upgrade/mysql/upgrade-1.2.0-to-2.0.0.mysql.sql'
+ mysql hive_hms_testing
ERROR 1060 (42S21)
Upgrading MetaStore schema from 1.2.0 to 2.0.0

< HIVE-7018 Remove Table and Partition tables column LINK_TARGET_ID
from Mysql for other DBs do not have it >
Completed remove LINK_TARGET_ID
Completed remove LINK_TARGET_ID
 at line 1 in file: '023-HIVE-12807.mysql.sql': Duplicate column name
'CQ_HIGHEST_TXN_ID'
Test failed: mysql/upgrade-1.2.0-to-2.0.0.mysql.sql
Error: Cannot execute SQL file:
/hive/testutils/metastore/../../metastore/scripts/upgrade/mysql/upgrade-1.2.0-to-2.0.0.mysql.sql



I think we should identify and fix the issue.
I am -1

- Sergio


On Thu, Feb 11, 2016 at 1:40 PM, Alan Gates  wrote:

> +1, checks sigs, build with fresh maven repo, and did a quick smoke test.
>
> Does the PMC member who votes on the most RC's get a prize?
>
> Alan.
>
> Sergey Shelukhin 
> February 9, 2016 at 18:52
> Another day, another release candidate... this time fixing the logging
> issue.
>
> Apache Hive 2.0.0 Release Candidate 3 is available here:
>
> http://people.apache.org/~sershe/hive-2.0.0-rc3/
>
> Maven artifacts are at
>
> https://repository.apache.org/content/repositories/orgapachehive-1046/
>
>
> Source tag for RC3 (github mirror) is:
> https://github.com/apache/hive/releases/tag/release-2.0.0-rc3
>
>
> Voting will conclude in 72 hours.
>
> Hive PMC Members: Please test and vote.
>
>
> Thanks.
>
>
>


Re: [VOTE] Apache Hive 2.0.0 Release Candidate 3

2016-02-11 Thread Sergio Pena
I found the reason of the failure, and it is due to these 2 upgrades
executed in order:

mysql/upgrade-1.2.0-to-1.3.0.mysql.sql
mysql/upgrade-1.2.0-to-2.0.0.mysql.sql

Both sql files have the same commands, so 1.2.0 -> 2.0.0 fails with
repeated columns.
The HMS upgrade script will need to handle this special situation.

Back to +1

On Thu, Feb 11, 2016 at 2:04 PM, Sergio Pena 
wrote:

> While running some HMS upgrade tests, I found an issue while upgrading
> Mysql metastore from 1.2.0 to 2.0.0
>
> http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-METASTORE-Test/110/consoleFull
>
> Executing sql test: mysql/upgrade-1.2.0-to-2.0.0.mysql.sql
> ++ dirname 
> /hive/testutils/metastore/../../metastore/scripts/upgrade/mysql/upgrade-1.2.0-to-2.0.0.mysql.sql
> + cd /hive/testutils/metastore/../../metastore/scripts/upgrade/mysql
> Executing script: 
> /hive/testutils/metastore/../../metastore/scripts/upgrade/mysql/upgrade-1.2.0-to-2.0.0.mysql.sql
> + echo 'Executing script: 
> /hive/testutils/metastore/../../metastore/scripts/upgrade/mysql/upgrade-1.2.0-to-2.0.0.mysql.sql'
> + mysql hive_hms_testing
> ERROR 1060 (42S21)
> Upgrading MetaStore schema from 1.2.0 to 2.0.0
>
> < HIVE-7018 Remove Table and Partition tables column LINK_TARGET_ID from 
> Mysql for other DBs do not have it >
> Completed remove LINK_TARGET_ID
> Completed remove LINK_TARGET_ID
>  at line 1 in file: '023-HIVE-12807.mysql.sql': Duplicate column name 
> 'CQ_HIGHEST_TXN_ID'
> Test failed: mysql/upgrade-1.2.0-to-2.0.0.mysql.sql
> Error: Cannot execute SQL file: 
> /hive/testutils/metastore/../../metastore/scripts/upgrade/mysql/upgrade-1.2.0-to-2.0.0.mysql.sql
>
>
>
> I think we should identify and fix the issue.
> I am -1
>
> - Sergio
>
>
> On Thu, Feb 11, 2016 at 1:40 PM, Alan Gates  wrote:
>
>> +1, checks sigs, build with fresh maven repo, and did a quick smoke test.
>>
>> Does the PMC member who votes on the most RC's get a prize?
>>
>> Alan.
>>
>> Sergey Shelukhin 
>> February 9, 2016 at 18:52
>> Another day, another release candidate... this time fixing the logging
>> issue.
>>
>> Apache Hive 2.0.0 Release Candidate 3 is available here:
>>
>> http://people.apache.org/~sershe/hive-2.0.0-rc3/
>>
>> Maven artifacts are at
>>
>> https://repository.apache.org/content/repositories/orgapachehive-1046/
>>
>>
>> Source tag for RC3 (github mirror) is:
>> https://github.com/apache/hive/releases/tag/release-2.0.0-rc3
>>
>>
>> Voting will conclude in 72 hours.
>>
>> Hive PMC Members: Please test and vote.
>>
>>
>> Thanks.
>>
>>
>>
>


Re: Review Request 43176: HIVE-12965: Insert overwrite local directory should perserve the overwritten directory permission

2016-02-11 Thread Chaoyu Tang

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/43176/
---

(Updated Feb. 11, 2016, 9:54 p.m.)


Review request for hive, Ashutosh Chauhan, Szehon Ho, and Xuefu Zhang.


Changes
---

Fixed the test failures


Bugs: HIVE-12965
https://issues.apache.org/jira/browse/HIVE-12965


Repository: hive-git


Description
---

In Hive, "insert overwrite local directory" first deletes the overwritten 
directory if exists, recreate a new one, then copy the files from src directory 
to the new local directory. This process sometimes changes the permissions of 
the to-be-overwritten local directory, therefore causing some applications no 
more to be able to access its content.


Diffs (updated)
-

  ql/src/java/org/apache/hadoop/hive/ql/exec/MoveTask.java e9cd450 

Diff: https://reviews.apache.org/r/43176/diff/


Testing
---

Manual tests
Precommit tests


Thanks,

Chaoyu Tang



Re: Review Request 43176: HIVE-12965: Insert overwrite local directory should perserve the overwritten directory permission

2016-02-11 Thread Xuefu Zhang

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/43176/#review118939
---




ql/src/java/org/apache/hadoop/hive/ql/exec/MoveTask.java 


qq: So closing the file systems gave the issues seen in the test failures?


- Xuefu Zhang


On Feb. 11, 2016, 9:54 p.m., Chaoyu Tang wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/43176/
> ---
> 
> (Updated Feb. 11, 2016, 9:54 p.m.)
> 
> 
> Review request for hive, Ashutosh Chauhan, Szehon Ho, and Xuefu Zhang.
> 
> 
> Bugs: HIVE-12965
> https://issues.apache.org/jira/browse/HIVE-12965
> 
> 
> Repository: hive-git
> 
> 
> Description
> ---
> 
> In Hive, "insert overwrite local directory" first deletes the overwritten 
> directory if exists, recreate a new one, then copy the files from src 
> directory to the new local directory. This process sometimes changes the 
> permissions of the to-be-overwritten local directory, therefore causing some 
> applications no more to be able to access its content.
> 
> 
> Diffs
> -
> 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/MoveTask.java e9cd450 
> 
> Diff: https://reviews.apache.org/r/43176/diff/
> 
> 
> Testing
> ---
> 
> Manual tests
> Precommit tests
> 
> 
> Thanks,
> 
> Chaoyu Tang
> 
>



Re: Review Request 43176: HIVE-12965: Insert overwrite local directory should perserve the overwritten directory permission

2016-02-11 Thread Chaoyu Tang


> On Feb. 11, 2016, 10:17 p.m., Xuefu Zhang wrote:
> > ql/src/java/org/apache/hadoop/hive/ql/exec/MoveTask.java, line 110
> > 
> >
> > qq: So closing the file systems gave the issues seen in the test 
> > failures?

Yeah. Unexpected but it might be reasonable.


- Chaoyu


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/43176/#review118939
---


On Feb. 11, 2016, 9:54 p.m., Chaoyu Tang wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/43176/
> ---
> 
> (Updated Feb. 11, 2016, 9:54 p.m.)
> 
> 
> Review request for hive, Ashutosh Chauhan, Szehon Ho, and Xuefu Zhang.
> 
> 
> Bugs: HIVE-12965
> https://issues.apache.org/jira/browse/HIVE-12965
> 
> 
> Repository: hive-git
> 
> 
> Description
> ---
> 
> In Hive, "insert overwrite local directory" first deletes the overwritten 
> directory if exists, recreate a new one, then copy the files from src 
> directory to the new local directory. This process sometimes changes the 
> permissions of the to-be-overwritten local directory, therefore causing some 
> applications no more to be able to access its content.
> 
> 
> Diffs
> -
> 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/MoveTask.java e9cd450 
> 
> Diff: https://reviews.apache.org/r/43176/diff/
> 
> 
> Testing
> ---
> 
> Manual tests
> Precommit tests
> 
> 
> Thanks,
> 
> Chaoyu Tang
> 
>



Re: Review Request 43176: HIVE-12965: Insert overwrite local directory should perserve the overwritten directory permission

2016-02-11 Thread Xuefu Zhang

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/43176/#review118941
---


Ship it!




Ship It!

- Xuefu Zhang


On Feb. 11, 2016, 9:54 p.m., Chaoyu Tang wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/43176/
> ---
> 
> (Updated Feb. 11, 2016, 9:54 p.m.)
> 
> 
> Review request for hive, Ashutosh Chauhan, Szehon Ho, and Xuefu Zhang.
> 
> 
> Bugs: HIVE-12965
> https://issues.apache.org/jira/browse/HIVE-12965
> 
> 
> Repository: hive-git
> 
> 
> Description
> ---
> 
> In Hive, "insert overwrite local directory" first deletes the overwritten 
> directory if exists, recreate a new one, then copy the files from src 
> directory to the new local directory. This process sometimes changes the 
> permissions of the to-be-overwritten local directory, therefore causing some 
> applications no more to be able to access its content.
> 
> 
> Diffs
> -
> 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/MoveTask.java e9cd450 
> 
> Diff: https://reviews.apache.org/r/43176/diff/
> 
> 
> Testing
> ---
> 
> Manual tests
> Precommit tests
> 
> 
> Thanks,
> 
> Chaoyu Tang
> 
>



Re: [VOTE] Apache Hive 2.0.0 Release Candidate 3

2016-02-11 Thread Prasanth Jayachandran
+1. Checked signature, checksums, verified no binaries in source, compiled 
source, ran smoke tests on tez and llap from binary and source.

Thanks
Prasanth

On Feb 11, 2016, at 1:40 PM, Alan Gates 
mailto:alanfga...@gmail.com>> wrote:

+1, checks sigs, build with fresh maven repo, and did a quick smoke test.

Does the PMC member who votes on the most RC's get a prize?

Alan.

[cid:part1.00020507.03030505@gmail.com]
Sergey Shelukhin
February 9, 2016 at 18:52
Another day, another release candidate... this time fixing the logging
issue.

Apache Hive 2.0.0 Release Candidate 3 is available here:

http://people.apache.org/~sershe/hive-2.0.0-rc3/

Maven artifacts are at

https://repository.apache.org/content/repositories/orgapachehive-1046/


Source tag for RC3 (github mirror) is:
https://github.com/apache/hive/releases/tag/release-2.0.0-rc3


Voting will conclude in 72 hours.

Hive PMC Members: Please test and vote.


Thanks.





Re: [VOTE] Apache Hive 2.0.0 Release Candidate 3

2016-02-11 Thread Sergey Shelukhin
Yeah, he gets to do 1.3 ;)

From: Alan Gates mailto:alanfga...@gmail.com>>
Reply-To: "dev@hive.apache.org" 
mailto:dev@hive.apache.org>>
Date: Thursday, February 11, 2016 at 11:40
To: "dev@hive.apache.org" 
mailto:dev@hive.apache.org>>
Subject: Re: [VOTE] Apache Hive 2.0.0 Release Candidate 3

+1, checks sigs, build with fresh maven repo, and did a quick smoke test.

Does the PMC member who votes on the most RC's get a prize?

Alan.

[cid:part1.00020507.03030505@gmail.com]
Sergey Shelukhin
February 9, 2016 at 18:52
Another day, another release candidate... this time fixing the logging
issue.

Apache Hive 2.0.0 Release Candidate 3 is available here:

http://people.apache.org/~sershe/hive-2.0.0-rc3/

Maven artifacts are at

https://repository.apache.org/content/repositories/orgapachehive-1046/


Source tag for RC3 (github mirror) is:
https://github.com/apache/hive/releases/tag/release-2.0.0-rc3


Voting will conclude in 72 hours.

Hive PMC Members: Please test and vote.


Thanks.




[jira] [Created] (HIVE-13045) move guava dependency back to 14 after HIVE-12952

2016-02-11 Thread Mohit Sabharwal (JIRA)
Mohit Sabharwal created HIVE-13045:
--

 Summary: move guava dependency back to 14 after HIVE-12952
 Key: HIVE-13045
 URL: https://issues.apache.org/jira/browse/HIVE-13045
 Project: Hive
  Issue Type: Bug
Reporter: Mohit Sabharwal
Assignee: Mohit Sabharwal


HIVE-12952 removed usage of EvictingQueue, so we don't need to up dependency to 
guava 15 at this point - avoid version related conflicts with clients if we can 
avoid it.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


Re: Review Request 42392: HIVE-12049: WIP Patch: Add a serde to serialize JDBC ResultSet in Tasks

2016-02-11 Thread Vaibhav Gumashta

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/42392/
---

(Updated Feb. 12, 2016, 2:48 a.m.)


Review request for hive, Rohit Dholakia and Thejas Nair.


Bugs: HIVE-12049
https://issues.apache.org/jira/browse/HIVE-12049


Repository: hive-git


Description
---

https://issues.apache.org/jira/browse/HIVE-12049


Diffs (updated)
-

  common/src/java/org/apache/hadoop/hive/conf/HiveConf.java 2c25cae 
  jdbc/src/java/org/apache/hive/jdbc/HiveBaseResultSet.java 98d0370 
  jdbc/src/java/org/apache/hive/jdbc/HiveResultSetMetaData.java 16a0894 
  jdbc/src/java/org/apache/hive/jdbc/HiveStatement.java b4dba44 
  jdbc/src/java/org/apache/hive/jdbc/JdbcColumn.java 691fd0e 
  ql/src/java/org/apache/hadoop/hive/ql/Driver.java 020f037 
  ql/src/java/org/apache/hadoop/hive/ql/exec/DefaultFetchFormatter.java b8be3a5 
  ql/src/java/org/apache/hadoop/hive/ql/exec/FetchFormatter.java c2ed0d6 
  ql/src/java/org/apache/hadoop/hive/ql/exec/FetchOperator.java a5489a9 
  ql/src/java/org/apache/hadoop/hive/ql/exec/FileSinkOperator.java 32bfcf5 
  ql/src/java/org/apache/hadoop/hive/ql/exec/ListSinkOperator.java 919e72f 
  ql/src/java/org/apache/hadoop/hive/ql/parse/QB.java f04b493 
  ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java c38699d 
  ql/src/java/org/apache/hadoop/hive/ql/parse/TaskCompiler.java a8f9f50 
  ql/src/java/org/apache/hadoop/hive/ql/plan/PlanUtils.java 5bea6fb 
  serde/pom.xml e025a4e 
  serde/src/java/org/apache/hadoop/hive/serde2/DefaultFetchFormatter.java 
PRE-CREATION 
  serde/src/java/org/apache/hadoop/hive/serde2/FetchFormatter.java PRE-CREATION 
  serde/src/java/org/apache/hadoop/hive/serde2/NoOpFetchFormatter.java 
PRE-CREATION 
  serde/src/java/org/apache/hadoop/hive/serde2/SerDeUtils.java 90439a2 
  serde/src/java/org/apache/hadoop/hive/serde2/thrift/ColumnBuffer.java 
PRE-CREATION 
  serde/src/java/org/apache/hadoop/hive/serde2/thrift/ThriftFormatter.java 
PRE-CREATION 
  
serde/src/java/org/apache/hadoop/hive/serde2/thrift/ThriftJDBCBinarySerDe.java 
PRE-CREATION 
  serde/src/java/org/apache/hadoop/hive/serde2/thrift/Type.java PRE-CREATION 
  serde/src/java/org/apache/hadoop/hive/serde2/typeinfo/TypeInfo.java 70dc181 
  service-rpc/if/TCLIService.thrift 0aa9d13 
  service-rpc/src/gen/thrift/gen-cpp/TCLIService_types.h 5364293 
  service-rpc/src/gen/thrift/gen-cpp/TCLIService_types.cpp e62e8b7 
  
service-rpc/src/gen/thrift/gen-javabean/org/apache/hive/service/rpc/thrift/TRowSet.java
 2f6e31c 
  service-rpc/src/gen/thrift/gen-php/Types.php 76805df 
  service-rpc/src/gen/thrift/gen-py/TCLIService/ttypes.py ef5f5f5 
  service-rpc/src/gen/thrift/gen-rb/t_c_l_i_service_types.rb f004ec4 
  service/src/java/org/apache/hive/service/cli/CLIService.java 0d5ae1e 
  service/src/java/org/apache/hive/service/cli/Column.java 102d920 
  service/src/java/org/apache/hive/service/cli/ColumnBasedSet.java b7fe663 
  service/src/java/org/apache/hive/service/cli/ColumnDescriptor.java 7bd9f06 
  service/src/java/org/apache/hive/service/cli/ColumnValue.java 37460e6 
  service/src/java/org/apache/hive/service/cli/RowBasedSet.java a80bac5 
  service/src/java/org/apache/hive/service/cli/RowSet.java 60d79dc 
  service/src/java/org/apache/hive/service/cli/RowSetFactory.java 1c2ff7f 
  service/src/java/org/apache/hive/service/cli/TableSchema.java 2206e2c 
  service/src/java/org/apache/hive/service/cli/Type.java f067b3d 
  service/src/java/org/apache/hive/service/cli/TypeDescriptor.java b4a5b77 
  
service/src/java/org/apache/hive/service/cli/operation/GetCatalogsOperation.java
 8868ec1 
  
service/src/java/org/apache/hive/service/cli/operation/GetColumnsOperation.java 
35b6c52 
  
service/src/java/org/apache/hive/service/cli/operation/GetFunctionsOperation.java
 8db2e62 
  
service/src/java/org/apache/hive/service/cli/operation/GetSchemasOperation.java 
d6f6280 
  
service/src/java/org/apache/hive/service/cli/operation/GetTableTypesOperation.java
 a09b39a 
  
service/src/java/org/apache/hive/service/cli/operation/GetTablesOperation.java 
740b851 
  
service/src/java/org/apache/hive/service/cli/operation/GetTypeInfoOperation.java
 2a0fec2 
  
service/src/java/org/apache/hive/service/cli/operation/HiveCommandOperation.java
 f5a9771 
  service/src/java/org/apache/hive/service/cli/operation/OperationManager.java 
92135cd 
  service/src/java/org/apache/hive/service/cli/operation/SQLOperation.java 
2eaab4a 
  service/src/java/org/apache/hive/service/cli/session/HiveSessionImpl.java 
3c5700b 
  service/src/java/org/apache/hive/service/cli/thrift/ThriftCLIService.java 
78b4b31 
  service/src/test/org/apache/hive/service/cli/CLIServiceTest.java e78181a 
  service/src/test/org/apache/hive/service/cli/TestColumn.java 87bf848 
  
service/src/test/org/apache/hive/service/cli/session/TestSessionGlobalInitFile.java
 55a325d 

Diff: https://reviews.apache.org/r/4

Re: Review Request 40415: HIVE-11675 make use of file footer PPD API in ETL strategy or separate strategy

2016-02-11 Thread Sergey Shelukhin

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/40415/
---

(Updated Feb. 12, 2016, 2:58 a.m.)


Review request for hive, Gopal V, Prasanth_J, and Vikram Dixit Kumaraswamy.


Repository: hive-git


Description
---

see jira


Diffs (updated)
-

  common/src/java/org/apache/hadoop/hive/conf/HiveConf.java cd17a84 
  metastore/src/java/org/apache/hadoop/hive/metastore/FileMetadataHandler.java 
bd4e188 
  metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStoreClient.java 
564fca4 
  metastore/src/java/org/apache/hadoop/hive/metastore/IMetaStoreClient.java 
07c20bf 
  
metastore/src/java/org/apache/hadoop/hive/metastore/filemeta/OrcFileMetadataHandler.java
 1b388aa 
  orc/src/java/org/apache/orc/impl/InStream.java b1c6de5 
  ql/src/java/org/apache/hadoop/hive/ql/io/AcidUtils.java 520ae74 
  ql/src/java/org/apache/hadoop/hive/ql/io/HdfsUtils.java af64fc8 
  ql/src/java/org/apache/hadoop/hive/ql/io/orc/OrcFileFormatProxy.java ef76723 
  ql/src/java/org/apache/hadoop/hive/ql/io/orc/OrcInputFormat.java f36f707 
  ql/src/java/org/apache/hadoop/hive/ql/io/orc/OrcNewInputFormat.java 2782d7e 
  ql/src/java/org/apache/hadoop/hive/ql/metadata/Hive.java a92c002 
  ql/src/test/org/apache/hadoop/hive/ql/io/orc/TestInputOutputFormat.java 
9b1d7ae 
  ql/src/test/org/apache/hadoop/hive/ql/io/orc/TestOrcSplitElimination.java 
7a93b54 
  storage-api/src/java/org/apache/hadoop/hive/ql/io/sarg/PredicateLeaf.java 
dc71db4 
  
storage-api/src/java/org/apache/hadoop/hive/ql/io/sarg/SearchArgumentImpl.java 
be5e67b 

Diff: https://reviews.apache.org/r/40415/diff/


Testing
---


Thanks,

Sergey Shelukhin



[jira] [Created] (HIVE-13046) DependencyResolver should not lowercase the dependency URI's authority

2016-02-11 Thread Anthony Hsu (JIRA)
Anthony Hsu created HIVE-13046:
--

 Summary: DependencyResolver should not lowercase the dependency 
URI's authority
 Key: HIVE-13046
 URL: https://issues.apache.org/jira/browse/HIVE-13046
 Project: Hive
  Issue Type: Bug
Reporter: Anthony Hsu
Assignee: Anthony Hsu


When using {{ADD JAR ivy://...}} to add a jar version {{1.2.3-SNAPSHOT}}, Hive 
will lowercase it to {{1.2.3-snapshot}} due to:

{code:title=DependencyResolver.java}
String[] authorityTokens = authority.toLowerCase().split(":");
{code}

We should not {{.lowerCase()}}.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (HIVE-13047) Disabling Web UI leads to NullPointerException

2016-02-11 Thread Mohit Sabharwal (JIRA)
Mohit Sabharwal created HIVE-13047:
--

 Summary: Disabling Web UI leads to NullPointerException
 Key: HIVE-13047
 URL: https://issues.apache.org/jira/browse/HIVE-13047
 Project: Hive
  Issue Type: Bug
Reporter: Mohit Sabharwal
Assignee: Mohit Sabharwal


Disabling the Web UI or it's historical query display feature can lead to 
NullPointerException since {{historicSqlOperations}} is unintialized.

For ex: If hive.server2.webui.port is set to 0

{code}
Caused by: java.lang.NullPointerException: null
at 
org.apache.hive.service.cli.operation.OperationManager.removeOperation(OperationManager.java:212)
at 
org.apache.hive.service.cli.operation.OperationManager.closeOperation(OperationManager.java:240)
at 
org.apache.hive.service.cli.session.HiveSessionImpl.closeOperation(HiveSessionImpl.java:727)
at 
org.apache.hive.service.cli.CLIService.closeOperation(CLIService.java:408)
at 
org.apache.hive.service.cli.thrift.ThriftCLIService.CloseOperation(ThriftCLIService.java:664)
at 
org.apache.hive.service.cli.thrift.TCLIService$Processor$CloseOperation.getResult(TCLIService.java:1513)
at 
org.apache.hive.service.cli.thrift.TCLIService$Processor$CloseOperation.getResult(TCLIService.java:1498)
at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
at 
org.apache.hive.service.auth.TSetIpAddressProcessor.process(TSetIpAddressProcessor.java:56)
at 
org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:285)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
{code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


Review Request 43513: HIVE-13046: DependencyResolver should not lowercase the dependency URI's authority

2016-02-11 Thread Anthony Hsu

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/43513/
---

Review request for hive, Carl Steinbach, Mark Wagner, and Ratandeep Ratti.


Bugs: HIVE-13046
https://issues.apache.org/jira/browse/HIVE-13046


Repository: hive-git


Description
---

HIVE-13046: DependencyResolver should not lowercase the dependency URI's 
authority


Diffs
-

  ql/src/java/org/apache/hadoop/hive/ql/util/DependencyResolver.java 
3891e59a274e6449c5f50eea51e4f23762efcbc0 

Diff: https://reviews.apache.org/r/43513/diff/


Testing
---

Tested manually.


Thanks,

Anthony Hsu



Re: Review Request 43431: HIVE-13033 SPDO unnecessarily duplicates columns in key & value of mapper output

2016-02-11 Thread j . prasanth . j

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/43431/#review118983
---


Ship it!




Ship It!

- Prasanth_J


On Feb. 10, 2016, 9:27 p.m., Ashutosh Chauhan wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/43431/
> ---
> 
> (Updated Feb. 10, 2016, 9:27 p.m.)
> 
> 
> Review request for hive and Prasanth_J.
> 
> 
> Bugs: HIVE-13033
> https://issues.apache.org/jira/browse/HIVE-13033
> 
> 
> Repository: hive-git
> 
> 
> Description
> ---
> 
> Removes duplicated columns from value field of RS
> 
> 
> Diffs
> -
> 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/ReduceSinkOperator.java e692460 
>   
> ql/src/java/org/apache/hadoop/hive/ql/optimizer/SortedDynPartitionOptimizer.java
>  27b0457 
>   ql/src/test/results/clientpositive/dynpart_sort_opt_vectorization.q.out 
> 8813802 
>   ql/src/test/results/clientpositive/dynpart_sort_optimization.q.out 2105d8b 
> 
> Diff: https://reviews.apache.org/r/43431/diff/
> 
> 
> Testing
> ---
> 
> Regression suites.
> 
> 
> Thanks,
> 
> Ashutosh Chauhan
> 
>