[jira] [Commented] (HIVE-8966) Delta files created by hive hcatalog streaming cannot be compacted

2014-12-06 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14237080#comment-14237080 ] Hive QA commented on HIVE-8966: --- {color:red}Overall{color}: -1 at least one tests failed H

[jira] [Commented] (HIVE-8638) Implement bucket map join optimization [Spark Branch]

2014-12-06 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14237079#comment-14237079 ] Hive QA commented on HIVE-8638: --- {color:red}Overall{color}: -1 at least one tests failed H

[jira] [Commented] (HIVE-8966) Delta files created by hive hcatalog streaming cannot be compacted

2014-12-06 Thread Jihong Liu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14237067#comment-14237067 ] Jihong Liu commented on HIVE-8966: -- Alan, I created a wrong patch about 1 hour ago. Before

[jira] [Commented] (HIVE-8966) Delta files created by hive hcatalog streaming cannot be compacted

2014-12-06 Thread Jihong Liu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14237062#comment-14237062 ] Jihong Liu commented on HIVE-8966: -- Hi Alan,I have created a new patch. It works fine. The

[jira] [Updated] (HIVE-8966) Delta files created by hive hcatalog streaming cannot be compacted

2014-12-06 Thread Jihong Liu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jihong Liu updated HIVE-8966: - Attachment: HIVE-8966.patch > Delta files created by hive hcatalog streaming cannot be compacted >

[jira] [Updated] (HIVE-8966) Delta files created by hive hcatalog streaming cannot be compacted

2014-12-06 Thread Jihong Liu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jihong Liu updated HIVE-8966: - Attachment: (was: HIVE-8966.patch) > Delta files created by hive hcatalog streaming cannot be compacted

Re: Review Request 28727: HIVE-8638 Implement bucket map join optimization [Spark Branch]

2014-12-06 Thread Jimmy Xiang
> On Dec. 5, 2014, 10:40 p.m., Xuefu Zhang wrote: > > ql/src/java/org/apache/hadoop/hive/ql/exec/persistence/MapJoinTableContainerSerDe.java, > > line 121 > > > > > > Be aware of different hadoop versions. I checked.

[jira] [Updated] (HIVE-8638) Implement bucket map join optimization [Spark Branch]

2014-12-06 Thread Jimmy Xiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jimmy Xiang updated HIVE-8638: -- Status: Patch Available (was: Open) Patch v4 is on RB: https://reviews.apache.org/r/28790/ > Implement

Review Request 28790: HIVE-8638 Implement bucket map join optimization [Spark Branch]

2014-12-06 Thread Jimmy Xiang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/28790/ --- Review request for hive and Xuefu Zhang. Bugs: HIVE-8638 https://issues.apa

[jira] [Updated] (HIVE-8638) Implement bucket map join optimization [Spark Branch]

2014-12-06 Thread Jimmy Xiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jimmy Xiang updated HIVE-8638: -- Attachment: HIVE-8638.4-spark.patch > Implement bucket map join optimization [Spark Branch] > ---

[jira] [Commented] (HIVE-8966) Delta files created by hive hcatalog streaming cannot be compacted

2014-12-06 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14237057#comment-14237057 ] Hive QA commented on HIVE-8966: --- {color:red}Overall{color}: -1 no tests executed Here are

[jira] [Commented] (HIVE-8966) Delta files created by hive hcatalog streaming cannot be compacted

2014-12-06 Thread Jihong Liu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14237048#comment-14237048 ] Jihong Liu commented on HIVE-8966: -- By the way, hive may need another cleaning process whi

[jira] [Commented] (HIVE-8966) Delta files created by hive hcatalog streaming cannot be compacted

2014-12-06 Thread Jihong Liu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14237047#comment-14237047 ] Jihong Liu commented on HIVE-8966: -- Solution: if the last delta has any file which is in

[jira] [Commented] (HIVE-8966) Delta files created by hive hcatalog streaming cannot be compacted

2014-12-06 Thread Jihong Liu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14237046#comment-14237046 ] Jihong Liu commented on HIVE-8966: -- The scenario of data lost: Assume when start compactio

[jira] [Updated] (HIVE-8966) Delta files created by hive hcatalog streaming cannot be compacted

2014-12-06 Thread Jihong Liu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jihong Liu updated HIVE-8966: - Release Note: Don't do compaction on the current delta if it has a file in bucket pattern but not compactab

[jira] [Updated] (HIVE-8966) Delta files created by hive hcatalog streaming cannot be compacted

2014-12-06 Thread Jihong Liu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jihong Liu updated HIVE-8966: - Attachment: HIVE-8966.patch > Delta files created by hive hcatalog streaming cannot be compacted >

[jira] [Updated] (HIVE-8966) Delta files created by hive hcatalog streaming cannot be compacted

2014-12-06 Thread Jihong Liu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jihong Liu updated HIVE-8966: - Attachment: (was: HIVE-8966.patch) > Delta files created by hive hcatalog streaming cannot be compacted

[jira] [Commented] (HIVE-8950) Add support in ParquetHiveSerde to create table schema from a parquet file

2014-12-06 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14237038#comment-14237038 ] Hive QA commented on HIVE-8950: --- {color:red}Overall{color}: -1 at least one tests failed H

[jira] [Commented] (HIVE-9037) Improve explain plan to show joining keys for shuffle join

2014-12-06 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14237025#comment-14237025 ] Hive QA commented on HIVE-9037: --- {color:green}Overall{color}: +1 all checks pass Here are

[jira] [Updated] (HIVE-8950) Add support in ParquetHiveSerde to create table schema from a parquet file

2014-12-06 Thread Ashish Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish Kumar Singh updated HIVE-8950: - Attachment: HIVE-8950.2.patch > Add support in ParquetHiveSerde to create table schema from

Re: Review Request 28372: HIVE-8950: Add support in ParquetHiveSerde to create table schema from a parquet file

2014-12-06 Thread Ashish Singh
> On Dec. 1, 2014, 8:13 p.m., Ryan Blue wrote: > > Ryan, thanks for the review. Made appropriate changes based on your comments. Kindly take a look. - Ashish --- This is an automatically generated e-mail. To reply, visit: https://revie

Re: Review Request 28372: HIVE-8950: Add support in ParquetHiveSerde to create table schema from a parquet file

2014-12-06 Thread Ashish Singh
> On Dec. 1, 2014, 8:13 p.m., Ryan Blue wrote: > > common/src/java/org/apache/hadoop/hive/conf/HiveConf.java, line 762 > > > > > > What does this change do? Serdes in this list must have one or more columns in the cre

Re: Review Request 28372: HIVE-8950: Add support in ParquetHiveSerde to create table schema from a parquet file

2014-12-06 Thread Ashish Singh
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/28372/ --- (Updated Dec. 7, 2014, 1:40 a.m.) Review request for hive. Changes --- A

Review Request 28787: Improve explain plan to show joining keys for shuffle join

2014-12-06 Thread Ashutosh Chauhan
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/28787/ --- Review request for hive. Bugs: HIVE-9037 https://issues.apache.org/jira/bro

Review Request 28787: Improve explain plan to show joining keys for shuffle join

2014-12-06 Thread Ashutosh Chauhan
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/28787/ --- Review request for hive. Bugs: HIVE-9037 https://issues.apache.org/jira/bro

[jira] [Updated] (HIVE-9037) Improve explain plan to show joining keys for shuffle join

2014-12-06 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-9037: --- Component/s: Diagnosability > Improve explain plan to show joining keys for shuffle join >

[jira] [Updated] (HIVE-9037) Improve explain plan to show joining keys for shuffle join

2014-12-06 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-9037: --- Component/s: (was: Query Processor) > Improve explain plan to show joining keys for shuffle

[jira] [Updated] (HIVE-9037) Improve explain plan to show joining keys for shuffle join

2014-12-06 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-9037: --- Attachment: HIVE-9037.1.patch updated golden files. > Improve explain plan to show joining key

[jira] [Updated] (HIVE-9037) Improve explain plan to show joining keys for shuffle join

2014-12-06 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-9037: --- Status: Open (was: Patch Available) > Improve explain plan to show joining keys for shuffle jo

[jira] [Updated] (HIVE-9037) Improve explain plan to show joining keys for shuffle join

2014-12-06 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-9037: --- Status: Patch Available (was: Open) > Improve explain plan to show joining keys for shuffle jo

[jira] [Updated] (HIVE-9001) Ship with log4j.properties file that has a reliable time based rolling policy

2014-12-06 Thread Sushanth Sowmyan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sushanth Sowmyan updated HIVE-9001: --- Labels: TODOC15 (was: ) > Ship with log4j.properties file that has a reliable time based rolli

Re: Apache Hive 1.0 ?

2014-12-06 Thread Thejas Nair
I don't know for sure if beeline has finally reached feature parity with hive cli. I haven't looked at that very closely. I think we should start a separate thread on it and discuss with the community. On Sat, Dec 6, 2014 at 12:28 AM, Carl Steinbach wrote: > Hi Thejas, > > I agree that it's impo

[jira] [Updated] (HIVE-8774) CBO: enable groupBy index

2014-12-06 Thread Damien Carol (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damien Carol updated HIVE-8774: --- Component/s: CBO > CBO: enable groupBy index > - > > Key: HIVE-

Re: Review Request 28786: patch for hive-8673

2014-12-06 Thread Ronan Stokes
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/28786/#review64172 --- Ship it! Ship It! - Ronan Stokes On Dec. 6, 2014, 8:43 p.m., Ron

Re: Review Request 28786: patch for hive-8673

2014-12-06 Thread Ronan Stokes
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/28786/ --- (Updated Dec. 6, 2014, 8:43 p.m.) Review request for hive. Bugs: hive-8673

Review Request 28786: patch for hive-8673

2014-12-06 Thread Ronan Stokes
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/28786/ --- Review request for hive. Bugs: hive-8673 https://issues.apache.org/jira/bro

[jira] [Commented] (HIVE-8920) SplitSparkWorkResolver doesn't work with UnionWork [Spark Branch]

2014-12-06 Thread Chao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14236931#comment-14236931 ] Chao commented on HIVE-8920: Hi [~xuefuz], yes, the plan is correct (albeit a little bit confus

[jira] [Commented] (HIVE-8920) SplitSparkWorkResolver doesn't work with UnionWork [Spark Branch]

2014-12-06 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14236924#comment-14236924 ] Xuefu Zhang commented on HIVE-8920: --- With latest Spark branch, I got the following plan {

[jira] [Issue Comment Deleted] (HIVE-8920) SplitSparkWorkResolver doesn't work with UnionWork [Spark Branch]

2014-12-06 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8920: -- Comment: was deleted (was: With latest Spark branch, I got the following plan {code} hive> explain from (

[jira] [Commented] (HIVE-9018) SHOW GRANT ROLE in Hive should return "grant_time" in human readable format

2014-12-06 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14236905#comment-14236905 ] Hive QA commented on HIVE-9018: --- {color:red}Overall{color}: -1 at least one tests failed H

[jira] [Assigned] (HIVE-9025) join38.q (without map join) produces incorrect result when testing with multiple reducers

2014-12-06 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang reassigned HIVE-9025: - Assignee: Ted Xu > join38.q (without map join) produces incorrect result when testing with > mult

[jira] [Updated] (HIVE-9025) join38.q (without map join) produces incorrect result when testing with multiple reducers

2014-12-06 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9025: -- Priority: Blocker (was: Major) > join38.q (without map join) produces incorrect result when testing with

[jira] [Updated] (HIVE-9025) join38.q (without map join) produces incorrect result when testing with multiple reducers

2014-12-06 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9025: -- Priority: Blocker (was: Major) > join38.q (without map join) produces incorrect result when testing with

[jira] [Updated] (HIVE-9025) join38.q (without map join) produces incorrect result when testing with multiple reducers

2014-12-06 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9025: -- Priority: Major (was: Blocker) > join38.q (without map join) produces incorrect result when testing with

[jira] [Updated] (HIVE-9024) NullPointerException when starting webhcat server if templeton.hive.properties is not set

2014-12-06 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9024: -- Resolution: Fixed Fix Version/s: 0.15.0 Status: Resolved (was: Patch Available) Commit

[jira] [Updated] (HIVE-9018) SHOW GRANT ROLE in Hive should return "grant_time" in human readable format

2014-12-06 Thread Dapeng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dapeng Sun updated HIVE-9018: - Attachment: HIVE-9018.007.patch > SHOW GRANT ROLE in Hive should return "grant_time" in human readable form

[jira] [Commented] (HIVE-6468) HS2 & Metastore using SASL out of memory error when curl sends a get request

2014-12-06 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-6468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14236824#comment-14236824 ] Hive QA commented on HIVE-6468: --- {color:red}Overall{color}: -1 no tests executed Here are

[jira] [Updated] (HIVE-6468) HS2 & Metastore using SASL out of memory error when curl sends a get request

2014-12-06 Thread Vaibhav Gumashta (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-6468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vaibhav Gumashta updated HIVE-6468: --- Attachment: HIVE-6468.0.patch Patch based on trunk for precommit run. > HS2 & Metastore using

[jira] [Commented] (HIVE-6468) HS2 & Metastore using SASL out of memory error when curl sends a get request

2014-12-06 Thread Vaibhav Gumashta (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-6468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14236769#comment-14236769 ] Vaibhav Gumashta commented on HIVE-6468: Thanks [~brocknoland]. I'll run it on the

[jira] [Commented] (HIVE-9037) Improve explain plan to show joining keys for shuffle join

2014-12-06 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14236721#comment-14236721 ] Hive QA commented on HIVE-9037: --- {color:red}Overall{color}: -1 at least one tests failed H

[jira] [Commented] (HIVE-8875) hive.optimize.sort.dynamic.partition should be turned off for ACID

2014-12-06 Thread Lefty Leverenz (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14236712#comment-14236712 ] Lefty Leverenz commented on HIVE-8875: -- Doc question: The DML wiki says "In version 0

[jira] [Updated] (HIVE-9037) Improve explain plan to show joining keys for shuffle join

2014-12-06 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-9037: --- Status: Patch Available (was: Open) > Improve explain plan to show joining keys for shuffle jo

Re: Apache Hive 1.0 ?

2014-12-06 Thread Carl Steinbach
Hi Thejas, I agree that it's important to give users adequate time to migrate off of HiveCLI. In order to avoid wasting time what do you think about including this deprecation notice in the 1.0 release? On Thu, Dec 4, 2014 at 3:15 PM, Thejas Nair wrote: > HiveServer, and the original JDBC drive

[jira] [Updated] (HIVE-9037) Improve explain plan to show joining keys for shuffle join

2014-12-06 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-9037: --- Attachment: HIVE-9037.patch > Improve explain plan to show joining keys for shuffle join >

[jira] [Created] (HIVE-9037) Improve explain plan to show joining keys for shuffle join

2014-12-06 Thread Ashutosh Chauhan (JIRA)
Ashutosh Chauhan created HIVE-9037: -- Summary: Improve explain plan to show joining keys for shuffle join Key: HIVE-9037 URL: https://issues.apache.org/jira/browse/HIVE-9037 Project: Hive Iss

[jira] [Commented] (HIVE-9025) join38.q (without map join) produces incorrect result when testing with multiple reducers

2014-12-06 Thread Ted Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14236682#comment-14236682 ] Ted Xu commented on HIVE-9025: -- Thanks [~csun], it is a bug. I will fix it ASAP. > join38.q