Re: Backward incompatible changes

2017-03-24 Thread Lefty Leverenz
We'll have to revise some TODOC2.2 labels in JIRA, as well as fix versions. -- Lefty On Fri, Mar 24, 2017 at 2:19 PM, Ashutosh Chauhan wrote: > Sounds good to me. I have created Fix versions 3.0 and 2.3 in jira. We can > use 2.3 for next release from branch-2. > > On Fri, Mar 24, 2017 at 10:46

[jira] [Created] (HIVE-16298) Add config to specify multi-column joins have correlated columns

2017-03-24 Thread Jason Dere (JIRA)
Jason Dere created HIVE-16298: - Summary: Add config to specify multi-column joins have correlated columns Key: HIVE-16298 URL: https://issues.apache.org/jira/browse/HIVE-16298 Project: Hive Issu

Review Request 57928: Support tuning of NDV of columns using lower/upper bounds

2017-03-24 Thread pengcheng xiong
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/57928/ --- Review request for hive and Ashutosh Chauhan. Repository: hive-git Descriptio

[jira] [Created] (HIVE-16297) Improving hive logging configuration variables

2017-03-24 Thread Vihang Karajgaonkar (JIRA)
Vihang Karajgaonkar created HIVE-16297: -- Summary: Improving hive logging configuration variables Key: HIVE-16297 URL: https://issues.apache.org/jira/browse/HIVE-16297 Project: Hive Issue

[GitHub] hive pull request #166: HIVE-16171: Support replication of truncate table

2017-03-24 Thread sankarh
GitHub user sankarh opened a pull request: https://github.com/apache/hive/pull/166 HIVE-16171: Support replication of truncate table Support replication on truncate table. You can merge this pull request into a Git repository by running: $ git pull https://github.com/sankarh/hi

Re: Review Request 57626: HIVE-16164: Provide mechanism for passing HMS notification ID between transactional and non-transactional listeners.

2017-03-24 Thread Sergio Pena
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/57626/ --- (Updated March 24, 2017, 10:23 p.m.) Review request for hive. Changes ---

[jira] [Created] (HIVE-16296) use LLAP executor count to configure reducer auto-parallelism

2017-03-24 Thread Sergey Shelukhin (JIRA)
Sergey Shelukhin created HIVE-16296: --- Summary: use LLAP executor count to configure reducer auto-parallelism Key: HIVE-16296 URL: https://issues.apache.org/jira/browse/HIVE-16296 Project: Hive

Re: Review Request 57903: HIVE-16282 Add faststart for semijoin reducer

2017-03-24 Thread Deepak Jaiswal
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/57903/ --- (Updated March 24, 2017, 9:20 p.m.) Review request for hive, Gopal V, Jason Der

Re: Backward incompatible changes

2017-03-24 Thread Ashutosh Chauhan
Sounds good to me. I have created Fix versions 3.0 and 2.3 in jira. We can use 2.3 for next release from branch-2. On Fri, Mar 24, 2017 at 10:46 AM, Owen O'Malley wrote: > All, > > I'm glad to see a plan to release master before the incompatible changes. > It will be great to have a release that

[jira] [Created] (HIVE-16295) Add support for using Hadoop's OutputCommitter

2017-03-24 Thread Sahil Takiar (JIRA)
Sahil Takiar created HIVE-16295: --- Summary: Add support for using Hadoop's OutputCommitter Key: HIVE-16295 URL: https://issues.apache.org/jira/browse/HIVE-16295 Project: Hive Issue Type: Sub-tas

[jira] [Created] (HIVE-16294) Support snapshot for truncate table

2017-03-24 Thread Vihang Karajgaonkar (JIRA)
Vihang Karajgaonkar created HIVE-16294: -- Summary: Support snapshot for truncate table Key: HIVE-16294 URL: https://issues.apache.org/jira/browse/HIVE-16294 Project: Hive Issue Type: Sub-

[jira] [Created] (HIVE-16293) Column pruner should continue to work when SEL has more than 1 child

2017-03-24 Thread Pengcheng Xiong (JIRA)
Pengcheng Xiong created HIVE-16293: -- Summary: Column pruner should continue to work when SEL has more than 1 child Key: HIVE-16293 URL: https://issues.apache.org/jira/browse/HIVE-16293 Project: Hive

Re: Backward incompatible changes

2017-03-24 Thread Owen O'Malley
All, I'm glad to see a plan to release master before the incompatible changes. It will be great to have a release that uses the separated out ORC code base. As I had previously discussed on list, I've been working on building a proposed 2.2 branch, which builds on 2.1.1 and cherry picks a bunch o

[jira] [Created] (HIVE-16292) SparkUtilities upload to HDFS doesn't work with viewfs

2017-03-24 Thread Jimmy Xiang (JIRA)
Jimmy Xiang created HIVE-16292: -- Summary: SparkUtilities upload to HDFS doesn't work with viewfs Key: HIVE-16292 URL: https://issues.apache.org/jira/browse/HIVE-16292 Project: Hive Issue Type: B

Re: Need help in knowing a procedure to automatically refresh HIVE metadata when a new partition is added

2017-03-24 Thread Srabasti Banerjee
Hi Anshuman, You can have a cron job that calls the (MSCK REPAIR ...table) script for the table in Shellscript/Python (whatever your prefer). Apache Nifi has a scheduling option as well. Maybe you can use it? ThanksSrabasti Banerjee On Friday, 24 March 2017 7:40 AM, Anshuman Ghosh wrote:

Re: Review Request 57728: HIVE-16231: Parquet timestamp may be stored differently since HIVE-12767

2017-03-24 Thread Sergio Pena
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/57728/#review170018 --- Ship it! Just remove the empty line from DateUtils. +1 - Serg

Re: Review Request 57728: HIVE-16231: Parquet timestamp may be stored differently since HIVE-12767

2017-03-24 Thread Sergio Pena
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/57728/#review170017 --- common/src/java/org/apache/hive/common/util/DateUtils.java Lines

Need help in knowing a procedure to automatically refresh HIVE metadata when a new partition is added

2017-03-24 Thread Anshuman Ghosh
Hello Team, This is Anshu here, nice to meet you! I am working at Crealytics, Berlin as a Big Data Consultant/ Solution Architect. We are building/ designing a data flow pipeline using mainly *Apache NiFi --> Consume data from Kafka --> Transform, Convert and Merge --> Write to HDFS* We have seve

[jira] [Created] (HIVE-16291) Hive fails when unions a parquet table with itself

2017-03-24 Thread Yibing Shi (JIRA)
Yibing Shi created HIVE-16291: - Summary: Hive fails when unions a parquet table with itself Key: HIVE-16291 URL: https://issues.apache.org/jira/browse/HIVE-16291 Project: Hive Issue Type: Bug

Re: Review Request 57728: HIVE-16231: Parquet timestamp may be stored differently since HIVE-12767

2017-03-24 Thread Barna Zsombor Klara
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/57728/ --- (Updated March 24, 2017, 9:56 a.m.) Review request for hive and Sergio Pena.

[jira] [Created] (HIVE-16290) Stats: StatsRulesProcFactory::evaluateComparator estimates are wrong when minValue == filterValue

2017-03-24 Thread Rajesh Balamohan (JIRA)
Rajesh Balamohan created HIVE-16290: --- Summary: Stats: StatsRulesProcFactory::evaluateComparator estimates are wrong when minValue == filterValue Key: HIVE-16290 URL: https://issues.apache.org/jira/browse/HIVE-16