Re: [help] how Hive bucket hashFunction works?

2016-09-14 Thread Prasanth Jayachandran
Hi Liu You can look at https://github.com/apache/hive/blob/master/serde/src/java/org/apache/hadoop/hive/serde2/objectinspector/ObjectInspectorUtils.java#L611 for the method that computes bucket number and hashcode that is needed. Thanks Prasanth > On Sep 14, 2016, at 8:40 PM, Liu Ming wrote: >

[help] how Hive bucket hashFunction works?

2016-09-14 Thread Liu Ming
Hi, all, I want to study underlying details of Hive bucket code. Given a value, I need to know which bucket it goes to, so I need to understand the HashFunction used in the bucket feature. Could someone helps to point me to the related code? Or any other hint will help me a lot. I spent a few d

Re: Hive ACID table error

2016-09-14 Thread Eugene Koifman
There should be a full stack trace somewhere either in the client side log on the job logs. ³serious error² is usually ORC complaining about some sort of data corruption. On 9/14/16, 11:16 AM, "naveen mahadevuni" wrote: >Hi Wei, >I'm using the hive shell. > >Thanks, >Naveen > >On Wed, Sep 14, 20

[jira] [Created] (HIVE-14762) Add logging while removing scratch space

2016-09-14 Thread Ashutosh Chauhan (JIRA)
Ashutosh Chauhan created HIVE-14762: --- Summary: Add logging while removing scratch space Key: HIVE-14762 URL: https://issues.apache.org/jira/browse/HIVE-14762 Project: Hive Issue Type: Impro

[jira] [Created] (HIVE-14761) Improve TestJdbcWithMiniMr run time

2016-09-14 Thread Vaibhav Gumashta (JIRA)
Vaibhav Gumashta created HIVE-14761: --- Summary: Improve TestJdbcWithMiniMr run time Key: HIVE-14761 URL: https://issues.apache.org/jira/browse/HIVE-14761 Project: Hive Issue Type: Sub-task

[jira] [Created] (HIVE-14760) Improve TestSSL run time

2016-09-14 Thread Vaibhav Gumashta (JIRA)
Vaibhav Gumashta created HIVE-14760: --- Summary: Improve TestSSL run time Key: HIVE-14760 URL: https://issues.apache.org/jira/browse/HIVE-14760 Project: Hive Issue Type: Sub-task

Re: Hive ACID table error

2016-09-14 Thread naveen mahadevuni
Hi Wei, I'm using the hive shell. Thanks, Naveen On Wed, Sep 14, 2016 at 8:01 PM, Wei Zheng wrote: > Hi Naveen, > > Which client are you using? Beeline? > > Thanks, > Wei > > On 9/14/16, 18:25, "naveen mahadevuni" wrote: > > Hi, > > I'm using Hive 1,.2. From a non-ACID hive session, I

Review Request 51895: HIVE-14714 - Finishing Hive on Spark causes "java.io.IOException: Stream closed"

2016-09-14 Thread Gabor Szadovszky
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/51895/ --- Review request for hive, Chaoyu Tang, Naveen Gangam, and Barna Zsombor Klara. R

Re: Review Request 51699: HIVE-12812: Enable mapred.input.dir.recursive by default to support union with aggregate function

2016-09-14 Thread Barna Zsombor Klara
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/51699/#review148911 --- ql/src/java/org/apache/hadoop/hive/ql/parse/MapReduceCompiler.jav

[GitHub] hive pull request #101: HIVE-14759 remove GenericUDF from funcName instead o...

2016-09-14 Thread cvaliente
GitHub user cvaliente opened a pull request: https://github.com/apache/hive/pull/101 HIVE-14759 remove GenericUDF from funcName instead of first 10 chars remove "GenericUDF" from the function Name instead of first 10 chars which causes IndexOutOfBounds when my Classname is less than

[jira] [Created] (HIVE-14759) GenericUDF.getFuncName breaks with UDF Classnames less than 10 characters

2016-09-14 Thread Clemens Valiente (JIRA)
Clemens Valiente created HIVE-14759: --- Summary: GenericUDF.getFuncName breaks with UDF Classnames less than 10 characters Key: HIVE-14759 URL: https://issues.apache.org/jira/browse/HIVE-14759 Project

Re: Hive ACID table error

2016-09-14 Thread Wei Zheng
Hi Naveen, Which client are you using? Beeline? Thanks, Wei On 9/14/16, 18:25, "naveen mahadevuni" wrote: Hi, I'm using Hive 1,.2. From a non-ACID hive session, I performed the following operations and Hive reports 'serious problem'. CREATE TABLE test5( i int,

[jira] [Created] (HIVE-14758) Metrics for threads/threading

2016-09-14 Thread Barna Zsombor Klara (JIRA)
Barna Zsombor Klara created HIVE-14758: -- Summary: Metrics for threads/threading Key: HIVE-14758 URL: https://issues.apache.org/jira/browse/HIVE-14758 Project: Hive Issue Type: Sub-task

[jira] [Created] (HIVE-14757) Metrics for Zookeeper locks/locking

2016-09-14 Thread Barna Zsombor Klara (JIRA)
Barna Zsombor Klara created HIVE-14757: -- Summary: Metrics for Zookeeper locks/locking Key: HIVE-14757 URL: https://issues.apache.org/jira/browse/HIVE-14757 Project: Hive Issue Type: Sub-

[jira] [Created] (HIVE-14756) Metrics for the HS2/HMS interface

2016-09-14 Thread Barna Zsombor Klara (JIRA)
Barna Zsombor Klara created HIVE-14756: -- Summary: Metrics for the HS2/HMS interface Key: HIVE-14756 URL: https://issues.apache.org/jira/browse/HIVE-14756 Project: Hive Issue Type: Sub-ta

[jira] [Created] (HIVE-14754) Track the queries execution lifecycle times

2016-09-14 Thread Barna Zsombor Klara (JIRA)
Barna Zsombor Klara created HIVE-14754: -- Summary: Track the queries execution lifecycle times Key: HIVE-14754 URL: https://issues.apache.org/jira/browse/HIVE-14754 Project: Hive Issue Ty

[jira] [Created] (HIVE-14755) Track the success/failure rate of queries

2016-09-14 Thread Barna Zsombor Klara (JIRA)
Barna Zsombor Klara created HIVE-14755: -- Summary: Track the success/failure rate of queries Key: HIVE-14755 URL: https://issues.apache.org/jira/browse/HIVE-14755 Project: Hive Issue Type

[jira] [Created] (HIVE-14753) Track the number of open/closed/abandoned sessions in HS2

2016-09-14 Thread Barna Zsombor Klara (JIRA)
Barna Zsombor Klara created HIVE-14753: -- Summary: Track the number of open/closed/abandoned sessions in HS2 Key: HIVE-14753 URL: https://issues.apache.org/jira/browse/HIVE-14753 Project: Hive

[jira] [Created] (HIVE-14752) New metrics should be introduced to more easily monitor the workload of HS2/HMS

2016-09-14 Thread Barna Zsombor Klara (JIRA)
Barna Zsombor Klara created HIVE-14752: -- Summary: New metrics should be introduced to more easily monitor the workload of HS2/HMS Key: HIVE-14752 URL: https://issues.apache.org/jira/browse/HIVE-14752

Hive ACID table error

2016-09-14 Thread naveen mahadevuni
Hi, I'm using Hive 1,.2. From a non-ACID hive session, I performed the following operations and Hive reports 'serious problem'. CREATE TABLE test5( i int, j int) CLUSTERED BY (i) INTO 8 BUCKETS STORED AS ORC TBLPROPERTIES ('transactional'='true'); insert into test5 values(1,2); insert into t

[jira] [Created] (HIVE-14751) Add support for date truncation

2016-09-14 Thread Jesus Camacho Rodriguez (JIRA)
Jesus Camacho Rodriguez created HIVE-14751: -- Summary: Add support for date truncation Key: HIVE-14751 URL: https://issues.apache.org/jira/browse/HIVE-14751 Project: Hive Issue Type:

Re: Review Request 51695: HIVE-5867: JDBC driver and beeline should support executing an initial SQL script

2016-09-14 Thread Jianguo Tian
> On Sept. 13, 2016, 2:52 a.m., Vihang Karajgaonkar wrote: > > jdbc/src/java/org/apache/hive/jdbc/HiveConnection.java, line 211 > > > > > > Will it work when we redirect the beeline output to a file? I have write on