[jira] [Created] (HIVE-17000) Upgrade Hive to PARQUET 1.9.0

2017-06-29 Thread Dapeng Sun (JIRA)
Dapeng Sun created HIVE-17000: - Summary: Upgrade Hive to PARQUET 1.9.0 Key: HIVE-17000 URL: https://issues.apache.org/jira/browse/HIVE-17000 Project: Hive Issue Type: Improvement

[jira] [Created] (HIVE-16999) Performance bottleneck in the add_resource api

2017-06-29 Thread Sailee Jain (JIRA)
Sailee Jain created HIVE-16999: -- Summary: Performance bottleneck in the add_resource api Key: HIVE-16999 URL: https://issues.apache.org/jira/browse/HIVE-16999 Project: Hive Issue Type: Bug

[jira] [Created] (HIVE-16998) Add config to enable HoS DPP only for map-joins

2017-06-29 Thread Sahil Takiar (JIRA)
Sahil Takiar created HIVE-16998: --- Summary: Add config to enable HoS DPP only for map-joins Key: HIVE-16998 URL: https://issues.apache.org/jira/browse/HIVE-16998 Project: Hive Issue Type:

Re: Review Request 60445: HIVE-16935: Hive should strip comments from input before choosing which CommandProcessor to run.

2017-06-29 Thread Andrew Sherman
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/60445/ --- (Updated June 30, 2017, 12:30 a.m.) Review request for hive and Sahil Takiar.

[jira] [Created] (HIVE-16997) Extend object store to store bit vectors

2017-06-29 Thread Pengcheng Xiong (JIRA)
Pengcheng Xiong created HIVE-16997: -- Summary: Extend object store to store bit vectors Key: HIVE-16997 URL: https://issues.apache.org/jira/browse/HIVE-16997 Project: Hive Issue Type:

[jira] [Created] (HIVE-16995) Merge NDV across partitions using bit vectors

2017-06-29 Thread Pengcheng Xiong (JIRA)
Pengcheng Xiong created HIVE-16995: -- Summary: Merge NDV across partitions using bit vectors Key: HIVE-16995 URL: https://issues.apache.org/jira/browse/HIVE-16995 Project: Hive Issue Type:

[jira] [Created] (HIVE-16996) Add HLL as an alternative to FM sketch to compute stats

2017-06-29 Thread Pengcheng Xiong (JIRA)
Pengcheng Xiong created HIVE-16996: -- Summary: Add HLL as an alternative to FM sketch to compute stats Key: HIVE-16996 URL: https://issues.apache.org/jira/browse/HIVE-16996 Project: Hive

[jira] [Created] (HIVE-16994) Support connection pooling for HiveMetaStoreClient

2017-06-29 Thread Alexander Kolbasov (JIRA)
Alexander Kolbasov created HIVE-16994: - Summary: Support connection pooling for HiveMetaStoreClient Key: HIVE-16994 URL: https://issues.apache.org/jira/browse/HIVE-16994 Project: Hive

Review Request 60552: hive.optimize.bucketingsorting should compare the schema before removing RS

2017-06-29 Thread pengcheng xiong
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/60552/ --- Review request for hive and Ashutosh Chauhan. Repository: hive-git

Re: Review Request 60445: HIVE-16935: Hive should strip comments from input before choosing which CommandProcessor to run.

2017-06-29 Thread Andrew Sherman
> On June 28, 2017, 10:39 a.m., Peter Vary wrote: > > Hi, > > > > Thanks for the change. > > Overall looks good. > > After running Yetus, it come up with the following warnings: > > > > ./common/src/java/org/apache/hive/common/util/HiveStringUtils.java:1077: > > /**: warning: First sentence

Re: Review Request 60445: HIVE-16935: Hive should strip comments from input before choosing which CommandProcessor to run.

2017-06-29 Thread Andrew Sherman
> On June 28, 2017, 5:18 a.m., Sahil Takiar wrote: > > common/src/java/org/apache/hive/common/util/HiveStringUtils.java > > Lines 1083 (patched) > > > > > > is this copied from somewhere, or is this logic new?

Re: Review Request 60289: HIVE-15665 LLAP: OrcFileMetadata objects in cache can impact heap usage

2017-06-29 Thread Sergey Shelukhin
> On June 29, 2017, 6:38 a.m., Prasanth_J wrote: > > llap-server/src/java/org/apache/hadoop/hive/llap/io/encoded/OrcEncodedDataReader.java > > Lines 614 (patched) > > > > > > can this all be baked in OrcFileMetadata

Re: Review Request 60289: HIVE-15665 LLAP: OrcFileMetadata objects in cache can impact heap usage

2017-06-29 Thread Sergey Shelukhin
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/60289/ --- (Updated June 29, 2017, 9:21 p.m.) Review request for hive, Gopal V and

Re: Review Request 60289: HIVE-15665 LLAP: OrcFileMetadata objects in cache can impact heap usage

2017-06-29 Thread Sergey Shelukhin
> On June 29, 2017, 6:38 a.m., Prasanth_J wrote: > > ql/src/java/org/apache/hadoop/hive/ql/io/orc/encoded/EncodedReaderImpl.java > > Lines 1685 (patched) > > > > > > This looks complicated. It will be better if ORC

[jira] [Created] (HIVE-16993) ThriftHiveMetastore.create_database can fail if the locationUri is not set

2017-06-29 Thread Dan Burkert (JIRA)
Dan Burkert created HIVE-16993: -- Summary: ThriftHiveMetastore.create_database can fail if the locationUri is not set Key: HIVE-16993 URL: https://issues.apache.org/jira/browse/HIVE-16993 Project: Hive

Re: Review Request 60289: HIVE-15665 LLAP: OrcFileMetadata objects in cache can impact heap usage

2017-06-29 Thread Sergey Shelukhin
> On June 29, 2017, 6:38 a.m., Prasanth_J wrote: > > common/src/java/org/apache/hadoop/hive/conf/HiveConf.java > > Line 2974 (original) > > > > > > Do we need this for offheap cache? For smaller cache, we don't

[jira] [Created] (HIVE-16992) LLAP: better default lambda for LRFU policy

2017-06-29 Thread Sergey Shelukhin (JIRA)
Sergey Shelukhin created HIVE-16992: --- Summary: LLAP: better default lambda for LRFU policy Key: HIVE-16992 URL: https://issues.apache.org/jira/browse/HIVE-16992 Project: Hive Issue Type:

[jira] [Created] (HIVE-16991) HiveMetaStoreClient needs a 2-arg constructor for backwards compatibility

2017-06-29 Thread Andrew Sherman (JIRA)
Andrew Sherman created HIVE-16991: - Summary: HiveMetaStoreClient needs a 2-arg constructor for backwards compatibility Key: HIVE-16991 URL: https://issues.apache.org/jira/browse/HIVE-16991 Project:

[GitHub] hive pull request #194: HIVE-16785: Ensure replication actions are idempoten...

2017-06-29 Thread sankarh
Github user sankarh closed the pull request at: https://github.com/apache/hive/pull/194 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Created] (HIVE-16990) REPL LOAD should update last repl ID only after successful copy of data files.

2017-06-29 Thread Sankar Hariappan (JIRA)
Sankar Hariappan created HIVE-16990: --- Summary: REPL LOAD should update last repl ID only after successful copy of data files. Key: HIVE-16990 URL: https://issues.apache.org/jira/browse/HIVE-16990

[jira] [Created] (HIVE-16989) Fix some issues identified by lgtm.com

2017-06-29 Thread Malcolm Taylor (JIRA)
Malcolm Taylor created HIVE-16989: - Summary: Fix some issues identified by lgtm.com Key: HIVE-16989 URL: https://issues.apache.org/jira/browse/HIVE-16989 Project: Hive Issue Type:

[jira] [Created] (HIVE-16988) if partition column type is boolean, Streaming api AbstractRecordWriter.getPathForEndPoint NoSuchObjectException: partition values=[Y, 2017-06-29 14:32:36.508]

2017-06-29 Thread brucewoo (JIRA)
brucewoo created HIVE-16988: --- Summary: if partition column type is boolean, Streaming api AbstractRecordWriter.getPathForEndPoint NoSuchObjectException: partition values=[Y, 2017-06-29 14:32:36.508] Key: HIVE-16988

Re: Review Request 60355: HIVE-16929 User-defined UDF functions can be registered as invariant functions

2017-06-29 Thread ZhangBing Lin
> On 六月 28, 2017, 10:49 a.m., Barna Zsombor Klara wrote: > > Sorry for getting back this late and thank you for the updates. I don't > > want to be too nitpicky but I did have another comment about rewording a > > log line, sorry. > > As for testing, you do have jars on the classpath during

Re: Review Request 60289: HIVE-15665 LLAP: OrcFileMetadata objects in cache can impact heap usage

2017-06-29 Thread j . prasanth . j
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/60289/#review179152 --- common/src/java/org/apache/hadoop/hive/conf/HiveConf.java Line

Re: Review Request 60355: HIVE-16929 User-defined UDF functions can be registered as invariant functions

2017-06-29 Thread ZhangBing Lin
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/60355/ --- (Updated 六月 29, 2017, 6:37 a.m.) Review request for hive, cheng xu and Xuefu