[jira] [Created] (HIVE-15386) Expose Spark task counts and stage Ids information in SparkTask from SparkJobMonitor

2016-12-07 Thread zhihai xu (JIRA)
zhihai xu created HIVE-15386: Summary: Expose Spark task counts and stage Ids information in SparkTask from SparkJobMonitor Key: HIVE-15386 URL: https://issues.apache.org/jira/browse/HIVE-15386 Project: H

Re: Review Request 54517: HIVE-15192: Subquery support with Calcite

2016-12-07 Thread Vineet Garg
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/54517/ --- (Updated Dec. 8, 2016, 1:49 a.m.) Review request for hive and Ashutosh Chauhan.

Review Request 54517: HIVE-15192: Subquery support with Calcite

2016-12-07 Thread Vineet Garg
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/54517/ --- Review request for hive and Ashutosh Chauhan. Bugs: HIVE-15192 https://issu

Re: Review Request 53204: HIVE-15076 Improve scalability of LDAP authentication provider group filter

2016-12-07 Thread Illya Yalovyy
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/53204/ --- (Updated Dec. 8, 2016, 12:45 a.m.) Review request for hive, Aihua Xu, Ashutosh

[jira] [Created] (HIVE-15385) Failure to inherit permissions when running HdfsUtils.setFullFileStatus(..., false) causes queries to fail

2016-12-07 Thread Sahil Takiar (JIRA)
Sahil Takiar created HIVE-15385: --- Summary: Failure to inherit permissions when running HdfsUtils.setFullFileStatus(..., false) causes queries to fail Key: HIVE-15385 URL: https://issues.apache.org/jira/browse/HIVE-1

[jira] [Created] (HIVE-15384) Compressor plugin framework

2016-12-07 Thread Ziyang Zhao (JIRA)
Ziyang Zhao created HIVE-15384: -- Summary: Compressor plugin framework Key: HIVE-15384 URL: https://issues.apache.org/jira/browse/HIVE-15384 Project: Hive Issue Type: Task Reporter: Z

Review Request 54505: HIVE-15331: Decimal multiplication with high precision/scale often returns NULL

2016-12-07 Thread Jason Dere
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/54505/ --- Review request for hive. Bugs: HIVE-15331 https://issues.apache.org/jira/br

Re: Review Request 54451: HIVE-15367: CTAS with LOCATION should write temp data under location directory rather than database location

2016-12-07 Thread Sergio Pena
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/54451/#review158430 --- Ship it! Ship It! - Sergio Pena On Dec. 7, 2016, 10:29 p.m.,

Re: [VOTE] Apache Hive 2.1.1 Release Candidate 1

2016-12-07 Thread Sergio Pena
Jesus, I was checking the md5 incorrectly. The md5 files from the links you provide are correct. I was trying to compare the md5 from the just created files I built, and they are different (due to different systems and OS of course). The release is good (+1 if counts). - Sergio On Wed, Dec 7, 2

Re: Review Request 54327: Add a FetchTask to REPL DUMP plan for reading dump uri, last repl id as ResultSet

2016-12-07 Thread Vaibhav Gumashta
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/54327/ --- (Updated Dec. 7, 2016, 10:49 p.m.) Review request for hive, Sushanth Sowmyan an

Re: [VOTE] Apache Hive 2.1.1 Release Candidate 1

2016-12-07 Thread Gary Gregory
For the build, please see https://issues.apache.org/jira/browse/HIVE-15111 Another Windows issue: https://issues.apache.org/jira/browse/HIVE-15152 Gary On Wed, Dec 7, 2016 at 10:52 AM, Jesus Camacho Rodriguez < jcamachorodrig...@hortonworks.com> wrote: > @Gary, thanks for the feedback. I did ru

Re: Review Request 54451: HIVE-15367: CTAS with LOCATION should write temp data under location directory rather than database location

2016-12-07 Thread Sahil Takiar
> On Dec. 7, 2016, 6:18 p.m., Sergio Pena wrote: > > ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java, line 2140 > > > > > > Shouldn't we use the parent directory instead of the location? I think >

[jira] [Created] (HIVE-15383) Add additional info to 'desc function extended' output

2016-12-07 Thread Aihua Xu (JIRA)
Aihua Xu created HIVE-15383: --- Summary: Add additional info to 'desc function extended' output Key: HIVE-15383 URL: https://issues.apache.org/jira/browse/HIVE-15383 Project: Hive Issue Type: Improve

Re: Review Request 54451: HIVE-15367: CTAS with LOCATION should write temp data under location directory rather than database location

2016-12-07 Thread Sahil Takiar
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/54451/ --- (Updated Dec. 7, 2016, 10:29 p.m.) Review request for hive, Sergio Pena and Yon

[jira] [Created] (HIVE-15382) auto_sortmerge_join_2 is unstable due to mapjoin memory checking

2016-12-07 Thread Sergey Shelukhin (JIRA)
Sergey Shelukhin created HIVE-15382: --- Summary: auto_sortmerge_join_2 is unstable due to mapjoin memory checking Key: HIVE-15382 URL: https://issues.apache.org/jira/browse/HIVE-15382 Project: Hive

[jira] [Created] (HIVE-15381) don't log the callstack for reduce.xml doesn't exist

2016-12-07 Thread Sergey Shelukhin (JIRA)
Sergey Shelukhin created HIVE-15381: --- Summary: don't log the callstack for reduce.xml doesn't exist Key: HIVE-15381 URL: https://issues.apache.org/jira/browse/HIVE-15381 Project: Hive Issue

Re: [VOTE] Apache Hive 2.1.1 Release Candidate 1

2016-12-07 Thread Jesus Camacho Rodriguez
@Gary, thanks for the feedback. I did run the test suite in OSX 10.11 and I did not have problems of the kind; I attach the trace for the ORC module tests at the end of this email. Indeed I did not run the test suite in Windows (and probably we do not do it regularly enough, which is a valid point

Re: Review Request 54451: HIVE-15367: CTAS with LOCATION should write temp data under location directory rather than database location

2016-12-07 Thread Sergio Pena
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/54451/#review158356 --- itests/hive-blobstore/src/test/queries/clientpositive/ctas.q (lin

[jira] [Created] (HIVE-15380) Update RELEASE_NOTES file to include all previous releases

2016-12-07 Thread Jesus Camacho Rodriguez (JIRA)
Jesus Camacho Rodriguez created HIVE-15380: -- Summary: Update RELEASE_NOTES file to include all previous releases Key: HIVE-15380 URL: https://issues.apache.org/jira/browse/HIVE-15380 Project:

Re: Review Request 54393: HIVE-15361: INSERT dynamic partition on S3 fails with a MoveTask failure

2016-12-07 Thread Sergio Pena
> On Dec. 7, 2016, 4:43 p.m., Mohit Sabharwal wrote: > > ql/src/java/org/apache/hadoop/hive/ql/optimizer/GenMapRedUtils.java, line > > 1765 > > > > > > can BlobStorageUtils.areOptimizationsEnabled(conf) return true

Re: Review Request 54393: HIVE-15361: INSERT dynamic partition on S3 fails with a MoveTask failure

2016-12-07 Thread Sergio Pena
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/54393/ --- (Updated Dec. 7, 2016, 5:02 p.m.) Review request for hive. Changes --- U

Re: Review Request 54393: HIVE-15361: INSERT dynamic partition on S3 fails with a MoveTask failure

2016-12-07 Thread Mohit Sabharwal
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/54393/#review158345 --- lgtm overall, one question. ql/src/java/org/apache/hadoop/hive/q

Re: [VOTE] Apache Hive 2.1.1 Release Candidate 1

2016-12-07 Thread Gary Gregory
(non-binding -1). Building from tag: Tests in error: TestRecordReaderImpl.testCloseWithException:1665->closeMockedRecordReader:1683 » NullPointer TestRecordReaderImpl.testClose:1654->closeMockedRecordReader:1683 » FileAlreadyExists TestRLEv2.testFixedDeltaOneDescending:141 » NullPointer Tes

Re: [VOTE] Apache Hive 2.1.1 Release Candidate 1

2016-12-07 Thread Gary Gregory
Did you try to run all the unit tests? On what platform? Certainly not on Windows... Gary On Wed, Dec 7, 2016 at 8:15 AM, Thejas Nair wrote: > +1 (Looks like I have the final word! :) ) > > Verified checksum and signature for both packages. Build from source and > ran some simple queries. > Als

Re: [VOTE] Apache Hive 2.1.1 Release Candidate 1

2016-12-07 Thread Thejas Nair
+1 (Looks like I have the final word! :) ) Verified checksum and signature for both packages. Build from source and ran some simple queries. Also examined LICENSE, NOTICE, and RELEASE_NOTES files. I see that the RELEASE_NOTES file this time contains only the changes in latest release, in the past

Re: Print actual key / value details in Hive

2016-12-07 Thread Robert Grandl
Hi, Can someone give me any advice on this? I have a hard time understanding how to properly get it. I observe that in ReduceSinkOperator.java, keys and values are available as HiveKey and BytesWritable, but I don't know how to extract the actual content. For key, I can use a StructObjectInspect

Re: [VOTE] Apache Hive 2.1.1 Release Candidate 1

2016-12-07 Thread Jesus Camacho Rodriguez
PMC Members, We still need one +1 vote to be able to release 2.1.1. Please test and vote! Thanks, Jesús On 12/6/16, 4:02 PM, "Ashutosh Chauhan" wrote: >+1 Verified md5 on src and binary distribution. Built src distribution. All >looks good. > >Thanks, >Ashutosh > >On Fri, Dec 2, 2016 at 7:3

[jira] [Created] (HIVE-15379) Get the key of hive.metastore.* values should be consistent with Hive Metastore Server.

2016-12-07 Thread Yuming Wang (JIRA)
Yuming Wang created HIVE-15379: -- Summary: Get the key of hive.metastore.* values should be consistent with Hive Metastore Server. Key: HIVE-15379 URL: https://issues.apache.org/jira/browse/HIVE-15379 Pr

[jira] [Created] (HIVE-15378) clean up HADOOP_USER_CLASSPATH_FIRST in bin scripts

2016-12-07 Thread Fei Hui (JIRA)
Fei Hui created HIVE-15378: -- Summary: clean up HADOOP_USER_CLASSPATH_FIRST in bin scripts Key: HIVE-15378 URL: https://issues.apache.org/jira/browse/HIVE-15378 Project: Hive Issue Type: Bug