Username/password authentication support in HiveServer

[郜瑜]

Hi all,

I noticed that HiveServer2 will have username/password authentication. When
will this HiveServer2 be available?

As we know, the existing HiveServer does not have any authentication
mechanism, so there's no security control on client connections and
operations. It would be good to introduce authentication infrastructure to
it as well, so I opened jira
HIVE-3719
and put the design there to achieve this.

Regards,
Yu Gao

[jira] [Commented] (HIVE-3724) Metastore tests use hardcoded ports

[Mark Grover (JIRA)]

[ 
https://issues.apache.org/jira/browse/HIVE-3724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13507106#comment-13507106
 ] 

Mark Grover commented on HIVE-3724:
---

+1 (non-committer)

> Metastore tests use hardcoded ports
> ---
>
> Key: HIVE-3724
> URL: https://issues.apache.org/jira/browse/HIVE-3724
> Project: Hive
>  Issue Type: Bug
>  Components: Tests
>Affects Versions: 0.10.0
>Reporter: Kevin Wilfong
>Assignee: Kevin Wilfong
>Priority: Minor
> Attachments: HIVE-3724.1.patch.txt, HIVE-3724.2.patch.txt
>
>
> Several of the metastore tests use hardcoded ports for remote metastore 
> Thrift servers.  This is causing transient failures in Jenkins, e.g. 
> https://builds.apache.org/job/Hive-trunk-h0.21/1804/
> A few tests already dynamically determine free ports, and this logic can be 
> shared.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HIVE-3384) HIVE JDBC module won't compile under JDK1.7 as new methods added in JDBC specification

[Ashutosh Chauhan (JIRA)]

[ 
https://issues.apache.org/jira/browse/HIVE-3384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13507090#comment-13507090
 ] 

Ashutosh Chauhan commented on HIVE-3384:


Patch doesn't apply cleanly. Can you rebase it on trunk. I will test and commit.

> HIVE JDBC module won't compile under JDK1.7 as new methods added in JDBC 
> specification
> --
>
> Key: HIVE-3384
> URL: https://issues.apache.org/jira/browse/HIVE-3384
> Project: Hive
>  Issue Type: Bug
>  Components: JDBC
>Reporter: Weidong Bian
>Priority: Minor
> Attachments: D6873-0.9.1.patch, D6873.1.patch, D6873.2.patch, 
> D6873.3.patch, D6873.4.patch, HIVE-3384.2.patch, HIVE-3384.patch, 
> HIVE-JDK7-JDBC.patch
>
>
> jdbc module couldn't be compiled with jdk7 as it adds some abstract method in 
> the JDBC specification 
> some error info:
>  error: HiveCallableStatement is not abstract and does not override abstract
> method getObject(String,Class) in CallableStatement
> .
> .
> .

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HIVE-3724) Metastore tests use hardcoded ports

[Ashutosh Chauhan (JIRA)]

[ 
https://issues.apache.org/jira/browse/HIVE-3724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13507087#comment-13507087
 ] 

Ashutosh Chauhan commented on HIVE-3724:


+1

> Metastore tests use hardcoded ports
> ---
>
> Key: HIVE-3724
> URL: https://issues.apache.org/jira/browse/HIVE-3724
> Project: Hive
>  Issue Type: Bug
>  Components: Tests
>Affects Versions: 0.10.0
>Reporter: Kevin Wilfong
>Assignee: Kevin Wilfong
>Priority: Minor
> Attachments: HIVE-3724.1.patch.txt, HIVE-3724.2.patch.txt
>
>
> Several of the metastore tests use hardcoded ports for remote metastore 
> Thrift servers.  This is causing transient failures in Jenkins, e.g. 
> https://builds.apache.org/job/Hive-trunk-h0.21/1804/
> A few tests already dynamically determine free ports, and this logic can be 
> shared.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HIVE-3752) Add a non-sql API in hive to access data.

[Namit Jain (JIRA)]

[ 
https://issues.apache.org/jira/browse/HIVE-3752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13507078#comment-13507078
 ] 

Namit Jain commented on HIVE-3752:
--

[~appodictic], yes we did. 

While HCatalog is a neat project, there are a several reasons why an Hive 
input/format packaged with Hive is better for Apache Giraph
*  HCatalog (trunk) unfortunately is not compatible with Hadoop-0.20
*  Hcatalog is much more complex than simply being an API to use Hive.  We only 
require a small part of Hcatalog's functionality, so having only a portion of 
this functionality will be easier to fix/update/maintain going forward
* Having an input/output format that is part of Hive will guarantee its 
compatibility with Hive going forward

As an aside, Hcatalog could also use this new input/output format to interface 
with Hive, potentially enabling a portion of its code to be simpler. 

In nutshell, HCatalog is a overkill for our simple usecase, and we want to 
avoid dependency on as many systems as possible.
For a simple usecase like ours, enhancing hive seems like a much simpler option 
and easier to maintain in the longer term.

ccing [~alangates], [~cwsteinbach]

> Add a non-sql API in hive to access data.
> -
>
> Key: HIVE-3752
> URL: https://issues.apache.org/jira/browse/HIVE-3752
> Project: Hive
>  Issue Type: Improvement
>Reporter: Nitay Joffe
>
> We would like to add an input/output format for accessing Hive data in Hadoop 
> directly without having to use e.g. a transform. Using a transform
> means having to do a whole map-reduce step with its own disk accesses and its 
> imposed structure. It also means needing to have Hive be the base 
> infrastructure for the entire system being developed which is not the right 
> fit as we only need a small part of it (access to the data).
> So we propose adding an API level InputFormat and OutputFormat to Hive that 
> will make it trivially easy to select a table with partition spec and read 
> from / write to it. We chose this design to make it compatible with Hadoop so 
> that existing systems that work with Hadoop's IO API will just work out of 
> the box.
> We need this system for the Giraph graph processing system 
> (http://giraph.apache.org/) as running graph jobs which read/write from Hive 
> is a common use case.
> [~namitjain] [~aching] [~kevinwilfong] [~apresta]

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HIVE-3733) Improve Hive's logic for conditional merge

[Pradeep Kamath (JIRA)]

[ 
https://issues.apache.org/jira/browse/HIVE-3733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13507055#comment-13507055
 ] 

Pradeep Kamath commented on HIVE-3733:
--

Re-running testCliDriver_groupby_multi_single_reducer locally I noticed it is 
failing because the new code is adding an additional conditional merge. The 
query is a multi insert one but all with map-reduce phases - so it appears like 
this is a regression.

In the debugger I noticed:
currWork.getReducer() is org.apache.hadoop.hive.ql.exec.ExtractOperator@66bb4c22

However stack does not contain it causing the merge operation to be added!
Stack has:
[org.apache.hadoop.hive.ql.exec.TableScanOperator@476acffa, 
org.apache.hadoop.hive.ql.exec.SelectOperator@3de76262, 
org.apache.hadoop.hive.ql.exec.ReduceSinkOperator@61607dda, 
org.apache.hadoop.hive.ql.exec.ForwardOperator@5e6a528, 
org.apache.hadoop.hive.ql.exec.FilterOperator@1b97680c, 
org.apache.hadoop.hive.ql.exec.GroupByOperator@712ff9fa, 
org.apache.hadoop.hive.ql.exec.SelectOperator@433d44fc, 
org.apache.hadoop.hive.ql.exec.SelectOperator@2c3b39be, 
org.apache.hadoop.hive.ql.exec.FileSinkOperator@397bd678]

Any ideas why this is happening?

> Improve Hive's logic for conditional merge
> --
>
> Key: HIVE-3733
> URL: https://issues.apache.org/jira/browse/HIVE-3733
> Project: Hive
>  Issue Type: Improvement
>Reporter: Pradeep Kamath
>Assignee: Pradeep Kamath
> Attachments: HIVE-3733.1.patch.txt, HIVE-3733.3.patch.txt
>
>
> If the config hive.merge.mapfiles is set to true and hive.merge.mapredfiles 
> is set to false then when hive encounters a FileSinkOperator when generating 
> map reduce tasks, it will look at the entire job to see if it has a reducer, 
> if it does it will not merge. Instead it should be check if the 
> FileSinkOperator is a child of the reducer. This means that outputs generated 
> in the mapper will be merged, and outputs generated in the reducer will not 
> be, the intended effect of setting those configs.
> Simple repro:
> set hive.merge.mapfiles=true;
> set hive.merge.mapredfiles=false;
> EXPLAIN
> FROM 
> INSERT OVERWRITE TABLE  SELECT key, COUNT(*) group by key
> INSERT OVERWRITE TABLE  SELECT *;
> The output should contain a Conditional Operator, Mapred Stages, and Move 
> tasks

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Hive-trunk-h0.21 - Build # 1826 - Still Failing

[Apache Jenkins Server]

Changes for Build #1783
[kevinwilfong] HIVE-3654. block relative path access in hive. (njain via 
kevinwilfong)

[hashutosh] HIVE-3658 : Unable to generate the Hbase related unit tests using 
velocity templates on Windows (Kanna Karanam via Ashutosh Chauhan)

[hashutosh] HIVE-3661 : Remove the Windows specific = related swizzle path 
changes from Proxy FileSystems (Kanna Karanam via Ashutosh Chauhan)

[hashutosh] HIVE-3480 : : Fix the file handle leaks in Symbolic 
& Symlink related input formats. (Kanna Karanam via Ashutosh Chauhan)


Changes for Build #1784
[kevinwilfong] HIVE-3675. NaN does not work correctly for round(n). (njain via 
kevinwilfong)

[cws] HIVE-3651. bucketmapjoin?.q tests fail with hadoop 0.23 (Prasad Mujumdar 
via cws)


Changes for Build #1785
[namit] HIVE-3613 Implement grouping_id function
(Ian Gorbachev via namit)

[namit] HIVE-3692 Update parallel test documentation
(Ivan Gorbachev via namit)

[namit] HIVE-3649 Hive List Bucketing - enhance DDL to specify list bucketing 
table
(Gang Tim Liu via namit)


Changes for Build #1786
[namit] HIVE-3696 Revert HIVE-3483 which causes performance regression
(Gang Tim Liu via namit)


Changes for Build #1787
[kevinwilfong] HIVE-3621. Make prompt in Hive CLI configurable. (Jingwei Lu via 
kevinwilfong)

[kevinwilfong] HIVE-3695. TestParse breaks due to HIVE-3675. (njain via 
kevinwilfong)


Changes for Build #1788
[kevinwilfong] HIVE-3557. Access to external URLs in hivetest.py. (Ivan 
Gorbachev via kevinwilfong)


Changes for Build #1789
[hashutosh] HIVE-3662 : TestHiveServer: testScratchDirShouldClearWhileStartup 
is failing on Windows (Kanna Karanam via Ashutosh Chauhan)

[hashutosh] HIVE-3659 : TestHiveHistory::testQueryloglocParentDirNotExist Test 
fails on Windows because of some resource leaks in ZK (Kanna Karanam via 
Ashutosh Chauhan)

[hashutosh] HIVE-3663 Unable to display the MR Job file path on Windows in case 
of MR job failures.  (Kanna Karanam via Ashutosh Chauhan)


Changes for Build #1790

Changes for Build #1791

Changes for Build #1792

Changes for Build #1793
[hashutosh] HIVE-3704 : name of some metastore scripts are not per convention 
(Ashutosh Chauhan)


Changes for Build #1794
[hashutosh] HIVE-3243 : ignore white space between entries of hive/hbase table 
mapping (Shengsheng Huang via Ashutosh Chauhan)

[hashutosh] HIVE-3215 : JobDebugger should use RunningJob.getTrackingURL 
(Bhushan Mandhani via Ashutosh Chauhan)


Changes for Build #1795
[cws] HIVE-3437. 0.23 compatibility: fix unit tests when building against 0.23 
(Chris Drome via cws)

[hashutosh] HIVE-3626 : RetryingHMSHandler should wrap JDOException inside 
MetaException (Bhushan Mandhani via Ashutosh Chauhan)

[hashutosh] HIVE-3560 : Hive always prints a warning message when using remote 
metastore (Travis Crawford via Ashutosh Chauhan)


Changes for Build #1796

Changes for Build #1797
[hashutosh] HIVE-3664 : Avoid to create a symlink for hive-contrib.jar file in 
dist\lib folder. (Kanna Karanam via Ashutosh Chauhan)


Changes for Build #1798
[namit] HIVE-3706 getBoolVar in FileSinkOperator can be optimized
(Kevin Wilfong via namit)

[namit] HIVE-3707 Round map/reduce progress down when it is in the range [99.5, 
100)
(Kevin Wilfong via namit)

[namit] HIVE-3471 Implement grouping sets in hive
(Ivan Gorbachev via namit)


Changes for Build #1799
[hashutosh] HIVE-3291 : fix fs resolvers (Ashish Singh via Ashutosh Chauhan)

[hashutosh] HIVE-3680 : Include Table information in Hive's AddPartitionEvent. 
(Mithun Radhakrishnan via Ashutosh Chauhan)


Changes for Build #1800
[hashutosh] HIVE-3520 : ivysettings.xml does not let you override 
.m2/repository (Raja Aluri via Ashutosh Chauhan)

[hashutosh] HIVE-3435 : Get pdk pluginTest passed when triggered from both 
builtin tests and pdk tests on hadoop23  (Zhenxiao Luo via Ashutosh Chauhan)


Changes for Build #1801

Changes for Build #1802

Changes for Build #1803

Changes for Build #1804

Changes for Build #1805

Changes for Build #1806
[hashutosh] Preparing for 0.11 development

[kevinwilfong] HIVE-3647. map-side groupby wrongly due to HIVE-3432. (njain via 
kevinwilfong)


Changes for Build #1807
[kevinwilfong] HIVE-3679. Unescape partition names returned by show partitions. 
(Wonho Kim via kevinwilfong)


Changes for Build #1808
[kevinwilfong] Remove extra files accidentally committed with HIVE-3679. 
(kevinwilfong)


Changes for Build #1809

Changes for Build #1810

Changes for Build #1811
[namit] HIVE-3735 PTest doesn't work due to hive snapshot version upgrade to 11
(Gang Tim Liu via namit)

[namit] HIVE-3722 Create index fails on CLI using remote metastore
(Kevin Wilfong via namit)


Changes for Build #1812
[namit] HIVE-3703 Hive Query Explain Plan JSON not being created properly
(Mayank Garg via namit)

[namit] HIVE-3721 ALTER TABLE ADD PARTS should check for valid partition spec 
and throw a SemanticException
if part spec is not valid (Pamela Vagata via namit)


Changes for Build #1813

Changes for Build

[jira] [Commented] (HIVE-3631) script_pipe.q fails when using JDK7

[Hudson (JIRA)]

[ 
https://issues.apache.org/jira/browse/HIVE-3631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13507036#comment-13507036
 ] 

Hudson commented on HIVE-3631:
--

Integrated in Hive-trunk-h0.21 #1826 (See 
[https://builds.apache.org/job/Hive-trunk-h0.21/1826/])
HIVE-3631 : script_pipe.q fails when using JDK7 (Chris Drome via Ashutosh 
Chauhan) (Revision 1415278)

 Result = FAILURE
hashutosh : 
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1415278
Files : 
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/ScriptOperator.java


> script_pipe.q fails when using JDK7
> ---
>
> Key: HIVE-3631
> URL: https://issues.apache.org/jira/browse/HIVE-3631
> Project: Hive
>  Issue Type: Bug
>  Components: Tests
>Affects Versions: 0.10.0, 0.9.1
>Reporter: Chris Drome
>Assignee: Chris Drome
> Attachments: HIVE-3631-0.9.patch, HIVE-3631-trunk.patch
>
>
> Hive Runtime Error while closing operators: Hit error while closing ..
> The MR job fails on this test. Unfortunately, the exception is not all that 
> helpful.
> I tracked this down to a class which attempts to close a stream that is 
> already closed. Broken pipe exceptions are caught and not propagated further, 
> but stream closed exception are not caught.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HIVE-3755) can't assign jira issue

[Gang Tim Liu (JIRA)]

[ 
https://issues.apache.org/jira/browse/HIVE-3755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13506948#comment-13506948
 ] 

Gang Tim Liu commented on HIVE-3755:


FYI, I was added to the list of contributor 6-7 months ago and jira assignment 
has been working fine until recent weeks. thank you very much again for fixing 
the privilege issue.

> can't assign jira issue
> ---
>
> Key: HIVE-3755
> URL: https://issues.apache.org/jira/browse/HIVE-3755
> Project: Hive
>  Issue Type: Bug
>  Components: Website
>Reporter: Gang Tim Liu
>Assignee: Ashutosh Chauhan
>Priority: Minor
>
> I can't assign jira issue even if the jira issue is created by myself.
> For example, I created Hive-3754 but "Workflow" button is greyed out so that 
> I can't assign it to myself.
> I used to be able to do so but recently not.
> Hope someone can help to check my jira previlidge or point out to me what I 
> can do.
> thanks a lot

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HIVE-3724) Metastore tests use hardcoded ports

[Kevin Wilfong (JIRA)]

[ 
https://issues.apache.org/jira/browse/HIVE-3724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13506946#comment-13506946
 ] 

Kevin Wilfong commented on HIVE-3724:
-

Thanks Ashutosh, switched to using that method in the refactored tests, and 
deleted the duplicate method.

> Metastore tests use hardcoded ports
> ---
>
> Key: HIVE-3724
> URL: https://issues.apache.org/jira/browse/HIVE-3724
> Project: Hive
>  Issue Type: Bug
>  Components: Tests
>Affects Versions: 0.10.0
>Reporter: Kevin Wilfong
>Assignee: Kevin Wilfong
>Priority: Minor
> Attachments: HIVE-3724.1.patch.txt, HIVE-3724.2.patch.txt
>
>
> Several of the metastore tests use hardcoded ports for remote metastore 
> Thrift servers.  This is causing transient failures in Jenkins, e.g. 
> https://builds.apache.org/job/Hive-trunk-h0.21/1804/
> A few tests already dynamically determine free ports, and this logic can be 
> shared.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (HIVE-3724) Metastore tests use hardcoded ports

[Kevin Wilfong (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HIVE-3724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Kevin Wilfong updated HIVE-3724:


Status: Patch Available  (was: Open)

> Metastore tests use hardcoded ports
> ---
>
> Key: HIVE-3724
> URL: https://issues.apache.org/jira/browse/HIVE-3724
> Project: Hive
>  Issue Type: Bug
>  Components: Tests
>Affects Versions: 0.10.0
>Reporter: Kevin Wilfong
>Assignee: Kevin Wilfong
>Priority: Minor
> Attachments: HIVE-3724.1.patch.txt, HIVE-3724.2.patch.txt
>
>
> Several of the metastore tests use hardcoded ports for remote metastore 
> Thrift servers.  This is causing transient failures in Jenkins, e.g. 
> https://builds.apache.org/job/Hive-trunk-h0.21/1804/
> A few tests already dynamically determine free ports, and this logic can be 
> shared.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (HIVE-3724) Metastore tests use hardcoded ports

[Kevin Wilfong (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HIVE-3724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Kevin Wilfong updated HIVE-3724:


Attachment: HIVE-3724.2.patch.txt

> Metastore tests use hardcoded ports
> ---
>
> Key: HIVE-3724
> URL: https://issues.apache.org/jira/browse/HIVE-3724
> Project: Hive
>  Issue Type: Bug
>  Components: Tests
>Affects Versions: 0.10.0
>Reporter: Kevin Wilfong
>Assignee: Kevin Wilfong
>Priority: Minor
> Attachments: HIVE-3724.1.patch.txt, HIVE-3724.2.patch.txt
>
>
> Several of the metastore tests use hardcoded ports for remote metastore 
> Thrift servers.  This is causing transient failures in Jenkins, e.g. 
> https://builds.apache.org/job/Hive-trunk-h0.21/1804/
> A few tests already dynamically determine free ports, and this logic can be 
> shared.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HIVE-3748) QTestUtil should correctly find data files when running in the build directory

[Phabricator (JIRA)]

[ 
https://issues.apache.org/jira/browse/HIVE-3748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13506931#comment-13506931
 ] 

Phabricator commented on HIVE-3748:
---

mbautin has abandoned the revision "[jira] [HIVE-3748] QTestUtil should 
correctly find data files when running in the build directory".

REVISION DETAIL
  https://reviews.facebook.net/D7005

To: ashutoshc, JIRA, njain, mbautin


> QTestUtil should correctly find data files when running in the build directory
> --
>
> Key: HIVE-3748
> URL: https://issues.apache.org/jira/browse/HIVE-3748
> Project: Hive
>  Issue Type: Improvement
>Reporter: Mikhail Bautin
>Assignee: Mikhail Bautin
>Priority: Minor
> Attachments: D7005.1.patch
>
>
> Some parts of the the TestCliDriver test suite (i.e. some jar lookups) 
> require that the current directory is set to the build directory. This makes 
> QTestUtil correctly find data files when running either in the Hive source 
> root or in the build directory.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Resolved] (HIVE-3748) QTestUtil should correctly find data files when running in the build directory

[Mikhail Bautin (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HIVE-3748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Mikhail Bautin resolved HIVE-3748.
--

  Resolution: Not A Problem
Release Note: I found a way to achieve the same result without changing the 
code. In fact, Hive does run unit tests from a directory one level above the 
source root (e.g. ${hive.root}/ql, etc.) but data/conf/hive-site.xml specifies 
the property to look for test data files one directory above.

> QTestUtil should correctly find data files when running in the build directory
> --
>
> Key: HIVE-3748
> URL: https://issues.apache.org/jira/browse/HIVE-3748
> Project: Hive
>  Issue Type: Improvement
>Reporter: Mikhail Bautin
>Assignee: Mikhail Bautin
>Priority: Minor
> Attachments: D7005.1.patch
>
>
> Some parts of the the TestCliDriver test suite (i.e. some jar lookups) 
> require that the current directory is set to the build directory. This makes 
> QTestUtil correctly find data files when running either in the Hive source 
> root or in the build directory.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HIVE-3753) 'CTAS' and INSERT OVERWRITE send different column names to the underlying SerDe

[Matthew Rathbone (JIRA)]

[ 
https://issues.apache.org/jira/browse/HIVE-3753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13506924#comment-13506924
 ] 

Matthew Rathbone commented on HIVE-3753:


We thought of that too, unfortunately it makes no difference, and the same 
issue persists.

> 'CTAS' and INSERT OVERWRITE send different column names to the underlying 
> SerDe
> ---
>
> Key: HIVE-3753
> URL: https://issues.apache.org/jira/browse/HIVE-3753
> Project: Hive
>  Issue Type: Bug
>  Components: Serializers/Deserializers
>Affects Versions: 0.9.0
>Reporter: Matthew Rathbone
>   Original Estimate: 24h
>  Remaining Estimate: 24h
>
> A good example is with a JSON serde 
> (https://github.com/rathboma/Hive-JSON-Serde-1)
> Here is a simple example of how the two results differ:
> CREATE TABLE foo ROW FORMAT SERDE 'JsonSerDe' SELECT host from table1;
> generates => {"_col0": "localhost"}
> CREATE TABLE foo(host string) ROW FORMAT SERDE 'JsonSerDe';
> INSERT OVERWRITE TABLE FOO SELECT host FROM table;
> generates => {"host": "localhost"}
> The SerDe gets passed column names in two places:
> 1) The property Constants.LIST_COLUMNS
> 2) It gets passed a StructObjectInspector on serialize
> In the CTAS example above, both of these contain '_col0' as the column name. 
> This is not true in the second example, as the LIST_COLUMNS property contains 
> the real column names.
> I'd be happy to help out with this change, but I fear that the solution lies 
> somewhere in SemanticAnalyser.java, and I'm having a hard time finding my way 
> around.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (HIVE-3384) HIVE JDBC module won't compile under JDK1.7 as new methods added in JDBC specification

[Phabricator (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HIVE-3384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Phabricator updated HIVE-3384:
--

Attachment: D6873.4.patch

mbautin updated the revision "[jira] [HIVE-3384] HIVE JDBC module won't compile 
under JDK1.7 as new methods added in JDBC specification".
Reviewers: cdrome, weidongbian, JIRA, ashutoshc

  Addressing Ashutosh's additional comment: putting -XX:-UseSplitVerifier into 
jvm.args defined in build.properties.

REVISION DETAIL
  https://reviews.facebook.net/D6873

AFFECTED FILES
  build-common.xml
  build.properties
  build.xml
  jdbc/src/java/org/apache/hadoop/hive/jdbc/HiveBaseResultSet.java
  jdbc/src/java/org/apache/hadoop/hive/jdbc/HiveCallableStatement.java
  jdbc/src/java/org/apache/hadoop/hive/jdbc/HiveConnection.java
  jdbc/src/java/org/apache/hadoop/hive/jdbc/HiveDataSource.java
  jdbc/src/java/org/apache/hadoop/hive/jdbc/HiveDatabaseMetaData.java
  jdbc/src/java/org/apache/hadoop/hive/jdbc/HiveDriver.java
  jdbc/src/java/org/apache/hadoop/hive/jdbc/HivePreparedStatement.java
  jdbc/src/java/org/apache/hadoop/hive/jdbc/HiveQueryResultSet.java
  jdbc/src/java/org/apache/hadoop/hive/jdbc/HiveStatement.java
  metastore/build.xml
  pdk/scripts/build-plugin.xml

To: cdrome, weidongbian, JIRA, ashutoshc, mbautin


> HIVE JDBC module won't compile under JDK1.7 as new methods added in JDBC 
> specification
> --
>
> Key: HIVE-3384
> URL: https://issues.apache.org/jira/browse/HIVE-3384
> Project: Hive
>  Issue Type: Bug
>  Components: JDBC
>Reporter: Weidong Bian
>Priority: Minor
> Attachments: D6873-0.9.1.patch, D6873.1.patch, D6873.2.patch, 
> D6873.3.patch, D6873.4.patch, HIVE-3384.2.patch, HIVE-3384.patch, 
> HIVE-JDK7-JDBC.patch
>
>
> jdbc module couldn't be compiled with jdk7 as it adds some abstract method in 
> the JDBC specification 
> some error info:
>  error: HiveCallableStatement is not abstract and does not override abstract
> method getObject(String,Class) in CallableStatement
> .
> .
> .

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (HIVE-3702) Renaming table changes table location scheme/authority

[Kevin Wilfong (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HIVE-3702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Kevin Wilfong updated HIVE-3702:


Attachment: HIVE-3702.2.patch.txt

> Renaming table changes table location scheme/authority
> --
>
> Key: HIVE-3702
> URL: https://issues.apache.org/jira/browse/HIVE-3702
> Project: Hive
>  Issue Type: Bug
>  Components: Metastore
>Affects Versions: 0.9.0
>Reporter: Kevin Wilfong
>Assignee: Kevin Wilfong
> Attachments: HIVE-3702.1.patch.txt, HIVE-3702.2.patch.txt
>
>
> Renaming a table changes the location of the table to the default location of 
> the database, followed by the table name.  This means that if the default 
> location of the database uses a different scheme/authority, an exception will 
> get thrown attempting to move the data.
> Instead, the table's location should be made the default location of the 
> database followed by the table name, but using the original location's scheme 
> and authority.
> This only applies for managed tables, and there is already a check to ensure 
> the new location doesn't already exist.
> This is analogous to what was done for partitions in HIVE-2875

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (HIVE-3702) Renaming table changes table location scheme/authority

[Kevin Wilfong (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HIVE-3702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Kevin Wilfong updated HIVE-3702:


Status: Patch Available  (was: Open)

Updated per comments.

> Renaming table changes table location scheme/authority
> --
>
> Key: HIVE-3702
> URL: https://issues.apache.org/jira/browse/HIVE-3702
> Project: Hive
>  Issue Type: Bug
>  Components: Metastore
>Affects Versions: 0.9.0
>Reporter: Kevin Wilfong
>Assignee: Kevin Wilfong
> Attachments: HIVE-3702.1.patch.txt, HIVE-3702.2.patch.txt
>
>
> Renaming a table changes the location of the table to the default location of 
> the database, followed by the table name.  This means that if the default 
> location of the database uses a different scheme/authority, an exception will 
> get thrown attempting to move the data.
> Instead, the table's location should be made the default location of the 
> database followed by the table name, but using the original location's scheme 
> and authority.
> This only applies for managed tables, and there is already a check to ensure 
> the new location doesn't already exist.
> This is analogous to what was done for partitions in HIVE-2875

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Build failed in Jenkins: Hive-0.9.1-SNAPSHOT-h0.21 #214

[Apache Jenkins Server]

See 

--
[...truncated 36418 lines...]
[junit] POSTHOOK: Input: default@testhivedrivertable
[junit] POSTHOOK: Output: 
file:/tmp/jenkins/hive_2012-11-29_14-03-17_428_4410577585558782764/-mr-1
[junit] OK
[junit] PREHOOK: query: drop table testhivedrivertable
[junit] PREHOOK: type: DROPTABLE
[junit] PREHOOK: Input: default@testhivedrivertable
[junit] PREHOOK: Output: default@testhivedrivertable
[junit] POSTHOOK: query: drop table testhivedrivertable
[junit] POSTHOOK: type: DROPTABLE
[junit] POSTHOOK: Input: default@testhivedrivertable
[junit] POSTHOOK: Output: default@testhivedrivertable
[junit] OK
[junit] Hive history 
file=
[junit] PREHOOK: query: drop table testhivedrivertable
[junit] PREHOOK: type: DROPTABLE
[junit] POSTHOOK: query: drop table testhivedrivertable
[junit] POSTHOOK: type: DROPTABLE
[junit] OK
[junit] PREHOOK: query: create table testhivedrivertable (num int)
[junit] PREHOOK: type: DROPTABLE
[junit] Copying file: 

[junit] POSTHOOK: query: create table testhivedrivertable (num int)
[junit] POSTHOOK: type: DROPTABLE
[junit] POSTHOOK: Output: default@testhivedrivertable
[junit] OK
[junit] PREHOOK: query: load data local inpath 
'
 into table testhivedrivertable
[junit] PREHOOK: type: DROPTABLE
[junit] PREHOOK: Output: default@testhivedrivertable
[junit] Copying data from 

[junit] Loading data to table default.testhivedrivertable
[junit] POSTHOOK: query: load data local inpath 
'
 into table testhivedrivertable
[junit] POSTHOOK: type: DROPTABLE
[junit] POSTHOOK: Output: default@testhivedrivertable
[junit] OK
[junit] PREHOOK: query: select * from testhivedrivertable limit 10
[junit] PREHOOK: type: DROPTABLE
[junit] PREHOOK: Input: default@testhivedrivertable
[junit] PREHOOK: Output: 
file:/tmp/jenkins/hive_2012-11-29_14-03-21_787_2897470774176236774/-mr-1
[junit] POSTHOOK: query: select * from testhivedrivertable limit 10
[junit] POSTHOOK: type: DROPTABLE
[junit] POSTHOOK: Input: default@testhivedrivertable
[junit] POSTHOOK: Output: 
file:/tmp/jenkins/hive_2012-11-29_14-03-21_787_2897470774176236774/-mr-1
[junit] OK
[junit] PREHOOK: query: drop table testhivedrivertable
[junit] PREHOOK: type: DROPTABLE
[junit] PREHOOK: Input: default@testhivedrivertable
[junit] PREHOOK: Output: default@testhivedrivertable
[junit] POSTHOOK: query: drop table testhivedrivertable
[junit] POSTHOOK: type: DROPTABLE
[junit] POSTHOOK: Input: default@testhivedrivertable
[junit] POSTHOOK: Output: default@testhivedrivertable
[junit] OK
[junit] Hive history 
file=
[junit] PREHOOK: query: drop table testhivedrivertable
[junit] PREHOOK: type: DROPTABLE
[junit] POSTHOOK: query: drop table testhivedrivertable
[junit] POSTHOOK: type: DROPTABLE
[junit] OK
[junit] PREHOOK: query: create table testhivedrivertable (num int)
[junit] PREHOOK: type: DROPTABLE
[junit] POSTHOOK: query: create table testhivedrivertable (num int)
[junit] POSTHOOK: type: DROPTABLE
[junit] POSTHOOK: Output: default@testhivedrivertable
[junit] OK
[junit] PREHOOK: query: drop table testhivedrivertable
[junit] PREHOOK: type: DROPTABLE
[junit] PREHOOK: Input: default@testhivedrivertable
[junit] PREHOOK: Output: default@testhivedrivertable
[junit] POSTHOOK: query: drop table testhivedrivertable
[junit] POSTHOOK: type: DROPTABLE
[junit] POSTHOOK: Input: default@testhivedrivertable
[junit] POSTHOOK: Output: default@testhivedrivertable
[junit] OK
[junit] Hive history 
file=
[junit] Hive history 
file=
[junit] PREHOOK: query: drop table testhivedrivertable
[junit] PREHOOK: type: DROPTABLE
[junit] POSTHOOK: query: drop table testhivedrivertable
[junit] POSTHOOK: type: DROPTABLE
[junit] OK
[junit] PREHOOK: query: create table testhivedrivertable (key

[jira] [Updated] (HIVE-3750) JDBCStatsPublisher fails when ID length exceeds length of ID column

[Kevin Wilfong (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HIVE-3750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Kevin Wilfong updated HIVE-3750:


Status: Patch Available  (was: Open)

> JDBCStatsPublisher fails when ID length exceeds length of ID column
> ---
>
> Key: HIVE-3750
> URL: https://issues.apache.org/jira/browse/HIVE-3750
> Project: Hive
>  Issue Type: Bug
>  Components: Statistics
>Affects Versions: 0.11
>Reporter: Kevin Wilfong
>Assignee: Kevin Wilfong
> Attachments: HIVE-3750.1.patch.txt
>
>
> When the length of the ID field passed to JDBCStatsPublisher exceeds the 
> length of the column in the table (currently 255 characters) stats collection 
> fails.  This causes the entire query to fail when hive.stats.reliable is set 
> to true.
> One way to prevent this would be to calculate a deterministic, very low 
> collision hash of the ID prefix used for aggregation and use that when the 
> length of the ID is too long.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HIVE-3750) JDBCStatsPublisher fails when ID length exceeds length of ID column

[Kevin Wilfong (JIRA)]

[ 
https://issues.apache.org/jira/browse/HIVE-3750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13506830#comment-13506830
 ] 

Kevin Wilfong commented on HIVE-3750:
-

https://reviews.facebook.net/D7017

> JDBCStatsPublisher fails when ID length exceeds length of ID column
> ---
>
> Key: HIVE-3750
> URL: https://issues.apache.org/jira/browse/HIVE-3750
> Project: Hive
>  Issue Type: Bug
>  Components: Statistics
>Affects Versions: 0.11
>Reporter: Kevin Wilfong
>Assignee: Kevin Wilfong
> Attachments: HIVE-3750.1.patch.txt
>
>
> When the length of the ID field passed to JDBCStatsPublisher exceeds the 
> length of the column in the table (currently 255 characters) stats collection 
> fails.  This causes the entire query to fail when hive.stats.reliable is set 
> to true.
> One way to prevent this would be to calculate a deterministic, very low 
> collision hash of the ID prefix used for aggregation and use that when the 
> length of the ID is too long.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (HIVE-3750) JDBCStatsPublisher fails when ID length exceeds length of ID column

[Kevin Wilfong (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HIVE-3750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Kevin Wilfong updated HIVE-3750:


Attachment: HIVE-3750.1.patch.txt

> JDBCStatsPublisher fails when ID length exceeds length of ID column
> ---
>
> Key: HIVE-3750
> URL: https://issues.apache.org/jira/browse/HIVE-3750
> Project: Hive
>  Issue Type: Bug
>  Components: Statistics
>Affects Versions: 0.11
>Reporter: Kevin Wilfong
>Assignee: Kevin Wilfong
> Attachments: HIVE-3750.1.patch.txt
>
>
> When the length of the ID field passed to JDBCStatsPublisher exceeds the 
> length of the column in the table (currently 255 characters) stats collection 
> fails.  This causes the entire query to fail when hive.stats.reliable is set 
> to true.
> One way to prevent this would be to calculate a deterministic, very low 
> collision hash of the ID prefix used for aggregation and use that when the 
> length of the ID is too long.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HIVE-2791) filter is still removed due to regression of HIVE-1538 althougth HIVE-2344

[Ankit Kamboj (JIRA)]

[ 
https://issues.apache.org/jira/browse/HIVE-2791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13506756#comment-13506756
 ] 

Ankit Kamboj commented on HIVE-2791:


Hi guys,

There is a use case I have attached: ppd-dropped-filter.q. The last 2 insert 
queries in the file contain following 'in' predicates:
where t3.crit5 in ('a' , 'b' ) and where t3.crit5 in ('c' , 'd' , 'e' )

The explain output doesn't contain Filter Operators for these 'in' predicates. 
This results in execution of incorrect query (without in clauses). 

The workaround is set hive.ppd.remove.duplicatefilters=false;

Is this use case related to this patch?

> filter is still removed due to regression of HIVE-1538 althougth HIVE-2344
> --
>
> Key: HIVE-2791
> URL: https://issues.apache.org/jira/browse/HIVE-2791
> Project: Hive
>  Issue Type: Bug
>Reporter: binlijin
>Assignee: binlijin
> Fix For: 0.9.0
>
> Attachments: HIVE-2791.2.patch, HIVE-2791.patch, ppd-dropped-filter.q
>
>


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (HIVE-2791) filter is still removed due to regression of HIVE-1538 althougth HIVE-2344

[Ankit Kamboj (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HIVE-2791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ankit Kamboj updated HIVE-2791:
---

Attachment: ppd-dropped-filter.q

> filter is still removed due to regression of HIVE-1538 althougth HIVE-2344
> --
>
> Key: HIVE-2791
> URL: https://issues.apache.org/jira/browse/HIVE-2791
> Project: Hive
>  Issue Type: Bug
>Reporter: binlijin
>Assignee: binlijin
> Fix For: 0.9.0
>
> Attachments: HIVE-2791.2.patch, HIVE-2791.patch, ppd-dropped-filter.q
>
>


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HIVE-3633) sort-merge join does not work with sub-queries

[Kevin Wilfong (JIRA)]

[ 
https://issues.apache.org/jira/browse/HIVE-3633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13506732#comment-13506732
 ] 

Kevin Wilfong commented on HIVE-3633:
-

Added a bunch of comments on the diff.  It's mostly minor things and questions 
to make sure I understand the logic.

> sort-merge join does not work with sub-queries
> --
>
> Key: HIVE-3633
> URL: https://issues.apache.org/jira/browse/HIVE-3633
> Project: Hive
>  Issue Type: Improvement
>  Components: Query Processor
>Reporter: Namit Jain
>Assignee: Namit Jain
> Attachments: hive.3633.1.patch, hive.3633.2.patch, hive.3633.3.patch, 
> hive.3633.4.patch, hive.3633.5.patch, hive.3633.6.patch, hive.3633.7.patch
>
>
> Consider the following query:
> create table smb_bucket_1(key int, value string) CLUSTERED BY (key) SORTED BY 
> (key) INTO 6 BUCKETS STORED AS TEXTFILE;
> create table smb_bucket_2(key int, value string) CLUSTERED BY (key) SORTED BY 
> (key) INTO 6 BUCKETS STORED AS TEXTFILE;
> -- load the above tables
> set hive.optimize.bucketmapjoin = true;
> set hive.optimize.bucketmapjoin.sortedmerge = true;
> set hive.input.format = 
> org.apache.hadoop.hive.ql.io.BucketizedHiveInputFormat;
> explain
> select count(*) from
> (
> select /*+mapjoin(a)*/ a.key as key1, b.key as key2, a.value as value1, 
> b.value as value2
> from smb_bucket_1 a join smb_bucket_2 b on a.key = b.key)
> subq;
> The above query does not use sort-merge join. This would be very useful as we 
> automatically convert the queries to use sorting and bucketing properties for 
> join.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Assigned] (HIVE-3650) Hive List Bucketing - validation

[Gang Tim Liu (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HIVE-3650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Gang Tim Liu reassigned HIVE-3650:
--

Assignee: Gang Tim Liu

> Hive List Bucketing - validation
> 
>
> Key: HIVE-3650
> URL: https://issues.apache.org/jira/browse/HIVE-3650
> Project: Hive
>  Issue Type: New Feature
>Affects Versions: 0.10.0
>Reporter: Gang Tim Liu
>Assignee: Gang Tim Liu
>Priority: Minor
>
> Many validations are done in each patch. This issue tracks left-over from 
> complete list
> https://cwiki.apache.org/confluence/display/Hive/ListBucketing

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Assigned] (HIVE-3642) Hive List Bucketing - optimize transform()

[Gang Tim Liu (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HIVE-3642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Gang Tim Liu reassigned HIVE-3642:
--

Assignee: Gang Tim Liu

> Hive List Bucketing - optimize transform()
> --
>
> Key: HIVE-3642
> URL: https://issues.apache.org/jira/browse/HIVE-3642
> Project: Hive
>  Issue Type: New Feature
>Reporter: Gang Tim Liu
>Assignee: Gang Tim Liu
>Priority: Minor
>
> In list bucketing transform(), we create pruning tree for each partition. 
> Although it is possible that different partitions have different skewed keys, 
> chances are that there will be a lot of overlap.
> It would be a good idea to optimize that case.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Assigned] (HIVE-3601) Hive List Bucketing - add Skewed Information to "explain extended insert overwrite"

[Gang Tim Liu (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HIVE-3601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Gang Tim Liu reassigned HIVE-3601:
--

Assignee: Gang Tim Liu

> Hive List Bucketing - add Skewed Information to "explain extended insert 
> overwrite"
> ---
>
> Key: HIVE-3601
> URL: https://issues.apache.org/jira/browse/HIVE-3601
> Project: Hive
>  Issue Type: Improvement
>Reporter: Gang Tim Liu
>Assignee: Gang Tim Liu
>Priority: Minor
>
> As we support list bucketing in DML, it will be useful for debugging to know 
> DML involve list bucketing.
> It can be added by adding skewed information to FileSinkOperator in "explain 
> extended insert overwrite"

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Assigned] (HIVE-3641) Hive List Bucketing - Query logic supports <>

[Gang Tim Liu (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HIVE-3641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Gang Tim Liu reassigned HIVE-3641:
--

Assignee: Gang Tim Liu

> Hive List Bucketing - Query logic supports <>
> -
>
> Key: HIVE-3641
> URL: https://issues.apache.org/jira/browse/HIVE-3641
> Project: Hive
>  Issue Type: New Feature
>Affects Versions: 0.10.0
>Reporter: Gang Tim Liu
>Assignee: Gang Tim Liu
>
> Hive List Bucketing - Query logic supports <>

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Created] (HIVE-3758) Failed to compile hive for hadoop 1.0.4

[Barak (JIRA)]

Barak  created HIVE-3758:


 Summary: Failed to compile hive for hadoop 1.0.4
 Key: HIVE-3758
 URL: https://issues.apache.org/jira/browse/HIVE-3758
 Project: Hive
  Issue Type: Bug
  Components: Build Infrastructure
Affects Versions: 0.9.0
Reporter: Barak 


Trying to build hive from source, I was checkout the trunk, then running:

ant very-clean package -Dhadoop.version=1.0.4 -Dhadoop-0.23.version=1.0.4 
-Dhadoop.mr.rev=23

The error I'm getting:

BUILD FAILED
/workspace/development/org/hive/trunk/build.xml:256: The following error 
occurred while executing this line:
/workspace/development/org/hive/trunk/ant/build.xml:38: 
/workspace/development/org/hive/trunk/build/ivy/lib/hadoop0.23.shim not found.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Assigned] (HIVE-3390) Hive List Bucketing - DDL support - DB upgrade script for Derby, Postgres, and Oracle

[Gang Tim Liu (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HIVE-3390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Gang Tim Liu reassigned HIVE-3390:
--

Assignee: Gang Tim Liu

> Hive List Bucketing - DDL support - DB upgrade script for Derby, Postgres, 
> and Oracle
> -
>
> Key: HIVE-3390
> URL: https://issues.apache.org/jira/browse/HIVE-3390
> Project: Hive
>  Issue Type: New Feature
>Reporter: Gang Tim Liu
>Assignee: Gang Tim Liu
>
> This is a follow-up for HIVE-3072.
> We need upgrade scripts for Derby, Postgres, and Oracle.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Assigned] (HIVE-3643) Hive List Bucketing - set hive.mapred.supports.subdirectories

[Gang Tim Liu (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HIVE-3643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Gang Tim Liu reassigned HIVE-3643:
--

Assignee: Gang Tim Liu

> Hive List Bucketing - set hive.mapred.supports.subdirectories
> -
>
> Key: HIVE-3643
> URL: https://issues.apache.org/jira/browse/HIVE-3643
> Project: Hive
>  Issue Type: New Feature
>Reporter: Gang Tim Liu
>Assignee: Gang Tim Liu
> Fix For: 0.10.0
>
>
> Once https://issues.apache.org/jira/browse/HIVE-3276 is in, the parameter
> hive.mapred.supports.subdirectories should be set for all positive tests 
> (query etc.)

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Assigned] (HIVE-3627) eclipse misses library: javolution-@javolution-version@.jar

[Gang Tim Liu (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HIVE-3627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Gang Tim Liu reassigned HIVE-3627:
--

Assignee: Gang Tim Liu

> eclipse misses library:  javolution-@javolution-version@.jar
> 
>
> Key: HIVE-3627
> URL: https://issues.apache.org/jira/browse/HIVE-3627
> Project: Hive
>  Issue Type: Bug
>  Components: Build Infrastructure
>Affects Versions: 0.10.0
>Reporter: Gang Tim Liu
>Assignee: Gang Tim Liu
>Priority: Minor
> Fix For: 0.10.0
>
> Attachments: HIVE-3627.patch.1
>
>
> After checking out the latest trunk, build eclipse project:
> ant clean package eclipse-files
> Then, import project to eclipse, you will see the error:
> Description   ResourcePathLocationType
> Project 'hive-trunk-10-26' is missing required library: 
> 'build/ivy/lib/default/javolution-@javolution-version@.jar'   
> hive-trunk-10-26Build path  Build Path Problem

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Assigned] (HIVE-3649) Hive List Bucketing - enhance DDL to specify list bucketing table

[Gang Tim Liu (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HIVE-3649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Gang Tim Liu reassigned HIVE-3649:
--

Assignee: Gang Tim Liu

> Hive List Bucketing - enhance DDL to specify list bucketing table
> -
>
> Key: HIVE-3649
> URL: https://issues.apache.org/jira/browse/HIVE-3649
> Project: Hive
>  Issue Type: New Feature
>Affects Versions: 0.10.0
>Reporter: Gang Tim Liu
>Assignee: Gang Tim Liu
> Fix For: 0.10.0
>
> Attachments: HIVE-3649.patch.4, HIVE-3649.patch.6, HIVE-3649.patch.7, 
> HIVE-3649.patch.8, HIVE-3649.patch.9
>
>
> We need to differ normal skewed table from list bucketing table. we use an 
> optional parameter "store as DIRECTORIES"
> 4 main cases:
> 1. create table  skewed by .. on .. stored as directories;
> 2. alter table  skewed by .. on .. stored as directories;
> 3. alter table  not skewed;
> 4. alter table  not stored as directories;
> details in https://cwiki.apache.org/confluence/display/Hive/ListBucketing

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Assigned] (HIVE-3696) Revert HIVE-3483 which causes performance regression

[Gang Tim Liu (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HIVE-3696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Gang Tim Liu reassigned HIVE-3696:
--

Assignee: Gang Tim Liu

> Revert HIVE-3483 which causes performance regression
> 
>
> Key: HIVE-3696
> URL: https://issues.apache.org/jira/browse/HIVE-3696
> Project: Hive
>  Issue Type: Bug
>Affects Versions: 0.10.0
>Reporter: Gang Tim Liu
>Assignee: Gang Tim Liu
>Priority: Critical
> Fix For: 0.10.0
>
> Attachments: HIVE-3696.patch.1
>
>
> HIVE-3483 causes performance regression.
> We'd like to revert it first and find another solution for it later.
> This issue is to track revert and HIVE-3693 tracks subsequent solution.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Assigned] (HIVE-3734) Static partition DML create duplicate files and records

[Gang Tim Liu (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HIVE-3734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Gang Tim Liu reassigned HIVE-3734:
--

Assignee: Gang Tim Liu

> Static partition DML create duplicate files and records
> ---
>
> Key: HIVE-3734
> URL: https://issues.apache.org/jira/browse/HIVE-3734
> Project: Hive
>  Issue Type: Bug
>  Components: Query Processor
>Affects Versions: 0.10.0
>Reporter: Gang Tim Liu
>Assignee: Gang Tim Liu
>
> Static DML create duplicate files and record.
> Given the following test case, hive will return 2 records:
> 484   val_484
> 484   val_484
> but srcpart returns one record:
> 484   val_484
> If you look at file system, DML generates duplicate file with the same 
> content:
> -rw-r--r-- 1 gang THEFACEBOOK\Domain Users 5812 Nov 21 17:55 00_0
> -rwxr-xr-x 1 gang THEFACEBOOK\Domain Users 5812 Nov 21 17:55 01_0
> Test Case
> ===
> set hive.mapred.supports.subdirectories=true;
> set hive.exec.dynamic.partition=true;
> set hive.exec.dynamic.partition.mode=nonstrict;
> set hive.input.format=org.apache.hadoop.hive.ql.io.HiveInputFormat;
> set hive.merge.mapfiles=false;
> set hive.merge.mapredfiles=false;
> set mapred.input.dir.recursive=true;
> create table testtable (key String, value String) partitioned by (ds String, 
> hr String) ;
> explain extended
> insert overwrite table testtable partition (ds='2008-04-08', hr='11') select 
> key, value from srcpart where ds='2008-04-08';
> insert overwrite table testtable partition (ds='2008-04-08', hr='11') select 
> key, value from srcpart where ds='2008-04-08';
> desc formatted testtable partition (ds='2008-04-08', hr='11');
> select count(1) from srcpart where ds='2008-04-08';
> select count(1) from testtable where ds='2008-04-08';
> select key, value from srcpart where ds='2008-04-08' and hr='11' and key = 
> "484";
> explain extended
> select key, value from testtable where ds='2008-04-08' and hr='11' and key = 
> "484";
> select key, value from testtable where ds='2008-04-08' and hr='11' and key = 
> "484";
> ===

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Assigned] (HIVE-3735) PTest doesn't work due to hive snapshot version upgrade to 11

[Gang Tim Liu (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HIVE-3735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Gang Tim Liu reassigned HIVE-3735:
--

Assignee: Gang Tim Liu

> PTest doesn't work due to hive snapshot version upgrade to 11
> -
>
> Key: HIVE-3735
> URL: https://issues.apache.org/jira/browse/HIVE-3735
> Project: Hive
>  Issue Type: Bug
>  Components: Testing Infrastructure
>Affects Versions: 0.10.0
>Reporter: Gang Tim Liu
>Assignee: Gang Tim Liu
>Priority: Critical
> Fix For: 0.10.0
>
> Attachments: HIVE-3735.patch.1
>
>
> PTest fails. Error
> ::
> [ivy:resolve] :: UNRESOLVED DEPENDENCIES ::
> [ivy:resolve] ::
> [ivy:resolve] :: org.apache.hive#hive-builtins;0.11.0-SNAPSHOT: not found
> [ivy:resolve] ::

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HIVE-3755) can't assign jira issue

[Gang Tim Liu (JIRA)]

[ 
https://issues.apache.org/jira/browse/HIVE-3755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13506709#comment-13506709
 ] 

Gang Tim Liu commented on HIVE-3755:


Hi Ashutosh,

thanks a lot

Gang

> can't assign jira issue
> ---
>
> Key: HIVE-3755
> URL: https://issues.apache.org/jira/browse/HIVE-3755
> Project: Hive
>  Issue Type: Bug
>  Components: Website
>Reporter: Gang Tim Liu
>Assignee: Ashutosh Chauhan
>Priority: Minor
>
> I can't assign jira issue even if the jira issue is created by myself.
> For example, I created Hive-3754 but "Workflow" button is greyed out so that 
> I can't assign it to myself.
> I used to be able to do so but recently not.
> Hope someone can help to check my jira previlidge or point out to me what I 
> can do.
> thanks a lot

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HIVE-3757) union_remove_9.q fails in trunk (hadoop 23)

[Gang Tim Liu (JIRA)]

[ 
https://issues.apache.org/jira/browse/HIVE-3757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13506708#comment-13506708
 ] 

Gang Tim Liu commented on HIVE-3757:


[~namit] some new codes might break your test case. Guess people don't test 
hadoop23 test cases completely.

> union_remove_9.q fails in trunk (hadoop 23)
> ---
>
> Key: HIVE-3757
> URL: https://issues.apache.org/jira/browse/HIVE-3757
> Project: Hive
>  Issue Type: Bug
>  Components: Query Processor
>Affects Versions: 0.10.0
>Reporter: Gang Tim Liu
>Assignee: Namit Jain
>
> check out the latest code from trunk
> {code}
> svn info
> {code}
> {quote}
> Path: .
> URL: http://svn.apache.org/repos/asf/hive/trunk
> Repository Root: http://svn.apache.org/repos/asf
> Repository UUID: 13f79535-47bb-0310-9956-ffa450edef68
> Revision: 1415321
> Node Kind: directory
> Schedule: normal
> Last Changed Author: hashutosh
> Last Changed Rev: 1415278
> Last Changed Date: 2012-11-29 09:11:53 -0800 (Thu, 29 Nov 2012)
> {quote}
> {code}
> ant -Dhadoop.version=0.23.3 -Dhadoop-0.23.version=0.23.3 -Dhadoop.mr.rev=23 
> test -Dtestcase=TestCliDriver -Dqfile=union_remove_9.q
> {code}
> {quote}
> [junit] diff -a 
> /Users/gang/hive-trunk-11-29/build/ql/test/logs/clientpositive/union_remove_9.q.out
>  
> /Users/gang/hive-trunk-11-29/ql/src/test/results/clientpositive/union_remove_9.q.out
> [junit] 106c106
> [junit] <   expr: UDFToLong(_col1)
> [junit] ---
> [junit] >   expr: _col1
> [junit] 109,123c109,116
> [junit] < Select Operator
> [junit] <   expressions:
> [junit] < expr: _col0
> [junit] < type: string
> [junit] < expr: _col1
> [junit] < type: bigint
> [junit] <   outputColumnNames: _col0, _col1
> [junit] <   File Output Operator
> [junit] < compressed: false
> [junit] < GlobalTableId: 1
> [junit] < table:
> [junit] < input format: 
> [junit] < output format: 
> [junit] < serde: 
> [junit] < name: default.outputtbl1
> [junit] ---
> [junit] > File Output Operator
> [junit] >   compressed: false
> [junit] >   GlobalTableId: 1
> [junit] >   table:
> [junit] >   input format: 
> [junit] >   output format: 
> [junit] >   serde: 
> [junit] >   name: default.outputtbl1
> [junit] <   expr: UDFToLong(_col1)
> [junit] ---
> [junit] >   expr: _col1
> [junit] 149,163c142,149
> [junit] < Select Operator
> [junit] <   expressions:
> [junit] < expr: _col0
> [junit] < type: string
> [junit] < expr: _col1
> [junit] < type: bigint
> [junit] <   outputColumnNames: _col0, _col1
> [junit] <   File Output Operator
> [junit] < compressed: false
> [junit] < GlobalTableId: 1
> [junit] < table:
> [junit] < input format: 
> [junit] < output format: 
> [junit] < serde: 
> [junit] < name: default.outputtbl1
> [junit] ---
> [junit] > File Output Operator
> [junit] >   compressed: false
> [junit] >   GlobalTableId: 1
> [junit] >   table:
> [junit] >   input format: 
> [junit] >   output format: 
> [junit] >   serde: 
> [junit] >   name: default.outputtbl1
> [junit] Failed query: union_remove_9.q
> {quote}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Assigned] (HIVE-3757) union_remove_9.q fails in trunk (hadoop 23)

[Gang Tim Liu (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HIVE-3757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Gang Tim Liu reassigned HIVE-3757:
--

Assignee: Namit Jain

> union_remove_9.q fails in trunk (hadoop 23)
> ---
>
> Key: HIVE-3757
> URL: https://issues.apache.org/jira/browse/HIVE-3757
> Project: Hive
>  Issue Type: Bug
>  Components: Query Processor
>Affects Versions: 0.10.0
>Reporter: Gang Tim Liu
>Assignee: Namit Jain
>
> check out the latest code from trunk
> {code}
> svn info
> {code}
> {quote}
> Path: .
> URL: http://svn.apache.org/repos/asf/hive/trunk
> Repository Root: http://svn.apache.org/repos/asf
> Repository UUID: 13f79535-47bb-0310-9956-ffa450edef68
> Revision: 1415321
> Node Kind: directory
> Schedule: normal
> Last Changed Author: hashutosh
> Last Changed Rev: 1415278
> Last Changed Date: 2012-11-29 09:11:53 -0800 (Thu, 29 Nov 2012)
> {quote}
> {code}
> ant -Dhadoop.version=0.23.3 -Dhadoop-0.23.version=0.23.3 -Dhadoop.mr.rev=23 
> test -Dtestcase=TestCliDriver -Dqfile=union_remove_9.q
> {code}
> {quote}
> [junit] diff -a 
> /Users/gang/hive-trunk-11-29/build/ql/test/logs/clientpositive/union_remove_9.q.out
>  
> /Users/gang/hive-trunk-11-29/ql/src/test/results/clientpositive/union_remove_9.q.out
> [junit] 106c106
> [junit] <   expr: UDFToLong(_col1)
> [junit] ---
> [junit] >   expr: _col1
> [junit] 109,123c109,116
> [junit] < Select Operator
> [junit] <   expressions:
> [junit] < expr: _col0
> [junit] < type: string
> [junit] < expr: _col1
> [junit] < type: bigint
> [junit] <   outputColumnNames: _col0, _col1
> [junit] <   File Output Operator
> [junit] < compressed: false
> [junit] < GlobalTableId: 1
> [junit] < table:
> [junit] < input format: 
> [junit] < output format: 
> [junit] < serde: 
> [junit] < name: default.outputtbl1
> [junit] ---
> [junit] > File Output Operator
> [junit] >   compressed: false
> [junit] >   GlobalTableId: 1
> [junit] >   table:
> [junit] >   input format: 
> [junit] >   output format: 
> [junit] >   serde: 
> [junit] >   name: default.outputtbl1
> [junit] <   expr: UDFToLong(_col1)
> [junit] ---
> [junit] >   expr: _col1
> [junit] 149,163c142,149
> [junit] < Select Operator
> [junit] <   expressions:
> [junit] < expr: _col0
> [junit] < type: string
> [junit] < expr: _col1
> [junit] < type: bigint
> [junit] <   outputColumnNames: _col0, _col1
> [junit] <   File Output Operator
> [junit] < compressed: false
> [junit] < GlobalTableId: 1
> [junit] < table:
> [junit] < input format: 
> [junit] < output format: 
> [junit] < serde: 
> [junit] < name: default.outputtbl1
> [junit] ---
> [junit] > File Output Operator
> [junit] >   compressed: false
> [junit] >   GlobalTableId: 1
> [junit] >   table:
> [junit] >   input format: 
> [junit] >   output format: 
> [junit] >   serde: 
> [junit] >   name: default.outputtbl1
> [junit] Failed query: union_remove_9.q
> {quote}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Created] (HIVE-3757) union_remove_9.q fails in trunk (hadoop 23)

[Gang Tim Liu (JIRA)]

Gang Tim Liu created HIVE-3757:
--

 Summary: union_remove_9.q fails in trunk (hadoop 23)
 Key: HIVE-3757
 URL: https://issues.apache.org/jira/browse/HIVE-3757
 Project: Hive
  Issue Type: Bug
  Components: Query Processor
Affects Versions: 0.10.0
Reporter: Gang Tim Liu


check out the latest code from trunk
{code}
svn info
{code}

{quote}
Path: .
URL: http://svn.apache.org/repos/asf/hive/trunk
Repository Root: http://svn.apache.org/repos/asf
Repository UUID: 13f79535-47bb-0310-9956-ffa450edef68
Revision: 1415321
Node Kind: directory
Schedule: normal
Last Changed Author: hashutosh
Last Changed Rev: 1415278
Last Changed Date: 2012-11-29 09:11:53 -0800 (Thu, 29 Nov 2012)
{quote}

{code}
ant -Dhadoop.version=0.23.3 -Dhadoop-0.23.version=0.23.3 -Dhadoop.mr.rev=23 
test -Dtestcase=TestCliDriver -Dqfile=union_remove_9.q
{code}

{quote}
[junit] diff -a 
/Users/gang/hive-trunk-11-29/build/ql/test/logs/clientpositive/union_remove_9.q.out
 
/Users/gang/hive-trunk-11-29/ql/src/test/results/clientpositive/union_remove_9.q.out
[junit] 106c106
[junit] <   expr: UDFToLong(_col1)
[junit] ---
[junit] >   expr: _col1
[junit] 109,123c109,116
[junit] < Select Operator
[junit] <   expressions:
[junit] < expr: _col0
[junit] < type: string
[junit] < expr: _col1
[junit] < type: bigint
[junit] <   outputColumnNames: _col0, _col1
[junit] <   File Output Operator
[junit] < compressed: false
[junit] < GlobalTableId: 1
[junit] < table:
[junit] < input format: 
[junit] < output format: 
[junit] < serde: 
[junit] < name: default.outputtbl1
[junit] ---
[junit] > File Output Operator
[junit] >   compressed: false
[junit] >   GlobalTableId: 1
[junit] >   table:
[junit] >   input format: 
[junit] >   output format: 
[junit] >   serde: 
[junit] >   name: default.outputtbl1
[junit] <   expr: UDFToLong(_col1)
[junit] ---
[junit] >   expr: _col1
[junit] 149,163c142,149
[junit] < Select Operator
[junit] <   expressions:
[junit] < expr: _col0
[junit] < type: string
[junit] < expr: _col1
[junit] < type: bigint
[junit] <   outputColumnNames: _col0, _col1
[junit] <   File Output Operator
[junit] < compressed: false
[junit] < GlobalTableId: 1
[junit] < table:
[junit] < input format: 
[junit] < output format: 
[junit] < serde: 
[junit] < name: default.outputtbl1
[junit] ---
[junit] > File Output Operator
[junit] >   compressed: false
[junit] >   GlobalTableId: 1
[junit] >   table:
[junit] >   input format: 
[junit] >   output format: 
[junit] >   serde: 
[junit] >   name: default.outputtbl1
[junit] Failed query: union_remove_9.q
{quote}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Resolved] (HIVE-3755) can't assign jira issue

[Ashutosh Chauhan (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HIVE-3755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ashutosh Chauhan resolved HIVE-3755.


Resolution: Fixed
  Assignee: Ashutosh Chauhan

Hi Gang,
I added you to the list of contributors.

> can't assign jira issue
> ---
>
> Key: HIVE-3755
> URL: https://issues.apache.org/jira/browse/HIVE-3755
> Project: Hive
>  Issue Type: Bug
>  Components: Website
>Reporter: Gang Tim Liu
>Assignee: Ashutosh Chauhan
>Priority: Minor
>
> I can't assign jira issue even if the jira issue is created by myself.
> For example, I created Hive-3754 but "Workflow" button is greyed out so that 
> I can't assign it to myself.
> I used to be able to do so but recently not.
> Hope someone can help to check my jira previlidge or point out to me what I 
> can do.
> thanks a lot

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (HIVE-3754) Trunk hadoop 23 build fails

[Ashutosh Chauhan (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HIVE-3754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ashutosh Chauhan updated HIVE-3754:
---

Assignee: Gang Tim Liu

> Trunk hadoop 23 build fails
> ---
>
> Key: HIVE-3754
> URL: https://issues.apache.org/jira/browse/HIVE-3754
> Project: Hive
>  Issue Type: Bug
>  Components: Documentation
>Reporter: Gang Tim Liu
>Assignee: Gang Tim Liu
>
> check out the latest code from trunk
> {code}
> svn info 
> {code}
> {quote}
> Path: .
> URL: http://svn.apache.org/repos/asf/hive/trunk
> Repository Root: http://svn.apache.org/repos/asf
> Repository UUID: 13f79535-47bb-0310-9956-ffa450edef68
> Revision: 1415005
> Node Kind: directory
> Schedule: normal
> Last Changed Author: namit
> Last Changed Rev: 1414608
> Last Changed Date: 2012-11-28 01:36:27 -0800 (Wed, 28 Nov 2012)
> {quote}
> {code}
> ant clean package -Dhadoop.version=0.23.1 -Dhadoop-0.23.version=0.23.1 
> -Dhadoop.mr.rev=23
> {code}
> {quote}
> ivy-retrieve-hadoop-shim:
>  [echo] Project: shims
> [javac] Compiling 2 source files to 
> /Users/gang/hive-trunk-11-28/build/shims/classes
> [javac] 
> /Users/gang/hive-trunk-11-28/shims/src/0.23/java/org/apache/hadoop/hive/shims/Hadoop23Shims.java:122:
>  getDefaultBlockSize() in org.apache.hadoop.fs.FileSystem cannot be applied 
> to (org.apache.hadoop.fs.Path)
> [javac] return fs.getDefaultBlockSize(path);
> [javac]  ^
> [javac] 
> /Users/gang/hive-trunk-11-28/shims/src/0.23/java/org/apache/hadoop/hive/shims/Hadoop23Shims.java:127:
>  getDefaultReplication() in org.apache.hadoop.fs.FileSystem cannot be applied 
> to (org.apache.hadoop.fs.Path)
> [javac] return fs.getDefaultReplication(path);
> [javac]  ^
> [javac] 2 errors
> BUILD FAILED
> /Users/gang/hive-trunk-11-28/build.xml:302: The following error occurred 
> while executing this line:
> {quote}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (HIVE-3733) Improve Hive's logic for conditional merge

[Pradeep Kamath (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HIVE-3733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Pradeep Kamath updated HIVE-3733:
-

Attachment: HIVE-3733.3.patch.txt

This is the most recent patch file - please review - I have also uploaded this 
to the review at https://reviews.facebook.net/D6969

A couple of unit tests fail:
1) testCliDriver_groupby_multi_single_reducer
This fails for me locally on trunk as well with a ClassNotFoundException for 
JSONFactory.
2) testNegativeCliDriver_stats_aggregator_error_1 
Apparently this one is known to be flakey.

Note that I needed to update union19.q.out to include the extra merge.

Please review - Thanks!

> Improve Hive's logic for conditional merge
> --
>
> Key: HIVE-3733
> URL: https://issues.apache.org/jira/browse/HIVE-3733
> Project: Hive
>  Issue Type: Improvement
>Reporter: Pradeep Kamath
>Assignee: Pradeep Kamath
> Attachments: HIVE-3733.1.patch.txt, HIVE-3733.3.patch.txt
>
>
> If the config hive.merge.mapfiles is set to true and hive.merge.mapredfiles 
> is set to false then when hive encounters a FileSinkOperator when generating 
> map reduce tasks, it will look at the entire job to see if it has a reducer, 
> if it does it will not merge. Instead it should be check if the 
> FileSinkOperator is a child of the reducer. This means that outputs generated 
> in the mapper will be merged, and outputs generated in the reducer will not 
> be, the intended effect of setting those configs.
> Simple repro:
> set hive.merge.mapfiles=true;
> set hive.merge.mapredfiles=false;
> EXPLAIN
> FROM 
> INSERT OVERWRITE TABLE  SELECT key, COUNT(*) group by key
> INSERT OVERWRITE TABLE  SELECT *;
> The output should contain a Conditional Operator, Mapred Stages, and Move 
> tasks

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HIVE-3754) Trunk hadoop 23 build fails

[Gang Tim Liu (JIRA)]

[ 
https://issues.apache.org/jira/browse/HIVE-3754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13506648#comment-13506648
 ] 

Gang Tim Liu commented on HIVE-3754:


Yes. thank Arup for follow up.

Actually, I tried 23.3 before Ashutosh's comment and it worked well :)

Ashutosh's comment confirmed my experiment and also told me another choice of 
"alpha". thank Ashutosh again for prompt comment. thanks a lot.

Again, Arup, thank you very much for prompt explanation and follow up.

> Trunk hadoop 23 build fails
> ---
>
> Key: HIVE-3754
> URL: https://issues.apache.org/jira/browse/HIVE-3754
> Project: Hive
>  Issue Type: Bug
>  Components: Documentation
>Reporter: Gang Tim Liu
>
> check out the latest code from trunk
> {code}
> svn info 
> {code}
> {quote}
> Path: .
> URL: http://svn.apache.org/repos/asf/hive/trunk
> Repository Root: http://svn.apache.org/repos/asf
> Repository UUID: 13f79535-47bb-0310-9956-ffa450edef68
> Revision: 1415005
> Node Kind: directory
> Schedule: normal
> Last Changed Author: namit
> Last Changed Rev: 1414608
> Last Changed Date: 2012-11-28 01:36:27 -0800 (Wed, 28 Nov 2012)
> {quote}
> {code}
> ant clean package -Dhadoop.version=0.23.1 -Dhadoop-0.23.version=0.23.1 
> -Dhadoop.mr.rev=23
> {code}
> {quote}
> ivy-retrieve-hadoop-shim:
>  [echo] Project: shims
> [javac] Compiling 2 source files to 
> /Users/gang/hive-trunk-11-28/build/shims/classes
> [javac] 
> /Users/gang/hive-trunk-11-28/shims/src/0.23/java/org/apache/hadoop/hive/shims/Hadoop23Shims.java:122:
>  getDefaultBlockSize() in org.apache.hadoop.fs.FileSystem cannot be applied 
> to (org.apache.hadoop.fs.Path)
> [javac] return fs.getDefaultBlockSize(path);
> [javac]  ^
> [javac] 
> /Users/gang/hive-trunk-11-28/shims/src/0.23/java/org/apache/hadoop/hive/shims/Hadoop23Shims.java:127:
>  getDefaultReplication() in org.apache.hadoop.fs.FileSystem cannot be applied 
> to (org.apache.hadoop.fs.Path)
> [javac] return fs.getDefaultReplication(path);
> [javac]  ^
> [javac] 2 errors
> BUILD FAILED
> /Users/gang/hive-trunk-11-28/build.xml:302: The following error occurred 
> while executing this line:
> {quote}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HIVE-3754) Trunk hadoop 23 build fails

[Arup Malakar (JIRA)]

[ 
https://issues.apache.org/jira/browse/HIVE-3754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13506643#comment-13506643
 ] 

Arup Malakar commented on HIVE-3754:


Gang I am assuming it is now compiling for you with the commands Ashutosh 
provided.

> Trunk hadoop 23 build fails
> ---
>
> Key: HIVE-3754
> URL: https://issues.apache.org/jira/browse/HIVE-3754
> Project: Hive
>  Issue Type: Bug
>  Components: Documentation
>Reporter: Gang Tim Liu
>
> check out the latest code from trunk
> {code}
> svn info 
> {code}
> {quote}
> Path: .
> URL: http://svn.apache.org/repos/asf/hive/trunk
> Repository Root: http://svn.apache.org/repos/asf
> Repository UUID: 13f79535-47bb-0310-9956-ffa450edef68
> Revision: 1415005
> Node Kind: directory
> Schedule: normal
> Last Changed Author: namit
> Last Changed Rev: 1414608
> Last Changed Date: 2012-11-28 01:36:27 -0800 (Wed, 28 Nov 2012)
> {quote}
> {code}
> ant clean package -Dhadoop.version=0.23.1 -Dhadoop-0.23.version=0.23.1 
> -Dhadoop.mr.rev=23
> {code}
> {quote}
> ivy-retrieve-hadoop-shim:
>  [echo] Project: shims
> [javac] Compiling 2 source files to 
> /Users/gang/hive-trunk-11-28/build/shims/classes
> [javac] 
> /Users/gang/hive-trunk-11-28/shims/src/0.23/java/org/apache/hadoop/hive/shims/Hadoop23Shims.java:122:
>  getDefaultBlockSize() in org.apache.hadoop.fs.FileSystem cannot be applied 
> to (org.apache.hadoop.fs.Path)
> [javac] return fs.getDefaultBlockSize(path);
> [javac]  ^
> [javac] 
> /Users/gang/hive-trunk-11-28/shims/src/0.23/java/org/apache/hadoop/hive/shims/Hadoop23Shims.java:127:
>  getDefaultReplication() in org.apache.hadoop.fs.FileSystem cannot be applied 
> to (org.apache.hadoop.fs.Path)
> [javac] return fs.getDefaultReplication(path);
> [javac]  ^
> [javac] 2 errors
> BUILD FAILED
> /Users/gang/hive-trunk-11-28/build.xml:302: The following error occurred 
> while executing this line:
> {quote}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Created] (HIVE-3755) can't assign jira issue

[Gang Tim Liu (JIRA)]

Gang Tim Liu created HIVE-3755:
--

 Summary: can't assign jira issue
 Key: HIVE-3755
 URL: https://issues.apache.org/jira/browse/HIVE-3755
 Project: Hive
  Issue Type: Bug
  Components: Website
Reporter: Gang Tim Liu
Priority: Minor


I can't assign jira issue even if the jira issue is created by myself.

For example, I created Hive-3754 but "Workflow" button is greyed out so that I 
can't assign it to myself.

I used to be able to do so but recently not.

Hope someone can help to check my jira previlidge or point out to me what I can 
do.

thanks a lot

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Created] (HIVE-3756) "LOAD DATA" does not honor permission inheritence

[Johndee Burks (JIRA)]

Johndee Burks created HIVE-3756:
---

 Summary: "LOAD DATA" does not honor permission inheritence
 Key: HIVE-3756
 URL: https://issues.apache.org/jira/browse/HIVE-3756
 Project: Hive
  Issue Type: Bug
  Components: Authorization, Security
Affects Versions: 0.9.0
Reporter: Johndee Burks


When a "LOAD DATA" operation is performed the resulting data in hdfs for the 
table does not maintain permission inheritance. This remains true even with the 
"hive.warehouse.subdir.inherit.perms" set to true.

The issue is easily reproducible by creating a table and loading some data into 
it. After the load is complete just do a "dfs -ls -R" on the warehouse 
directory and you will see that the inheritance of permissions worked for the 
table directory but not for the data. 

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Resolved] (HIVE-3754) Trunk hadoop 23 build fails

[Gang Tim Liu (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HIVE-3754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Gang Tim Liu resolved HIVE-3754.


Resolution: Fixed

update documentation 
https://cwiki.apache.org/confluence/display/Hive/GettingStarted

> Trunk hadoop 23 build fails
> ---
>
> Key: HIVE-3754
> URL: https://issues.apache.org/jira/browse/HIVE-3754
> Project: Hive
>  Issue Type: Bug
>  Components: Documentation
>Reporter: Gang Tim Liu
>
> check out the latest code from trunk
> {code}
> svn info 
> {code}
> {quote}
> Path: .
> URL: http://svn.apache.org/repos/asf/hive/trunk
> Repository Root: http://svn.apache.org/repos/asf
> Repository UUID: 13f79535-47bb-0310-9956-ffa450edef68
> Revision: 1415005
> Node Kind: directory
> Schedule: normal
> Last Changed Author: namit
> Last Changed Rev: 1414608
> Last Changed Date: 2012-11-28 01:36:27 -0800 (Wed, 28 Nov 2012)
> {quote}
> {code}
> ant clean package -Dhadoop.version=0.23.1 -Dhadoop-0.23.version=0.23.1 
> -Dhadoop.mr.rev=23
> {code}
> {quote}
> ivy-retrieve-hadoop-shim:
>  [echo] Project: shims
> [javac] Compiling 2 source files to 
> /Users/gang/hive-trunk-11-28/build/shims/classes
> [javac] 
> /Users/gang/hive-trunk-11-28/shims/src/0.23/java/org/apache/hadoop/hive/shims/Hadoop23Shims.java:122:
>  getDefaultBlockSize() in org.apache.hadoop.fs.FileSystem cannot be applied 
> to (org.apache.hadoop.fs.Path)
> [javac] return fs.getDefaultBlockSize(path);
> [javac]  ^
> [javac] 
> /Users/gang/hive-trunk-11-28/shims/src/0.23/java/org/apache/hadoop/hive/shims/Hadoop23Shims.java:127:
>  getDefaultReplication() in org.apache.hadoop.fs.FileSystem cannot be applied 
> to (org.apache.hadoop.fs.Path)
> [javac] return fs.getDefaultReplication(path);
> [javac]  ^
> [javac] 2 errors
> BUILD FAILED
> /Users/gang/hive-trunk-11-28/build.xml:302: The following error occurred 
> while executing this line:
> {quote}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HIVE-3754) Trunk hadoop 23 build fails

[Gang Tim Liu (JIRA)]

[ 
https://issues.apache.org/jira/browse/HIVE-3754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13506619#comment-13506619
 ] 

Gang Tim Liu commented on HIVE-3754:


[~ashutoshc] thanks. 

I will use this jira to track documentation change. I just update 
https://cwiki.apache.org/confluence/display/Hive/GettingStarted with new build 
command.

thanks

Tim

> Trunk hadoop 23 build fails
> ---
>
> Key: HIVE-3754
> URL: https://issues.apache.org/jira/browse/HIVE-3754
> Project: Hive
>  Issue Type: Bug
>  Components: Documentation
>Reporter: Gang Tim Liu
>
> check out the latest code from trunk
> {code}
> svn info 
> {code}
> {quote}
> Path: .
> URL: http://svn.apache.org/repos/asf/hive/trunk
> Repository Root: http://svn.apache.org/repos/asf
> Repository UUID: 13f79535-47bb-0310-9956-ffa450edef68
> Revision: 1415005
> Node Kind: directory
> Schedule: normal
> Last Changed Author: namit
> Last Changed Rev: 1414608
> Last Changed Date: 2012-11-28 01:36:27 -0800 (Wed, 28 Nov 2012)
> {quote}
> {code}
> ant clean package -Dhadoop.version=0.23.1 -Dhadoop-0.23.version=0.23.1 
> -Dhadoop.mr.rev=23
> {code}
> {quote}
> ivy-retrieve-hadoop-shim:
>  [echo] Project: shims
> [javac] Compiling 2 source files to 
> /Users/gang/hive-trunk-11-28/build/shims/classes
> [javac] 
> /Users/gang/hive-trunk-11-28/shims/src/0.23/java/org/apache/hadoop/hive/shims/Hadoop23Shims.java:122:
>  getDefaultBlockSize() in org.apache.hadoop.fs.FileSystem cannot be applied 
> to (org.apache.hadoop.fs.Path)
> [javac] return fs.getDefaultBlockSize(path);
> [javac]  ^
> [javac] 
> /Users/gang/hive-trunk-11-28/shims/src/0.23/java/org/apache/hadoop/hive/shims/Hadoop23Shims.java:127:
>  getDefaultReplication() in org.apache.hadoop.fs.FileSystem cannot be applied 
> to (org.apache.hadoop.fs.Path)
> [javac] return fs.getDefaultReplication(path);
> [javac]  ^
> [javac] 2 errors
> BUILD FAILED
> /Users/gang/hive-trunk-11-28/build.xml:302: The following error occurred 
> while executing this line:
> {quote}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (HIVE-3754) Trunk hadoop 23 build fails

[Gang Tim Liu (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HIVE-3754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Gang Tim Liu updated HIVE-3754:
---

Component/s: (was: Build Infrastructure)
 Documentation

> Trunk hadoop 23 build fails
> ---
>
> Key: HIVE-3754
> URL: https://issues.apache.org/jira/browse/HIVE-3754
> Project: Hive
>  Issue Type: Bug
>  Components: Documentation
>Reporter: Gang Tim Liu
>
> check out the latest code from trunk
> {code}
> svn info 
> {code}
> {quote}
> Path: .
> URL: http://svn.apache.org/repos/asf/hive/trunk
> Repository Root: http://svn.apache.org/repos/asf
> Repository UUID: 13f79535-47bb-0310-9956-ffa450edef68
> Revision: 1415005
> Node Kind: directory
> Schedule: normal
> Last Changed Author: namit
> Last Changed Rev: 1414608
> Last Changed Date: 2012-11-28 01:36:27 -0800 (Wed, 28 Nov 2012)
> {quote}
> {code}
> ant clean package -Dhadoop.version=0.23.1 -Dhadoop-0.23.version=0.23.1 
> -Dhadoop.mr.rev=23
> {code}
> {quote}
> ivy-retrieve-hadoop-shim:
>  [echo] Project: shims
> [javac] Compiling 2 source files to 
> /Users/gang/hive-trunk-11-28/build/shims/classes
> [javac] 
> /Users/gang/hive-trunk-11-28/shims/src/0.23/java/org/apache/hadoop/hive/shims/Hadoop23Shims.java:122:
>  getDefaultBlockSize() in org.apache.hadoop.fs.FileSystem cannot be applied 
> to (org.apache.hadoop.fs.Path)
> [javac] return fs.getDefaultBlockSize(path);
> [javac]  ^
> [javac] 
> /Users/gang/hive-trunk-11-28/shims/src/0.23/java/org/apache/hadoop/hive/shims/Hadoop23Shims.java:127:
>  getDefaultReplication() in org.apache.hadoop.fs.FileSystem cannot be applied 
> to (org.apache.hadoop.fs.Path)
> [javac] return fs.getDefaultReplication(path);
> [javac]  ^
> [javac] 2 errors
> BUILD FAILED
> /Users/gang/hive-trunk-11-28/build.xml:302: The following error occurred 
> while executing this line:
> {quote}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Hive-trunk-h0.21 - Build # 1825 - Still Failing

[Apache Jenkins Server]

Changes for Build #1782
[hashutosh] HIVE-2715: Upgrade Thrift dependency to 0.9.0 (Ashutosh Chauhan)


Changes for Build #1783
[kevinwilfong] HIVE-3654. block relative path access in hive. (njain via 
kevinwilfong)

[hashutosh] HIVE-3658 : Unable to generate the Hbase related unit tests using 
velocity templates on Windows (Kanna Karanam via Ashutosh Chauhan)

[hashutosh] HIVE-3661 : Remove the Windows specific = related swizzle path 
changes from Proxy FileSystems (Kanna Karanam via Ashutosh Chauhan)

[hashutosh] HIVE-3480 : : Fix the file handle leaks in Symbolic 
& Symlink related input formats. (Kanna Karanam via Ashutosh Chauhan)


Changes for Build #1784
[kevinwilfong] HIVE-3675. NaN does not work correctly for round(n). (njain via 
kevinwilfong)

[cws] HIVE-3651. bucketmapjoin?.q tests fail with hadoop 0.23 (Prasad Mujumdar 
via cws)


Changes for Build #1785
[namit] HIVE-3613 Implement grouping_id function
(Ian Gorbachev via namit)

[namit] HIVE-3692 Update parallel test documentation
(Ivan Gorbachev via namit)

[namit] HIVE-3649 Hive List Bucketing - enhance DDL to specify list bucketing 
table
(Gang Tim Liu via namit)


Changes for Build #1786
[namit] HIVE-3696 Revert HIVE-3483 which causes performance regression
(Gang Tim Liu via namit)


Changes for Build #1787
[kevinwilfong] HIVE-3621. Make prompt in Hive CLI configurable. (Jingwei Lu via 
kevinwilfong)

[kevinwilfong] HIVE-3695. TestParse breaks due to HIVE-3675. (njain via 
kevinwilfong)


Changes for Build #1788
[kevinwilfong] HIVE-3557. Access to external URLs in hivetest.py. (Ivan 
Gorbachev via kevinwilfong)


Changes for Build #1789
[hashutosh] HIVE-3662 : TestHiveServer: testScratchDirShouldClearWhileStartup 
is failing on Windows (Kanna Karanam via Ashutosh Chauhan)

[hashutosh] HIVE-3659 : TestHiveHistory::testQueryloglocParentDirNotExist Test 
fails on Windows because of some resource leaks in ZK (Kanna Karanam via 
Ashutosh Chauhan)

[hashutosh] HIVE-3663 Unable to display the MR Job file path on Windows in case 
of MR job failures.  (Kanna Karanam via Ashutosh Chauhan)


Changes for Build #1790

Changes for Build #1791

Changes for Build #1792

Changes for Build #1793
[hashutosh] HIVE-3704 : name of some metastore scripts are not per convention 
(Ashutosh Chauhan)


Changes for Build #1794
[hashutosh] HIVE-3243 : ignore white space between entries of hive/hbase table 
mapping (Shengsheng Huang via Ashutosh Chauhan)

[hashutosh] HIVE-3215 : JobDebugger should use RunningJob.getTrackingURL 
(Bhushan Mandhani via Ashutosh Chauhan)


Changes for Build #1795
[cws] HIVE-3437. 0.23 compatibility: fix unit tests when building against 0.23 
(Chris Drome via cws)

[hashutosh] HIVE-3626 : RetryingHMSHandler should wrap JDOException inside 
MetaException (Bhushan Mandhani via Ashutosh Chauhan)

[hashutosh] HIVE-3560 : Hive always prints a warning message when using remote 
metastore (Travis Crawford via Ashutosh Chauhan)


Changes for Build #1796

Changes for Build #1797
[hashutosh] HIVE-3664 : Avoid to create a symlink for hive-contrib.jar file in 
dist\lib folder. (Kanna Karanam via Ashutosh Chauhan)


Changes for Build #1798
[namit] HIVE-3706 getBoolVar in FileSinkOperator can be optimized
(Kevin Wilfong via namit)

[namit] HIVE-3707 Round map/reduce progress down when it is in the range [99.5, 
100)
(Kevin Wilfong via namit)

[namit] HIVE-3471 Implement grouping sets in hive
(Ivan Gorbachev via namit)


Changes for Build #1799
[hashutosh] HIVE-3291 : fix fs resolvers (Ashish Singh via Ashutosh Chauhan)

[hashutosh] HIVE-3680 : Include Table information in Hive's AddPartitionEvent. 
(Mithun Radhakrishnan via Ashutosh Chauhan)


Changes for Build #1800
[hashutosh] HIVE-3520 : ivysettings.xml does not let you override 
.m2/repository (Raja Aluri via Ashutosh Chauhan)

[hashutosh] HIVE-3435 : Get pdk pluginTest passed when triggered from both 
builtin tests and pdk tests on hadoop23  (Zhenxiao Luo via Ashutosh Chauhan)


Changes for Build #1801

Changes for Build #1802

Changes for Build #1803

Changes for Build #1804

Changes for Build #1805

Changes for Build #1806
[hashutosh] Preparing for 0.11 development

[kevinwilfong] HIVE-3647. map-side groupby wrongly due to HIVE-3432. (njain via 
kevinwilfong)


Changes for Build #1807
[kevinwilfong] HIVE-3679. Unescape partition names returned by show partitions. 
(Wonho Kim via kevinwilfong)


Changes for Build #1808
[kevinwilfong] Remove extra files accidentally committed with HIVE-3679. 
(kevinwilfong)


Changes for Build #1809

Changes for Build #1810

Changes for Build #1811
[namit] HIVE-3735 PTest doesn't work due to hive snapshot version upgrade to 11
(Gang Tim Liu via namit)

[namit] HIVE-3722 Create index fails on CLI using remote metastore
(Kevin Wilfong via namit)


Changes for Build #1812
[namit] HIVE-3703 Hive Query Explain Plan JSON not being created properly
(Mayank Garg via namit)

[namit] HIVE-3721 ALTER TABLE ADD PARTS should check for valid partition spec 
and throw a SemanticExc

[jira] [Commented] (HIVE-3693) Performance regression introduced by HIVE-3483

[Hudson (JIRA)]

[ 
https://issues.apache.org/jira/browse/HIVE-3693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13506608#comment-13506608
 ] 

Hudson commented on HIVE-3693:
--

Integrated in Hive-trunk-h0.21 #1825 (See 
[https://builds.apache.org/job/Hive-trunk-h0.21/1825/])
HIVE-3693 : Performance regression introduced by HIVE-3483 (Thejas Nair via 
Ashutosh Chauhan) (Revision 1415098)

 Result = FAILURE
hashutosh : 
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1415098
Files : 
* 
/hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/io/CombineHiveInputFormat.java


> Performance regression introduced by HIVE-3483
> --
>
> Key: HIVE-3693
> URL: https://issues.apache.org/jira/browse/HIVE-3693
> Project: Hive
>  Issue Type: Bug
>Reporter: Gang Tim Liu
>Assignee: Thejas M Nair
>Priority: Minor
> Fix For: 0.10.0
>
> Attachments: HIVE-3693.1.patch
>
>
> https://issues.apache.org/jira/browse/HIVE-3483 introduced a performance 
> regression in the client side during split computation.
> The client side spends a lot more time in the split computation phase. The 
> problem is checkFilterPathContains method.
> While investigating, can you create a config to disable it by default?
> thanks

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HIVE-3483) joins using partitioned table give incorrect results on windows

[Hudson (JIRA)]

[ 
https://issues.apache.org/jira/browse/HIVE-3483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13506607#comment-13506607
 ] 

Hudson commented on HIVE-3483:
--

Integrated in Hive-trunk-h0.21 #1825 (See 
[https://builds.apache.org/job/Hive-trunk-h0.21/1825/])
HIVE-3693 : Performance regression introduced by HIVE-3483 (Thejas Nair via 
Ashutosh Chauhan) (Revision 1415098)

 Result = FAILURE
hashutosh : 
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1415098
Files : 
* 
/hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/io/CombineHiveInputFormat.java


> joins using partitioned table give incorrect results on windows 
> 
>
> Key: HIVE-3483
> URL: https://issues.apache.org/jira/browse/HIVE-3483
> Project: Hive
>  Issue Type: Bug
>Affects Versions: 0.9.0
>Reporter: Thejas M Nair
>Assignee: Thejas M Nair
> Fix For: 0.10.0
>
> Attachments: HIVE-3483.1.patch, HIVE-3483.2.patch
>
>
> Hive CombineFilter.getSplits returns single split instead of multiple splits 
> on windows. The comparison in CombineFilter.accept() was using paths 
> converted to strings instead of using Paths themselves, and one of the 
> strings had "/C:" and other had "C:" .
> The tests that are affected by this issue include - 
> auto_join18.q,auto_join18_multi_distinct.q,
> join18.q,join18_multi_distinct.q,ppd_union_view.q,create_view.q and union20.q

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HIVE-3754) Trunk hadoop 23 build fails

[Ashutosh Chauhan (JIRA)]

[ 
https://issues.apache.org/jira/browse/HIVE-3754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13506596#comment-13506596
 ] 

Ashutosh Chauhan commented on HIVE-3754:


You can use either of 
{code}
ant clean package -Dhadoop.version=0.23.3 -Dhadoop-0.23.version=0.23.3 
-Dhadoop.mr.rev=23
ant clean package -Dhadoop.version=2.0.0-alpha 
-Dhadoop-0.23.version=2.0.0-alpha -Dhadoop.mr.rev=23
{code}

> Trunk hadoop 23 build fails
> ---
>
> Key: HIVE-3754
> URL: https://issues.apache.org/jira/browse/HIVE-3754
> Project: Hive
>  Issue Type: Bug
>  Components: Build Infrastructure
>Reporter: Gang Tim Liu
>
> check out the latest code from trunk
> {code}
> svn info 
> {code}
> {quote}
> Path: .
> URL: http://svn.apache.org/repos/asf/hive/trunk
> Repository Root: http://svn.apache.org/repos/asf
> Repository UUID: 13f79535-47bb-0310-9956-ffa450edef68
> Revision: 1415005
> Node Kind: directory
> Schedule: normal
> Last Changed Author: namit
> Last Changed Rev: 1414608
> Last Changed Date: 2012-11-28 01:36:27 -0800 (Wed, 28 Nov 2012)
> {quote}
> {code}
> ant clean package -Dhadoop.version=0.23.1 -Dhadoop-0.23.version=0.23.1 
> -Dhadoop.mr.rev=23
> {code}
> {quote}
> ivy-retrieve-hadoop-shim:
>  [echo] Project: shims
> [javac] Compiling 2 source files to 
> /Users/gang/hive-trunk-11-28/build/shims/classes
> [javac] 
> /Users/gang/hive-trunk-11-28/shims/src/0.23/java/org/apache/hadoop/hive/shims/Hadoop23Shims.java:122:
>  getDefaultBlockSize() in org.apache.hadoop.fs.FileSystem cannot be applied 
> to (org.apache.hadoop.fs.Path)
> [javac] return fs.getDefaultBlockSize(path);
> [javac]  ^
> [javac] 
> /Users/gang/hive-trunk-11-28/shims/src/0.23/java/org/apache/hadoop/hive/shims/Hadoop23Shims.java:127:
>  getDefaultReplication() in org.apache.hadoop.fs.FileSystem cannot be applied 
> to (org.apache.hadoop.fs.Path)
> [javac] return fs.getDefaultReplication(path);
> [javac]  ^
> [javac] 2 errors
> BUILD FAILED
> /Users/gang/hive-trunk-11-28/build.xml:302: The following error occurred 
> while executing this line:
> {quote}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HIVE-3754) Trunk hadoop 23 build fails

[Gang Tim Liu (JIRA)]

[ 
https://issues.apache.org/jira/browse/HIVE-3754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13506590#comment-13506590
 ] 

Gang Tim Liu commented on HIVE-3754:


Hi Arup

Thank you for explanation.

What ant command should we use for Hadoop 23 build after jira 3645?

Thanks





> Trunk hadoop 23 build fails
> ---
>
> Key: HIVE-3754
> URL: https://issues.apache.org/jira/browse/HIVE-3754
> Project: Hive
>  Issue Type: Bug
>  Components: Build Infrastructure
>Reporter: Gang Tim Liu
>
> check out the latest code from trunk
> {code}
> svn info 
> {code}
> {quote}
> Path: .
> URL: http://svn.apache.org/repos/asf/hive/trunk
> Repository Root: http://svn.apache.org/repos/asf
> Repository UUID: 13f79535-47bb-0310-9956-ffa450edef68
> Revision: 1415005
> Node Kind: directory
> Schedule: normal
> Last Changed Author: namit
> Last Changed Rev: 1414608
> Last Changed Date: 2012-11-28 01:36:27 -0800 (Wed, 28 Nov 2012)
> {quote}
> {code}
> ant clean package -Dhadoop.version=0.23.1 -Dhadoop-0.23.version=0.23.1 
> -Dhadoop.mr.rev=23
> {code}
> {quote}
> ivy-retrieve-hadoop-shim:
>  [echo] Project: shims
> [javac] Compiling 2 source files to 
> /Users/gang/hive-trunk-11-28/build/shims/classes
> [javac] 
> /Users/gang/hive-trunk-11-28/shims/src/0.23/java/org/apache/hadoop/hive/shims/Hadoop23Shims.java:122:
>  getDefaultBlockSize() in org.apache.hadoop.fs.FileSystem cannot be applied 
> to (org.apache.hadoop.fs.Path)
> [javac] return fs.getDefaultBlockSize(path);
> [javac]  ^
> [javac] 
> /Users/gang/hive-trunk-11-28/shims/src/0.23/java/org/apache/hadoop/hive/shims/Hadoop23Shims.java:127:
>  getDefaultReplication() in org.apache.hadoop.fs.FileSystem cannot be applied 
> to (org.apache.hadoop.fs.Path)
> [javac] return fs.getDefaultReplication(path);
> [javac]  ^
> [javac] 2 errors
> BUILD FAILED
> /Users/gang/hive-trunk-11-28/build.xml:302: The following error occurred 
> while executing this line:
> {quote}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Build failed in Jenkins: Hive-0.9.1-SNAPSHOT-h0.21-keepgoing=false #214

[Apache Jenkins Server]

See 


--
[...truncated 9912 lines...]

compile-test:
 [echo] Project: serde
[javac] Compiling 26 source files to 

[javac] Note: Some input files use or override a deprecated API.
[javac] Note: Recompile with -Xlint:deprecation for details.
[javac] Note: Some input files use unchecked or unsafe operations.
[javac] Note: Recompile with -Xlint:unchecked for details.

create-dirs:
 [echo] Project: service
 [copy] Warning: 

 does not exist.

init:
 [echo] Project: service

ivy-init-settings:
 [echo] Project: service

ivy-resolve:
 [echo] Project: service
[ivy:resolve] :: loading settings :: file = 

[ivy:report] Processing 

 to 


ivy-retrieve:
 [echo] Project: service

compile:
 [echo] Project: service

ivy-resolve-test:
 [echo] Project: service

ivy-retrieve-test:
 [echo] Project: service

compile-test:
 [echo] Project: service
[javac] Compiling 2 source files to 


test:
 [echo] Project: hive

test-shims:
 [echo] Project: hive

test-conditions:
 [echo] Project: shims

gen-test:
 [echo] Project: shims

create-dirs:
 [echo] Project: shims
 [copy] Warning: 

 does not exist.

init:
 [echo] Project: shims

ivy-init-settings:
 [echo] Project: shims

ivy-resolve:
 [echo] Project: shims
[ivy:resolve] :: loading settings :: file = 

[ivy:report] Processing 

 to 


ivy-retrieve:
 [echo] Project: shims

compile:
 [echo] Project: shims
 [echo] Building shims 0.20

build_shims:
 [echo] Project: shims
 [echo] Compiling 

 against hadoop 0.20.2 
(

ivy-init-settings:
 [echo] Project: shims

ivy-resolve-hadoop-shim:
 [echo] Project: shims
[ivy:resolve] :: loading settings :: file = 


ivy-retrieve-hadoop-shim:
 [echo] Project: shims
 [echo] Building shims 0.20S

build_shims:
 [echo] Project: shims
 [echo] Compiling 

 against hadoop 1.0.0 
(

ivy-init-settings:
 [echo] Project: shims

ivy-resolve-hadoop-shim:
 [echo] Project: shims
[ivy:resolve] :: loading settings :: file = 


ivy-retrieve-hadoop-shim:
 [echo] Project: shims
 [echo] Building shims 0.23

build_shims:
 [echo] Project: shims
 [echo] Compiling 

 against hadoop 0.23.3 
(

Hive-trunk-h0.21 - Build # 1824 - Still Failing

[Apache Jenkins Server]

Changes for Build #1781
[namit] HIVE-3687 smb_mapjoin_13.q is nondeterministic
(Kevin Wilfong via namit)


Changes for Build #1782
[hashutosh] HIVE-2715: Upgrade Thrift dependency to 0.9.0 (Ashutosh Chauhan)


Changes for Build #1783
[kevinwilfong] HIVE-3654. block relative path access in hive. (njain via 
kevinwilfong)

[hashutosh] HIVE-3658 : Unable to generate the Hbase related unit tests using 
velocity templates on Windows (Kanna Karanam via Ashutosh Chauhan)

[hashutosh] HIVE-3661 : Remove the Windows specific = related swizzle path 
changes from Proxy FileSystems (Kanna Karanam via Ashutosh Chauhan)

[hashutosh] HIVE-3480 : : Fix the file handle leaks in Symbolic 
& Symlink related input formats. (Kanna Karanam via Ashutosh Chauhan)


Changes for Build #1784
[kevinwilfong] HIVE-3675. NaN does not work correctly for round(n). (njain via 
kevinwilfong)

[cws] HIVE-3651. bucketmapjoin?.q tests fail with hadoop 0.23 (Prasad Mujumdar 
via cws)


Changes for Build #1785
[namit] HIVE-3613 Implement grouping_id function
(Ian Gorbachev via namit)

[namit] HIVE-3692 Update parallel test documentation
(Ivan Gorbachev via namit)

[namit] HIVE-3649 Hive List Bucketing - enhance DDL to specify list bucketing 
table
(Gang Tim Liu via namit)


Changes for Build #1786
[namit] HIVE-3696 Revert HIVE-3483 which causes performance regression
(Gang Tim Liu via namit)


Changes for Build #1787
[kevinwilfong] HIVE-3621. Make prompt in Hive CLI configurable. (Jingwei Lu via 
kevinwilfong)

[kevinwilfong] HIVE-3695. TestParse breaks due to HIVE-3675. (njain via 
kevinwilfong)


Changes for Build #1788
[kevinwilfong] HIVE-3557. Access to external URLs in hivetest.py. (Ivan 
Gorbachev via kevinwilfong)


Changes for Build #1789
[hashutosh] HIVE-3662 : TestHiveServer: testScratchDirShouldClearWhileStartup 
is failing on Windows (Kanna Karanam via Ashutosh Chauhan)

[hashutosh] HIVE-3659 : TestHiveHistory::testQueryloglocParentDirNotExist Test 
fails on Windows because of some resource leaks in ZK (Kanna Karanam via 
Ashutosh Chauhan)

[hashutosh] HIVE-3663 Unable to display the MR Job file path on Windows in case 
of MR job failures.  (Kanna Karanam via Ashutosh Chauhan)


Changes for Build #1790

Changes for Build #1791

Changes for Build #1792

Changes for Build #1793
[hashutosh] HIVE-3704 : name of some metastore scripts are not per convention 
(Ashutosh Chauhan)


Changes for Build #1794
[hashutosh] HIVE-3243 : ignore white space between entries of hive/hbase table 
mapping (Shengsheng Huang via Ashutosh Chauhan)

[hashutosh] HIVE-3215 : JobDebugger should use RunningJob.getTrackingURL 
(Bhushan Mandhani via Ashutosh Chauhan)


Changes for Build #1795
[cws] HIVE-3437. 0.23 compatibility: fix unit tests when building against 0.23 
(Chris Drome via cws)

[hashutosh] HIVE-3626 : RetryingHMSHandler should wrap JDOException inside 
MetaException (Bhushan Mandhani via Ashutosh Chauhan)

[hashutosh] HIVE-3560 : Hive always prints a warning message when using remote 
metastore (Travis Crawford via Ashutosh Chauhan)


Changes for Build #1796

Changes for Build #1797
[hashutosh] HIVE-3664 : Avoid to create a symlink for hive-contrib.jar file in 
dist\lib folder. (Kanna Karanam via Ashutosh Chauhan)


Changes for Build #1798
[namit] HIVE-3706 getBoolVar in FileSinkOperator can be optimized
(Kevin Wilfong via namit)

[namit] HIVE-3707 Round map/reduce progress down when it is in the range [99.5, 
100)
(Kevin Wilfong via namit)

[namit] HIVE-3471 Implement grouping sets in hive
(Ivan Gorbachev via namit)


Changes for Build #1799
[hashutosh] HIVE-3291 : fix fs resolvers (Ashish Singh via Ashutosh Chauhan)

[hashutosh] HIVE-3680 : Include Table information in Hive's AddPartitionEvent. 
(Mithun Radhakrishnan via Ashutosh Chauhan)


Changes for Build #1800
[hashutosh] HIVE-3520 : ivysettings.xml does not let you override 
.m2/repository (Raja Aluri via Ashutosh Chauhan)

[hashutosh] HIVE-3435 : Get pdk pluginTest passed when triggered from both 
builtin tests and pdk tests on hadoop23  (Zhenxiao Luo via Ashutosh Chauhan)


Changes for Build #1801

Changes for Build #1802

Changes for Build #1803

Changes for Build #1804

Changes for Build #1805

Changes for Build #1806
[hashutosh] Preparing for 0.11 development

[kevinwilfong] HIVE-3647. map-side groupby wrongly due to HIVE-3432. (njain via 
kevinwilfong)


Changes for Build #1807
[kevinwilfong] HIVE-3679. Unescape partition names returned by show partitions. 
(Wonho Kim via kevinwilfong)


Changes for Build #1808
[kevinwilfong] Remove extra files accidentally committed with HIVE-3679. 
(kevinwilfong)


Changes for Build #1809

Changes for Build #1810

Changes for Build #1811
[namit] HIVE-3735 PTest doesn't work due to hive snapshot version upgrade to 11
(Gang Tim Liu via namit)

[namit] HIVE-3722 Create index fails on CLI using remote metastore
(Kevin Wilfong via namit)


Changes for Build #1812
[namit] HIVE-3703 Hive Query Explain Plan JSON not being created properly
(Mayank Garg via nam

[jira] [Commented] (HIVE-3709) Stop storing default ConfVars in temp file

[Hudson (JIRA)]

[ 
https://issues.apache.org/jira/browse/HIVE-3709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13506407#comment-13506407
 ] 

Hudson commented on HIVE-3709:
--

Integrated in Hive-trunk-h0.21 #1824 (See 
[https://builds.apache.org/job/Hive-trunk-h0.21/1824/])
HIVE-3709. Stop storing default ConfVars in temp file (Kevin Wilfong via 
cws) (Revision 1415038)

 Result = FAILURE
cws : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1415038
Files : 
* /hive/trunk/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java
* 
/hive/trunk/common/src/java/org/apache/hadoop/hive/conf/LoopingByteArrayInputStream.java


> Stop storing default ConfVars in temp file
> --
>
> Key: HIVE-3709
> URL: https://issues.apache.org/jira/browse/HIVE-3709
> Project: Hive
>  Issue Type: Improvement
>  Components: Configuration
>Affects Versions: 0.10.0
>Reporter: Kevin Wilfong
>Assignee: Kevin Wilfong
> Fix For: 0.11
>
> Attachments: HIVE-3709.1.patch.txt, HIVE-3709.2.patch.txt, 
> HIVE-3709.3.patch.txt
>
>
> To work around issues with Hadoop's Configuration object, specifically it's 
> addResource(InputStream), default configurations are written to a temp file 
> (I think HIVE-2362 introduced this).
> This, however, introduces the problem that once that file is deleted from 
> /tmp the client crashes.  This is particularly problematic for long running 
> services like the metastore server.
> Writing a custom InputStream to deal with the problems in the Configuration 
> object should provide a work around, which does not introduce a time bomb 
> into Hive.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HIVE-1555) JDBC Storage Handler

[Jakub Holy (JIRA)]

[ 
https://issues.apache.org/jira/browse/HIVE-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13506366#comment-13506366
 ] 

Jakub Holy commented on HIVE-1555:
--

Can I help in any way to get this into trunk?

> JDBC Storage Handler
> 
>
> Key: HIVE-1555
> URL: https://issues.apache.org/jira/browse/HIVE-1555
> Project: Hive
>  Issue Type: New Feature
>  Components: JDBC
>Reporter: Bob Robertson
>Assignee: Andrew Wilson
> Attachments: JDBCStorageHandler Design Doc.pdf
>
>   Original Estimate: 24h
>  Remaining Estimate: 24h
>
> With the Cassandra and HBase Storage Handlers I thought it would make sense 
> to include a generic JDBC RDBMS Storage Handler so that you could import a 
> standard DB table into Hive. Many people must want to perform HiveQL joins, 
> etc against tables in other systems etc.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HIVE-3631) script_pipe.q fails when using JDK7

[Ashutosh Chauhan (JIRA)]

[ 
https://issues.apache.org/jira/browse/HIVE-3631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13506358#comment-13506358
 ] 

Ashutosh Chauhan commented on HIVE-3631:


+1 will commit if tests pass.

> script_pipe.q fails when using JDK7
> ---
>
> Key: HIVE-3631
> URL: https://issues.apache.org/jira/browse/HIVE-3631
> Project: Hive
>  Issue Type: Bug
>  Components: Tests
>Affects Versions: 0.10.0, 0.9.1
>Reporter: Chris Drome
>Assignee: Chris Drome
> Attachments: HIVE-3631-0.9.patch, HIVE-3631-trunk.patch
>
>
> Hive Runtime Error while closing operators: Hit error while closing ..
> The MR job fails on this test. Unfortunately, the exception is not all that 
> helpful.
> I tracked this down to a class which attempts to close a stream that is 
> already closed. Broken pipe exceptions are caught and not propagated further, 
> but stream closed exception are not caught.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (HIVE-3693) Performance regression introduced by HIVE-3483

[Ashutosh Chauhan (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HIVE-3693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ashutosh Chauhan updated HIVE-3693:
---

   Resolution: Fixed
Fix Version/s: 0.10.0
   Status: Resolved  (was: Patch Available)

Committed to trunk and 0.10. Thanks, Thejas!

> Performance regression introduced by HIVE-3483
> --
>
> Key: HIVE-3693
> URL: https://issues.apache.org/jira/browse/HIVE-3693
> Project: Hive
>  Issue Type: Bug
>Reporter: Gang Tim Liu
>Assignee: Thejas M Nair
>Priority: Minor
> Fix For: 0.10.0
>
> Attachments: HIVE-3693.1.patch
>
>
> https://issues.apache.org/jira/browse/HIVE-3483 introduced a performance 
> regression in the client side during split computation.
> The client side spends a lot more time in the split computation phase. The 
> problem is checkFilterPathContains method.
> While investigating, can you create a config to disable it by default?
> thanks

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HIVE-3612) RetryingHMSHandler should retry on MetaExceptions if the cause was a JDOException

[Ashutosh Chauhan (JIRA)]

[ 
https://issues.apache.org/jira/browse/HIVE-3612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13506345#comment-13506345
 ] 

Ashutosh Chauhan commented on HIVE-3612:


Is there an easy way to write a test-case for this to avoid regressions?

> RetryingHMSHandler should retry on MetaExceptions if the cause was a 
> JDOException
> -
>
> Key: HIVE-3612
> URL: https://issues.apache.org/jira/browse/HIVE-3612
> Project: Hive
>  Issue Type: Improvement
>  Components: Metastore
>Affects Versions: 0.10.0
>Reporter: Kevin Wilfong
>Assignee: Jean Xu
>
> The RetryingHMSHandler would be much more effective if it retried on 
> MetaExceptions wrapped around JDOExceptions.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HIVE-3724) Metastore tests use hardcoded ports

[Ashutosh Chauhan (JIRA)]

[ 
https://issues.apache.org/jira/browse/HIVE-3724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13506340#comment-13506340
 ] 

Ashutosh Chauhan commented on HIVE-3724:


We can reuse MetaStoreUtils::startMetaStore() for some of this refactoring 
which has a nice property of not waiting for fixed amount of time. See, its 
usage in TestMetaStoreAuthorization::testMetaStoreAuthorization.

> Metastore tests use hardcoded ports
> ---
>
> Key: HIVE-3724
> URL: https://issues.apache.org/jira/browse/HIVE-3724
> Project: Hive
>  Issue Type: Bug
>  Components: Tests
>Affects Versions: 0.10.0
>Reporter: Kevin Wilfong
>Assignee: Kevin Wilfong
>Priority: Minor
> Attachments: HIVE-3724.1.patch.txt
>
>
> Several of the metastore tests use hardcoded ports for remote metastore 
> Thrift servers.  This is causing transient failures in Jenkins, e.g. 
> https://builds.apache.org/job/Hive-trunk-h0.21/1804/
> A few tests already dynamically determine free ports, and this logic can be 
> shared.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (HIVE-3724) Metastore tests use hardcoded ports

[Ashutosh Chauhan (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HIVE-3724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ashutosh Chauhan updated HIVE-3724:
---

Status: Open  (was: Patch Available)

> Metastore tests use hardcoded ports
> ---
>
> Key: HIVE-3724
> URL: https://issues.apache.org/jira/browse/HIVE-3724
> Project: Hive
>  Issue Type: Bug
>  Components: Tests
>Affects Versions: 0.10.0
>Reporter: Kevin Wilfong
>Assignee: Kevin Wilfong
>Priority: Minor
> Attachments: HIVE-3724.1.patch.txt
>
>
> Several of the metastore tests use hardcoded ports for remote metastore 
> Thrift servers.  This is causing transient failures in Jenkins, e.g. 
> https://builds.apache.org/job/Hive-trunk-h0.21/1804/
> A few tests already dynamically determine free ports, and this logic can be 
> shared.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HIVE-3384) HIVE JDBC module won't compile under JDK1.7 as new methods added in JDBC specification

[Phabricator (JIRA)]

[ 
https://issues.apache.org/jira/browse/HIVE-3384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13506334#comment-13506334
 ] 

Phabricator commented on HIVE-3384:
---

ashutoshc has requested changes to the revision "[jira] [HIVE-3384] HIVE JDBC 
module won't compile under JDK1.7 as new methods added in JDBC specification".

  One more comment. Patch looks good otherwise.

INLINE COMMENTS
  build-common.xml:440 Instead of hardcoding jvmarg I will suggest to define a 
variable here $jvm.args and add it in build.properties with default value set 
to -XX:-UseSplitVerifier that way folks can override this value if they want 
(e.g. for non-Oracle jdks)
  metastore/build.xml:106 Instead of hardcoding jvmarg I will suggest to define 
a variable here $jvm.args and add it in build.properties with default value set 
to -XX:-UseSplitVerifier that way folks can override this value if they want 
(e.g. for non-Oracle jdks)

REVISION DETAIL
  https://reviews.facebook.net/D6873

BRANCH
  trunk-hive-3384-jdbc-compilation-on-jdk7

To: cdrome, weidongbian, JIRA, ashutoshc, mbautin


> HIVE JDBC module won't compile under JDK1.7 as new methods added in JDBC 
> specification
> --
>
> Key: HIVE-3384
> URL: https://issues.apache.org/jira/browse/HIVE-3384
> Project: Hive
>  Issue Type: Bug
>  Components: JDBC
>Reporter: Weidong Bian
>Priority: Minor
> Attachments: D6873-0.9.1.patch, D6873.1.patch, D6873.2.patch, 
> D6873.3.patch, HIVE-3384.2.patch, HIVE-3384.patch, HIVE-JDK7-JDBC.patch
>
>
> jdbc module couldn't be compiled with jdk7 as it adds some abstract method in 
> the JDBC specification 
> some error info:
>  error: HiveCallableStatement is not abstract and does not override abstract
> method getObject(String,Class) in CallableStatement
> .
> .
> .

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (HIVE-2902) undefined property exists in eclipse-templates/.classpath

[Ashutosh Chauhan (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HIVE-2902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ashutosh Chauhan updated HIVE-2902:
---

Resolution: Not A Problem
Status: Resolved  (was: Patch Available)

No longer a problem on trunk.

> undefined property exists in eclipse-templates/.classpath
> -
>
> Key: HIVE-2902
> URL: https://issues.apache.org/jira/browse/HIVE-2902
> Project: Hive
>  Issue Type: Bug
>  Components: Build Infrastructure
>Reporter: tamtam180
>Assignee: tamtam180
>Priority: Minor
> Attachments: HIVE-2902.1.patch.txt, HIVE-2902.2.patch.txt, 
> HIVE-2902.3.patch.txt
>
>
> @hbase-test.version@ was removed from ivy/libraries.properties in HIVE-2748,
> but the property still exists in eclipse-templates/.classpath.
> {code}
> 
>  path="build/ivy/lib/default/hbase-@hbase-test.vers...@-tests.jar"/>
> {code}
> It should be changed to @hbase.version@

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira