[jira] Commented: (HIVE-1538) FilterOperator is applied twice with ppd on.

[Amareshwari Sriramadasu (JIRA)]

[ 
https://issues.apache.org/jira/browse/HIVE-1538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12929976#action_12929976
 ] 

Amareshwari Sriramadasu commented on HIVE-1538:
---

There are a couple of issues in removing the original filter operator.
# All the expressions in the filter predicate may not be pushed.
** I'm planning to create a filter operator with non-final candidates as a 
child of the original filter op and mark the original filter op for deletion.
# The candidate predicates may not pushed past some operators. For ex. Outer 
Join operator does not allow candidates for all aliases; LIMIT/SCRIPT/UDTF 
operators do not push any predicates.
** I'm planning to create a filter operator with unpushed predicates, as a 
child of the operator through which the predicates could not be pushed.

Finally, remove the original filter operators which are marked for deletion.

Thoughts? Any suggestions?

> FilterOperator is applied twice with ppd on.
> 
>
> Key: HIVE-1538
> URL: https://issues.apache.org/jira/browse/HIVE-1538
> Project: Hive
>  Issue Type: Bug
>  Components: Query Processor
>Reporter: Amareshwari Sriramadasu
>Assignee: Amareshwari Sriramadasu
>
> With hive.optimize.ppd set to true, FilterOperator is applied twice. And it 
> seems second operator is always filtering zero rows.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Re: Review Request: HIVE-1771: ROUND(infinity) chokes

[John Sichi]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/53/
---

(Updated 2010-11-08 18:36:25.984539)


Review request for hive.


Summary
---

Review request from jvs.


This addresses bug HIVE-1771.
https://issues.apache.org/jira/browse/HIVE-1771


Diffs
-

  
http://svn.apache.org/repos/asf/hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/udf/UDFRound.java
 1032795 
  
http://svn.apache.org/repos/asf/hive/trunk/ql/src/test/queries/clientpositive/udf_round.q
 1032795 
  
http://svn.apache.org/repos/asf/hive/trunk/ql/src/test/results/clientpositive/udf_round.q.out
 1032795 

Diff: https://reviews.apache.org/r/53/diff


Testing
---


Thanks,

John

[jira] Commented: (HIVE-78) Authorization infrastructure for Hive

[John Sichi (JIRA)]

[ 
https://issues.apache.org/jira/browse/HIVE-78?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12929896#action_12929896
 ] 

John Sichi commented on HIVE-78:


It looks like HIVE-78.1.nothrift.patch still has a bunch of thrift-generate 
files in it (metastore/src/gen-javabean/org/apache/hadoop/hive/metastore/api/*)


> Authorization infrastructure for Hive
> -
>
> Key: HIVE-78
> URL: https://issues.apache.org/jira/browse/HIVE-78
> Project: Hive
>  Issue Type: New Feature
>  Components: Metastore, Query Processor, Server Infrastructure
>Reporter: Ashish Thusoo
>Assignee: He Yongqiang
> Attachments: createuser-v1.patch, hive-78-metadata-v1.patch, 
> hive-78-syntax-v1.patch, HIVE-78.1.nothrift.patch, HIVE-78.1.thrift.patch, 
> hive-78.diff
>
>
> Allow hive to integrate with existing user repositories for authentication 
> and authorization infromation.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Review Request: HIVE-78: Authorization infrastructure for Hive

[John Sichi]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55/
---

Review request for hive.


Summary
---

Review for patch without generated thrift code (note that the index is still 
split over three pages due to size).


This addresses bug HIVE-78.
https://issues.apache.org/jira/browse/HIVE-78


Diffs
-

  
http://svn.apache.org/repos/asf/hive/trunk/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java
 1030336 
  http://svn.apache.org/repos/asf/hive/trunk/metastore/if/hive_metastore.thrift 
1030336 
  
http://svn.apache.org/repos/asf/hive/trunk/metastore/src/gen-javabean/org/apache/hadoop/hive/metastore/api/ColumnPrivilegeBag.java
 PRE-CREATION 
  
http://svn.apache.org/repos/asf/hive/trunk/metastore/src/gen-javabean/org/apache/hadoop/hive/metastore/api/Database.java
 1030336 
  
http://svn.apache.org/repos/asf/hive/trunk/metastore/src/gen-javabean/org/apache/hadoop/hive/metastore/api/Index.java
 1030336 
  
http://svn.apache.org/repos/asf/hive/trunk/metastore/src/gen-javabean/org/apache/hadoop/hive/metastore/api/Partition.java
 1030336 
  
http://svn.apache.org/repos/asf/hive/trunk/metastore/src/gen-javabean/org/apache/hadoop/hive/metastore/api/PrincipalPrivilegeSet.java
 PRE-CREATION 
  
http://svn.apache.org/repos/asf/hive/trunk/metastore/src/gen-javabean/org/apache/hadoop/hive/metastore/api/PrivilegeBag.java
 PRE-CREATION 
  
http://svn.apache.org/repos/asf/hive/trunk/metastore/src/gen-javabean/org/apache/hadoop/hive/metastore/api/PrivilegeSet.java
 PRE-CREATION 
  
http://svn.apache.org/repos/asf/hive/trunk/metastore/src/gen-javabean/org/apache/hadoop/hive/metastore/api/Role.java
 PRE-CREATION 
  
http://svn.apache.org/repos/asf/hive/trunk/metastore/src/gen-javabean/org/apache/hadoop/hive/metastore/api/Schema.java
 1030336 
  
http://svn.apache.org/repos/asf/hive/trunk/metastore/src/gen-javabean/org/apache/hadoop/hive/metastore/api/SecurityColumn.java
 PRE-CREATION 
  
http://svn.apache.org/repos/asf/hive/trunk/metastore/src/gen-javabean/org/apache/hadoop/hive/metastore/api/SecurityDB.java
 PRE-CREATION 
  
http://svn.apache.org/repos/asf/hive/trunk/metastore/src/gen-javabean/org/apache/hadoop/hive/metastore/api/SecurityTablePartition.java
 PRE-CREATION 
  
http://svn.apache.org/repos/asf/hive/trunk/metastore/src/gen-javabean/org/apache/hadoop/hive/metastore/api/SecurityUser.java
 PRE-CREATION 
  
http://svn.apache.org/repos/asf/hive/trunk/metastore/src/gen-javabean/org/apache/hadoop/hive/metastore/api/SerDeInfo.java
 1030336 
  
http://svn.apache.org/repos/asf/hive/trunk/metastore/src/gen-javabean/org/apache/hadoop/hive/metastore/api/StorageDescriptor.java
 1030336 
  
http://svn.apache.org/repos/asf/hive/trunk/metastore/src/gen-javabean/org/apache/hadoop/hive/metastore/api/Table.java
 1030336 
  
http://svn.apache.org/repos/asf/hive/trunk/metastore/src/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java
 1030336 
  
http://svn.apache.org/repos/asf/hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStore.java
 1030336 
  
http://svn.apache.org/repos/asf/hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStoreClient.java
 1030336 
  
http://svn.apache.org/repos/asf/hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/IMetaStoreClient.java
 1030336 
  
http://svn.apache.org/repos/asf/hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/ObjectStore.java
 1030336 
  
http://svn.apache.org/repos/asf/hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/RawStore.java
 1030336 
  
http://svn.apache.org/repos/asf/hive/trunk/metastore/src/model/org/apache/hadoop/hive/metastore/model/MSecurityColumn.java
 PRE-CREATION 
  
http://svn.apache.org/repos/asf/hive/trunk/metastore/src/model/org/apache/hadoop/hive/metastore/model/MSecurityDB.java
 PRE-CREATION 
  
http://svn.apache.org/repos/asf/hive/trunk/metastore/src/model/org/apache/hadoop/hive/metastore/model/MSecurityRoleEntity.java
 PRE-CREATION 
  
http://svn.apache.org/repos/asf/hive/trunk/metastore/src/model/org/apache/hadoop/hive/metastore/model/MSecurityTablePartition.java
 PRE-CREATION 
  
http://svn.apache.org/repos/asf/hive/trunk/metastore/src/model/org/apache/hadoop/hive/metastore/model/MSecurityUser.java
 PRE-CREATION 
  
http://svn.apache.org/repos/asf/hive/trunk/metastore/src/model/org/apache/hadoop/hive/metastore/model/MSecurityUserRoleMap.java
 PRE-CREATION 
  http://svn.apache.org/repos/asf/hive/trunk/metastore/src/model/package.jdo 
1030336 
  
http://svn.apache.org/repos/asf/hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/DDLTask.java
 1030336 
  
http://svn.apache.org/repos/asf/hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/metadata/Hive.java
 1030336 
  
http://svn.apache.org/repos/asf/hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/DDLSemanticAnalyzer.java
 1030336 
  
ht

[jira] Commented: (HIVE-78) Authorization infrastructure for Hive

[John Sichi (JIRA)]

[ 
https://issues.apache.org/jira/browse/HIVE-78?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12929888#action_12929888
 ] 

John Sichi commented on HIVE-78:


https://reviews.apache.org/r/55/diff/#index_header

> Authorization infrastructure for Hive
> -
>
> Key: HIVE-78
> URL: https://issues.apache.org/jira/browse/HIVE-78
> Project: Hive
>  Issue Type: New Feature
>  Components: Metastore, Query Processor, Server Infrastructure
>Reporter: Ashish Thusoo
>Assignee: He Yongqiang
> Attachments: createuser-v1.patch, hive-78-metadata-v1.patch, 
> hive-78-syntax-v1.patch, HIVE-78.1.nothrift.patch, HIVE-78.1.thrift.patch, 
> hive-78.diff
>
>
> Allow hive to integrate with existing user repositories for authentication 
> and authorization infromation.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[ANNOUNCE] New Hive Committer - Amareshwari Sriramadasu

[Namit Jain]

Hi Folks,

The Hive PMC has passed the vote to make Amareshwari Sriramadasu a
new committer on the Apache Hive project.

Following is a list of the contributions that Amareshwari has made to the
project:

http://bit.ly/c3z0ty

Congratulations Amareshwari.
Please send over your CLA to Apache.


Thanks,
Namit

[jira] Commented: (HIVE-1771) ROUND(infinity) chokes

[John Sichi (JIRA)]

[ 
https://issues.apache.org/jira/browse/HIVE-1771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12929887#action_12929887
 ] 

John Sichi commented on HIVE-1771:
--

https://reviews.apache.org/r/53/diff/#index_header

> ROUND(infinity) chokes
> --
>
> Key: HIVE-1771
> URL: https://issues.apache.org/jira/browse/HIVE-1771
> Project: Hive
>  Issue Type: Bug
>  Components: UDF
>Affects Versions: 0.6.0
>Reporter: John Sichi
>Assignee: John Sichi
> Fix For: 0.7.0
>
> Attachments: HIVE-1771.1.patch
>
>
> Since 1-arg ROUND returns an integer, it's hard to fix this without either 
> losing data (return NULL) or making a backwards-incompatible change (return 
> DOUBLE instead of BIGINT).
> In any case, we should definitely fix 2-arg ROUND to preserve 
> infinity/NaN/etc, since it is already returning double.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Review Request: HIVE-1771: ROUND(infinity) chokes

[John Sichi]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/53/
---

Review request for hive.


Summary
---

Review request from jvs.


Diffs
-

  
http://svn.apache.org/repos/asf/hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/udf/UDFRound.java
 1032795 
  
http://svn.apache.org/repos/asf/hive/trunk/ql/src/test/queries/clientpositive/udf_round.q
 1032795 
  
http://svn.apache.org/repos/asf/hive/trunk/ql/src/test/results/clientpositive/udf_round.q.out
 1032795 

Diff: https://reviews.apache.org/r/53/diff


Testing
---


Thanks,

John

[jira] Updated: (HIVE-1754) Remove JDBM component from Map Join

[Liyin Tang (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HIVE-1754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Liyin Tang updated HIVE-1754:
-

Attachment: Hive-1754_3.patch

Fix a bug when join value is null
Also fix the hive-1775

> Remove JDBM component from Map Join
> ---
>
> Key: HIVE-1754
> URL: https://issues.apache.org/jira/browse/HIVE-1754
> Project: Hive
>  Issue Type: Improvement
>  Components: Query Processor
>Affects Versions: 0.6.0, 0.7.0
>Reporter: Liyin Tang
>Assignee: Liyin Tang
> Fix For: 0.7.0
>
> Attachments: Hive-1754.patch, Hive-1754_2.patch, Hive-1754_3.patch
>
>
> Right now, JDBM is the major performance bottleneck of performance.
> With the growth of the small table, the PUT and GET operation will take most 
> of execution time.
> Map Join is designed to load the data of small table into memory. 
> If the data is too large to hold in memory, then there is no need to use the 
> map join strategy.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Commented: (HIVE-1775) Assertation on inputObjInspectors.length in Groupy operator

[Liyin Tang (JIRA)]

[ 
https://issues.apache.org/jira/browse/HIVE-1775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12929869#action_12929869
 ] 

Liyin Tang commented on HIVE-1775:
--

resolved in patch hive-1754

> Assertation on inputObjInspectors.length in Groupy operator
> ---
>
> Key: HIVE-1775
> URL: https://issues.apache.org/jira/browse/HIVE-1775
> Project: Hive
>  Issue Type: Bug
>  Components: Query Processor
>Affects Versions: 0.6.0, 0.7.0
>Reporter: Liyin Tang
>Assignee: Liyin Tang
> Fix For: 0.7.0
>
>
> In the Groupby Operator:
> Line 188: assert (inputObjInspectors.length == 1); 
> But this assertion may not necessary true

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Updated: (HIVE-1743) Group-by to determine equals of Keys in reverse order

[Siying Dong (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HIVE-1743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Siying Dong updated HIVE-1743:
--

Attachment: HIVE-1743.1.patch

Use revers order to compare list of keys. Also a couple of minor bugs in 
GenericUDF OP codes.

> Group-by to determine equals of Keys in reverse order
> -
>
> Key: HIVE-1743
> URL: https://issues.apache.org/jira/browse/HIVE-1743
> Project: Hive
>  Issue Type: Improvement
>Reporter: Siying Dong
>Assignee: Siying Dong
>Priority: Minor
> Attachments: HIVE-1743.1.patch
>
>
> When processing group-by, in reduce side, keys are ordered. Comparing 
> equality of two keys can be more efficient in reverse order.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Updated: (HIVE-1771) ROUND(infinity) chokes

[John Sichi (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HIVE-1771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

John Sichi updated HIVE-1771:
-

Status: Patch Available  (was: Open)

> ROUND(infinity) chokes
> --
>
> Key: HIVE-1771
> URL: https://issues.apache.org/jira/browse/HIVE-1771
> Project: Hive
>  Issue Type: Bug
>  Components: UDF
>Affects Versions: 0.6.0
>Reporter: John Sichi
>Assignee: John Sichi
> Fix For: 0.7.0
>
> Attachments: HIVE-1771.1.patch
>
>
> Since 1-arg ROUND returns an integer, it's hard to fix this without either 
> losing data (return NULL) or making a backwards-incompatible change (return 
> DOUBLE instead of BIGINT).
> In any case, we should definitely fix 2-arg ROUND to preserve 
> infinity/NaN/etc, since it is already returning double.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Updated: (HIVE-1771) ROUND(infinity) chokes

[John Sichi (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HIVE-1771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

John Sichi updated HIVE-1771:
-

Attachment: HIVE-1771.1.patch

This patch fixes the two-arg version, but leaves the one-arg version as is.

> ROUND(infinity) chokes
> --
>
> Key: HIVE-1771
> URL: https://issues.apache.org/jira/browse/HIVE-1771
> Project: Hive
>  Issue Type: Bug
>  Components: UDF
>Affects Versions: 0.6.0
>Reporter: John Sichi
>Assignee: John Sichi
> Fix For: 0.7.0
>
> Attachments: HIVE-1771.1.patch
>
>
> Since 1-arg ROUND returns an integer, it's hard to fix this without either 
> losing data (return NULL) or making a backwards-incompatible change (return 
> DOUBLE instead of BIGINT).
> In any case, we should definitely fix 2-arg ROUND to preserve 
> infinity/NaN/etc, since it is already returning double.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Created: (HIVE-1778) simultaneously launched queries collide on hive intermediate directories

[Joydeep Sen Sarma (JIRA)]

simultaneously launched queries collide on hive intermediate directories


 Key: HIVE-1778
 URL: https://issues.apache.org/jira/browse/HIVE-1778
 Project: Hive
  Issue Type: Bug
Reporter: Joydeep Sen Sarma


we saw one instance of multiple queries for the same user launched in parallel 
(from a workflow engine) use the same intermediate directories. which is 
obviously super bad but not suprising considering how we allocate them:

   Random rand = new Random();
  String executionId = "hive_" + format.format(new Date()) + "_"  + 
Math.abs(rand.nextLong());

 Java documentation says: Two Random objects created within the same 
millisecond will have the same sequence of random numbers.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Re: retirement of org.apache.hadoop.security.UnixUserGroupInformation in new version of hadoop

[Vinithra Varadharajan]

Jimmy,

The patch that you need to make hive compile with Hadoop 0.20S is HIVE-1264,
which has been committed to Hive trunk. Is your Hive repo up to date?

If you'd like to apply patches of cdh3b3 Hive to Hive trunk, you can find
them in cdh3b3's hive tarball in hive-0.5.0+32/src/cloudera/patches.

Hope this helps.

-Vinithra

On Mon, Nov 8, 2010 at 3:14 PM, Jinsong Hu  wrote:

> I am very  interested in hive_hbase-handler in 0.6 version of hive. I have
> compiled the hive trunk's  hive_hbase-handler  and got it working with
> cdh3b2's hbase after some minor code change. However, in my testing, I found
> that cdh3b2's hbase is not stable enough. I tested cdh3b3's hbase and I
> found it was much better. However,
> when I tried to get hive to work with it, I found that neither hive 0.6 nor
> the hive trunk are compatible with cdh3b3 hbase, as they use
> UnixUserGroupInformation .
>
> the hive released with cdh3b3 is still 0.5 version. it doesn't have the
> hive_hbase-handler . and according to my reading, hive itself needs a patch
> HIVE-705 in order to work with hive_hbase-handler, and hive-0.5 version
> doesn't have that patch. This means I can't really use the hive shipped with
> cdh3b3. and compiling hive-0.6 so it work with cdh3b3 is my best hope.
>
> Which goes back to the question: can se use  UserGroupInformation to
> replace UnixUserGroupInformation
> in hive-0.6 ?
>
>
> Jimmy
>
>
>
>
> --
> From: "Vinithra Varadharajan" 
> Sent: Monday, November 08, 2010 2:52 PM
> To: ; 
> Cc: 
> Subject: Re: retirement of
> org.apache.hadoop.security.UnixUserGroupInformation in new version of hadoop
>
>
>  Hi Jimmy,
>>
>> cdh3b3 Hadoop includes the patches written by Yahoo! to introduce
>> authentication based on Kerberos. These patches include removal of
>> UnixUserGroupInformation. cdh3b3's Hive release includes patches to
>> Driver.java to not use UnixUserGroupInformation and instead make calls to
>> a
>> shim layer that works with the authentication system in Hadoop.
>>
>> Are there features in hive trunk/0.6 that you are interested in using but
>> are not available in cdh3b3 Hive?
>>
>> -Vinithra
>>
>> On Mon, Nov 8, 2010 at 12:28 PM, Jinsong Hu 
>> wrote:
>>
>>  Hi, There:
>>>  I was trying to compile trunk version of hive with cloudera cdh3b3
>>> distribution and noticed that in
>>> org.apache.hadoop.hive.ql Driver.java was using:
>>>
>>> org.apache.hadoop.security.UnixUserGroupInformation;
>>>
>>> However, in the cdh3b3 version of hadoop, this class is gone, so
>>> Driver.java doesn't compile.
>>>
>>> I checked 0.6 version of hive, the same issue exists.
>>>
>>> I noticed that class org.apache.hadoop.security.UserGroupInformation is
>>> still there, both
>>> in cdh3b2 and cdh3b3 version of hadoop. Can we change the Driver.java to
>>> use
>>>
>>> org.apache.hadoop.security.UserGroupInformation;
>>>
>>> instead ? This class does sound like a more generic class that in the
>>> future, we may
>>> even get it to work under windows or other os.
>>>
>>> Jimmy.
>>>
>>>
>>>
>>>
>>>
>>

[jira] Updated: (HIVE-1777) Outdated comments for GenericUDTF.close()

[Paul Yang (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HIVE-1777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Paul Yang updated HIVE-1777:


Component/s: Query Processor

> Outdated comments for GenericUDTF.close()
> -
>
> Key: HIVE-1777
> URL: https://issues.apache.org/jira/browse/HIVE-1777
> Project: Hive
>  Issue Type: Bug
>  Components: Query Processor
>Affects Versions: 0.7.0
>Reporter: Paul Yang
>Assignee: Paul Yang
> Attachments: HIVE-1777.1.patch
>
>
> In a GenericUDTF, rows can be forward()'ed on close(), contrary to what the 
> comment says.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Updated: (HIVE-1777) Outdated comments for GenericUDTF.close()

[Paul Yang (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HIVE-1777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Paul Yang updated HIVE-1777:


Attachment: HIVE-1777.1.patch

> Outdated comments for GenericUDTF.close()
> -
>
> Key: HIVE-1777
> URL: https://issues.apache.org/jira/browse/HIVE-1777
> Project: Hive
>  Issue Type: Bug
>  Components: Query Processor
>Affects Versions: 0.7.0
>Reporter: Paul Yang
>Assignee: Paul Yang
> Attachments: HIVE-1777.1.patch
>
>
> In a GenericUDTF, rows can be forward()'ed on close(), contrary to what the 
> comment says.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Updated: (HIVE-1777) Outdated comments for GenericUDTF.close()

[Paul Yang (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HIVE-1777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Paul Yang updated HIVE-1777:


Attachment: HIVE-1777.1.patch

> Outdated comments for GenericUDTF.close()
> -
>
> Key: HIVE-1777
> URL: https://issues.apache.org/jira/browse/HIVE-1777
> Project: Hive
>  Issue Type: Bug
>  Components: Query Processor
>Affects Versions: 0.7.0
>Reporter: Paul Yang
>Assignee: Paul Yang
> Attachments: HIVE-1777.1.patch
>
>
> In a GenericUDTF, rows can be forward()'ed on close(), contrary to what the 
> comment says.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Updated: (HIVE-1777) Outdated comments for GenericUDTF.close()

[Paul Yang (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HIVE-1777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Paul Yang updated HIVE-1777:


Attachment: (was: HIVE-1777.1.patch)

> Outdated comments for GenericUDTF.close()
> -
>
> Key: HIVE-1777
> URL: https://issues.apache.org/jira/browse/HIVE-1777
> Project: Hive
>  Issue Type: Bug
>  Components: Query Processor
>Affects Versions: 0.7.0
>Reporter: Paul Yang
>Assignee: Paul Yang
> Attachments: HIVE-1777.1.patch
>
>
> In a GenericUDTF, rows can be forward()'ed on close(), contrary to what the 
> comment says.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Updated: (HIVE-1777) Outdated comments for GenericUDTF.close()

[Paul Yang (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HIVE-1777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Paul Yang updated HIVE-1777:


Status: Patch Available  (was: Open)

> Outdated comments for GenericUDTF.close()
> -
>
> Key: HIVE-1777
> URL: https://issues.apache.org/jira/browse/HIVE-1777
> Project: Hive
>  Issue Type: Bug
>  Components: Query Processor
>Affects Versions: 0.7.0
>Reporter: Paul Yang
>Assignee: Paul Yang
> Attachments: HIVE-1777.1.patch
>
>
> In a GenericUDTF, rows can be forward()'ed on close(), contrary to what the 
> comment says.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Created: (HIVE-1777) Outdated comments for GenericUDTF.close()

[Paul Yang (JIRA)]

Outdated comments for GenericUDTF.close()
-

 Key: HIVE-1777
 URL: https://issues.apache.org/jira/browse/HIVE-1777
 Project: Hive
  Issue Type: Bug
Affects Versions: 0.7.0
Reporter: Paul Yang
Assignee: Paul Yang


In a GenericUDTF, rows can be forward()'ed on close(), contrary to what the 
comment says.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Re: retirement of org.apache.hadoop.security.UnixUserGroupInformation in new version of hadoop

[Jinsong Hu]

I am very  interested in hive_hbase-handler in 0.6 version of hive. I have 
compiled the hive trunk's  hive_hbase-handler  and got it working with 
cdh3b2's hbase after some minor code change. However, in my testing, I found
that cdh3b2's hbase is not stable enough. I tested cdh3b3's hbase and I 
found it was much better. However,
when I tried to get hive to work with it, I found that neither hive 0.6 nor 
the hive trunk are compatible with cdh3b3 hbase, as they use 
UnixUserGroupInformation .


the hive released with cdh3b3 is still 0.5 version. it doesn't have the 
hive_hbase-handler . and according to my reading, hive itself needs a patch 
HIVE-705 in order to work with hive_hbase-handler, and hive-0.5 version 
doesn't have that patch. This means I can't really use the hive shipped with 
cdh3b3. and compiling hive-0.6 so it work with cdh3b3 is my best hope.


Which goes back to the question: can se use  UserGroupInformation to replace 
UnixUserGroupInformation

in hive-0.6 ?


Jimmy




--
From: "Vinithra Varadharajan" 
Sent: Monday, November 08, 2010 2:52 PM
To: ; 
Cc: 
Subject: Re: retirement of 
org.apache.hadoop.security.UnixUserGroupInformation in new version of hadoop



Hi Jimmy,

cdh3b3 Hadoop includes the patches written by Yahoo! to introduce
authentication based on Kerberos. These patches include removal of
UnixUserGroupInformation. cdh3b3's Hive release includes patches to
Driver.java to not use UnixUserGroupInformation and instead make calls to 
a

shim layer that works with the authentication system in Hadoop.

Are there features in hive trunk/0.6 that you are interested in using but
are not available in cdh3b3 Hive?

-Vinithra

On Mon, Nov 8, 2010 at 12:28 PM, Jinsong Hu  
wrote:



Hi, There:
 I was trying to compile trunk version of hive with cloudera cdh3b3
distribution and noticed that in
org.apache.hadoop.hive.ql Driver.java was using:

org.apache.hadoop.security.UnixUserGroupInformation;

However, in the cdh3b3 version of hadoop, this class is gone, so
Driver.java doesn't compile.

I checked 0.6 version of hive, the same issue exists.

I noticed that class org.apache.hadoop.security.UserGroupInformation is
still there, both
in cdh3b2 and cdh3b3 version of hadoop. Can we change the Driver.java to
use

org.apache.hadoop.security.UserGroupInformation;

instead ? This class does sound like a more generic class that in the
future, we may
even get it to work under windows or other os.

Jimmy.

Re: retirement of org.apache.hadoop.security.UnixUserGroupInformation in new version of hadoop

[Vinithra Varadharajan]

Hi Jimmy,

cdh3b3 Hadoop includes the patches written by Yahoo! to introduce
authentication based on Kerberos. These patches include removal of
UnixUserGroupInformation. cdh3b3's Hive release includes patches to
Driver.java to not use UnixUserGroupInformation and instead make calls to a
shim layer that works with the authentication system in Hadoop.

Are there features in hive trunk/0.6 that you are interested in using but
are not available in cdh3b3 Hive?

-Vinithra

On Mon, Nov 8, 2010 at 12:28 PM, Jinsong Hu  wrote:

> Hi, There:
>  I was trying to compile trunk version of hive with cloudera cdh3b3
> distribution and noticed that in
> org.apache.hadoop.hive.ql Driver.java was using:
>
> org.apache.hadoop.security.UnixUserGroupInformation;
>
> However, in the cdh3b3 version of hadoop, this class is gone, so
> Driver.java doesn't compile.
>
> I checked 0.6 version of hive, the same issue exists.
>
> I noticed that class org.apache.hadoop.security.UserGroupInformation is
> still there, both
> in cdh3b2 and cdh3b3 version of hadoop. Can we change the Driver.java to
> use
>
> org.apache.hadoop.security.UserGroupInformation;
>
> instead ? This class does sound like a more generic class that in the
> future, we may
> even get it to work under windows or other os.
>
> Jimmy.
>
>
>
>

[jira] Updated: (HIVE-1746) Support for using ALTER to set IDXPROPERTIES

[John Sichi (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HIVE-1746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

John Sichi updated HIVE-1746:
-

Status: Open  (was: Patch Available)

In DDLTask:

* Eliminate System.out.println calls
* Instead of duplicating last_modified_by/time code from ALTER TABLE, factor it 
out to a private helper method instead
* You have a bug in the case where the table is in a non-default database.  You 
need to remember the base table's database name in AlterIndexDesc and use it 
later.


> Support for using ALTER to set IDXPROPERTIES
> 
>
> Key: HIVE-1746
> URL: https://issues.apache.org/jira/browse/HIVE-1746
> Project: Hive
>  Issue Type: Improvement
>  Components: Indexing
>Affects Versions: 0.7.0
>Reporter: Marquis Wang
>Assignee: Marquis Wang
> Fix For: 0.7.0
>
> Attachments: 1746.prelim.patch, HIVE-1746.2.patch
>
>
> Hive-1498 has support for IDXPROPERTIES on index creation, so now we want to 
> support ALTERing those properties.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Commented: (HIVE-1526) Hive should depend on a release version of Thrift

[Carl Steinbach (JIRA)]

[ 
https://issues.apache.org/jira/browse/HIVE-1526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12929777#action_12929777
 ] 

Carl Steinbach commented on HIVE-1526:
--

@Pradeep: working on it now :)

> Hive should depend on a release version of Thrift
> -
>
> Key: HIVE-1526
> URL: https://issues.apache.org/jira/browse/HIVE-1526
> Project: Hive
>  Issue Type: Task
>  Components: Build Infrastructure, Clients
>Reporter: Carl Steinbach
>Assignee: Todd Lipcon
> Fix For: 0.7.0
>
> Attachments: HIVE-1526.2.patch.txt, hive-1526.txt, libfb303.jar, 
> libthrift.jar
>
>
> Hive should depend on a release version of Thrift, and ideally it should use 
> Ivy to resolve this dependency.
> The Thrift folks are working on adding Thrift artifacts to a maven repository 
> here: https://issues.apache.org/jira/browse/THRIFT-363

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Commented: (HIVE-1501) when generating reentrant INSERT for index rebuild, quote identifiers using backticks

[John Sichi (JIRA)]

[ 
https://issues.apache.org/jira/browse/HIVE-1501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12929769#action_12929769
 ] 

John Sichi commented on HIVE-1501:
--

(Other than those, this one should be ready to go.)

> when generating reentrant INSERT for index rebuild, quote identifiers using 
> backticks
> -
>
> Key: HIVE-1501
> URL: https://issues.apache.org/jira/browse/HIVE-1501
> Project: Hive
>  Issue Type: Bug
>  Components: Indexing
>Affects Versions: 0.7.0
>Reporter: John Sichi
>Assignee: Skye Berghel
> Fix For: 0.7.0
>
> Attachments: 1501.patch, 1501_new_tests.patch, 1501_with_tests.patch, 
> HIVE-1501.4.patch, HIVE-1501.5.patch
>
>
> Yongqiang, you mentioned that you weren't able to do this due to SORT BY not 
> accepting them.  The SORT BY is gone now as of HIVE-1494 (and SORT BY needs 
> to be fixed anyway).

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Commented: (HIVE-1501) when generating reentrant INSERT for index rebuild, quote identifiers using backticks

[John Sichi (JIRA)]

[ 
https://issues.apache.org/jira/browse/HIVE-1501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12929766#action_12929766
 ] 

John Sichi commented on HIVE-1501:
--

* HiveUtils.getUnparsedColumnNamesFromFieldSchema has an extra line of 
whitespace in between the Javadoc and the method declaration.

(If you're using Eclipse for editing, it's easy to end up with extraneous 
whitespace.)

> when generating reentrant INSERT for index rebuild, quote identifiers using 
> backticks
> -
>
> Key: HIVE-1501
> URL: https://issues.apache.org/jira/browse/HIVE-1501
> Project: Hive
>  Issue Type: Bug
>  Components: Indexing
>Affects Versions: 0.7.0
>Reporter: John Sichi
>Assignee: Skye Berghel
> Fix For: 0.7.0
>
> Attachments: 1501.patch, 1501_new_tests.patch, 1501_with_tests.patch, 
> HIVE-1501.4.patch, HIVE-1501.5.patch
>
>
> Yongqiang, you mentioned that you weren't able to do this due to SORT BY not 
> accepting them.  The SORT BY is gone now as of HIVE-1494 (and SORT BY needs 
> to be fixed anyway).

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Updated: (HIVE-1501) when generating reentrant INSERT for index rebuild, quote identifiers using backticks

[John Sichi (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HIVE-1501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

John Sichi updated HIVE-1501:
-

Status: Open  (was: Patch Available)

Whitespace nitpicks:

* MetaStoreUtils.java no longer has any changes, so it should not be in the 
patch at all

* 

> when generating reentrant INSERT for index rebuild, quote identifiers using 
> backticks
> -
>
> Key: HIVE-1501
> URL: https://issues.apache.org/jira/browse/HIVE-1501
> Project: Hive
>  Issue Type: Bug
>  Components: Indexing
>Affects Versions: 0.7.0
>Reporter: John Sichi
>Assignee: Skye Berghel
> Fix For: 0.7.0
>
> Attachments: 1501.patch, 1501_new_tests.patch, 1501_with_tests.patch, 
> HIVE-1501.4.patch, HIVE-1501.5.patch
>
>
> Yongqiang, you mentioned that you weren't able to do this due to SORT BY not 
> accepting them.  The SORT BY is gone now as of HIVE-1494 (and SORT BY needs 
> to be fixed anyway).

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Created: (HIVE-1776) parallel execution and auto-local mode combine to place plan file in wrong file system

[Joydeep Sen Sarma (JIRA)]

parallel execution and auto-local mode combine to place plan file in wrong file 
system
--

 Key: HIVE-1776
 URL: https://issues.apache.org/jira/browse/HIVE-1776
 Project: Hive
  Issue Type: Bug
Reporter: Joydeep Sen Sarma


A query (that i can't reproduce verbatim) submits a job to a MR cluster with a 
plan file that is resident on  the local file system. This job obviously fails.

This seems to result from an interaction between the parallel execution (which 
is trying to run one local and one remote job at the same time). Turning off 
either the parallel execution mode or the auto-local mode seems to fix the 
problem.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Updated: (HIVE-1746) Support for using ALTER to set IDXPROPERTIES

[John Sichi (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HIVE-1746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

John Sichi updated HIVE-1746:
-

  Component/s: Indexing
Affects Version/s: 0.7.0
Fix Version/s: 0.7.0

> Support for using ALTER to set IDXPROPERTIES
> 
>
> Key: HIVE-1746
> URL: https://issues.apache.org/jira/browse/HIVE-1746
> Project: Hive
>  Issue Type: Improvement
>  Components: Indexing
>Affects Versions: 0.7.0
>Reporter: Marquis Wang
>Assignee: Marquis Wang
> Fix For: 0.7.0
>
> Attachments: 1746.prelim.patch, HIVE-1746.2.patch
>
>
> Hive-1498 has support for IDXPROPERTIES on index creation, so now we want to 
> support ALTERing those properties.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Updated: (HIVE-1497) support COMMENT clause on CREATE INDEX, and add new command for SHOW INDEXES

[John Sichi (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HIVE-1497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

John Sichi updated HIVE-1497:
-

Summary: support COMMENT clause on CREATE INDEX, and add new command for 
SHOW INDEXES  (was: support COMMENT clause on CREATE INDEX, and add new 
commands for SHOW/DESCRIBE indexes)

> support COMMENT clause on CREATE INDEX, and add new command for SHOW INDEXES
> 
>
> Key: HIVE-1497
> URL: https://issues.apache.org/jira/browse/HIVE-1497
> Project: Hive
>  Issue Type: Improvement
>  Components: Indexing
>Affects Versions: 0.7.0
>Reporter: John Sichi
>Assignee: Russell Melick
> Fix For: 0.7.0
>
> Attachments: HIVE-1497.4.patch, HIVE-1497.5.patch, 
> hive-1497.p1.patch, hive-1497.p2.patch, hive-1497.p3.patch
>
>
> We need to work out the syntax for SHOW/DESCRIBE, taking partitioning into 
> account.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Commented: (HIVE-1497) support COMMENT clause on CREATE INDEX, and add new commands for SHOW/DESCRIBE indexes

[John Sichi (JIRA)]

[ 
https://issues.apache.org/jira/browse/HIVE-1497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12929763#action_12929763
 ] 

John Sichi commented on HIVE-1497:
--

Oops, the followup already exists (HIVE-1764).  I'll edit the title of this one.

> support COMMENT clause on CREATE INDEX, and add new commands for 
> SHOW/DESCRIBE indexes
> --
>
> Key: HIVE-1497
> URL: https://issues.apache.org/jira/browse/HIVE-1497
> Project: Hive
>  Issue Type: Improvement
>  Components: Indexing
>Affects Versions: 0.7.0
>Reporter: John Sichi
>Assignee: Russell Melick
> Fix For: 0.7.0
>
> Attachments: HIVE-1497.4.patch, HIVE-1497.5.patch, 
> hive-1497.p1.patch, hive-1497.p2.patch, hive-1497.p3.patch
>
>
> We need to work out the syntax for SHOW/DESCRIBE, taking partitioning into 
> account.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Commented: (HIVE-1497) support COMMENT clause on CREATE INDEX, and add new commands for SHOW/DESCRIBE indexes

[John Sichi (JIRA)]

[ 
https://issues.apache.org/jira/browse/HIVE-1497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12929742#action_12929742
 ] 

John Sichi commented on HIVE-1497:
--

Regarding the output format, none of the other SHOW commands currently produce 
column headers, and we probably won't be able to modify them for 
backwards-compatibility reasons.  What we ended up doing for DESCRIBE was to 
introduce DESCRIBE FORMATTED with the prettier format.

Let's do the same for SHOW INDEXES.  If we see SHOW FORMATTED INDEXES, produce 
the column headers; without FORMATTED, then omit them.  (We can open a separate 
JIRA for doing that retroactively for the existing SHOW commands.)

Also:  add a test case for a compound index (multiple columns in the key), and 
change that header to col_names plural.


> support COMMENT clause on CREATE INDEX, and add new commands for 
> SHOW/DESCRIBE indexes
> --
>
> Key: HIVE-1497
> URL: https://issues.apache.org/jira/browse/HIVE-1497
> Project: Hive
>  Issue Type: Improvement
>  Components: Indexing
>Affects Versions: 0.7.0
>Reporter: John Sichi
>Assignee: Russell Melick
> Fix For: 0.7.0
>
> Attachments: HIVE-1497.4.patch, HIVE-1497.5.patch, 
> hive-1497.p1.patch, hive-1497.p2.patch, hive-1497.p3.patch
>
>
> We need to work out the syntax for SHOW/DESCRIBE, taking partitioning into 
> account.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

retirement of org.apache.hadoop.security.UnixUserGroupInformation in new version of hadoop

[Jinsong Hu]

Hi, There:
 I was trying to compile trunk version of hive with cloudera cdh3b3 
distribution and noticed that in

org.apache.hadoop.hive.ql Driver.java was using:

org.apache.hadoop.security.UnixUserGroupInformation;

However, in the cdh3b3 version of hadoop, this class is gone, so Driver.java 
doesn't compile.


I checked 0.6 version of hive, the same issue exists.

I noticed that class org.apache.hadoop.security.UserGroupInformation is 
still there, both

in cdh3b2 and cdh3b3 version of hadoop. Can we change the Driver.java to use

org.apache.hadoop.security.UserGroupInformation;

instead ? This class does sound like a more generic class that in the 
future, we may

even get it to work under windows or other os.

Jimmy.

[jira] Commented: (HIVE-1497) support COMMENT clause on CREATE INDEX, and add new commands for SHOW/DESCRIBE indexes

[John Sichi (JIRA)]

[ 
https://issues.apache.org/jira/browse/HIVE-1497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12929674#action_12929674
 ] 

John Sichi commented on HIVE-1497:
--

Right, we decided to do more details for a single index in a separate DESCRIBE 
command.  Russell, please open a followup JIRA for that one now, link it to 
this one as related, and then edit the title for this one.

> support COMMENT clause on CREATE INDEX, and add new commands for 
> SHOW/DESCRIBE indexes
> --
>
> Key: HIVE-1497
> URL: https://issues.apache.org/jira/browse/HIVE-1497
> Project: Hive
>  Issue Type: Improvement
>  Components: Indexing
>Affects Versions: 0.7.0
>Reporter: John Sichi
>Assignee: Russell Melick
> Fix For: 0.7.0
>
> Attachments: HIVE-1497.4.patch, HIVE-1497.5.patch, 
> hive-1497.p1.patch, hive-1497.p2.patch, hive-1497.p3.patch
>
>
> We need to work out the syntax for SHOW/DESCRIBE, taking partitioning into 
> account.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Hudson build is back to normal : Hive-trunk-h0.20 #416

[Apache Hudson Server]

See 

[jira] Updated: (HIVE-1497) support COMMENT clause on CREATE INDEX, and add new commands for SHOW/DESCRIBE indexes

[He Yongqiang (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HIVE-1497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

He Yongqiang updated HIVE-1497:
---

Status: Open  (was: Patch Available)

> support COMMENT clause on CREATE INDEX, and add new commands for 
> SHOW/DESCRIBE indexes
> --
>
> Key: HIVE-1497
> URL: https://issues.apache.org/jira/browse/HIVE-1497
> Project: Hive
>  Issue Type: Improvement
>  Components: Indexing
>Affects Versions: 0.7.0
>Reporter: John Sichi
>Assignee: Russell Melick
> Fix For: 0.7.0
>
> Attachments: HIVE-1497.4.patch, HIVE-1497.5.patch, 
> hive-1497.p1.patch, hive-1497.p2.patch, hive-1497.p3.patch
>
>
> We need to work out the syntax for SHOW/DESCRIBE, taking partitioning into 
> account.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Commented: (HIVE-1497) support COMMENT clause on CREATE INDEX, and add new commands for SHOW/DESCRIBE indexes

[He Yongqiang (JIRA)]

[ 
https://issues.apache.org/jira/browse/HIVE-1497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12929659#action_12929659
 ] 

He Yongqiang commented on HIVE-1497:


+/*if (!tbl.isIndexed()) {
+  console.printError("Table " + tableName + " does not have any indexes");
+  return 1;
+}*/

need to be removed.

{noformat}
setFetchTask(createFetchTask(showIndexesDesc.getSchema()));
{noformat}

need to be removed.

There is no index comment in the new testcase. Can you add some test cases?

SHOW INDEX ON shidx_t1; right now lists all indexes on the given table? Can we 
also support show one index? i mean sth like : 'show index index_name on tbl'  
(you can do it in a follow up jira)

Right now the show index output format is:

{noformat}
+idx_name   tab_namecol_name
idx_tab_nameidx_typecomment 
+
+
+idx_1  show_idx_full   key 
default__show_idx_full_idx_1__  compact 
+idx_2  show_idx_full   value1  
default__show_idx_full_idx_2__  compact 
+idx_3  show_idx_full   value2  
default__show_idx_full_idx_3__  compact  
{noformat}

John, is this intentional? 

Otherwise, the patch looks good.

> support COMMENT clause on CREATE INDEX, and add new commands for 
> SHOW/DESCRIBE indexes
> --
>
> Key: HIVE-1497
> URL: https://issues.apache.org/jira/browse/HIVE-1497
> Project: Hive
>  Issue Type: Improvement
>  Components: Indexing
>Affects Versions: 0.7.0
>Reporter: John Sichi
>Assignee: Russell Melick
> Fix For: 0.7.0
>
> Attachments: HIVE-1497.4.patch, HIVE-1497.5.patch, 
> hive-1497.p1.patch, hive-1497.p2.patch, hive-1497.p3.patch
>
>
> We need to work out the syntax for SHOW/DESCRIBE, taking partitioning into 
> account.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Commented: (HIVE-1526) Hive should depend on a release version of Thrift

[Pradeep Kamath (JIRA)]

[ 
https://issues.apache.org/jira/browse/HIVE-1526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12929632#action_12929632
 ] 

Pradeep Kamath commented on HIVE-1526:
--

Hi Carl - just wondering if you have had a chance to look at this..

> Hive should depend on a release version of Thrift
> -
>
> Key: HIVE-1526
> URL: https://issues.apache.org/jira/browse/HIVE-1526
> Project: Hive
>  Issue Type: Task
>  Components: Build Infrastructure, Clients
>Reporter: Carl Steinbach
>Assignee: Todd Lipcon
> Fix For: 0.7.0
>
> Attachments: HIVE-1526.2.patch.txt, hive-1526.txt, libfb303.jar, 
> libthrift.jar
>
>
> Hive should depend on a release version of Thrift, and ideally it should use 
> Ivy to resolve this dependency.
> The Thrift folks are working on adding Thrift artifacts to a maven repository 
> here: https://issues.apache.org/jira/browse/THRIFT-363

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Updated: (HIVE-1712) Migrating metadata from derby to mysql thrown NullPointerException

[Jake Farrell (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HIVE-1712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jake Farrell updated HIVE-1712:
---

Status: Patch Available  (was: Open)

Patch rebased against trunk r1032602

> Migrating metadata from derby to mysql thrown NullPointerException
> --
>
> Key: HIVE-1712
> URL: https://issues.apache.org/jira/browse/HIVE-1712
> Project: Hive
>  Issue Type: Bug
>  Components: Metastore
>Affects Versions: 0.6.0, 0.5.0
>Reporter: Jake Farrell
> Fix For: 0.7.0
>
> Attachments: hive-1712.patch, hive-1712_rebase.patch
>
>
> Exported derby data to csv, loaded data into mysql and ran hive query which 
> worked in derby and got the following exception
> 2010-10-16 08:57:29,080 INFO  metastore.ObjectStore 
> (ObjectStore.java:setConf(106)) - Initialized ObjectStore
> 2010-10-16 08:57:29,552 INFO  metastore.HiveMetaStore 
> (HiveMetaStore.java:logStartFunction(171)) - 0: get_table : db=default 
> tbl=testimport
> 2010-10-16 08:57:30,140 ERROR metadata.Hive (Hive.java:getTable(395)) - 
> java.lang.NullPointerException
> at java.util.Hashtable.put(Hashtable.java:394)
> at java.util.Hashtable.putAll(Hashtable.java:466)
> at 
> org.apache.hadoop.hive.metastore.MetaStoreUtils.getSchema(MetaStoreUtils.java:520)
> at 
> org.apache.hadoop.hive.metastore.MetaStoreUtils.getSchema(MetaStoreUtils.java:489)
> at org.apache.hadoop.hive.ql.metadata.Hive.getTable(Hive.java:381)
> at org.apache.hadoop.hive.ql.metadata.Hive.getTable(Hive.java:333)
> at 
> org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.getMetaData(SemanticAnalyzer.java:683)
> at 
> org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.analyzeInternal(SemanticAnalyzer.java:5200)
> at 
> org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:105)
> at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:275)
> at org.apache.hadoop.hive.ql.Driver.runCommand(Driver.java:320)
> at org.apache.hadoop.hive.ql.Driver.run(Driver.java:312)
> at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:123)
> at 
> org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:181)
> at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:287)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:156)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Updated: (HIVE-1712) Migrating metadata from derby to mysql thrown NullPointerException

[Jake Farrell (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HIVE-1712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jake Farrell updated HIVE-1712:
---

Attachment: hive-1712_rebase.patch

rebase of patch against trunk r1032602

> Migrating metadata from derby to mysql thrown NullPointerException
> --
>
> Key: HIVE-1712
> URL: https://issues.apache.org/jira/browse/HIVE-1712
> Project: Hive
>  Issue Type: Bug
>  Components: Metastore
>Affects Versions: 0.5.0, 0.6.0
>Reporter: Jake Farrell
> Fix For: 0.7.0
>
> Attachments: hive-1712.patch, hive-1712_rebase.patch
>
>
> Exported derby data to csv, loaded data into mysql and ran hive query which 
> worked in derby and got the following exception
> 2010-10-16 08:57:29,080 INFO  metastore.ObjectStore 
> (ObjectStore.java:setConf(106)) - Initialized ObjectStore
> 2010-10-16 08:57:29,552 INFO  metastore.HiveMetaStore 
> (HiveMetaStore.java:logStartFunction(171)) - 0: get_table : db=default 
> tbl=testimport
> 2010-10-16 08:57:30,140 ERROR metadata.Hive (Hive.java:getTable(395)) - 
> java.lang.NullPointerException
> at java.util.Hashtable.put(Hashtable.java:394)
> at java.util.Hashtable.putAll(Hashtable.java:466)
> at 
> org.apache.hadoop.hive.metastore.MetaStoreUtils.getSchema(MetaStoreUtils.java:520)
> at 
> org.apache.hadoop.hive.metastore.MetaStoreUtils.getSchema(MetaStoreUtils.java:489)
> at org.apache.hadoop.hive.ql.metadata.Hive.getTable(Hive.java:381)
> at org.apache.hadoop.hive.ql.metadata.Hive.getTable(Hive.java:333)
> at 
> org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.getMetaData(SemanticAnalyzer.java:683)
> at 
> org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.analyzeInternal(SemanticAnalyzer.java:5200)
> at 
> org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:105)
> at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:275)
> at org.apache.hadoop.hive.ql.Driver.runCommand(Driver.java:320)
> at org.apache.hadoop.hive.ql.Driver.run(Driver.java:312)
> at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:123)
> at 
> org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:181)
> at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:287)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:156)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.