Hive-trunk-h0.21 - Build # 1233 - Still Failing

2012-01-31 Thread Apache Jenkins Server
Changes for Build #1190
[amareshwari] HIVE-2629. Make a single Hive binary work with both 0.20.x and 
0.23.0. (Thomas Weise via amareshwari)


Changes for Build #1191
[amareshwari] HIVE-2629. Reverting previous commit


Changes for Build #1192
[heyongqiang] HIVE-2706 [jira] StackOverflowError when using custom UDF after 
adding archive
after adding jars
(Kevin Wilfong via Yongqiang He)

Summary:
https://issues.apache.org/jira/browse/HIVE-2706

The issue was that the current thread's classloader and the classloader in the
conf differed due to the prehook updating only the current thread's classloader
with new jars.  Now, it updates both classloaders, fixing the issue.

When a custom UDF is used in a query after add an archive, such as a zip file,
after adding jars, the XMLEncoder enters an infinite loop when serializing the
map reduce task, as part of sending it to be executed. This results in a stack
overflow error.

Test Plan: Verified it fixed the stack overflow error.

Reviewers: JIRA, heyongqiang, njain

Reviewed By: heyongqiang

CC: heyongqiang

Differential Revision: https://reviews.facebook.net/D1167


Changes for Build #1193
[hashutosh] HIVE-2705: SemanticAnalyzer twice swallows an exception it 
shouldn't (jghoman via hashutosh)


Changes for Build #1194

Changes for Build #1195
[hashutosh] HIVE-2589: Newly created partition should inherit properties from 
table (Ashutosh Chauhan)

[hashutosh] HIVE-2682: Clean-up logs (Rajat Goel via Ashutosh Chauhan)


Changes for Build #1196
[amareshwari] HIVE-2629. Make a single Hive binary work with both 0.20.x and 
0.23.0. (Thomas Weise via amareshwari)


Changes for Build #1197

Changes for Build #1198
[namit] HIVE-2504 Warehouse table subdirectories should inherit the group 
permissions of the warehouse
parent directory (Chinna Rao Lalam via namit)

[namit] HIVE-2695 Add PRINTF() Udf (Zhenxiao Luo via namit)


Changes for Build #1199

Changes for Build #1200

Changes for Build #1201

Changes for Build #1202

Changes for Build #1203

Changes for Build #1204
[cws] HIVE-2719. Revert HIVE-2589 (He Yongqiang via cws)


Changes for Build #1205

Changes for Build #1207
[namit] HIVE-2718 NPE in union followed by join
(He Yongqiang via namit)


Changes for Build #1208

Changes for Build #1209

Changes for Build #1210
[namit] HIVE-2674 get_partitions_ps throws TApplicationException if table 
doesn't
exist (Kevin Wilfong via namit)


Changes for Build #1211
[cws] HIVE-2203. Extend concat_ws() UDF to support arrays of strings (Zhenxiao 
Luo via cws)

[cws] HIVE-2279. Implement sort(array) UDF (Zhenxiao Luo via cws)


Changes for Build #1212
[hashutosh] HIVE-2589 : Newly created partition should inherit properties from 
table (Ashutosh Chauhan)


Changes for Build #1213

Changes for Build #1214

Changes for Build #1215

Changes for Build #1216
[cws] HIVE-2724. Remove unused lib/log4j-1.2.15.jar (Andrew Bayer via cws)


Changes for Build #1217

Changes for Build #1218

Changes for Build #1219
[hashutosh] HIVE-2665 : Support for metastore service specific HADOOP_OPTS 
environment setting (thw via hashutosh)


Changes for Build #1220
[namit] HIVE-2727 add a testcase for partitioned view on union and base tables 
have
index (He Yongqiang via namit)


Changes for Build #1221
[hashutosh] HIVE-2746 : Metastore client doesn't log properly in case of 
connection failure to server (hashutosh)

[cws] HIVE-2698 [jira] Enable Hadoop-1.0.0 in Hive
(Enis Söztutar via Carl Steinbach)

Summary:
third version of the patch

Hadoop-1.0.0 is recently released, which is AFAIK, API compatible to the 0.20S
release.

Test Plan: EMPTY

Reviewers: JIRA, cwsteinbach

Reviewed By: cwsteinbach

CC: cwsteinbach, enis

Differential Revision: https://reviews.facebook.net/D1389


Changes for Build #1222
[namit] HIVE-2750 Hive multi group by single reducer optimization causes 
invalid column
reference error (Kevin Wilfong via namit)


Changes for Build #1223

Changes for Build #1224
[cws] HIVE-2734 [jira] Fix some nondeterministic test output
(Zhenxiao Luo via Carl Steinbach)

Summary:
HIVE-2734: Fix some nondeterministic test output

Many Hive query tests lack an ORDER BY clause, and consequently the ordering
of the rows in the result set is nondeterministic:

groupby1_limit
input11_limit
input1_limit
input_lazyserde
join18_multi_distinct
join_1to1
join_casesensitive
join_filters
join_nulls
merge3
rcfile_columnar
rcfile_lazydecompress
rcfile_union
sample10
udf_sentences
union24
columnarserde_create_shortcut
combine1
global_limit

Test Plan: EMPTY

Reviewers: JIRA, cwsteinbach

Reviewed By: cwsteinbach

CC: zhenxiao, cwsteinbach

Differential Revision: https://reviews.facebook.net/D1449

[namit] HIVE-2754 NPE in union with lateral view
(Yongqiang He via namit)


Changes for Build #1225

Changes for Build #1226

Changes for Build #1227
[namit] HIVE-2755 union follwowed by union_subq does not work if the subquery 
union
has reducers (He Yongqiang via namit)


Changes for Build #1228

Changes for Build 

Who can I get the MapReduce Jobs codes generated by Hive Compiler?

2012-01-31 Thread Alexis De La Cruz Toledo
Hi I'd like to know what is the code generated by
the compiler of SQL hive. i.e. If I execute one sql sentence
I'd like to see the code of MapReduce jobs generated by compiler of SQL
hive.

Who can I get it?

Thanks.
-- 
Ing. Alexis de la Cruz Toledo.
*Av. Instituto Politécnico Nacional No. 2508 Col. San Pedro Zacatenco. México,
D.F, 07360 *
*CINVESTAV, DF.*


Hive-trunk-h0.21 - Build # 1234 - Still Failing

2012-01-31 Thread Apache Jenkins Server
Changes for Build #1190
[amareshwari] HIVE-2629. Make a single Hive binary work with both 0.20.x and 
0.23.0. (Thomas Weise via amareshwari)


Changes for Build #1191
[amareshwari] HIVE-2629. Reverting previous commit


Changes for Build #1192
[heyongqiang] HIVE-2706 [jira] StackOverflowError when using custom UDF after 
adding archive
after adding jars
(Kevin Wilfong via Yongqiang He)

Summary:
https://issues.apache.org/jira/browse/HIVE-2706

The issue was that the current thread's classloader and the classloader in the
conf differed due to the prehook updating only the current thread's classloader
with new jars.  Now, it updates both classloaders, fixing the issue.

When a custom UDF is used in a query after add an archive, such as a zip file,
after adding jars, the XMLEncoder enters an infinite loop when serializing the
map reduce task, as part of sending it to be executed. This results in a stack
overflow error.

Test Plan: Verified it fixed the stack overflow error.

Reviewers: JIRA, heyongqiang, njain

Reviewed By: heyongqiang

CC: heyongqiang

Differential Revision: https://reviews.facebook.net/D1167


Changes for Build #1193
[hashutosh] HIVE-2705: SemanticAnalyzer twice swallows an exception it 
shouldn't (jghoman via hashutosh)


Changes for Build #1194

Changes for Build #1195
[hashutosh] HIVE-2589: Newly created partition should inherit properties from 
table (Ashutosh Chauhan)

[hashutosh] HIVE-2682: Clean-up logs (Rajat Goel via Ashutosh Chauhan)


Changes for Build #1196
[amareshwari] HIVE-2629. Make a single Hive binary work with both 0.20.x and 
0.23.0. (Thomas Weise via amareshwari)


Changes for Build #1197

Changes for Build #1198
[namit] HIVE-2504 Warehouse table subdirectories should inherit the group 
permissions of the warehouse
parent directory (Chinna Rao Lalam via namit)

[namit] HIVE-2695 Add PRINTF() Udf (Zhenxiao Luo via namit)


Changes for Build #1199

Changes for Build #1200

Changes for Build #1201

Changes for Build #1202

Changes for Build #1203

Changes for Build #1204
[cws] HIVE-2719. Revert HIVE-2589 (He Yongqiang via cws)


Changes for Build #1205

Changes for Build #1207
[namit] HIVE-2718 NPE in union followed by join
(He Yongqiang via namit)


Changes for Build #1208

Changes for Build #1209

Changes for Build #1210
[namit] HIVE-2674 get_partitions_ps throws TApplicationException if table 
doesn't
exist (Kevin Wilfong via namit)


Changes for Build #1211
[cws] HIVE-2203. Extend concat_ws() UDF to support arrays of strings (Zhenxiao 
Luo via cws)

[cws] HIVE-2279. Implement sort(array) UDF (Zhenxiao Luo via cws)


Changes for Build #1212
[hashutosh] HIVE-2589 : Newly created partition should inherit properties from 
table (Ashutosh Chauhan)


Changes for Build #1213

Changes for Build #1214

Changes for Build #1215

Changes for Build #1216
[cws] HIVE-2724. Remove unused lib/log4j-1.2.15.jar (Andrew Bayer via cws)


Changes for Build #1217

Changes for Build #1218

Changes for Build #1219
[hashutosh] HIVE-2665 : Support for metastore service specific HADOOP_OPTS 
environment setting (thw via hashutosh)


Changes for Build #1220
[namit] HIVE-2727 add a testcase for partitioned view on union and base tables 
have
index (He Yongqiang via namit)


Changes for Build #1221
[hashutosh] HIVE-2746 : Metastore client doesn't log properly in case of 
connection failure to server (hashutosh)

[cws] HIVE-2698 [jira] Enable Hadoop-1.0.0 in Hive
(Enis Söztutar via Carl Steinbach)

Summary:
third version of the patch

Hadoop-1.0.0 is recently released, which is AFAIK, API compatible to the 0.20S
release.

Test Plan: EMPTY

Reviewers: JIRA, cwsteinbach

Reviewed By: cwsteinbach

CC: cwsteinbach, enis

Differential Revision: https://reviews.facebook.net/D1389


Changes for Build #1222
[namit] HIVE-2750 Hive multi group by single reducer optimization causes 
invalid column
reference error (Kevin Wilfong via namit)


Changes for Build #1223

Changes for Build #1224
[cws] HIVE-2734 [jira] Fix some nondeterministic test output
(Zhenxiao Luo via Carl Steinbach)

Summary:
HIVE-2734: Fix some nondeterministic test output

Many Hive query tests lack an ORDER BY clause, and consequently the ordering
of the rows in the result set is nondeterministic:

groupby1_limit
input11_limit
input1_limit
input_lazyserde
join18_multi_distinct
join_1to1
join_casesensitive
join_filters
join_nulls
merge3
rcfile_columnar
rcfile_lazydecompress
rcfile_union
sample10
udf_sentences
union24
columnarserde_create_shortcut
combine1
global_limit

Test Plan: EMPTY

Reviewers: JIRA, cwsteinbach

Reviewed By: cwsteinbach

CC: zhenxiao, cwsteinbach

Differential Revision: https://reviews.facebook.net/D1449

[namit] HIVE-2754 NPE in union with lateral view
(Yongqiang He via namit)


Changes for Build #1225

Changes for Build #1226

Changes for Build #1227
[namit] HIVE-2755 union follwowed by union_subq does not work if the subquery 
union
has reducers (He Yongqiang via namit)


Changes for Build #1228

Changes for Build 

[jira] [Updated] (HIVE-2758) Metastore is caching too aggressively

2012-01-31 Thread Phabricator (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-2758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Phabricator updated HIVE-2758:
--

Attachment: HIVE-2758.D1491.2.patch

kevinwilfong updated the revision HIVE-2758 [jira] Metastore is caching too 
aggressively.
Reviewers: JIRA, njain, heyongqiang, cwsteinbach

  Added a unit test to the metastore tests.  It creates a table using the 
current HiveMetaStoreClient, then simulates another client renaming the table 
by changing the value in the db.  It then attempts to get the table again using 
the new name and verifying the name of the table is correct.  This test is used 
for both the metastore Thrift server and an embedded metastore.

  Using the current configuration, it fails with the exception
  Client returned table with different name after rename. 
expected:[]concurrenttbl but was:[rename_]concurrenttbl
  Indicating that the client can retrieve the table with the new name, but when 
it checks the name stored in the Table object, it is still the old name.
  Using the update in this patch, however, it succeeds.

REVISION DETAIL
  https://reviews.facebook.net/D1491

AFFECTED FILES
  metastore/src/test/org/apache/hadoop/hive/metastore/TestHiveMetaStore.java
  common/src/java/org/apache/hadoop/hive/conf/HiveConf.java


 Metastore is caching too aggressively
 -

 Key: HIVE-2758
 URL: https://issues.apache.org/jira/browse/HIVE-2758
 Project: Hive
  Issue Type: Bug
Reporter: Kevin Wilfong
Assignee: Kevin Wilfong
 Attachments: HIVE-2758.D1491.1.patch, HIVE-2758.D1491.2.patch


 The metastore is caching values, like table names and locations too 
 aggressively, leading to inconsistencies across Hive clients and metastore 
 Thrift servers.
 For example, open two Hive clients, in each call
 DESCRIBE FORMATTED table_foo;
 Then in one of those clients, execute
 ALTER TABLE table_foo RENAME TO table_bar;
 Then in both clients call
 DESCRIBE FORMATTED table_bar;
 In the client that executed the alter command, the location is correct, 
 however, in the other Hive client, it will still show the original location 
 of table_foo.
 A similar experiment can be done using metastore Thrift servers, substituting 
 get_table for DESCRIBE FORMATTED and alter_table for ALTER TABLE ... RENAME 
 TO.
 On the Thrift server you can see that the one which did not execute the alter 
 command, not only returns the wrong location, despite calling 
 get_table('table_bar') it will return a table that still has the name 
 table_foo.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (HIVE-2758) Metastore is caching too aggressively

2012-01-31 Thread Kevin Wilfong (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-2758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Kevin Wilfong updated HIVE-2758:


Status: Patch Available  (was: Open)

 Metastore is caching too aggressively
 -

 Key: HIVE-2758
 URL: https://issues.apache.org/jira/browse/HIVE-2758
 Project: Hive
  Issue Type: Bug
Reporter: Kevin Wilfong
Assignee: Kevin Wilfong
 Attachments: HIVE-2758.D1491.1.patch, HIVE-2758.D1491.2.patch


 The metastore is caching values, like table names and locations too 
 aggressively, leading to inconsistencies across Hive clients and metastore 
 Thrift servers.
 For example, open two Hive clients, in each call
 DESCRIBE FORMATTED table_foo;
 Then in one of those clients, execute
 ALTER TABLE table_foo RENAME TO table_bar;
 Then in both clients call
 DESCRIBE FORMATTED table_bar;
 In the client that executed the alter command, the location is correct, 
 however, in the other Hive client, it will still show the original location 
 of table_foo.
 A similar experiment can be done using metastore Thrift servers, substituting 
 get_table for DESCRIBE FORMATTED and alter_table for ALTER TABLE ... RENAME 
 TO.
 On the Thrift server you can see that the one which did not execute the alter 
 command, not only returns the wrong location, despite calling 
 get_table('table_bar') it will return a table that still has the name 
 table_foo.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Created] (HIVE-2767) Optionally use framed transport with metastore

2012-01-31 Thread Travis Crawford (Created) (JIRA)
Optionally use framed transport with metastore
--

 Key: HIVE-2767
 URL: https://issues.apache.org/jira/browse/HIVE-2767
 Project: Hive
  Issue Type: New Feature
  Components: Metastore
Reporter: Travis Crawford


Users may want/need to use thrift's framed transport when communicating with 
the Hive MetaStore. This patch adds a new property 
{{hive.metastore.thrift.framed.transport.enabled}} that enables the framed 
transport (defaults to off, aka no change from before the patch). This property 
must be set for both clients and the HMS server.

It wasn't immediately clear how to use the framed transport with SASL, so as 
written an exception is thrown if you try starting the server with both 
options. If SASL and the framed transport will indeed work together I can 
update the patch (although I don't have a secured environment to test in).

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (HIVE-2767) Optionally use framed transport with metastore

2012-01-31 Thread Travis Crawford (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-2767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Travis Crawford updated HIVE-2767:
--

Attachment: HIVE-2767.patch.txt

 Optionally use framed transport with metastore
 --

 Key: HIVE-2767
 URL: https://issues.apache.org/jira/browse/HIVE-2767
 Project: Hive
  Issue Type: New Feature
  Components: Metastore
Reporter: Travis Crawford
 Attachments: HIVE-2767.patch.txt


 Users may want/need to use thrift's framed transport when communicating with 
 the Hive MetaStore. This patch adds a new property 
 {{hive.metastore.thrift.framed.transport.enabled}} that enables the framed 
 transport (defaults to off, aka no change from before the patch). This 
 property must be set for both clients and the HMS server.
 It wasn't immediately clear how to use the framed transport with SASL, so as 
 written an exception is thrown if you try starting the server with both 
 options. If SASL and the framed transport will indeed work together I can 
 update the patch (although I don't have a secured environment to test in).

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (HIVE-2767) Optionally use framed transport with metastore

2012-01-31 Thread Travis Crawford (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-2767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Travis Crawford updated HIVE-2767:
--

Status: Patch Available  (was: Open)

 Optionally use framed transport with metastore
 --

 Key: HIVE-2767
 URL: https://issues.apache.org/jira/browse/HIVE-2767
 Project: Hive
  Issue Type: New Feature
  Components: Metastore
Reporter: Travis Crawford
 Attachments: HIVE-2767.patch.txt


 Users may want/need to use thrift's framed transport when communicating with 
 the Hive MetaStore. This patch adds a new property 
 {{hive.metastore.thrift.framed.transport.enabled}} that enables the framed 
 transport (defaults to off, aka no change from before the patch). This 
 property must be set for both clients and the HMS server.
 It wasn't immediately clear how to use the framed transport with SASL, so as 
 written an exception is thrown if you try starting the server with both 
 options. If SASL and the framed transport will indeed work together I can 
 update the patch (although I don't have a secured environment to test in).

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Commented] (HIVE-2758) Metastore is caching too aggressively

2012-01-31 Thread Phabricator (Commented) (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-2758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13197141#comment-13197141
 ] 

Phabricator commented on HIVE-2758:
---

cwsteinbach has accepted the revision HIVE-2758 [jira] Metastore is caching 
too aggressively.

  +1. Kevin, can you handle testing and committing this change?

REVISION DETAIL
  https://reviews.facebook.net/D1491


 Metastore is caching too aggressively
 -

 Key: HIVE-2758
 URL: https://issues.apache.org/jira/browse/HIVE-2758
 Project: Hive
  Issue Type: Bug
Reporter: Kevin Wilfong
Assignee: Kevin Wilfong
 Attachments: HIVE-2758.D1491.1.patch, HIVE-2758.D1491.2.patch


 The metastore is caching values, like table names and locations too 
 aggressively, leading to inconsistencies across Hive clients and metastore 
 Thrift servers.
 For example, open two Hive clients, in each call
 DESCRIBE FORMATTED table_foo;
 Then in one of those clients, execute
 ALTER TABLE table_foo RENAME TO table_bar;
 Then in both clients call
 DESCRIBE FORMATTED table_bar;
 In the client that executed the alter command, the location is correct, 
 however, in the other Hive client, it will still show the original location 
 of table_foo.
 A similar experiment can be done using metastore Thrift servers, substituting 
 get_table for DESCRIBE FORMATTED and alter_table for ALTER TABLE ... RENAME 
 TO.
 On the Thrift server you can see that the one which did not execute the alter 
 command, not only returns the wrong location, despite calling 
 get_table('table_bar') it will return a table that still has the name 
 table_foo.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




Re: Who can I get the MapReduce Jobs codes generated by Hive Compiler?

2012-01-31 Thread Alexis De La Cruz Toledo
Thank you

El 31 de enero de 2012 11:13, bharath vissapragada 
bharathvissapragada1...@gmail.com escribió:

 Hey,

 Explain command is what you need . Just type explain query in the
 console and it dumps the entire plan to the screen. You can analyze it and
 get the plan generated by hive.

 Thanks

 On Tue, Jan 31, 2012 at 4:57 PM, Alexis De La Cruz Toledo 
 alexis...@gmail.com wrote:

  Hi I'd like to know what is the code generated by
  the compiler of SQL hive. i.e. If I execute one sql sentence
  I'd like to see the code of MapReduce jobs generated by compiler of SQL
  hive.
 
  Who can I get it?
 
  Thanks.
  --
  Ing. Alexis de la Cruz Toledo.
  *Av. Instituto Politécnico Nacional No. 2508 Col. San Pedro Zacatenco.
  México,
  D.F, 07360 *
  *CINVESTAV, DF.*
 



 --
 Regards,
 Bharath .V
 w:http://researchweb.iiit.ac.in/~bharath.v




-- 
Ing. Alexis de la Cruz Toledo.
*Av. Instituto Politécnico Nacional No. 2508 Col. San Pedro Zacatenco. México,
D.F, 07360 *
*CINVESTAV, DF.*


[jira] [Created] (HIVE-2768) Add a getAuthorizationProvider to HiveStorageHandler

2012-01-31 Thread Alan Gates (Created) (JIRA)
Add a getAuthorizationProvider to HiveStorageHandler


 Key: HIVE-2768
 URL: https://issues.apache.org/jira/browse/HIVE-2768
 Project: Hive
  Issue Type: Task
  Components: HBase Handler
Reporter: Alan Gates


In version 0.92 HBase supports ACLs for tables.  In HCatalog, since we delegate 
security to the underlying storage layer, we would like to be able to obtain a 
HiveAuthorizationProvider specific to a HiveStorageHandler instance.  This can 
be done by adding a getAuthorizationProvider method to HiveStorageHandler.  In 
the case where Hive is configured to use the DefaultHiveAuthorizationProvider 
this call will return the same default provider, since Hive handles all of the 
authorization itself in that case.  In the case where it is configured to use 
the HCatAuthorizationProvider, it would return an instance specific to the 
underlying storage.

For more background on this proposed change see HCATALOG-237 and 
https://cwiki.apache.org/confluence/display/HCATALOG/Hcat+Security+Design

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Commented] (HIVE-123) refactor DDL code (both DDLWork and DDLTask)

2012-01-31 Thread Phabricator (Commented) (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13197320#comment-13197320
 ] 

Phabricator commented on HIVE-123:
--

hobbymanyp has commented on the revision HIVE-123 [jira] refactor DDL code 
(both DDLWork and DDLTask).

  According to the steps, I think i am using HIVE-123.  Should I change it to 
arc diff --jira HIVE-123x (instead of  arc diff --jira HIVE-123) ?

  https://cwiki.apache.org/Hive/phabricatorcodereview.html
  From a git checkout (e.g. from git clone git://github.com/apache/hive.git), a 
typical usage sequence is as follows:

  ant arc-setup
  git checkout -b HIVE-123-dev-branch
  edit some files to implement HIVE-123
  git commit -a -m initial description of how I have gone about making DDL 
code suck less
  arc diff --jira HIVE-123
  optionally, visit diff URL provided by Phabricator to do things like add 
reviewers and CC's


REVISION DETAIL
  https://reviews.facebook.net/D1485


 refactor DDL code (both DDLWork and DDLTask)
 

 Key: HIVE-123
 URL: https://issues.apache.org/jira/browse/HIVE-123
 Project: Hive
  Issue Type: Bug
  Components: Query Processor
Reporter: Namit Jain
Assignee: Ashutosh Chauhan
  Labels: cleanup, refactoring
 Attachments: HIVE-123.D1485.1.patch, hive-123.patch


 It might be good to break DDLTask into separate tasks. The abstract class 
 DDLWork can have various subclasses:
 showTablesWork, DescribeTableWork etc. and a separate task for each of them. 
 This will make them completely independent.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (HIVE-123) refactor DDL code (both DDLWork and DDLTask)

2012-01-31 Thread Phabricator (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Phabricator updated HIVE-123:
-

Attachment: HIVE-123.D1485.2.patch

hobbymanyp updated the revision HIVE-123 [jira] refactor DDL code (both 
DDLWork and DDLTask).
Reviewers: JIRA, heyongqiang, cwsteinbach

  Use the correct JIRA id  HIVE-2765

REVISION DETAIL
  https://reviews.facebook.net/D1485

AFFECTED FILES
  hbase-handler/src/java/org/apache/hadoop/hive/hbase/HBaseStorageHandler.java


 refactor DDL code (both DDLWork and DDLTask)
 

 Key: HIVE-123
 URL: https://issues.apache.org/jira/browse/HIVE-123
 Project: Hive
  Issue Type: Bug
  Components: Query Processor
Reporter: Namit Jain
Assignee: Ashutosh Chauhan
  Labels: cleanup, refactoring
 Attachments: HIVE-123.D1485.1.patch, HIVE-123.D1485.2.patch, 
 hive-123.patch


 It might be good to break DDLTask into separate tasks. The abstract class 
 DDLWork can have various subclasses:
 showTablesWork, DescribeTableWork etc. and a separate task for each of them. 
 This will make them completely independent.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (HIVE-2765) hbase handler uses ZooKeeperConnectionException which is not compatible with HBase versions other than 0.89

2012-01-31 Thread Phabricator (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-2765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Phabricator updated HIVE-2765:
--

Attachment: HIVE-2765.D1485.3.patch

hobbymanyp updated the revision HIVE-2765 [jira] refactor DDL code (both 
DDLWork and DDLTask).
Reviewers: JIRA, heyongqiang, cwsteinbach

  Update diff title with jira number HIVE-2765

REVISION DETAIL
  https://reviews.facebook.net/D1485

AFFECTED FILES
  hbase-handler/src/java/org/apache/hadoop/hive/hbase/HBaseStorageHandler.java


 hbase handler uses ZooKeeperConnectionException which is not compatible with 
 HBase versions other than 0.89 
 

 Key: HIVE-2765
 URL: https://issues.apache.org/jira/browse/HIVE-2765
 Project: Hive
  Issue Type: Improvement
  Components: HBase Handler
Affects Versions: 0.7.0, 0.8.0
Reporter: Pei Yue
  Labels: patch
 Attachments: HIVE-2765.D1485.3.patch

   Original Estimate: 2h
  Remaining Estimate: 2h

 It cannot integrate with HBase0.21 and may not be able to integrate with 
 hbase0.9x

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Resolved] (HIVE-2765) hbase handler uses ZooKeeperConnectionException which is not compatible with HBase versions other than 0.89

2012-01-31 Thread He Yongqiang (Resolved) (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-2765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

He Yongqiang resolved HIVE-2765.


Resolution: Fixed

I manually committed via svn commit'. Thanks Pei!

 hbase handler uses ZooKeeperConnectionException which is not compatible with 
 HBase versions other than 0.89 
 

 Key: HIVE-2765
 URL: https://issues.apache.org/jira/browse/HIVE-2765
 Project: Hive
  Issue Type: Improvement
  Components: HBase Handler
Affects Versions: 0.7.0, 0.8.0
Reporter: Pei Yue
  Labels: patch
 Attachments: HIVE-2765.D1485.3.patch

   Original Estimate: 2h
  Remaining Estimate: 2h

 It cannot integrate with HBase0.21 and may not be able to integrate with 
 hbase0.9x

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (HIVE-2769) union with a multi-table insert is not working

2012-01-31 Thread Phabricator (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-2769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Phabricator updated HIVE-2769:
--

Attachment: HIVE-2769.D1545.1.patch

njain requested code review of HIVE-2769 [jira] union with a multi-table 
insert is not working.
Reviewers: JIRA

  https://issues.apache.org/jira/browse/HIVE-2769

  HIVE-2769



TEST PLAN
  EMPTY

REVISION DETAIL
  https://reviews.facebook.net/D1545

AFFECTED FILES
  ql/src/test/results/clientpositive/union31.q.out
  ql/src/test/queries/clientpositive/union31.q
  ql/src/java/org/apache/hadoop/hive/ql/optimizer/GenMRRedSink3.java
  ql/src/java/org/apache/hadoop/hive/ql/optimizer/GenMapRedUtils.java

MANAGE HERALD DIFFERENTIAL RULES
  https://reviews.facebook.net/herald/view/differential/

WHY DID I GET THIS EMAIL?
  https://reviews.facebook.net/herald/transcript/3255/

Tip: use the X-Herald-Rules header to filter Herald messages in your client.


 union with a multi-table insert is not working
 --

 Key: HIVE-2769
 URL: https://issues.apache.org/jira/browse/HIVE-2769
 Project: Hive
  Issue Type: Bug
Reporter: Namit Jain
Assignee: Namit Jain
 Attachments: HIVE-2769.D1545.1.patch




--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Created] (HIVE-2770) HCatInputFormat.getSplits() ignores properties added in JobContext.getConfiguration()

2012-01-31 Thread Francis Liu (Created) (JIRA)
HCatInputFormat.getSplits() ignores properties added in 
JobContext.getConfiguration()
-

 Key: HIVE-2770
 URL: https://issues.apache.org/jira/browse/HIVE-2770
 Project: Hive
  Issue Type: Bug
Affects Versions: 0.3.0
Reporter: Francis Liu




--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Resolved] (HIVE-2770) HCatInputFormat.getSplits() ignores properties added in JobContext.getConfiguration()

2012-01-31 Thread Francis Liu (Resolved) (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-2770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Francis Liu resolved HIVE-2770.
---

Resolution: Invalid

sorry wrong project. 

 HCatInputFormat.getSplits() ignores properties added in 
 JobContext.getConfiguration()
 -

 Key: HIVE-2770
 URL: https://issues.apache.org/jira/browse/HIVE-2770
 Project: Hive
  Issue Type: Bug
Affects Versions: 0.3.0
Reporter: Francis Liu



--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Commented] (HIVE-2769) union with a multi-table insert is not working

2012-01-31 Thread He Yongqiang (Commented) (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-2769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13197444#comment-13197444
 ] 

He Yongqiang commented on HIVE-2769:


+1, will commit after tests pass

 union with a multi-table insert is not working
 --

 Key: HIVE-2769
 URL: https://issues.apache.org/jira/browse/HIVE-2769
 Project: Hive
  Issue Type: Bug
Reporter: Namit Jain
Assignee: Namit Jain
 Attachments: HIVE-2769.D1545.1.patch




--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Commented] (HIVE-2769) union with a multi-table insert is not working

2012-01-31 Thread Phabricator (Commented) (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-2769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13197452#comment-13197452
 ] 

Phabricator commented on HIVE-2769:
---

heyongqiang has accepted the revision HIVE-2769 [jira] union with a 
multi-table insert is not working.

REVISION DETAIL
  https://reviews.facebook.net/D1545


 union with a multi-table insert is not working
 --

 Key: HIVE-2769
 URL: https://issues.apache.org/jira/browse/HIVE-2769
 Project: Hive
  Issue Type: Bug
Reporter: Namit Jain
Assignee: Namit Jain
 Attachments: HIVE-2769.D1545.1.patch




--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Commented] (HIVE-2676) The row count that loaded to a table may not right

2012-01-31 Thread binlijin (Commented) (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-2676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13197488#comment-13197488
 ] 

binlijin commented on HIVE-2676:


Yes, it ready for review

 The row count that loaded to a table may not right   
 -

 Key: HIVE-2676
 URL: https://issues.apache.org/jira/browse/HIVE-2676
 Project: Hive
  Issue Type: Improvement
Reporter: binlijin
Priority: Minor
  Labels: patch
 Attachments: HIVE-2676.patch


 create table tablename as SELECT ***
 At the end hive will print a number that show how many Rows loaded to the 
 tablename, but sometimes the number is not right.  

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (HIVE-2765) hbase handler uses ZooKeeperConnectionException which is not compatible with HBase versions other than 0.89

2012-01-31 Thread Carl Steinbach (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-2765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Carl Steinbach updated HIVE-2765:
-

Fix Version/s: 0.9.0

 hbase handler uses ZooKeeperConnectionException which is not compatible with 
 HBase versions other than 0.89 
 

 Key: HIVE-2765
 URL: https://issues.apache.org/jira/browse/HIVE-2765
 Project: Hive
  Issue Type: Improvement
  Components: HBase Handler
Affects Versions: 0.7.0, 0.8.0
Reporter: Pei Yue
  Labels: patch
 Fix For: 0.9.0

 Attachments: HIVE-2765.D1485.3.patch

   Original Estimate: 2h
  Remaining Estimate: 2h

 It cannot integrate with HBase0.21 and may not be able to integrate with 
 hbase0.9x

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Commented] (HIVE-2765) hbase handler uses ZooKeeperConnectionException which is not compatible with HBase versions other than 0.89

2012-01-31 Thread Hudson (Commented) (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-2765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13197560#comment-13197560
 ] 

Hudson commented on HIVE-2765:
--

Integrated in Hive-trunk-h0.21 #1235 (See 
[https://builds.apache.org/job/Hive-trunk-h0.21/1235/])
HIVE-2765 hbase handler uses ZooKeeperConnectionException which is not 
compatible with HBase versions other than 0.89 (Pei Yue via He Yongqiang)

heyongqiang : 
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1238837
Files : 
* 
/hive/trunk/hbase-handler/src/java/org/apache/hadoop/hive/hbase/HBaseStorageHandler.java


 hbase handler uses ZooKeeperConnectionException which is not compatible with 
 HBase versions other than 0.89 
 

 Key: HIVE-2765
 URL: https://issues.apache.org/jira/browse/HIVE-2765
 Project: Hive
  Issue Type: Improvement
  Components: HBase Handler
Affects Versions: 0.7.0, 0.8.0
Reporter: Pei Yue
  Labels: patch
 Fix For: 0.9.0

 Attachments: HIVE-2765.D1485.3.patch

   Original Estimate: 2h
  Remaining Estimate: 2h

 It cannot integrate with HBase0.21 and may not be able to integrate with 
 hbase0.9x

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




Hive-trunk-h0.21 - Build # 1235 - Still Failing

2012-01-31 Thread Apache Jenkins Server
Changes for Build #1191
[amareshwari] HIVE-2629. Reverting previous commit


Changes for Build #1192
[heyongqiang] HIVE-2706 [jira] StackOverflowError when using custom UDF after 
adding archive
after adding jars
(Kevin Wilfong via Yongqiang He)

Summary:
https://issues.apache.org/jira/browse/HIVE-2706

The issue was that the current thread's classloader and the classloader in the
conf differed due to the prehook updating only the current thread's classloader
with new jars.  Now, it updates both classloaders, fixing the issue.

When a custom UDF is used in a query after add an archive, such as a zip file,
after adding jars, the XMLEncoder enters an infinite loop when serializing the
map reduce task, as part of sending it to be executed. This results in a stack
overflow error.

Test Plan: Verified it fixed the stack overflow error.

Reviewers: JIRA, heyongqiang, njain

Reviewed By: heyongqiang

CC: heyongqiang

Differential Revision: https://reviews.facebook.net/D1167


Changes for Build #1193
[hashutosh] HIVE-2705: SemanticAnalyzer twice swallows an exception it 
shouldn't (jghoman via hashutosh)


Changes for Build #1194

Changes for Build #1195
[hashutosh] HIVE-2589: Newly created partition should inherit properties from 
table (Ashutosh Chauhan)

[hashutosh] HIVE-2682: Clean-up logs (Rajat Goel via Ashutosh Chauhan)


Changes for Build #1196
[amareshwari] HIVE-2629. Make a single Hive binary work with both 0.20.x and 
0.23.0. (Thomas Weise via amareshwari)


Changes for Build #1197

Changes for Build #1198
[namit] HIVE-2504 Warehouse table subdirectories should inherit the group 
permissions of the warehouse
parent directory (Chinna Rao Lalam via namit)

[namit] HIVE-2695 Add PRINTF() Udf (Zhenxiao Luo via namit)


Changes for Build #1199

Changes for Build #1200

Changes for Build #1201

Changes for Build #1202

Changes for Build #1203

Changes for Build #1204
[cws] HIVE-2719. Revert HIVE-2589 (He Yongqiang via cws)


Changes for Build #1205

Changes for Build #1207
[namit] HIVE-2718 NPE in union followed by join
(He Yongqiang via namit)


Changes for Build #1208

Changes for Build #1209

Changes for Build #1210
[namit] HIVE-2674 get_partitions_ps throws TApplicationException if table 
doesn't
exist (Kevin Wilfong via namit)


Changes for Build #1211
[cws] HIVE-2203. Extend concat_ws() UDF to support arrays of strings (Zhenxiao 
Luo via cws)

[cws] HIVE-2279. Implement sort(array) UDF (Zhenxiao Luo via cws)


Changes for Build #1212
[hashutosh] HIVE-2589 : Newly created partition should inherit properties from 
table (Ashutosh Chauhan)


Changes for Build #1213

Changes for Build #1214

Changes for Build #1215

Changes for Build #1216
[cws] HIVE-2724. Remove unused lib/log4j-1.2.15.jar (Andrew Bayer via cws)


Changes for Build #1217

Changes for Build #1218

Changes for Build #1219
[hashutosh] HIVE-2665 : Support for metastore service specific HADOOP_OPTS 
environment setting (thw via hashutosh)


Changes for Build #1220
[namit] HIVE-2727 add a testcase for partitioned view on union and base tables 
have
index (He Yongqiang via namit)


Changes for Build #1221
[hashutosh] HIVE-2746 : Metastore client doesn't log properly in case of 
connection failure to server (hashutosh)

[cws] HIVE-2698 [jira] Enable Hadoop-1.0.0 in Hive
(Enis Söztutar via Carl Steinbach)

Summary:
third version of the patch

Hadoop-1.0.0 is recently released, which is AFAIK, API compatible to the 0.20S
release.

Test Plan: EMPTY

Reviewers: JIRA, cwsteinbach

Reviewed By: cwsteinbach

CC: cwsteinbach, enis

Differential Revision: https://reviews.facebook.net/D1389


Changes for Build #1222
[namit] HIVE-2750 Hive multi group by single reducer optimization causes 
invalid column
reference error (Kevin Wilfong via namit)


Changes for Build #1223

Changes for Build #1224
[cws] HIVE-2734 [jira] Fix some nondeterministic test output
(Zhenxiao Luo via Carl Steinbach)

Summary:
HIVE-2734: Fix some nondeterministic test output

Many Hive query tests lack an ORDER BY clause, and consequently the ordering
of the rows in the result set is nondeterministic:

groupby1_limit
input11_limit
input1_limit
input_lazyserde
join18_multi_distinct
join_1to1
join_casesensitive
join_filters
join_nulls
merge3
rcfile_columnar
rcfile_lazydecompress
rcfile_union
sample10
udf_sentences
union24
columnarserde_create_shortcut
combine1
global_limit

Test Plan: EMPTY

Reviewers: JIRA, cwsteinbach

Reviewed By: cwsteinbach

CC: zhenxiao, cwsteinbach

Differential Revision: https://reviews.facebook.net/D1449

[namit] HIVE-2754 NPE in union with lateral view
(Yongqiang He via namit)


Changes for Build #1225

Changes for Build #1226

Changes for Build #1227
[namit] HIVE-2755 union follwowed by union_subq does not work if the subquery 
union
has reducers (He Yongqiang via namit)


Changes for Build #1228

Changes for Build #1229
[hashutosh] HIVE-2735: PlanUtils.configureTableJobPropertiesForStorageHandler() 
is not called for partitioned table (sushanth via ashutosh)


[jira] [Updated] (HIVE-2700) Add 'ivy-clean-cache' and 'very-clean' Ant targets

2012-01-31 Thread Ashutosh Chauhan (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-2700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ashutosh Chauhan updated HIVE-2700:
---

   Resolution: Fixed
Fix Version/s: 0.9.0
   Status: Resolved  (was: Patch Available)

Committed to trunk.

 Add 'ivy-clean-cache' and 'very-clean' Ant targets
 --

 Key: HIVE-2700
 URL: https://issues.apache.org/jira/browse/HIVE-2700
 Project: Hive
  Issue Type: Improvement
  Components: Build Infrastructure
Reporter: Carl Steinbach
Assignee: Carl Steinbach
 Fix For: 0.9.0

 Attachments: HIVE-2700.1.patch.txt, HIVE-2700.2.patch.txt, 
 HIVE-2700.D1293.1.patch




--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Created] (HIVE-2771) Add support for filter pushdown for key ranges in hbase for keys of type string

2012-01-31 Thread Ashutosh Chauhan (Created) (JIRA)
Add support for filter pushdown for key ranges in hbase for keys of type string
---

 Key: HIVE-2771
 URL: https://issues.apache.org/jira/browse/HIVE-2771
 Project: Hive
  Issue Type: New Feature
  Components: HBase Handler
Affects Versions: 0.8.0, 0.7.1, 0.7.0, 0.8.1
Reporter: Ashutosh Chauhan
Assignee: Ashutosh Chauhan


This is a subtask of HIVE-1643

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (HIVE-2771) Add support for filter pushdown for key ranges in hbase for keys of type string

2012-01-31 Thread Ashutosh Chauhan (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-2771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ashutosh Chauhan updated HIVE-2771:
---

Issue Type: Sub-task  (was: New Feature)
Parent: HIVE-1643

 Add support for filter pushdown for key ranges in hbase for keys of type 
 string
 ---

 Key: HIVE-2771
 URL: https://issues.apache.org/jira/browse/HIVE-2771
 Project: Hive
  Issue Type: Sub-task
  Components: HBase Handler
Affects Versions: 0.7.0, 0.7.1, 0.8.0, 0.8.1
Reporter: Ashutosh Chauhan
Assignee: Ashutosh Chauhan

 This is a subtask of HIVE-1643

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Commented] (HIVE-1643) support range scans and non-key columns in HBase filter pushdown

2012-01-31 Thread Ashutosh Chauhan (Commented) (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-1643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13197583#comment-13197583
 ] 

Ashutosh Chauhan commented on HIVE-1643:


I created a subtask for this (range scans for key of string type) and added 
patch over there. Comments and suggestions welcome. 

 support range scans and non-key columns in HBase filter pushdown
 

 Key: HIVE-1643
 URL: https://issues.apache.org/jira/browse/HIVE-1643
 Project: Hive
  Issue Type: Improvement
  Components: HBase Handler
Affects Versions: 0.7.0
Reporter: John Sichi
Assignee: Vaibhav Aggarwal
 Attachments: hbase_handler.patch


 HIVE-1226 added support for WHERE rowkey=3.  We would like to support WHERE 
 rowkey BETWEEN 10 and 20, as well as predicates on non-rowkeys (plus 
 conjunctions etc).  Non-rowkey conditions can't be used to filter out entire 
 ranges, but they can be used to push the per-row filter processing as far 
 down as possible.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (HIVE-2771) Add support for filter pushdown for key ranges in hbase for keys of type string

2012-01-31 Thread Phabricator (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-2771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Phabricator updated HIVE-2771:
--

Attachment: HIVE-2771.D1551.1.patch

ashutoshc requested code review of HIVE-2771 [jira] Add support for filter 
pushdown for key ranges in hbase for keys of type string.
Reviewers: JIRA

  https://issues.apache.org/jira/browse/HIVE-2771

  This patch adds support for key range scans pushdown to hbase for keys of 
type string. With this patch filter pushdowns of following types are supported:
  a) Point lookups for keys of any types.
  b) Range scans for keys of type string.

  Test Plan:
  Added hbase_ppd_key_range.q which is modeled after hbase_pushdown.q

  This is a subtask of HIVE-1643

TEST PLAN
  EMPTY

REVISION DETAIL
  https://reviews.facebook.net/D1551

AFFECTED FILES
  hbase-handler/src/test/results/hbase_ppd_key_range.q.out
  hbase-handler/src/test/queries/hbase_ppd_key_range.q
  
hbase-handler/src/java/org/apache/hadoop/hive/hbase/HiveHBaseTableInputFormat.java
  hbase-handler/src/java/org/apache/hadoop/hive/hbase/HBaseStorageHandler.java
  ql/src/java/org/apache/hadoop/hive/ql/ppd/OpProcFactory.java
  ql/src/java/org/apache/hadoop/hive/ql/exec/Utilities.java
  ql/src/java/org/apache/hadoop/hive/ql/io/HiveInputFormat.java

MANAGE HERALD DIFFERENTIAL RULES
  https://reviews.facebook.net/herald/view/differential/

WHY DID I GET THIS EMAIL?
  https://reviews.facebook.net/herald/transcript/3261/

Tip: use the X-Herald-Rules header to filter Herald messages in your client.


 Add support for filter pushdown for key ranges in hbase for keys of type 
 string
 ---

 Key: HIVE-2771
 URL: https://issues.apache.org/jira/browse/HIVE-2771
 Project: Hive
  Issue Type: Sub-task
  Components: HBase Handler
Affects Versions: 0.7.0, 0.7.1, 0.8.0, 0.8.1
Reporter: Ashutosh Chauhan
Assignee: Ashutosh Chauhan
 Attachments: HIVE-2771.D1551.1.patch


 This is a subtask of HIVE-1643

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Commented] (HIVE-1643) support range scans and non-key columns in HBase filter pushdown

2012-01-31 Thread Ashutosh Chauhan (Commented) (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-1643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13197584#comment-13197584
 ] 

Ashutosh Chauhan commented on HIVE-1643:


Forgot to mention HIVE-2771

 support range scans and non-key columns in HBase filter pushdown
 

 Key: HIVE-1643
 URL: https://issues.apache.org/jira/browse/HIVE-1643
 Project: Hive
  Issue Type: Improvement
  Components: HBase Handler
Affects Versions: 0.7.0
Reporter: John Sichi
Assignee: Vaibhav Aggarwal
 Attachments: hbase_handler.patch


 HIVE-1226 added support for WHERE rowkey=3.  We would like to support WHERE 
 rowkey BETWEEN 10 and 20, as well as predicates on non-rowkeys (plus 
 conjunctions etc).  Non-rowkey conditions can't be used to filter out entire 
 ranges, but they can be used to push the per-row filter processing as far 
 down as possible.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (HIVE-2673) Eclipse launch configurations fail due to unsatisfied builtins JAR dependency

2012-01-31 Thread Ashutosh Chauhan (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-2673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ashutosh Chauhan updated HIVE-2673:
---

   Resolution: Fixed
Fix Version/s: 0.9.0
   Status: Resolved  (was: Patch Available)

+1 Committed to trunk.

 Eclipse launch configurations fail due to unsatisfied builtins JAR dependency
 -

 Key: HIVE-2673
 URL: https://issues.apache.org/jira/browse/HIVE-2673
 Project: Hive
  Issue Type: Bug
  Components: Build Infrastructure
Reporter: Carl Steinbach
Assignee: Carl Steinbach
 Fix For: 0.9.0

 Attachments: HIVE-2673.1.patch.txt




--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira