[jira] [Commented] (HIVE-2467) HA Support for Metastore Server

2011-11-13 Thread Ashutosh Chauhan (Commented) (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-2467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13149251#comment-13149251
 ] 

Ashutosh Chauhan commented on HIVE-2467:


ZK security in upcoming release may require some time to bake in. Another 
alternative approaches could have been to store tokens in hdfs or mysql server. 
Both of them are secure right now. Though, good part of your design is you have 
made TokenStore abstract so there could be multiple implementations of it, if 
need be.

 HA Support for Metastore Server 
 

 Key: HIVE-2467
 URL: https://issues.apache.org/jira/browse/HIVE-2467
 Project: Hive
  Issue Type: Improvement
  Components: Metastore, Security, Server Infrastructure
Affects Versions: 0.8.0, 0.9.0
Reporter: Thomas Weise
Assignee: Thomas Weise
 Fix For: 0.9.0

 Attachments: HIVE-2467.patch


 We require HA deployment for metastore server for HCatalog:
 * Multiple server instances run behind VIP
 * Database provides HA
 Metastore server instances will need to be able to share any state required 
 for VIP outside RDBMS. As of Hive 0.8 affected conversational state that 
 needs to support VIP/HA setup is limited to current delegation tokens. Is 
 this correct?
 We are planning to use ZooKeeper to share current delegation tokens and 
 master keys between nodes of the VIP. ZK is already (optionally) used by Hive 
 for concurrency control. Access to ZK would be limited on the network level 
 or in the future, when ZooKeeper supports security, through Kerberos, similar 
 to NN access.
 Currently Hive taps into Hadoop core security delegation token support 
 through extension of
 org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManagerTokenIdent
 A solution could amend the Hive specific extension to support:
 * Pluggable delegation token and master key store (ZooKeeper as alternative 
 for in-memory AbstractDelegationTokenSecretManager)
 * Delegation token retrieval from token store when not found in memory 
 (wrap/extend retrievePassword(...))
 * Cancellation of token in token store
 * Purging of expired tokens from token store
 http://www.mail-archive.com/hcatalog-user@incubator.apache.org/msg00053.html

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (HIVE-2439) Upgrade antlr version to 3.4

2011-11-13 Thread Ashutosh Chauhan (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-2439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ashutosh Chauhan updated HIVE-2439:
---

Attachment: hive-2439_incomplete.patch

This is an incomplete patch which you need to get past this problem. But this 
patch is not sufficient. I worked on this briefly in September and encountered 
a bug in antlr. See: 
http://www.antlr.org/pipermail/antlr-interest/2011-September/042720.html I have 
not been able to narrow it down to file an official bug in antlr but right now 
I am apprehensive about 3.4. Good news though is antlr community is talking 
about 3.4.1 which may get released soon. 

 Upgrade antlr version to 3.4
 

 Key: HIVE-2439
 URL: https://issues.apache.org/jira/browse/HIVE-2439
 Project: Hive
  Issue Type: Improvement
Affects Versions: 0.8.0
Reporter: Ashutosh Chauhan
 Attachments: hive-2439_incomplete.patch


 Upgrade antlr version to 3.4

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Commented] (HIVE-2439) Upgrade antlr version to 3.4

2011-11-13 Thread Ashutosh Chauhan (Commented) (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-2439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13149256#comment-13149256
 ] 

Ashutosh Chauhan commented on HIVE-2439:


If any one wants to pursue this further feel free to take over the patch.

 Upgrade antlr version to 3.4
 

 Key: HIVE-2439
 URL: https://issues.apache.org/jira/browse/HIVE-2439
 Project: Hive
  Issue Type: Improvement
Affects Versions: 0.8.0
Reporter: Ashutosh Chauhan
 Attachments: hive-2439_incomplete.patch


 Upgrade antlr version to 3.4

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




Hive-0.8.0-SNAPSHOT-h0.21 - Build # 93 - Fixed

2011-11-13 Thread Apache Jenkins Server
Changes for Build #92

Changes for Build #93



All tests passed

The Apache Jenkins build system has built Hive-0.8.0-SNAPSHOT-h0.21 (build #93)

Status: Fixed

Check console output at 
https://builds.apache.org/job/Hive-0.8.0-SNAPSHOT-h0.21/93/ to view the results.


Hive-trunk-h0.21 - Build # 1081 - Failure

2011-11-13 Thread Apache Jenkins Server
Changes for Build #1081



2 tests failed.
REGRESSION:  
org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_bucketmapjoin6

Error Message:
Unexpected exception See build/ql/tmp/hive.log, or try ant test ... 
-Dtest.silent=false to get more logs.

Stack Trace:
junit.framework.AssertionFailedError: Unexpected exception
See build/ql/tmp/hive.log, or try ant test ... -Dtest.silent=false to get 
more logs.
at junit.framework.Assert.fail(Assert.java:50)
at 
org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_bucketmapjoin6(TestMinimrCliDriver.java:242)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at junit.framework.TestCase.runTest(TestCase.java:168)
at junit.framework.TestCase.runBare(TestCase.java:134)
at junit.framework.TestResult$1.protect(TestResult.java:110)
at junit.framework.TestResult.runProtected(TestResult.java:128)
at junit.framework.TestResult.run(TestResult.java:113)
at junit.framework.TestCase.run(TestCase.java:124)
at junit.framework.TestSuite.runTest(TestSuite.java:243)
at junit.framework.TestSuite.run(TestSuite.java:238)
at 
org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:422)
at 
org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.launch(JUnitTestRunner.java:931)
at 
org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:785)


REGRESSION:  
org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_groupby2

Error Message:
Unexpected exception See build/ql/tmp/hive.log, or try ant test ... 
-Dtest.silent=false to get more logs.

Stack Trace:
junit.framework.AssertionFailedError: Unexpected exception
See build/ql/tmp/hive.log, or try ant test ... -Dtest.silent=false to get 
more logs.
at junit.framework.Assert.fail(Assert.java:50)
at 
org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_groupby2(TestMinimrCliDriver.java:338)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at junit.framework.TestCase.runTest(TestCase.java:168)
at junit.framework.TestCase.runBare(TestCase.java:134)
at junit.framework.TestResult$1.protect(TestResult.java:110)
at junit.framework.TestResult.runProtected(TestResult.java:128)
at junit.framework.TestResult.run(TestResult.java:113)
at junit.framework.TestCase.run(TestCase.java:124)
at junit.framework.TestSuite.runTest(TestSuite.java:243)
at junit.framework.TestSuite.run(TestSuite.java:238)
at 
org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:422)
at 
org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.launch(JUnitTestRunner.java:931)
at 
org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:785)




The Apache Jenkins build system has built Hive-trunk-h0.21 (build #1081)

Status: Failure

Check console output at https://builds.apache.org/job/Hive-trunk-h0.21/1081/ to 
view the results.


Hive-trunk-h0.21 - Build # 1082 - Still Failing

2011-11-13 Thread Apache Jenkins Server
Changes for Build #1081

Changes for Build #1082
[namit] HIVE-2572 HIVE-2246 upgrade script changed the COLUMNS_V2.COMMENT length
(Ning Zhang via namit)




10 tests failed.
REGRESSION:  
org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_bucketizedhiveinputformat

Error Message:
Unexpected exception
See build/ql/tmp/hive.log, or try ant test ... -Dtest.silent=false to get 
more logs.

Stack Trace:
junit.framework.AssertionFailedError: Unexpected exception
See build/ql/tmp/hive.log, or try ant test ... -Dtest.silent=false to get 
more logs.
at junit.framework.Assert.fail(Assert.java:50)
at 
org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_bucketizedhiveinputformat(TestMinimrCliDriver.java:194)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at junit.framework.TestCase.runTest(TestCase.java:168)
at junit.framework.TestCase.runBare(TestCase.java:134)
at junit.framework.TestResult$1.protect(TestResult.java:110)
at junit.framework.TestResult.runProtected(TestResult.java:128)
at junit.framework.TestResult.run(TestResult.java:113)
at junit.framework.TestCase.run(TestCase.java:124)
at junit.framework.TestSuite.runTest(TestSuite.java:243)
at junit.framework.TestSuite.run(TestSuite.java:238)
at 
org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:518)
at 
org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.launch(JUnitTestRunner.java:1052)
at 
org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:906)


REGRESSION:  
org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_disable_merge_for_bucketing

Error Message:
Unexpected exception
See build/ql/tmp/hive.log, or try ant test ... -Dtest.silent=false to get 
more logs.

Stack Trace:
junit.framework.AssertionFailedError: Unexpected exception
See build/ql/tmp/hive.log, or try ant test ... -Dtest.silent=false to get 
more logs.
at junit.framework.Assert.fail(Assert.java:50)
at 
org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_disable_merge_for_bucketing(TestMinimrCliDriver.java:290)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at junit.framework.TestCase.runTest(TestCase.java:168)
at junit.framework.TestCase.runBare(TestCase.java:134)
at junit.framework.TestResult$1.protect(TestResult.java:110)
at junit.framework.TestResult.runProtected(TestResult.java:128)
at junit.framework.TestResult.run(TestResult.java:113)
at junit.framework.TestCase.run(TestCase.java:124)
at junit.framework.TestSuite.runTest(TestSuite.java:243)
at junit.framework.TestSuite.run(TestSuite.java:238)
at 
org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:518)
at 
org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.launch(JUnitTestRunner.java:1052)
at 
org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:906)


REGRESSION:  
org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_reduce_deduplicate

Error Message:
Unexpected exception
See build/ql/tmp/hive.log, or try ant test ... -Dtest.silent=false to get 
more logs.

Stack Trace:
junit.framework.AssertionFailedError: Unexpected exception
See build/ql/tmp/hive.log, or try ant test ... -Dtest.silent=false to get 
more logs.
at junit.framework.Assert.fail(Assert.java:50)
at 
org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_reduce_deduplicate(TestMinimrCliDriver.java:482)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at junit.framework.TestCase.runTest(TestCase.java:168)
at junit.framework.TestCase.runBare(TestCase.java:134)
at junit.framework.TestResult$1.protect(TestResult.java:110)
at junit.framework.TestResult.runProtected(TestResult.java:128)
at junit.framework.TestResult.run(TestResult.java:113)
at junit.framework.TestCase.run(TestCase.java:124)
at junit.framework.TestSuite.runTest(TestSuite.java:243)
at junit.framework.TestSuite.run(TestSuite.java:238)

[jira] [Commented] (HIVE-2572) HIVE-2246 upgrade script changed the COLUMNS_V2.COMMENT length

2011-11-13 Thread Hudson (Commented) (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-2572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13149396#comment-13149396
 ] 

Hudson commented on HIVE-2572:
--

Integrated in Hive-trunk-h0.21 #1082 (See 
[https://builds.apache.org/job/Hive-trunk-h0.21/1082/])
HIVE-2572 HIVE-2246 upgrade script changed the COLUMNS_V2.COMMENT length
(Ning Zhang via namit)

namit : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1201470
Files : 
* /hive/trunk/metastore/scripts/upgrade/mysql/008-HIVE-2246.mysql.sql


 HIVE-2246 upgrade script changed the COLUMNS_V2.COMMENT length
 --

 Key: HIVE-2572
 URL: https://issues.apache.org/jira/browse/HIVE-2572
 Project: Hive
  Issue Type: Bug
Affects Versions: 0.8.0
Reporter: Ning Zhang
Assignee: Ning Zhang
 Fix For: 0.8.0, 0.9.0

 Attachments: D381.1.patch


 This changes from varchar(4000) to varchar(128) is backward incompatible. 

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Commented] (HIVE-2246) Dedupe tables' column schemas from partitions in the metastore db

2011-11-13 Thread Hudson (Commented) (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-2246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13149397#comment-13149397
 ] 

Hudson commented on HIVE-2246:
--

Integrated in Hive-trunk-h0.21 #1082 (See 
[https://builds.apache.org/job/Hive-trunk-h0.21/1082/])
HIVE-2572 HIVE-2246 upgrade script changed the COLUMNS_V2.COMMENT length
(Ning Zhang via namit)

namit : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1201470
Files : 
* /hive/trunk/metastore/scripts/upgrade/mysql/008-HIVE-2246.mysql.sql


 Dedupe tables' column schemas from partitions in the metastore db
 -

 Key: HIVE-2246
 URL: https://issues.apache.org/jira/browse/HIVE-2246
 Project: Hive
  Issue Type: Improvement
  Components: Metastore
Reporter: Sohan Jain
Assignee: Sohan Jain
 Fix For: 0.8.0

 Attachments: HIVE-2246.2.patch, HIVE-2246.3.patch, HIVE-2246.4.patch, 
 HIVE-2246.8.patch


 Note: this patch proposes a schema change, and is therefore incompatible with 
 the current metastore.
 We can re-organize the JDO models to reduce space usage to keep the metastore 
 scalable for the future.  Currently, partitions are the fastest growing 
 objects in the metastore, and the metastore keeps a separate copy of the 
 columns list for each partition.  We can normalize the metastore db by 
 decoupling Columns from Storage Descriptors and not storing duplicate lists 
 of the columns for each partition. 
 An idea is to create an additional level of indirection with a Column 
 Descriptor that has a list of columns.  A table has a reference to its 
 latest Column Descriptor (note: a table may have more than one Column 
 Descriptor in the case of schema evolution).  Partitions and Indexes can 
 reference the same Column Descriptors as their parent table.
 Currently, the COLUMNS table in the metastore has roughly (number of 
 partitions + number of tables) * (average number of columns pertable) rows.  
 We can reduce this to (number of tables) * (average number of columns per 
 table) rows, while incurring a small cost proportional to the number of 
 tables to store the Column Descriptors.
 Please see the latest review board for additional implementation details.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Resolved] (HIVE-2553) Use hashing instead of list traversal for IN operator for primitive types

2011-11-13 Thread Ning Zhang (Resolved) (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-2553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ning Zhang resolved HIVE-2553.
--

   Resolution: Fixed
Fix Version/s: 0.9.0
 Hadoop Flags: Reviewed

Committed. Thanks Robert!

 Use hashing instead of list traversal for IN operator for primitive types
 -

 Key: HIVE-2553
 URL: https://issues.apache.org/jira/browse/HIVE-2553
 Project: Hive
  Issue Type: Improvement
Reporter: Robert Surówka
Assignee: Robert Surówka
Priority: Minor
 Fix For: 0.9.0

 Attachments: HIVE-2553.1.patch, HIVE-2553.2.patch, HIVE-2553.3.patch, 
 HIVE-2553.4.patch




--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Commented] (HIVE-2567) Some CTAS queries with * and group by don't work.

2011-11-13 Thread Ning Zhang (Commented) (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-2567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13149443#comment-13149443
 ] 

Ning Zhang commented on HIVE-2567:
--

Robert, this patch doesn't apply cleanly. Can you svn up and regenerate the 
patch?

 Some CTAS queries with * and group by don't work.
 -

 Key: HIVE-2567
 URL: https://issues.apache.org/jira/browse/HIVE-2567
 Project: Hive
  Issue Type: Bug
Reporter: Robert Surówka
Assignee: Robert Surówka
Priority: Minor
 Attachments: HIVE-2567.1.patch




--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (HIVE-2566) reduce the number map-reduce jobs for union all

2011-11-13 Thread Phabricator (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-2566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Phabricator updated HIVE-2566:
--

Attachment: HIVE-2566.D405.2.patch

njain updated the revision HIVE-2566 [jira] reduce the number map-reduce jobs 
for union all.
Reviewers: JIRA

  HIVE-2566 patch available

REVISION DETAIL
  https://reviews.facebook.net/D405

AFFECTED FILES
  ql/src/test/results/clientpositive/merge4.q.out
  ql/src/test/results/clientpositive/auto_join27.q.out
  ql/src/test/results/clientpositive/union19.q.out
  ql/src/test/results/clientpositive/union4.q.out
  ql/src/test/results/clientpositive/union14.q.out
  ql/src/test/results/clientpositive/create_view.q.out
  ql/src/test/results/clientpositive/union5.q.out
  ql/src/test/results/clientpositive/ql_rewrite_gbtoidx.q.out
  ql/src/test/results/clientpositive/load_dyn_part14.q.out
  ql/src/test/results/clientpositive/union15.q.out
  ql/src/test/results/clientpositive/union24.q.out
  ql/src/test/results/clientpositive/union10.q.out
  ql/src/test/results/clientpositive/input25.q.out
  ql/src/test/results/clientpositive/union6.q.out
  ql/src/test/results/clientpositive/lineage1.q.out
  ql/src/test/results/clientpositive/union11.q.out
  ql/src/test/results/clientpositive/join35.q.out
  ql/src/test/results/clientpositive/union20.q.out
  ql/src/test/results/clientpositive/input26.q.out
  ql/src/test/results/clientpositive/union7.q.out
  ql/src/test/results/clientpositive/union17.q.out
  ql/src/test/results/clientpositive/union12.q.out
  ql/src/test/results/clientpositive/stats1.q.out
  ql/src/test/results/clientpositive/union18.q.out
  ql/src/test/results/clientpositive/union3.q.out
  ql/src/test/results/clientpositive/ppd_union_view.q.out
  ql/src/test/queries/clientpositive/union24.q
  ql/src/java/org/apache/hadoop/hive/ql/optimizer/GenMRProcContext.java
  ql/src/java/org/apache/hadoop/hive/ql/optimizer/GenMRUnion1.java
  ql/src/java/org/apache/hadoop/hive/ql/optimizer/GenMapRedUtils.java
  ql/src/java/org/apache/hadoop/hive/ql/exec/Operator.java


 reduce the number map-reduce jobs for union all
 ---

 Key: HIVE-2566
 URL: https://issues.apache.org/jira/browse/HIVE-2566
 Project: Hive
  Issue Type: Improvement
Reporter: Namit Jain
Assignee: Namit Jain
 Attachments: HIVE-2566.D405.1.patch, HIVE-2566.D405.2.patch


 A query like:
 select s.key, s.value from (
   select key, value from src2  where key  10
   union all 
   select key, value from src3  where key  10
   union all 
   select key, value from src4  where key  10
   union all 
   select key, count(1) as value from src5 group by key
 )s;
 should run the last sub-query 
 'select key, count(1) as value from src5 group by key'
 as a map-reduce job.
 And then the union should be a map-only job reading from the first 3 map-only 
 subqueries
 and the output of the last map-reduce job.
 The current plan is very inefficient.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Resolved] (HIVE-2572) HIVE-2246 upgrade script changed the COLUMNS_V2.COMMENT length

2011-11-13 Thread Namit Jain (Resolved) (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-2572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Namit Jain resolved HIVE-2572.
--

  Resolution: Fixed
Hadoop Flags: Reviewed

Committed. Thanks Ning

 HIVE-2246 upgrade script changed the COLUMNS_V2.COMMENT length
 --

 Key: HIVE-2572
 URL: https://issues.apache.org/jira/browse/HIVE-2572
 Project: Hive
  Issue Type: Bug
Affects Versions: 0.8.0
Reporter: Ning Zhang
Assignee: Ning Zhang
 Fix For: 0.8.0, 0.9.0

 Attachments: D381.1.patch


 This changes from varchar(4000) to varchar(128) is backward incompatible. 

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (HIVE-2503) HiveServer should provide per session configuration

2011-11-13 Thread Navis (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-2503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Navis updated HIVE-2503:


Attachment: (was: HIVE-2503-0.8.0.patch)

 HiveServer should provide per session configuration
 ---

 Key: HIVE-2503
 URL: https://issues.apache.org/jira/browse/HIVE-2503
 Project: Hive
  Issue Type: Bug
  Components: CLI, Server Infrastructure
Reporter: Navis

 Currently ThriftHiveProcessorFactory returns same HiveConf instance to 
 HiveServerHandler, making impossible to use per sesssion configuration. Just 
 wrapping 'conf' - 'new HiveConf(conf)' seemed to solve this problem.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira