Hive-trunk-h0.21 - Build # 1317 - Fixed

2012-03-17 Thread Apache Jenkins Server
Changes for Build #1312
[cws] HIVE-2856. Fix TestCliDriver escape1.q failure on MR2 (Zhenxiao Luo via 
cws)


Changes for Build #1313
[cws] HIVE-2815 [jira] Filter pushdown in hbase for keys stored in binary format
(Ashutosh Chauhan via Carl Steinbach)

Summary:
Further support for pushdown on keys stored in binary format

This patch enables filter pushdown for keys stored in binary format in hbase

Test Plan: Included a new test case.

Reviewers: JIRA, jsichi, njain, cwsteinbach

Reviewed By: cwsteinbach

Differential Revision: https://reviews.facebook.net/D1875

[cws] HIVE-2778 [jira] Fail on table sampling
(Navis Ryu via Carl Steinbach)

Summary:
HIVE-2778 fix NPE on table sampling

Trying table sampling on any non-empty table throws NPE. This does not occur by
test on mini-MR.  div class=preformatted panel style=border-width:
1px;div class=preformattedContent panelContent preselect count(*) from
emp tablesample (0.1 percent);  Total MapReduce jobs = 1 Launching Job 1 out
of 1 Number of reduce tasks determined at compile time: 1 In order to change the
average load for a reducer (in bytes):   set
hive.exec.reducers.bytes.per.reducer=number In order to limit the maximum
number of reducers:   set hive.exec.reducers.max=number In order to set a
constant number of reducers:   set mapred.reduce.tasks=number
java.lang.NullPointerException  at
org.apache.hadoop.hive.ql.io.CombineHiveInputFormat.sampleSplits(CombineHiveInputFormat.java:450)
at
org.apache.hadoop.hive.ql.io.CombineHiveInputFormat.getSplits(CombineHiveInputFormat.java:403)
at 
org.apache.hadoop.mapred.JobClient.writeOldSplits(JobClient.java:971)at
org.apache.hadoop.mapred.JobClient.writeSplits(JobClient.java:963)  at
org.apache.hadoop.mapred.JobClient.access$500(JobClient.java:170)   at
org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:880)at
org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:833)at
java.security.AccessController.doPrivileged(Native Method)  at
javax.security.auth.Subject.doAs(Subject.java:396)  at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1127)
at 
org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:833) at
org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:807)at
org.apache.hadoop.hive.ql.exec.ExecDriver.execute(ExecDriver.java:432)  at
org.apache.hadoop.hive.ql.exec.MapRedTask.execute(MapRedTask.java:136)  at
org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:134)  at
org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:57) 
at
org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1332)   at
org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1123)  at
org.apache.hadoop.hive.ql.Driver.run(Driver.java:931)   at
org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:255)
at
org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:212) at
org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:403)at
org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:671)at
org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:554)   at
sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597) at
org.apache.hadoop.util.RunJar.main(RunJar.java:186) Job Submission failed with
exception 'java.lang.NullPointerException(null)' FAILED: Execution Error, return
code 1 from org.apache.hadoop.hive.ql.exec.MapRedTask  /pre /div/div

Test Plan: EMPTY

Reviewers: JIRA, cwsteinbach

Reviewed By: cwsteinbach

Differential Revision: https://reviews.facebook.net/D1593


Changes for Build #1314
[hashutosh] HIVE-2835: Change default configuration for 
hive.exec.dynamic.partition (Owen Omalley via hashutosh)

[namit] HIVE-2872 Store which configs the user has explicitly changed
(Kevin Wilfng via namit)


Changes for Build #1315
[hashutosh] HIVE-2503: HiveServer should provide per session configuration 
(navis via hashutosh)


Changes for Build #1316
[hashutosh] HIVE-2831 [jira] Mask FsShell output in QTestUtil
(Carl Steinbach via Ashutosh Chauhan)

Summary: HIVE-2831. Mask FsShell output in QTestUtil

Test Plan: EMPTY

Reviewers: JIRA, edwardcapriolo, ashutoshc

Reviewed By: ashutoshc

Differential Revision: https://reviews.facebook.net/D2049

[hashutosh] HIVE-2850 [jira] Remove zero length files
(Owen O'Malley via Ashutosh Chauhan)

Summary:
Enter Revision Title

Remove empty files

There are also zero-length non-source files that need to be removed.

Test Plan: EMPTY

Reviewers: JIRA, ashutoshc

Reviewed By: ashutoshc

Differential Revision: https://reviews.facebook.net/D2163

[namit] HIVE-2871 Add a new hook to run at the beginning and end of the 
Driver.run method
(Kevin Wilfong via 

[jira] [Commented] (HIVE-2865) hive-config.sh should honor HIVE_HOME env

2012-03-17 Thread Hudson (Commented) (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-2865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13231864#comment-13231864
 ] 

Hudson commented on HIVE-2865:
--

Integrated in Hive-trunk-h0.21 #1317 (See 
[https://builds.apache.org/job/Hive-trunk-h0.21/1317/])
HIVE-2865 : hive-config.sh should honor HIVE_HOME env (gkesvan via 
hashutosh) (Revision 1301797)

 Result = SUCCESS
hashutosh : 
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1301797
Files : 
* /hive/trunk/bin/hive-config.sh


 hive-config.sh should honor HIVE_HOME env 
 --

 Key: HIVE-2865
 URL: https://issues.apache.org/jira/browse/HIVE-2865
 Project: Hive
  Issue Type: Improvement
Affects Versions: 0.8.0
Reporter: Giridharan Kesavan
Assignee: Giridharan Kesavan
 Fix For: 0.9.0

 Attachments: HIVE-2865.patch


 hive-config.sh should honor HIVE_HOME env variable if set.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




Hive-trunk-h0.21 - Build # 1318 - Failure

2012-03-17 Thread Apache Jenkins Server
Changes for Build #1318



2 tests failed.
REGRESSION:  
org.apache.hadoop.hive.thrift.TestHadoop20SAuthBridge.testSaslWithHiveMetaStore

Error Message:
null

Stack Trace:
java.lang.NullPointerException
at 
org.apache.hadoop.hive.metastore.HiveMetaStore.getDelegationToken(HiveMetaStore.java:2749)
at 
org.apache.hadoop.hive.thrift.TestHadoop20SAuthBridge.getDelegationTokenStr(TestHadoop20SAuthBridge.java:296)
at 
org.apache.hadoop.hive.thrift.TestHadoop20SAuthBridge.obtainTokenAndAddIntoUGI(TestHadoop20SAuthBridge.java:303)
at 
org.apache.hadoop.hive.thrift.TestHadoop20SAuthBridge.testSaslWithHiveMetaStore(TestHadoop20SAuthBridge.java:212)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at junit.framework.TestCase.runTest(TestCase.java:168)
at junit.framework.TestCase.runBare(TestCase.java:134)
at junit.framework.TestResult$1.protect(TestResult.java:110)
at junit.framework.TestResult.runProtected(TestResult.java:128)
at junit.framework.TestResult.run(TestResult.java:113)
at junit.framework.TestCase.run(TestCase.java:124)
at junit.framework.TestSuite.runTest(TestSuite.java:243)
at junit.framework.TestSuite.run(TestSuite.java:238)
at 
org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:518)
at 
org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.launch(JUnitTestRunner.java:1052)
at 
org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:906)


REGRESSION:  
org.apache.hadoop.hive.thrift.TestHadoop20SAuthBridge.testMetastoreProxyUser

Error Message:
null

Stack Trace:
java.lang.NullPointerException
at 
org.apache.hadoop.hive.metastore.HiveMetaStore.getDelegationToken(HiveMetaStore.java:2749)
at 
org.apache.hadoop.hive.thrift.TestHadoop20SAuthBridge.getDelegationTokenStr(TestHadoop20SAuthBridge.java:296)
at 
org.apache.hadoop.hive.thrift.TestHadoop20SAuthBridge.access$100(TestHadoop20SAuthBridge.java:58)
at 
org.apache.hadoop.hive.thrift.TestHadoop20SAuthBridge$1.run(TestHadoop20SAuthBridge.java:237)
at 
org.apache.hadoop.hive.thrift.TestHadoop20SAuthBridge$1.run(TestHadoop20SAuthBridge.java:232)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at 
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1083)
at 
org.apache.hadoop.hive.thrift.TestHadoop20SAuthBridge.testMetastoreProxyUser(TestHadoop20SAuthBridge.java:232)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at junit.framework.TestCase.runTest(TestCase.java:168)
at junit.framework.TestCase.runBare(TestCase.java:134)
at junit.framework.TestResult$1.protect(TestResult.java:110)
at junit.framework.TestResult.runProtected(TestResult.java:128)
at junit.framework.TestResult.run(TestResult.java:113)
at junit.framework.TestCase.run(TestCase.java:124)
at junit.framework.TestSuite.runTest(TestSuite.java:243)
at junit.framework.TestSuite.run(TestSuite.java:238)
at 
org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:518)
at 
org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.launch(JUnitTestRunner.java:1052)
at 
org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:906)




The Apache Jenkins build system has built Hive-trunk-h0.21 (build #1318)

Status: Failure

Check console output at https://builds.apache.org/job/Hive-trunk-h0.21/1318/ to 
view the results.

[jira] [Commented] (HIVE-2591) Hive 0.7.1 fails with Exception in thread main java.lang.NoSuchFieldError: type

2012-03-17 Thread ransom.hezhiqiang (Commented) (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-2591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13232031#comment-13232031
 ] 

ransom.hezhiqiang commented on HIVE-2591:
-

type error:
it looks some problems in antlr. is the hive.g files changed?

 Hive 0.7.1 fails with Exception in thread main java.lang.NoSuchFieldError: 
 type
 ---

 Key: HIVE-2591
 URL: https://issues.apache.org/jira/browse/HIVE-2591
 Project: Hive
  Issue Type: Bug
  Components: CLI, JDBC, SQL
Affects Versions: 0.7.1
 Environment: Intel Core2 Quad CPU Q8400 @2.66GHz
 4 GB RAM
 Ubuntu 10.10 32 bit
 JDK 6.0_27
 Apache Ant 1.8.0
 Apache Hive 0.7.1
 Apache Hadoop 0.20.203.0
Reporter: Prashanth
Priority: Blocker
  Labels: hive

 Hi,
 When I try to invoke hive and type in SHOW TABLES in cli in the environment 
 as explained above, I get Exception in thread main 
 java.lang.NoSuchFieldError: type and I am not able to use it at all.
 Is there any temporary fix for this? Please let me know, if I am making any 
 mistake here.
 I have downloaded Hive 0.7.1 from the download link as mentioned in the Hive 
 Wiki. The download url is http://hive.apache.org/releases.html.
 /opt/hive-0.7.1$ hive
 WARNING: org.apache.hadoop.metrics.jvm.EventCounter is deprecated. Please use 
 org.apache.hadoop.log.metrics.EventCounter in all the log4j.properties files.
 Hive history file=/tmp/hadoop/hive_job_log_hduser_20190121_764439225.txt
 hive SHOW TABLES;
 Exception in thread main java.lang.NoSuchFieldError: type
 at 
 org.apache.hadoop.hive.ql.parse.HiveLexer.mKW_SHOW(HiveLexer.java:1234)
 at 
 org.apache.hadoop.hive.ql.parse.HiveLexer.mTokens(HiveLexer.java:5942)
 at org.antlr.runtime.Lexer.nextToken(Lexer.java:89)
 at 
 org.antlr.runtime.BufferedTokenStream.fetch(BufferedTokenStream.java:133)
 at 
 org.antlr.runtime.BufferedTokenStream.sync(BufferedTokenStream.java:127)
 at 
 org.antlr.runtime.CommonTokenStream.setup(CommonTokenStream.java:127)
 at org.antlr.runtime.CommonTokenStream.LT(CommonTokenStream.java:91)
 at 
 org.apache.hadoop.hive.ql.parse.HiveParser.statement(HiveParser.java:521)
 at 
 org.apache.hadoop.hive.ql.parse.ParseDriver.parse(ParseDriver.java:436)
 at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:327)
 at org.apache.hadoop.hive.ql.Driver.run(Driver.java:736)
 at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:164)
 at 
 org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:241)
 at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:456)
 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
 at 
 sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
 at 
 sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
 at java.lang.reflect.Method.invoke(Method.java:597)
 at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
 I am not sure what is the actual issue here or rather how to fix it.
 Can you please let me know if there is any workaround for this.
 Alternatively I tried building hive from the SVN source repo.
 I am neither able to build hive from SVN. I get the following error.
 [datanucleusenhancer]   D:\hive\build\ivy\lib\default\zookeeper-3.3.1.jar
 [datanucleusenhancer] Exception in thread main java.lang.VerifyError: 
 Expecting a stackmap frame at branch target 76 in method 
 org.apache.hadoop.hive.metastore.model.MDatabase.jdoCopyField(Lorg/apache/hadoop/hive/metastore/model/MDatabase;I)V
  at offset 1
 [datanucleusenhancer]   at java.lang.Class.getDeclaredFields0(Native Method)
 [datanucleusenhancer]   at 
 java.lang.Class.privateGetDeclaredFields(Class.java:2308)
 [datanucleusenhancer]   at java.lang.Class.getDeclaredFields(Class.java:1760)
 [datanucleusenhancer]   at 
 org.datanucleus.metadata.ClassMetaData.addMetaDataForMembersNotInMetaData(ClassMetaData.java:358)
 [datanucleusenhancer]   at 
 org.datanucleus.metadata.ClassMetaData.populate(ClassMetaData.java:199)
 [datanucleusenhancer]   at 
 org.datanucleus.metadata.MetaDataManager$1.run(MetaDataManager.java:2394)
 [datanucleusenhancer]   at java.security.AccessController.doPrivileged(Native 
 Method)
 [datanucleusenhancer]   at 
 org.datanucleus.metadata.MetaDataManager.populateAbstractClassMetaData(MetaDataManager.java:2388)
 [datanucleusenhancer]   at 
 org.datanucleus.metadata.MetaDataManager.populateFileMetaData(MetaDataManager.java:2225)
 [datanucleusenhancer]   at 
 org.datanucleus.metadata.MetaDataManager.initialiseFileMetaDataForUse(MetaDataManager.java:925)
 [datanucleusenhancer]   at 
 

Hive-0.8.1-SNAPSHOT-h0.21 - Build # 225 - Fixed

2012-03-17 Thread Apache Jenkins Server
Changes for Build #224

Changes for Build #225



All tests passed

The Apache Jenkins build system has built Hive-0.8.1-SNAPSHOT-h0.21 (build #225)

Status: Fixed

Check console output at 
https://builds.apache.org/job/Hive-0.8.1-SNAPSHOT-h0.21/225/ to view the 
results.