Hive-trunk-h0.21 - Build # 1317 - Fixed
Changes for Build #1312 [cws] HIVE-2856. Fix TestCliDriver escape1.q failure on MR2 (Zhenxiao Luo via cws) Changes for Build #1313 [cws] HIVE-2815 [jira] Filter pushdown in hbase for keys stored in binary format (Ashutosh Chauhan via Carl Steinbach) Summary: Further support for pushdown on keys stored in binary format This patch enables filter pushdown for keys stored in binary format in hbase Test Plan: Included a new test case. Reviewers: JIRA, jsichi, njain, cwsteinbach Reviewed By: cwsteinbach Differential Revision: https://reviews.facebook.net/D1875 [cws] HIVE-2778 [jira] Fail on table sampling (Navis Ryu via Carl Steinbach) Summary: HIVE-2778 fix NPE on table sampling Trying table sampling on any non-empty table throws NPE. This does not occur by test on mini-MR. div class=preformatted panel style=border-width: 1px;div class=preformattedContent panelContent preselect count(*) from emp tablesample (0.1 percent); Total MapReduce jobs = 1 Launching Job 1 out of 1 Number of reduce tasks determined at compile time: 1 In order to change the average load for a reducer (in bytes): set hive.exec.reducers.bytes.per.reducer=number In order to limit the maximum number of reducers: set hive.exec.reducers.max=number In order to set a constant number of reducers: set mapred.reduce.tasks=number java.lang.NullPointerException at org.apache.hadoop.hive.ql.io.CombineHiveInputFormat.sampleSplits(CombineHiveInputFormat.java:450) at org.apache.hadoop.hive.ql.io.CombineHiveInputFormat.getSplits(CombineHiveInputFormat.java:403) at org.apache.hadoop.mapred.JobClient.writeOldSplits(JobClient.java:971)at org.apache.hadoop.mapred.JobClient.writeSplits(JobClient.java:963) at org.apache.hadoop.mapred.JobClient.access$500(JobClient.java:170) at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:880)at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:833)at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:396) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1127) at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:833) at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:807)at org.apache.hadoop.hive.ql.exec.ExecDriver.execute(ExecDriver.java:432) at org.apache.hadoop.hive.ql.exec.MapRedTask.execute(MapRedTask.java:136) at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:134) at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:57) at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1332) at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1123) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:931) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:255) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:212) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:403)at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:671)at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:554) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.hadoop.util.RunJar.main(RunJar.java:186) Job Submission failed with exception 'java.lang.NullPointerException(null)' FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MapRedTask /pre /div/div Test Plan: EMPTY Reviewers: JIRA, cwsteinbach Reviewed By: cwsteinbach Differential Revision: https://reviews.facebook.net/D1593 Changes for Build #1314 [hashutosh] HIVE-2835: Change default configuration for hive.exec.dynamic.partition (Owen Omalley via hashutosh) [namit] HIVE-2872 Store which configs the user has explicitly changed (Kevin Wilfng via namit) Changes for Build #1315 [hashutosh] HIVE-2503: HiveServer should provide per session configuration (navis via hashutosh) Changes for Build #1316 [hashutosh] HIVE-2831 [jira] Mask FsShell output in QTestUtil (Carl Steinbach via Ashutosh Chauhan) Summary: HIVE-2831. Mask FsShell output in QTestUtil Test Plan: EMPTY Reviewers: JIRA, edwardcapriolo, ashutoshc Reviewed By: ashutoshc Differential Revision: https://reviews.facebook.net/D2049 [hashutosh] HIVE-2850 [jira] Remove zero length files (Owen O'Malley via Ashutosh Chauhan) Summary: Enter Revision Title Remove empty files There are also zero-length non-source files that need to be removed. Test Plan: EMPTY Reviewers: JIRA, ashutoshc Reviewed By: ashutoshc Differential Revision: https://reviews.facebook.net/D2163 [namit] HIVE-2871 Add a new hook to run at the beginning and end of the Driver.run method (Kevin Wilfong via
[jira] [Commented] (HIVE-2865) hive-config.sh should honor HIVE_HOME env
[ https://issues.apache.org/jira/browse/HIVE-2865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13231864#comment-13231864 ] Hudson commented on HIVE-2865: -- Integrated in Hive-trunk-h0.21 #1317 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1317/]) HIVE-2865 : hive-config.sh should honor HIVE_HOME env (gkesvan via hashutosh) (Revision 1301797) Result = SUCCESS hashutosh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1301797 Files : * /hive/trunk/bin/hive-config.sh hive-config.sh should honor HIVE_HOME env -- Key: HIVE-2865 URL: https://issues.apache.org/jira/browse/HIVE-2865 Project: Hive Issue Type: Improvement Affects Versions: 0.8.0 Reporter: Giridharan Kesavan Assignee: Giridharan Kesavan Fix For: 0.9.0 Attachments: HIVE-2865.patch hive-config.sh should honor HIVE_HOME env variable if set. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
Hive-trunk-h0.21 - Build # 1318 - Failure
Changes for Build #1318 2 tests failed. REGRESSION: org.apache.hadoop.hive.thrift.TestHadoop20SAuthBridge.testSaslWithHiveMetaStore Error Message: null Stack Trace: java.lang.NullPointerException at org.apache.hadoop.hive.metastore.HiveMetaStore.getDelegationToken(HiveMetaStore.java:2749) at org.apache.hadoop.hive.thrift.TestHadoop20SAuthBridge.getDelegationTokenStr(TestHadoop20SAuthBridge.java:296) at org.apache.hadoop.hive.thrift.TestHadoop20SAuthBridge.obtainTokenAndAddIntoUGI(TestHadoop20SAuthBridge.java:303) at org.apache.hadoop.hive.thrift.TestHadoop20SAuthBridge.testSaslWithHiveMetaStore(TestHadoop20SAuthBridge.java:212) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at junit.framework.TestCase.runTest(TestCase.java:168) at junit.framework.TestCase.runBare(TestCase.java:134) at junit.framework.TestResult$1.protect(TestResult.java:110) at junit.framework.TestResult.runProtected(TestResult.java:128) at junit.framework.TestResult.run(TestResult.java:113) at junit.framework.TestCase.run(TestCase.java:124) at junit.framework.TestSuite.runTest(TestSuite.java:243) at junit.framework.TestSuite.run(TestSuite.java:238) at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:518) at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.launch(JUnitTestRunner.java:1052) at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:906) REGRESSION: org.apache.hadoop.hive.thrift.TestHadoop20SAuthBridge.testMetastoreProxyUser Error Message: null Stack Trace: java.lang.NullPointerException at org.apache.hadoop.hive.metastore.HiveMetaStore.getDelegationToken(HiveMetaStore.java:2749) at org.apache.hadoop.hive.thrift.TestHadoop20SAuthBridge.getDelegationTokenStr(TestHadoop20SAuthBridge.java:296) at org.apache.hadoop.hive.thrift.TestHadoop20SAuthBridge.access$100(TestHadoop20SAuthBridge.java:58) at org.apache.hadoop.hive.thrift.TestHadoop20SAuthBridge$1.run(TestHadoop20SAuthBridge.java:237) at org.apache.hadoop.hive.thrift.TestHadoop20SAuthBridge$1.run(TestHadoop20SAuthBridge.java:232) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:396) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1083) at org.apache.hadoop.hive.thrift.TestHadoop20SAuthBridge.testMetastoreProxyUser(TestHadoop20SAuthBridge.java:232) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at junit.framework.TestCase.runTest(TestCase.java:168) at junit.framework.TestCase.runBare(TestCase.java:134) at junit.framework.TestResult$1.protect(TestResult.java:110) at junit.framework.TestResult.runProtected(TestResult.java:128) at junit.framework.TestResult.run(TestResult.java:113) at junit.framework.TestCase.run(TestCase.java:124) at junit.framework.TestSuite.runTest(TestSuite.java:243) at junit.framework.TestSuite.run(TestSuite.java:238) at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:518) at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.launch(JUnitTestRunner.java:1052) at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:906) The Apache Jenkins build system has built Hive-trunk-h0.21 (build #1318) Status: Failure Check console output at https://builds.apache.org/job/Hive-trunk-h0.21/1318/ to view the results.
[jira] [Commented] (HIVE-2591) Hive 0.7.1 fails with Exception in thread main java.lang.NoSuchFieldError: type
[ https://issues.apache.org/jira/browse/HIVE-2591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13232031#comment-13232031 ] ransom.hezhiqiang commented on HIVE-2591: - type error: it looks some problems in antlr. is the hive.g files changed? Hive 0.7.1 fails with Exception in thread main java.lang.NoSuchFieldError: type --- Key: HIVE-2591 URL: https://issues.apache.org/jira/browse/HIVE-2591 Project: Hive Issue Type: Bug Components: CLI, JDBC, SQL Affects Versions: 0.7.1 Environment: Intel Core2 Quad CPU Q8400 @2.66GHz 4 GB RAM Ubuntu 10.10 32 bit JDK 6.0_27 Apache Ant 1.8.0 Apache Hive 0.7.1 Apache Hadoop 0.20.203.0 Reporter: Prashanth Priority: Blocker Labels: hive Hi, When I try to invoke hive and type in SHOW TABLES in cli in the environment as explained above, I get Exception in thread main java.lang.NoSuchFieldError: type and I am not able to use it at all. Is there any temporary fix for this? Please let me know, if I am making any mistake here. I have downloaded Hive 0.7.1 from the download link as mentioned in the Hive Wiki. The download url is http://hive.apache.org/releases.html. /opt/hive-0.7.1$ hive WARNING: org.apache.hadoop.metrics.jvm.EventCounter is deprecated. Please use org.apache.hadoop.log.metrics.EventCounter in all the log4j.properties files. Hive history file=/tmp/hadoop/hive_job_log_hduser_20190121_764439225.txt hive SHOW TABLES; Exception in thread main java.lang.NoSuchFieldError: type at org.apache.hadoop.hive.ql.parse.HiveLexer.mKW_SHOW(HiveLexer.java:1234) at org.apache.hadoop.hive.ql.parse.HiveLexer.mTokens(HiveLexer.java:5942) at org.antlr.runtime.Lexer.nextToken(Lexer.java:89) at org.antlr.runtime.BufferedTokenStream.fetch(BufferedTokenStream.java:133) at org.antlr.runtime.BufferedTokenStream.sync(BufferedTokenStream.java:127) at org.antlr.runtime.CommonTokenStream.setup(CommonTokenStream.java:127) at org.antlr.runtime.CommonTokenStream.LT(CommonTokenStream.java:91) at org.apache.hadoop.hive.ql.parse.HiveParser.statement(HiveParser.java:521) at org.apache.hadoop.hive.ql.parse.ParseDriver.parse(ParseDriver.java:436) at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:327) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:736) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:164) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:241) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:456) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.hadoop.util.RunJar.main(RunJar.java:156) I am not sure what is the actual issue here or rather how to fix it. Can you please let me know if there is any workaround for this. Alternatively I tried building hive from the SVN source repo. I am neither able to build hive from SVN. I get the following error. [datanucleusenhancer] D:\hive\build\ivy\lib\default\zookeeper-3.3.1.jar [datanucleusenhancer] Exception in thread main java.lang.VerifyError: Expecting a stackmap frame at branch target 76 in method org.apache.hadoop.hive.metastore.model.MDatabase.jdoCopyField(Lorg/apache/hadoop/hive/metastore/model/MDatabase;I)V at offset 1 [datanucleusenhancer] at java.lang.Class.getDeclaredFields0(Native Method) [datanucleusenhancer] at java.lang.Class.privateGetDeclaredFields(Class.java:2308) [datanucleusenhancer] at java.lang.Class.getDeclaredFields(Class.java:1760) [datanucleusenhancer] at org.datanucleus.metadata.ClassMetaData.addMetaDataForMembersNotInMetaData(ClassMetaData.java:358) [datanucleusenhancer] at org.datanucleus.metadata.ClassMetaData.populate(ClassMetaData.java:199) [datanucleusenhancer] at org.datanucleus.metadata.MetaDataManager$1.run(MetaDataManager.java:2394) [datanucleusenhancer] at java.security.AccessController.doPrivileged(Native Method) [datanucleusenhancer] at org.datanucleus.metadata.MetaDataManager.populateAbstractClassMetaData(MetaDataManager.java:2388) [datanucleusenhancer] at org.datanucleus.metadata.MetaDataManager.populateFileMetaData(MetaDataManager.java:2225) [datanucleusenhancer] at org.datanucleus.metadata.MetaDataManager.initialiseFileMetaDataForUse(MetaDataManager.java:925) [datanucleusenhancer] at
Hive-0.8.1-SNAPSHOT-h0.21 - Build # 225 - Fixed
Changes for Build #224 Changes for Build #225 All tests passed The Apache Jenkins build system has built Hive-0.8.1-SNAPSHOT-h0.21 (build #225) Status: Fixed Check console output at https://builds.apache.org/job/Hive-0.8.1-SNAPSHOT-h0.21/225/ to view the results.