Re: vote for release candidate for hive
I recently switched to the 0.4 branch to do some testing and I'm running into a problem. When I run a query from the cli - the first one works, but the second query always fails with a NullPointerException. Did anyone else run into this ? Thanks -Matt hive select count(1) from table1; Total MapReduce jobs = 1 Number of reduce tasks determined at compile time: 1 In order to change the average load for a reducer (in bytes): set hive.exec.reducers.bytes.per.reducer=number In order to limit the maximum number of reducers: set hive.exec.reducers.max=number In order to set a constant number of reducers: set mapred.reduce.tasks=number Starting Job = job_200909171501_0001, Tracking URL = http://mustique:50030/jobdetails.jsp?jobid=job_200909171501_0001 Kill Command = /home/hadoop/hadoop/bin/../bin/hadoop job -Dmapred.job.tracker=mustique:9001 -kill job_200909171501_0001 2009-09-17 03:05:54,855 map = 0%, reduce =0% 2009-09-17 03:06:02,895 map = 22%, reduce =0% 2009-09-17 03:06:06,933 map = 44%, reduce =0% 2009-09-17 03:06:11,965 map = 67%, reduce =0% 2009-09-17 03:06:15,988 map = 89%, reduce =0% 2009-09-17 03:06:20,009 map = 100%, reduce =0% 2009-09-17 03:06:25,036 map = 100%, reduce =11% 2009-09-17 03:06:30,054 map = 100%, reduce =15% 2009-09-17 03:06:31,063 map = 100%, reduce =22% 2009-09-17 03:06:34,075 map = 100%, reduce =26% 2009-09-17 03:06:36,101 map = 100%, reduce =100% Ended Job = job_200909171501_0001 OK 274087 Time taken: 45.401 seconds hive select count(1) from table1; Total MapReduce jobs = 1 Number of reduce tasks determined at compile time: 1 In order to change the average load for a reducer (in bytes): set hive.exec.reducers.bytes.per.reducer=number In order to limit the maximum number of reducers: set hive.exec.reducers.max=number In order to set a constant number of reducers: set mapred.reduce.tasks=number java.lang.NullPointerException at org.apache.hadoop.hive.ql.exec.Utilities.setMapRedWork(Utilities.java:154) at org.apache.hadoop.hive.ql.exec.ExecDriver.execute(ExecDriver.java:373) at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:379) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:285) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:123) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:181) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:287) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.hadoop.util.RunJar.main(RunJar.java:155) at org.apache.hadoop.mapred.JobShell.run(JobShell.java:54) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79) at org.apache.hadoop.mapred.JobShell.main(JobShell.java:68) Job Submission failed with exception 'java.lang.RuntimeException(java.lang.NullPointerException)' FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.ExecDriver hive On Thu, Sep 17, 2009 at 12:36 PM, Namit Jain nj...@facebook.com wrote: https://issues.apache.org/jira/browse/HIVE-838 is a blocker for 0.4 - Once this is merged, I will have another release candidate -Original Message- From: Johan Oskarsson [mailto:jo...@oskarsson.nu] Sent: Wednesday, September 16, 2009 8:29 AM To: hive-dev@hadoop.apache.org Subject: Re: vote for release candidate for hive +1 based on running unit tests. /Johan Namit Jain wrote: Sorry, was meant for hive-dev@ From: Namit Jain [mailto:nj...@facebook.com] Sent: Tuesday, September 15, 2009 1:30 PM To: hive-u...@hadoop.apache.org Subject: vote for release candidate for hive I have created another release candidate for Hive. https://svn.apache.org/repos/asf/hadoop/hive/tags/release-0.4.0-rc1/ Let me know if it is OK to publish this release candidate. The only change from the previous candidate ( https://svn.apache.org/repos/asf/hadoop/hive/tags/release-0.4.0-rc0/) is the fix for https://issues.apache.org/jira/browse/HIVE-718 Thanks, -namit
Re: vote for release candidate for hive
Please disregard. I found the cause of my error. Thanks. On Thu, Sep 17, 2009 at 3:09 PM, Matt Pestritto m...@pestritto.com wrote: I recently switched to the 0.4 branch to do some testing and I'm running into a problem. When I run a query from the cli - the first one works, but the second query always fails with a NullPointerException. Did anyone else run into this ? Thanks -Matt hive select count(1) from table1; Total MapReduce jobs = 1 Number of reduce tasks determined at compile time: 1 In order to change the average load for a reducer (in bytes): set hive.exec.reducers.bytes.per.reducer=number In order to limit the maximum number of reducers: set hive.exec.reducers.max=number In order to set a constant number of reducers: set mapred.reduce.tasks=number Starting Job = job_200909171501_0001, Tracking URL = http://mustique:50030/jobdetails.jsp?jobid=job_200909171501_0001 Kill Command = /home/hadoop/hadoop/bin/../bin/hadoop job -Dmapred.job.tracker=mustique:9001 -kill job_200909171501_0001 2009-09-17 03:05:54,855 map = 0%, reduce =0% 2009-09-17 03:06:02,895 map = 22%, reduce =0% 2009-09-17 03:06:06,933 map = 44%, reduce =0% 2009-09-17 03:06:11,965 map = 67%, reduce =0% 2009-09-17 03:06:15,988 map = 89%, reduce =0% 2009-09-17 03:06:20,009 map = 100%, reduce =0% 2009-09-17 03:06:25,036 map = 100%, reduce =11% 2009-09-17 03:06:30,054 map = 100%, reduce =15% 2009-09-17 03:06:31,063 map = 100%, reduce =22% 2009-09-17 03:06:34,075 map = 100%, reduce =26% 2009-09-17 03:06:36,101 map = 100%, reduce =100% Ended Job = job_200909171501_0001 OK 274087 Time taken: 45.401 seconds hive select count(1) from table1; Total MapReduce jobs = 1 Number of reduce tasks determined at compile time: 1 In order to change the average load for a reducer (in bytes): set hive.exec.reducers.bytes.per.reducer=number In order to limit the maximum number of reducers: set hive.exec.reducers.max=number In order to set a constant number of reducers: set mapred.reduce.tasks=number java.lang.NullPointerException at org.apache.hadoop.hive.ql.exec.Utilities.setMapRedWork(Utilities.java:154) at org.apache.hadoop.hive.ql.exec.ExecDriver.execute(ExecDriver.java:373) at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:379) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:285) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:123) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:181) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:287) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.hadoop.util.RunJar.main(RunJar.java:155) at org.apache.hadoop.mapred.JobShell.run(JobShell.java:54) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79) at org.apache.hadoop.mapred.JobShell.main(JobShell.java:68) Job Submission failed with exception 'java.lang.RuntimeException(java.lang.NullPointerException)' FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.ExecDriver hive On Thu, Sep 17, 2009 at 12:36 PM, Namit Jain nj...@facebook.com wrote: https://issues.apache.org/jira/browse/HIVE-838 is a blocker for 0.4 - Once this is merged, I will have another release candidate -Original Message- From: Johan Oskarsson [mailto:jo...@oskarsson.nu] Sent: Wednesday, September 16, 2009 8:29 AM To: hive-dev@hadoop.apache.org Subject: Re: vote for release candidate for hive +1 based on running unit tests. /Johan Namit Jain wrote: Sorry, was meant for hive-dev@ From: Namit Jain [mailto:nj...@facebook.com] Sent: Tuesday, September 15, 2009 1:30 PM To: hive-u...@hadoop.apache.org Subject: vote for release candidate for hive I have created another release candidate for Hive. https://svn.apache.org/repos/asf/hadoop/hive/tags/release-0.4.0-rc1/ Let me know if it is OK to publish this release candidate. The only change from the previous candidate ( https://svn.apache.org/repos/asf/hadoop/hive/tags/release-0.4.0-rc0/) is the fix for https://issues.apache.org/jira/browse/HIVE-718 Thanks, -namit
Re: vote for release candidate for hive
+1 based on running unit tests. /Johan Namit Jain wrote: Sorry, was meant for hive-dev@ From: Namit Jain [mailto:nj...@facebook.com] Sent: Tuesday, September 15, 2009 1:30 PM To: hive-u...@hadoop.apache.org Subject: vote for release candidate for hive I have created another release candidate for Hive. https://svn.apache.org/repos/asf/hadoop/hive/tags/release-0.4.0-rc1/ Let me know if it is OK to publish this release candidate. The only change from the previous candidate (https://svn.apache.org/repos/asf/hadoop/hive/tags/release-0.4.0-rc0/) is the fix for https://issues.apache.org/jira/browse/HIVE-718 Thanks, -namit
