Re: vote for release candidate for hive

2009-09-17 Thread Matt Pestritto 
Please disregard.  I found the cause of my error.

Thanks.

On Thu, Sep 17, 2009 at 3:09 PM, Matt Pestritto  wrote:

> I recently switched to the 0.4 branch to do some testing and I'm running
> into a problem.
>
> When I run a query from the cli - the first one works, but the second query
> always fails with a NullPointerException.
>
> Did anyone else run into this ?
>
> Thanks
> -Matt
>
> hive> select count(1) from table1;
> Total MapReduce jobs = 1
> Number of reduce tasks determined at compile time: 1
> In order to change the average load for a reducer (in bytes):
>   set hive.exec.reducers.bytes.per.reducer=
> In order to limit the maximum number of reducers:
>   set hive.exec.reducers.max=
> In order to set a constant number of reducers:
>   set mapred.reduce.tasks=
> Starting Job = job_200909171501_0001, Tracking URL =
> http://mustique:50030/jobdetails.jsp?jobid=job_200909171501_0001
> Kill Command = /home/hadoop/hadoop/bin/../bin/hadoop job
> -Dmapred.job.tracker=mustique:9001 -kill job_200909171501_0001
> 2009-09-17 03:05:54,855 map = 0%,  reduce =0%
> 2009-09-17 03:06:02,895 map = 22%,  reduce =0%
> 2009-09-17 03:06:06,933 map = 44%,  reduce =0%
> 2009-09-17 03:06:11,965 map = 67%,  reduce =0%
> 2009-09-17 03:06:15,988 map = 89%,  reduce =0%
> 2009-09-17 03:06:20,009 map = 100%,  reduce =0%
> 2009-09-17 03:06:25,036 map = 100%,  reduce =11%
> 2009-09-17 03:06:30,054 map = 100%,  reduce =15%
> 2009-09-17 03:06:31,063 map = 100%,  reduce =22%
> 2009-09-17 03:06:34,075 map = 100%,  reduce =26%
> 2009-09-17 03:06:36,101 map = 100%,  reduce =100%
> Ended Job = job_200909171501_0001
> OK
> 274087
> Time taken: 45.401 seconds
> hive> select count(1) from table1;
> Total MapReduce jobs = 1
> Number of reduce tasks determined at compile time: 1
> In order to change the average load for a reducer (in bytes):
>   set hive.exec.reducers.bytes.per.reducer=
> In order to limit the maximum number of reducers:
>   set hive.exec.reducers.max=
> In order to set a constant number of reducers:
>   set mapred.reduce.tasks=
> java.lang.NullPointerException
> at
> org.apache.hadoop.hive.ql.exec.Utilities.setMapRedWork(Utilities.java:154)
> at
> org.apache.hadoop.hive.ql.exec.ExecDriver.execute(ExecDriver.java:373)
> at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:379)
> at org.apache.hadoop.hive.ql.Driver.run(Driver.java:285)
> at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:123)
> at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:181)
> at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:287)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:155)
> at org.apache.hadoop.mapred.JobShell.run(JobShell.java:54)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
> at org.apache.hadoop.mapred.JobShell.main(JobShell.java:68)
> Job Submission failed with exception
> 'java.lang.RuntimeException(java.lang.NullPointerException)'
> FAILED: Execution Error, return code 1 from
> org.apache.hadoop.hive.ql.exec.ExecDriver
> hive>
>
>
> On Thu, Sep 17, 2009 at 12:36 PM, Namit Jain  wrote:
>
>> https://issues.apache.org/jira/browse/HIVE-838
>>
>> is a blocker for 0.4 -
>> Once this is merged, I will have another release candidate
>>
>>
>> -Original Message-
>> From: Johan Oskarsson [mailto:jo...@oskarsson.nu]
>> Sent: Wednesday, September 16, 2009 8:29 AM
>> To: hive-dev@hadoop.apache.org
>> Subject: Re: vote for release candidate for hive
>>
>> +1 based on running unit tests.
>>
>> /Johan
>>
>> Namit Jain wrote:
>> > Sorry, was meant for hive-dev@
>> >
>> > From: Namit Jain [mailto:nj...@facebook.com]
>> > Sent: Tuesday, September 15, 2009 1:30 PM
>> > To: hive-u...@hadoop.apache.org
>> > Subject: vote for release candidate for hive
>> >
>> >
>> > I have created another release candidate for Hive.
>> >
>> >
>> >
>> >  https://svn.apache.org/repos/asf/hadoop/hive/tags/release-0.4.0-rc1/
>> >
>> >
>> >
>> >
>> >
>> > Let me know if it is OK to publish this release candidate.
>> >
>> >
>> >
>> > The only change from the previous candidate (
>> https://svn.apache.org/repos/asf/hadoop/hive/tags/release-0.4.0-rc0/) is
>> the fix for
>> >
>> > https://issues.apache.org/jira/browse/HIVE-718
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> > Thanks,
>> >
>> > -namit
>> >
>> >
>> >
>> >
>>
>>
>

Re: vote for release candidate for hive

2009-09-17 Thread Matt Pestritto 
I recently switched to the 0.4 branch to do some testing and I'm running
into a problem.

When I run a query from the cli - the first one works, but the second query
always fails with a NullPointerException.

Did anyone else run into this ?

Thanks
-Matt

hive> select count(1) from table1;
Total MapReduce jobs = 1
Number of reduce tasks determined at compile time: 1
In order to change the average load for a reducer (in bytes):
  set hive.exec.reducers.bytes.per.reducer=
In order to limit the maximum number of reducers:
  set hive.exec.reducers.max=
In order to set a constant number of reducers:
  set mapred.reduce.tasks=
Starting Job = job_200909171501_0001, Tracking URL =
http://mustique:50030/jobdetails.jsp?jobid=job_200909171501_0001
Kill Command = /home/hadoop/hadoop/bin/../bin/hadoop job
-Dmapred.job.tracker=mustique:9001 -kill job_200909171501_0001
2009-09-17 03:05:54,855 map = 0%,  reduce =0%
2009-09-17 03:06:02,895 map = 22%,  reduce =0%
2009-09-17 03:06:06,933 map = 44%,  reduce =0%
2009-09-17 03:06:11,965 map = 67%,  reduce =0%
2009-09-17 03:06:15,988 map = 89%,  reduce =0%
2009-09-17 03:06:20,009 map = 100%,  reduce =0%
2009-09-17 03:06:25,036 map = 100%,  reduce =11%
2009-09-17 03:06:30,054 map = 100%,  reduce =15%
2009-09-17 03:06:31,063 map = 100%,  reduce =22%
2009-09-17 03:06:34,075 map = 100%,  reduce =26%
2009-09-17 03:06:36,101 map = 100%,  reduce =100%
Ended Job = job_200909171501_0001
OK
274087
Time taken: 45.401 seconds
hive> select count(1) from table1;
Total MapReduce jobs = 1
Number of reduce tasks determined at compile time: 1
In order to change the average load for a reducer (in bytes):
  set hive.exec.reducers.bytes.per.reducer=
In order to limit the maximum number of reducers:
  set hive.exec.reducers.max=
In order to set a constant number of reducers:
  set mapred.reduce.tasks=
java.lang.NullPointerException
at
org.apache.hadoop.hive.ql.exec.Utilities.setMapRedWork(Utilities.java:154)
at
org.apache.hadoop.hive.ql.exec.ExecDriver.execute(ExecDriver.java:373)
at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:379)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:285)
at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:123)
at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:181)
at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:287)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.RunJar.main(RunJar.java:155)
at org.apache.hadoop.mapred.JobShell.run(JobShell.java:54)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
at org.apache.hadoop.mapred.JobShell.main(JobShell.java:68)
Job Submission failed with exception
'java.lang.RuntimeException(java.lang.NullPointerException)'
FAILED: Execution Error, return code 1 from
org.apache.hadoop.hive.ql.exec.ExecDriver
hive>


On Thu, Sep 17, 2009 at 12:36 PM, Namit Jain  wrote:

> https://issues.apache.org/jira/browse/HIVE-838
>
> is a blocker for 0.4 -
> Once this is merged, I will have another release candidate
>
>
> -Original Message-
> From: Johan Oskarsson [mailto:jo...@oskarsson.nu]
> Sent: Wednesday, September 16, 2009 8:29 AM
> To: hive-dev@hadoop.apache.org
> Subject: Re: vote for release candidate for hive
>
> +1 based on running unit tests.
>
> /Johan
>
> Namit Jain wrote:
> > Sorry, was meant for hive-dev@
> >
> > From: Namit Jain [mailto:nj...@facebook.com]
> > Sent: Tuesday, September 15, 2009 1:30 PM
> > To: hive-u...@hadoop.apache.org
> > Subject: vote for release candidate for hive
> >
> >
> > I have created another release candidate for Hive.
> >
> >
> >
> >  https://svn.apache.org/repos/asf/hadoop/hive/tags/release-0.4.0-rc1/
> >
> >
> >
> >
> >
> > Let me know if it is OK to publish this release candidate.
> >
> >
> >
> > The only change from the previous candidate (
> https://svn.apache.org/repos/asf/hadoop/hive/tags/release-0.4.0-rc0/) is
> the fix for
> >
> > https://issues.apache.org/jira/browse/HIVE-718
> >
> >
> >
> >
> >
> >
> >
> > Thanks,
> >
> > -namit
> >
> >
> >
> >
>
>

RE: vote for release candidate for hive

2009-09-17 Thread Namit Jain 
https://issues.apache.org/jira/browse/HIVE-838

is a blocker for 0.4 - 
Once this is merged, I will have another release candidate


-Original Message-
From: Johan Oskarsson [mailto:jo...@oskarsson.nu] 
Sent: Wednesday, September 16, 2009 8:29 AM
To: hive-dev@hadoop.apache.org
Subject: Re: vote for release candidate for hive

+1 based on running unit tests.

/Johan

Namit Jain wrote:
> Sorry, was meant for hive-dev@
> 
> From: Namit Jain [mailto:nj...@facebook.com]
> Sent: Tuesday, September 15, 2009 1:30 PM
> To: hive-u...@hadoop.apache.org
> Subject: vote for release candidate for hive
> 
> 
> I have created another release candidate for Hive.
> 
> 
> 
>  https://svn.apache.org/repos/asf/hadoop/hive/tags/release-0.4.0-rc1/
> 
> 
> 
> 
> 
> Let me know if it is OK to publish this release candidate.
> 
> 
> 
> The only change from the previous candidate 
> (https://svn.apache.org/repos/asf/hadoop/hive/tags/release-0.4.0-rc0/) is the 
> fix for
> 
> https://issues.apache.org/jira/browse/HIVE-718
> 
> 
> 
> 
> 
> 
> 
> Thanks,
> 
> -namit
> 
> 
> 
>

RE: vote for release candidate for hive

2009-09-16 Thread Namit Jain 
Generated the tar balls:


Look at

/home/namit/public_html/hive-0.4.0-cadidate-1/hive-0.4.0-dev*

in people.apache.org


Thanks,
-namit


From: Ashish Thusoo [mailto:athu...@facebook.com]
Sent: Tuesday, September 15, 2009 4:41 PM
To: hive-u...@hadoop.apache.org
Subject: RE: vote for release candidate for hive

We need to generate the tar balls for the binary and the source release and put 
them out for vote.

Ashish


From: Namit Jain [mailto:nj...@facebook.com]
Sent: Tuesday, September 15, 2009 1:30 PM
To: hive-u...@hadoop.apache.org
Subject: vote for release candidate for hive

I have created another release candidate for Hive.



 https://svn.apache.org/repos/asf/hadoop/hive/tags/release-0.4.0-rc1/





Let me know if it is OK to publish this release candidate.



The only change from the previous candidate 
(https://svn.apache.org/repos/asf/hadoop/hive/tags/release-0.4.0-rc0/) is the 
fix for

https://issues.apache.org/jira/browse/HIVE-718







Thanks,

-namit

Re: vote for release candidate for hive

2009-09-16 Thread Johan Oskarsson 
+1 based on running unit tests.

/Johan

Namit Jain wrote:
> Sorry, was meant for hive-dev@
> 
> From: Namit Jain [mailto:nj...@facebook.com]
> Sent: Tuesday, September 15, 2009 1:30 PM
> To: hive-u...@hadoop.apache.org
> Subject: vote for release candidate for hive
> 
> 
> I have created another release candidate for Hive.
> 
> 
> 
>  https://svn.apache.org/repos/asf/hadoop/hive/tags/release-0.4.0-rc1/
> 
> 
> 
> 
> 
> Let me know if it is OK to publish this release candidate.
> 
> 
> 
> The only change from the previous candidate 
> (https://svn.apache.org/repos/asf/hadoop/hive/tags/release-0.4.0-rc0/) is the 
> fix for
> 
> https://issues.apache.org/jira/browse/HIVE-718
> 
> 
> 
> 
> 
> 
> 
> Thanks,
> 
> -namit
> 
> 
> 
>