Re: hadoop-2.0.4-alpha bug-fix release

2013-04-01 Thread Konstantin Boudnik
On Mon, Apr 01, 2013 at 12:42PM, Andrew Wang wrote:
> One of those failures is fixed in
> https://issues.apache.org/jira/browse/HADOOP-9405 which looks like it got
> into 2.0.5 but not 2.0.4.

As it never been marked for 2.0.4. I will mark the JIRA accordingly and
backport the fix to 2.0.4 right away.

Thanks for the pointer!
  Cos

> Best,
> Andrew
> 
> 
> On Mon, Apr 1, 2013 at 12:17 PM, Konstantin Boudnik  wrote:
> 
> > On Wed, Mar 27, 2013 at 01:33PM, Arun C Murthy wrote:
> > > Thanks to Bobby we might have narrowed down the issue to a change needed
> > in
> > > Oozie, I'll start preparing to make the 2.0.4 release later this week.
> >
> > I am running 2.0.4-alpha build now to supply Bigtop 0.6.0 with official
> > source
> > tarball for upcoming release of 2.0.4.
> >
> > The job URL is
> >   https://builds.apache.org/view/Hadoop/job/Hadoop-branch-2.0.4
> >
> > At the moment 4 tests are failing on the branch:
> >
> > https://builds.apache.org/view/Hadoop/job/Hadoop-branch-2.0.4/lastCompletedBuild/testReport/
> >
> > Cos
> >
> > > On Mar 26, 2013, at 10:20 AM, Arun C Murthy wrote:
> > >
> > > > Roman - Looks like the confusion is solely centered around
> > https://issues.apache.org/jira/browse/MAPREDUCE-4549. Can you please
> > revert back asap?
> > > >
> > > > thanks,
> > > > Arun
> > > >
> > > > On Mar 22, 2013, at 1:47 PM, Roman Shaposhnik wrote:
> > > >
> > > >> On Thu, Mar 7, 2013 at 6:33 AM, Arun C Murthy 
> > wrote:
> > > >>> Folks,
> > > >>>
> > > >>> To fix YARN-429 and a couple of other critical bugs, I've created
> > branch-2.0.4-alpha and necessary versions in jira etc.
> > > >>>
> > > >>> Currently, here is the list of bugs slated for this release:
> > http://s.apache.org/hadoop-2.0.4-alpha
> > > >>>
> > > >>> Committers, please talk to me if you feel there are are other
> > blocker bugs which warrant getting into this release.
> > > >>
> > > >> Just wanted to quickly check what is the status of 2.0.4-alpha.
> > > >>
> > > >> Currently I see the following issues blocking it:
> > > >>
> > https://issues.apache.org/jira/issues/?jql=project%20%3D%20MAPREDUCE%20AND%20fixVersion%20%3D%20%222.0.4-alpha%22%20AND%20resolution%20%3D%20Unresolved%20AND%20priority%20%3D%20Blocker%20ORDER%20BY%20key%20DESC
> > > >>
> > > >> What's the consensus here on how complete that list is?
> > > >>
> > > >> We haven't really finished Bigtop testing yet, since we currently
> > > >> seem to be blocked on MAPREDUCE-4820 which means that
> > > >> we may discover additional stoppers yet.
> > > >>
> > > >> Still I wanted to know what is the overall thinking on what else
> > > >> need to go into 2.0.4-alpha.
> > > >>
> > > >> Thanks,
> > > >> Roman.
> > > >
> > > > --
> > > > Arun C. Murthy
> > > > Hortonworks Inc.
> > > > http://hortonworks.com/
> > > >
> > > >
> > >
> > > --
> > > Arun C. Murthy
> > > Hortonworks Inc.
> > > http://hortonworks.com/
> > >
> > >
> >


Re: hadoop-2.0.4-alpha bug-fix release

2013-04-01 Thread Andrew Wang
One of those failures is fixed in
https://issues.apache.org/jira/browse/HADOOP-9405 which looks like it got
into 2.0.5 but not 2.0.4.

Best,
Andrew


On Mon, Apr 1, 2013 at 12:17 PM, Konstantin Boudnik  wrote:

> On Wed, Mar 27, 2013 at 01:33PM, Arun C Murthy wrote:
> > Thanks to Bobby we might have narrowed down the issue to a change needed
> in
> > Oozie, I'll start preparing to make the 2.0.4 release later this week.
>
> I am running 2.0.4-alpha build now to supply Bigtop 0.6.0 with official
> source
> tarball for upcoming release of 2.0.4.
>
> The job URL is
>   https://builds.apache.org/view/Hadoop/job/Hadoop-branch-2.0.4
>
> At the moment 4 tests are failing on the branch:
>
> https://builds.apache.org/view/Hadoop/job/Hadoop-branch-2.0.4/lastCompletedBuild/testReport/
>
> Cos
>
> > On Mar 26, 2013, at 10:20 AM, Arun C Murthy wrote:
> >
> > > Roman - Looks like the confusion is solely centered around
> https://issues.apache.org/jira/browse/MAPREDUCE-4549. Can you please
> revert back asap?
> > >
> > > thanks,
> > > Arun
> > >
> > > On Mar 22, 2013, at 1:47 PM, Roman Shaposhnik wrote:
> > >
> > >> On Thu, Mar 7, 2013 at 6:33 AM, Arun C Murthy 
> wrote:
> > >>> Folks,
> > >>>
> > >>> To fix YARN-429 and a couple of other critical bugs, I've created
> branch-2.0.4-alpha and necessary versions in jira etc.
> > >>>
> > >>> Currently, here is the list of bugs slated for this release:
> http://s.apache.org/hadoop-2.0.4-alpha
> > >>>
> > >>> Committers, please talk to me if you feel there are are other
> blocker bugs which warrant getting into this release.
> > >>
> > >> Just wanted to quickly check what is the status of 2.0.4-alpha.
> > >>
> > >> Currently I see the following issues blocking it:
> > >>
> https://issues.apache.org/jira/issues/?jql=project%20%3D%20MAPREDUCE%20AND%20fixVersion%20%3D%20%222.0.4-alpha%22%20AND%20resolution%20%3D%20Unresolved%20AND%20priority%20%3D%20Blocker%20ORDER%20BY%20key%20DESC
> > >>
> > >> What's the consensus here on how complete that list is?
> > >>
> > >> We haven't really finished Bigtop testing yet, since we currently
> > >> seem to be blocked on MAPREDUCE-4820 which means that
> > >> we may discover additional stoppers yet.
> > >>
> > >> Still I wanted to know what is the overall thinking on what else
> > >> need to go into 2.0.4-alpha.
> > >>
> > >> Thanks,
> > >> Roman.
> > >
> > > --
> > > Arun C. Murthy
> > > Hortonworks Inc.
> > > http://hortonworks.com/
> > >
> > >
> >
> > --
> > Arun C. Murthy
> > Hortonworks Inc.
> > http://hortonworks.com/
> >
> >
>


Re: hadoop-2.0.4-alpha bug-fix release

2013-04-01 Thread Konstantin Boudnik
On Wed, Mar 27, 2013 at 01:33PM, Arun C Murthy wrote:
> Thanks to Bobby we might have narrowed down the issue to a change needed in
> Oozie, I'll start preparing to make the 2.0.4 release later this week.

I am running 2.0.4-alpha build now to supply Bigtop 0.6.0 with official source
tarball for upcoming release of 2.0.4.

The job URL is 
  https://builds.apache.org/view/Hadoop/job/Hadoop-branch-2.0.4
  
At the moment 4 tests are failing on the branch:
  
https://builds.apache.org/view/Hadoop/job/Hadoop-branch-2.0.4/lastCompletedBuild/testReport/
  
Cos
 
> On Mar 26, 2013, at 10:20 AM, Arun C Murthy wrote:
> 
> > Roman - Looks like the confusion is solely centered around 
> > https://issues.apache.org/jira/browse/MAPREDUCE-4549. Can you please revert 
> > back asap?
> > 
> > thanks,
> > Arun
> > 
> > On Mar 22, 2013, at 1:47 PM, Roman Shaposhnik wrote:
> > 
> >> On Thu, Mar 7, 2013 at 6:33 AM, Arun C Murthy  wrote:
> >>> Folks,
> >>> 
> >>> To fix YARN-429 and a couple of other critical bugs, I've created 
> >>> branch-2.0.4-alpha and necessary versions in jira etc.
> >>> 
> >>> Currently, here is the list of bugs slated for this release: 
> >>> http://s.apache.org/hadoop-2.0.4-alpha
> >>> 
> >>> Committers, please talk to me if you feel there are are other blocker 
> >>> bugs which warrant getting into this release.
> >> 
> >> Just wanted to quickly check what is the status of 2.0.4-alpha.
> >> 
> >> Currently I see the following issues blocking it:
> >>   
> >> https://issues.apache.org/jira/issues/?jql=project%20%3D%20MAPREDUCE%20AND%20fixVersion%20%3D%20%222.0.4-alpha%22%20AND%20resolution%20%3D%20Unresolved%20AND%20priority%20%3D%20Blocker%20ORDER%20BY%20key%20DESC
> >> 
> >> What's the consensus here on how complete that list is?
> >> 
> >> We haven't really finished Bigtop testing yet, since we currently
> >> seem to be blocked on MAPREDUCE-4820 which means that
> >> we may discover additional stoppers yet.
> >> 
> >> Still I wanted to know what is the overall thinking on what else
> >> need to go into 2.0.4-alpha.
> >> 
> >> Thanks,
> >> Roman.
> > 
> > --
> > Arun C. Murthy
> > Hortonworks Inc.
> > http://hortonworks.com/
> > 
> > 
> 
> --
> Arun C. Murthy
> Hortonworks Inc.
> http://hortonworks.com/
> 
> 


Re: hadoop-2.0.4-alpha bug-fix release

2013-03-28 Thread Vinod Kumar Vavilapalli

I just checked in YARN-509/HADOOP-9444.

Thanks,
+Vinod Kumar Vavilapalli

On Mar 28, 2013, at 9:02 AM, Roman Shaposhnik wrote:

> Also, we are not out of the woods yet. The Hadoop build out of the
> 2.0.4-alpha branch
> still seem to have issues with Kerberos deployments. Here's the first
> in a series
> of JIRAs:
> https://issues.apache.org/jira/browse/YARN-509



Re: hadoop-2.0.4-alpha bug-fix release

2013-03-28 Thread Roman Shaposhnik
On Wed, Mar 27, 2013 at 1:33 PM, Arun C Murthy  wrote:
> Thanks to Bobby we might have narrowed down the issue to a change needed in
> Oozie, I'll start preparing to make the 2.0.4 release later this week.

Here's an update. I filed https://issues.apache.org/jira/browse/MAPREDUCE-5117
which feels like a true blocker since Kerberos with Oozie used to work in
previous releases of Bigtop.

I would really appreciate all the help with figuring out what could be
wrong there.

Thanks,
Roman.


Re: hadoop-2.0.4-alpha bug-fix release

2013-03-28 Thread Roman Shaposhnik
On Wed, Mar 27, 2013 at 1:33 PM, Arun C Murthy  wrote:
> Thanks to Bobby we might have narrowed down the issue to a change needed in
>  Oozie, I'll start preparing to make the 2.0.4 release later this week.

First question: as far as I can tell MAPREDUCE-5088 is still unresolved. Do you
plan to commit it soon?

Also, we are not out of the woods yet. The Hadoop build out of the
2.0.4-alpha branch
still seem to have issues with Kerberos deployments. Here's the first
in a series
of JIRAs:
 https://issues.apache.org/jira/browse/YARN-509

There's also: " ERROR org.apache.hadoop.ipc.RPC: RPC.stopProxy called
on non proxy."
exception between kerberized Oozie and RM that came in last night.
Alejandro and I are investigating it today.

As it stands, however, Bigtop can't yet validate 2.0.4-alpha.

Thanks,
Roman.


Re: hadoop-2.0.4-alpha bug-fix release

2013-03-27 Thread Arun C Murthy
Thanks to Bobby we might have narrowed down the issue to a change needed in 
Oozie, I'll start preparing to make the 2.0.4 release later this week.

thanks,
Arun

On Mar 26, 2013, at 10:20 AM, Arun C Murthy wrote:

> Roman - Looks like the confusion is solely centered around 
> https://issues.apache.org/jira/browse/MAPREDUCE-4549. Can you please revert 
> back asap?
> 
> thanks,
> Arun
> 
> On Mar 22, 2013, at 1:47 PM, Roman Shaposhnik wrote:
> 
>> On Thu, Mar 7, 2013 at 6:33 AM, Arun C Murthy  wrote:
>>> Folks,
>>> 
>>> To fix YARN-429 and a couple of other critical bugs, I've created 
>>> branch-2.0.4-alpha and necessary versions in jira etc.
>>> 
>>> Currently, here is the list of bugs slated for this release: 
>>> http://s.apache.org/hadoop-2.0.4-alpha
>>> 
>>> Committers, please talk to me if you feel there are are other blocker bugs 
>>> which warrant getting into this release.
>> 
>> Just wanted to quickly check what is the status of 2.0.4-alpha.
>> 
>> Currently I see the following issues blocking it:
>>   
>> https://issues.apache.org/jira/issues/?jql=project%20%3D%20MAPREDUCE%20AND%20fixVersion%20%3D%20%222.0.4-alpha%22%20AND%20resolution%20%3D%20Unresolved%20AND%20priority%20%3D%20Blocker%20ORDER%20BY%20key%20DESC
>> 
>> What's the consensus here on how complete that list is?
>> 
>> We haven't really finished Bigtop testing yet, since we currently
>> seem to be blocked on MAPREDUCE-4820 which means that
>> we may discover additional stoppers yet.
>> 
>> Still I wanted to know what is the overall thinking on what else
>> need to go into 2.0.4-alpha.
>> 
>> Thanks,
>> Roman.
> 
> --
> Arun C. Murthy
> Hortonworks Inc.
> http://hortonworks.com/
> 
> 

--
Arun C. Murthy
Hortonworks Inc.
http://hortonworks.com/




Re: hadoop-2.0.4-alpha bug-fix release

2013-03-26 Thread Arun C Murthy
Roman - Looks like the confusion is solely centered around 
https://issues.apache.org/jira/browse/MAPREDUCE-4549. Can you please revert 
back asap?

thanks,
Arun

On Mar 22, 2013, at 1:47 PM, Roman Shaposhnik wrote:

> On Thu, Mar 7, 2013 at 6:33 AM, Arun C Murthy  wrote:
>> Folks,
>> 
>> To fix YARN-429 and a couple of other critical bugs, I've created 
>> branch-2.0.4-alpha and necessary versions in jira etc.
>> 
>> Currently, here is the list of bugs slated for this release: 
>> http://s.apache.org/hadoop-2.0.4-alpha
>> 
>> Committers, please talk to me if you feel there are are other blocker bugs 
>> which warrant getting into this release.
> 
> Just wanted to quickly check what is the status of 2.0.4-alpha.
> 
> Currently I see the following issues blocking it:
>   
> https://issues.apache.org/jira/issues/?jql=project%20%3D%20MAPREDUCE%20AND%20fixVersion%20%3D%20%222.0.4-alpha%22%20AND%20resolution%20%3D%20Unresolved%20AND%20priority%20%3D%20Blocker%20ORDER%20BY%20key%20DESC
> 
> What's the consensus here on how complete that list is?
> 
> We haven't really finished Bigtop testing yet, since we currently
> seem to be blocked on MAPREDUCE-4820 which means that
> we may discover additional stoppers yet.
> 
> Still I wanted to know what is the overall thinking on what else
> need to go into 2.0.4-alpha.
> 
> Thanks,
> Roman.

--
Arun C. Murthy
Hortonworks Inc.
http://hortonworks.com/




Re: hadoop-2.0.4-alpha bug-fix release

2013-03-22 Thread Roman Shaposhnik
On Thu, Mar 7, 2013 at 6:33 AM, Arun C Murthy  wrote:
> Folks,
>
>  To fix YARN-429 and a couple of other critical bugs, I've created 
> branch-2.0.4-alpha and necessary versions in jira etc.
>
>  Currently, here is the list of bugs slated for this release: 
> http://s.apache.org/hadoop-2.0.4-alpha
>
>  Committers, please talk to me if you feel there are are other blocker bugs 
> which warrant getting into this release.

Just wanted to quickly check what is the status of 2.0.4-alpha.

Currently I see the following issues blocking it:
   
https://issues.apache.org/jira/issues/?jql=project%20%3D%20MAPREDUCE%20AND%20fixVersion%20%3D%20%222.0.4-alpha%22%20AND%20resolution%20%3D%20Unresolved%20AND%20priority%20%3D%20Blocker%20ORDER%20BY%20key%20DESC

What's the consensus here on how complete that list is?

We haven't really finished Bigtop testing yet, since we currently
seem to be blocked on MAPREDUCE-4820 which means that
we may discover additional stoppers yet.

Still I wanted to know what is the overall thinking on what else
need to go into 2.0.4-alpha.

Thanks,
Roman.