Re: hadoop-2.0.4-alpha bug-fix release
On Mon, Apr 01, 2013 at 12:42PM, Andrew Wang wrote: > One of those failures is fixed in > https://issues.apache.org/jira/browse/HADOOP-9405 which looks like it got > into 2.0.5 but not 2.0.4. As it never been marked for 2.0.4. I will mark the JIRA accordingly and backport the fix to 2.0.4 right away. Thanks for the pointer! Cos > Best, > Andrew > > > On Mon, Apr 1, 2013 at 12:17 PM, Konstantin Boudnik wrote: > > > On Wed, Mar 27, 2013 at 01:33PM, Arun C Murthy wrote: > > > Thanks to Bobby we might have narrowed down the issue to a change needed > > in > > > Oozie, I'll start preparing to make the 2.0.4 release later this week. > > > > I am running 2.0.4-alpha build now to supply Bigtop 0.6.0 with official > > source > > tarball for upcoming release of 2.0.4. > > > > The job URL is > > https://builds.apache.org/view/Hadoop/job/Hadoop-branch-2.0.4 > > > > At the moment 4 tests are failing on the branch: > > > > https://builds.apache.org/view/Hadoop/job/Hadoop-branch-2.0.4/lastCompletedBuild/testReport/ > > > > Cos > > > > > On Mar 26, 2013, at 10:20 AM, Arun C Murthy wrote: > > > > > > > Roman - Looks like the confusion is solely centered around > > https://issues.apache.org/jira/browse/MAPREDUCE-4549. Can you please > > revert back asap? > > > > > > > > thanks, > > > > Arun > > > > > > > > On Mar 22, 2013, at 1:47 PM, Roman Shaposhnik wrote: > > > > > > > >> On Thu, Mar 7, 2013 at 6:33 AM, Arun C Murthy > > wrote: > > > >>> Folks, > > > >>> > > > >>> To fix YARN-429 and a couple of other critical bugs, I've created > > branch-2.0.4-alpha and necessary versions in jira etc. > > > >>> > > > >>> Currently, here is the list of bugs slated for this release: > > http://s.apache.org/hadoop-2.0.4-alpha > > > >>> > > > >>> Committers, please talk to me if you feel there are are other > > blocker bugs which warrant getting into this release. > > > >> > > > >> Just wanted to quickly check what is the status of 2.0.4-alpha. > > > >> > > > >> Currently I see the following issues blocking it: > > > >> > > https://issues.apache.org/jira/issues/?jql=project%20%3D%20MAPREDUCE%20AND%20fixVersion%20%3D%20%222.0.4-alpha%22%20AND%20resolution%20%3D%20Unresolved%20AND%20priority%20%3D%20Blocker%20ORDER%20BY%20key%20DESC > > > >> > > > >> What's the consensus here on how complete that list is? > > > >> > > > >> We haven't really finished Bigtop testing yet, since we currently > > > >> seem to be blocked on MAPREDUCE-4820 which means that > > > >> we may discover additional stoppers yet. > > > >> > > > >> Still I wanted to know what is the overall thinking on what else > > > >> need to go into 2.0.4-alpha. > > > >> > > > >> Thanks, > > > >> Roman. > > > > > > > > -- > > > > Arun C. Murthy > > > > Hortonworks Inc. > > > > http://hortonworks.com/ > > > > > > > > > > > > > > -- > > > Arun C. Murthy > > > Hortonworks Inc. > > > http://hortonworks.com/ > > > > > > > >
Re: hadoop-2.0.4-alpha bug-fix release
One of those failures is fixed in https://issues.apache.org/jira/browse/HADOOP-9405 which looks like it got into 2.0.5 but not 2.0.4. Best, Andrew On Mon, Apr 1, 2013 at 12:17 PM, Konstantin Boudnik wrote: > On Wed, Mar 27, 2013 at 01:33PM, Arun C Murthy wrote: > > Thanks to Bobby we might have narrowed down the issue to a change needed > in > > Oozie, I'll start preparing to make the 2.0.4 release later this week. > > I am running 2.0.4-alpha build now to supply Bigtop 0.6.0 with official > source > tarball for upcoming release of 2.0.4. > > The job URL is > https://builds.apache.org/view/Hadoop/job/Hadoop-branch-2.0.4 > > At the moment 4 tests are failing on the branch: > > https://builds.apache.org/view/Hadoop/job/Hadoop-branch-2.0.4/lastCompletedBuild/testReport/ > > Cos > > > On Mar 26, 2013, at 10:20 AM, Arun C Murthy wrote: > > > > > Roman - Looks like the confusion is solely centered around > https://issues.apache.org/jira/browse/MAPREDUCE-4549. Can you please > revert back asap? > > > > > > thanks, > > > Arun > > > > > > On Mar 22, 2013, at 1:47 PM, Roman Shaposhnik wrote: > > > > > >> On Thu, Mar 7, 2013 at 6:33 AM, Arun C Murthy > wrote: > > >>> Folks, > > >>> > > >>> To fix YARN-429 and a couple of other critical bugs, I've created > branch-2.0.4-alpha and necessary versions in jira etc. > > >>> > > >>> Currently, here is the list of bugs slated for this release: > http://s.apache.org/hadoop-2.0.4-alpha > > >>> > > >>> Committers, please talk to me if you feel there are are other > blocker bugs which warrant getting into this release. > > >> > > >> Just wanted to quickly check what is the status of 2.0.4-alpha. > > >> > > >> Currently I see the following issues blocking it: > > >> > https://issues.apache.org/jira/issues/?jql=project%20%3D%20MAPREDUCE%20AND%20fixVersion%20%3D%20%222.0.4-alpha%22%20AND%20resolution%20%3D%20Unresolved%20AND%20priority%20%3D%20Blocker%20ORDER%20BY%20key%20DESC > > >> > > >> What's the consensus here on how complete that list is? > > >> > > >> We haven't really finished Bigtop testing yet, since we currently > > >> seem to be blocked on MAPREDUCE-4820 which means that > > >> we may discover additional stoppers yet. > > >> > > >> Still I wanted to know what is the overall thinking on what else > > >> need to go into 2.0.4-alpha. > > >> > > >> Thanks, > > >> Roman. > > > > > > -- > > > Arun C. Murthy > > > Hortonworks Inc. > > > http://hortonworks.com/ > > > > > > > > > > -- > > Arun C. Murthy > > Hortonworks Inc. > > http://hortonworks.com/ > > > > >
Re: hadoop-2.0.4-alpha bug-fix release
On Wed, Mar 27, 2013 at 01:33PM, Arun C Murthy wrote: > Thanks to Bobby we might have narrowed down the issue to a change needed in > Oozie, I'll start preparing to make the 2.0.4 release later this week. I am running 2.0.4-alpha build now to supply Bigtop 0.6.0 with official source tarball for upcoming release of 2.0.4. The job URL is https://builds.apache.org/view/Hadoop/job/Hadoop-branch-2.0.4 At the moment 4 tests are failing on the branch: https://builds.apache.org/view/Hadoop/job/Hadoop-branch-2.0.4/lastCompletedBuild/testReport/ Cos > On Mar 26, 2013, at 10:20 AM, Arun C Murthy wrote: > > > Roman - Looks like the confusion is solely centered around > > https://issues.apache.org/jira/browse/MAPREDUCE-4549. Can you please revert > > back asap? > > > > thanks, > > Arun > > > > On Mar 22, 2013, at 1:47 PM, Roman Shaposhnik wrote: > > > >> On Thu, Mar 7, 2013 at 6:33 AM, Arun C Murthy wrote: > >>> Folks, > >>> > >>> To fix YARN-429 and a couple of other critical bugs, I've created > >>> branch-2.0.4-alpha and necessary versions in jira etc. > >>> > >>> Currently, here is the list of bugs slated for this release: > >>> http://s.apache.org/hadoop-2.0.4-alpha > >>> > >>> Committers, please talk to me if you feel there are are other blocker > >>> bugs which warrant getting into this release. > >> > >> Just wanted to quickly check what is the status of 2.0.4-alpha. > >> > >> Currently I see the following issues blocking it: > >> > >> https://issues.apache.org/jira/issues/?jql=project%20%3D%20MAPREDUCE%20AND%20fixVersion%20%3D%20%222.0.4-alpha%22%20AND%20resolution%20%3D%20Unresolved%20AND%20priority%20%3D%20Blocker%20ORDER%20BY%20key%20DESC > >> > >> What's the consensus here on how complete that list is? > >> > >> We haven't really finished Bigtop testing yet, since we currently > >> seem to be blocked on MAPREDUCE-4820 which means that > >> we may discover additional stoppers yet. > >> > >> Still I wanted to know what is the overall thinking on what else > >> need to go into 2.0.4-alpha. > >> > >> Thanks, > >> Roman. > > > > -- > > Arun C. Murthy > > Hortonworks Inc. > > http://hortonworks.com/ > > > > > > -- > Arun C. Murthy > Hortonworks Inc. > http://hortonworks.com/ > >
Re: hadoop-2.0.4-alpha bug-fix release
I just checked in YARN-509/HADOOP-9444. Thanks, +Vinod Kumar Vavilapalli On Mar 28, 2013, at 9:02 AM, Roman Shaposhnik wrote: > Also, we are not out of the woods yet. The Hadoop build out of the > 2.0.4-alpha branch > still seem to have issues with Kerberos deployments. Here's the first > in a series > of JIRAs: > https://issues.apache.org/jira/browse/YARN-509
Re: hadoop-2.0.4-alpha bug-fix release
On Wed, Mar 27, 2013 at 1:33 PM, Arun C Murthy wrote: > Thanks to Bobby we might have narrowed down the issue to a change needed in > Oozie, I'll start preparing to make the 2.0.4 release later this week. Here's an update. I filed https://issues.apache.org/jira/browse/MAPREDUCE-5117 which feels like a true blocker since Kerberos with Oozie used to work in previous releases of Bigtop. I would really appreciate all the help with figuring out what could be wrong there. Thanks, Roman.
Re: hadoop-2.0.4-alpha bug-fix release
On Wed, Mar 27, 2013 at 1:33 PM, Arun C Murthy wrote: > Thanks to Bobby we might have narrowed down the issue to a change needed in > Oozie, I'll start preparing to make the 2.0.4 release later this week. First question: as far as I can tell MAPREDUCE-5088 is still unresolved. Do you plan to commit it soon? Also, we are not out of the woods yet. The Hadoop build out of the 2.0.4-alpha branch still seem to have issues with Kerberos deployments. Here's the first in a series of JIRAs: https://issues.apache.org/jira/browse/YARN-509 There's also: " ERROR org.apache.hadoop.ipc.RPC: RPC.stopProxy called on non proxy." exception between kerberized Oozie and RM that came in last night. Alejandro and I are investigating it today. As it stands, however, Bigtop can't yet validate 2.0.4-alpha. Thanks, Roman.
Re: hadoop-2.0.4-alpha bug-fix release
Thanks to Bobby we might have narrowed down the issue to a change needed in Oozie, I'll start preparing to make the 2.0.4 release later this week. thanks, Arun On Mar 26, 2013, at 10:20 AM, Arun C Murthy wrote: > Roman - Looks like the confusion is solely centered around > https://issues.apache.org/jira/browse/MAPREDUCE-4549. Can you please revert > back asap? > > thanks, > Arun > > On Mar 22, 2013, at 1:47 PM, Roman Shaposhnik wrote: > >> On Thu, Mar 7, 2013 at 6:33 AM, Arun C Murthy wrote: >>> Folks, >>> >>> To fix YARN-429 and a couple of other critical bugs, I've created >>> branch-2.0.4-alpha and necessary versions in jira etc. >>> >>> Currently, here is the list of bugs slated for this release: >>> http://s.apache.org/hadoop-2.0.4-alpha >>> >>> Committers, please talk to me if you feel there are are other blocker bugs >>> which warrant getting into this release. >> >> Just wanted to quickly check what is the status of 2.0.4-alpha. >> >> Currently I see the following issues blocking it: >> >> https://issues.apache.org/jira/issues/?jql=project%20%3D%20MAPREDUCE%20AND%20fixVersion%20%3D%20%222.0.4-alpha%22%20AND%20resolution%20%3D%20Unresolved%20AND%20priority%20%3D%20Blocker%20ORDER%20BY%20key%20DESC >> >> What's the consensus here on how complete that list is? >> >> We haven't really finished Bigtop testing yet, since we currently >> seem to be blocked on MAPREDUCE-4820 which means that >> we may discover additional stoppers yet. >> >> Still I wanted to know what is the overall thinking on what else >> need to go into 2.0.4-alpha. >> >> Thanks, >> Roman. > > -- > Arun C. Murthy > Hortonworks Inc. > http://hortonworks.com/ > > -- Arun C. Murthy Hortonworks Inc. http://hortonworks.com/
Re: hadoop-2.0.4-alpha bug-fix release
Roman - Looks like the confusion is solely centered around https://issues.apache.org/jira/browse/MAPREDUCE-4549. Can you please revert back asap? thanks, Arun On Mar 22, 2013, at 1:47 PM, Roman Shaposhnik wrote: > On Thu, Mar 7, 2013 at 6:33 AM, Arun C Murthy wrote: >> Folks, >> >> To fix YARN-429 and a couple of other critical bugs, I've created >> branch-2.0.4-alpha and necessary versions in jira etc. >> >> Currently, here is the list of bugs slated for this release: >> http://s.apache.org/hadoop-2.0.4-alpha >> >> Committers, please talk to me if you feel there are are other blocker bugs >> which warrant getting into this release. > > Just wanted to quickly check what is the status of 2.0.4-alpha. > > Currently I see the following issues blocking it: > > https://issues.apache.org/jira/issues/?jql=project%20%3D%20MAPREDUCE%20AND%20fixVersion%20%3D%20%222.0.4-alpha%22%20AND%20resolution%20%3D%20Unresolved%20AND%20priority%20%3D%20Blocker%20ORDER%20BY%20key%20DESC > > What's the consensus here on how complete that list is? > > We haven't really finished Bigtop testing yet, since we currently > seem to be blocked on MAPREDUCE-4820 which means that > we may discover additional stoppers yet. > > Still I wanted to know what is the overall thinking on what else > need to go into 2.0.4-alpha. > > Thanks, > Roman. -- Arun C. Murthy Hortonworks Inc. http://hortonworks.com/
Re: hadoop-2.0.4-alpha bug-fix release
On Thu, Mar 7, 2013 at 6:33 AM, Arun C Murthy wrote: > Folks, > > To fix YARN-429 and a couple of other critical bugs, I've created > branch-2.0.4-alpha and necessary versions in jira etc. > > Currently, here is the list of bugs slated for this release: > http://s.apache.org/hadoop-2.0.4-alpha > > Committers, please talk to me if you feel there are are other blocker bugs > which warrant getting into this release. Just wanted to quickly check what is the status of 2.0.4-alpha. Currently I see the following issues blocking it: https://issues.apache.org/jira/issues/?jql=project%20%3D%20MAPREDUCE%20AND%20fixVersion%20%3D%20%222.0.4-alpha%22%20AND%20resolution%20%3D%20Unresolved%20AND%20priority%20%3D%20Blocker%20ORDER%20BY%20key%20DESC What's the consensus here on how complete that list is? We haven't really finished Bigtop testing yet, since we currently seem to be blocked on MAPREDUCE-4820 which means that we may discover additional stoppers yet. Still I wanted to know what is the overall thinking on what else need to go into 2.0.4-alpha. Thanks, Roman.