RE: Welcoming Harsh J as a Hadoop committer

2011-09-16 Thread a00902702

many congratulations & wish you all the best Harsh!!! :)


-Original Message-
From: t...@cloudera.com [mailto:t...@cloudera.com] On Behalf Of Todd Lipcon
Sent: Friday, September 16, 2011 12:04 PM
To: general@hadoop.apache.org
Subject: Welcoming Harsh J as a Hadoop committer

On behalf of the PMC, I am pleased to announce that Harsh J Chouraria has
been elected a committer in the Apache Hadoop Common, HDFS, and MapReduce
projects. Anyone subscribed to the mailing list or JIRA will undoubtedly
recognize Harsh's name as one of the most helpful community members and an
author of increasingly many code contributions. The Hadoop PMC and community
appreciates Harsh's involvement and looks forward to continuing
contributions!

Welcome, Harsh!

-Todd and the Hadoop Project Management Committee



Rejuvenate Hadoop 0.22 effort

2011-09-16 Thread Konstantin Shvachko
Hi everybody,

I think there is no need to change anything drastically with the plans
for Hadoop 0.22 release, so I'll continue  along the lines previously
rendered by Nigel, discussed, and agreed upon within the community.

1. First thing, we need to resurrect Hadoop-0.22 Jenkins builds ASAP.
Does anybody want to help with that? Any help is greatly appreciated.

2. I will start sorting out jiras currently assigned to 0.22. There
are 10 blockers (again) over the three projects. Details below. My
plan is to get the release candidate out late October.

3. Let's start discussing what else people think needs to be included
in 0.22. I will include issues based on the following priorities
- build fixes,
- test failures,
- bug fixes,
- documentation
- compatibility issues directed to making H-0.22 work with other
project (HBase, Pig, Hive, Oozie)
- minor improvements (irritating for users but simple)
- no new features in 0.22.0, but I'd like to have a list of things
which people would've considered for 0.22.1

4. I will use the following filter to watch the jiras assigned to the release:
project in (HADOOP, HDFS, MAPREDUCE) AND resolution = Unresolved AND
fixVersion = "0.22.0" ORDER BY priority DESC
If you think an issue should be considered for inclusion please set
fixVersion = "0.22.0". I will mark them as blockers based on the
priorities above and my common sense.
Note, if the jira is consciously assigned to a contributor it has high
chance to make into the blockers.

== TESTING ==
5. I think Steve's idea of integrating 0.22 with Apache BigTop is
great. Will be glad to see any steps in this direction.

6. Hadoop-0.22 is being tested since January 2011. We conducted some
internal testing lately. Testing is proceeding now on a dev cluster.
If anybody plans to setup a cluster for testing and wants to
coordinate the efforts please ping me.

== 10 BLOCKERS ==
7. There are 10 official blockers.

Key AssigneeSummary
MAPREDUCE-1991  Todd Lipcon taskcontroller allows stealing permissions
on any local file
MAPREDUCE-2178  Devaraj Das Race condition in LinuxTaskController
permissions handling
MAPREDUCE-2266  Unassigned  JvmManager sleeps between SIGTERM and
SIGKILL while holding many TT locks

I will unblock TaskController issues as per discussion related to
MAPREDUCE-2767.

MAPREDUCE-1100  Vinod Kumar User's task-logs filling up local disks on
the TaskTrackers
MAPREDUCE-1716  Vinod Kumar MAPREDUCE-1100 Truncate logs of finished
tasks to prevent node thrash due to excessive logging

Don't see any activity from Vinod. Any volunteers to port this to 0.22?

HADOOP-7035 Tom White   Document incompatible API changes 
between releases

Looks like close to completion. Tom are you still on it?

MAPREDUCE-2268  Todd Lipcon With JVM reuse, JvmManager doesn't delete
last workdir properly

Todd, is it a blocker? Do you plan to fix it soon?

MAPREDUCE-1506  Unassigned  Assertion failure in 
TestTaskTrackerMemoryManager

Will unblock, as no volunteers emerged.

HDFS-1967   Unassigned  HDFS-1852 TestHDFSTrash failing on 
trunk and 22
HDFS-2012   Unassigned  Recurring failure of TestBalancer on 
branch-0.22

Don't see failures anymore. Will follow up when Jenkins builds are 
restored

HDFS-2290   Benoy AntonyBlock with corrupt replica is not 
getting replicated

Close to completion.

Thanks,
--Konstantin


Re: Welcoming Harsh J as a Hadoop committer

2011-09-16 Thread Marcos Luis Ortiz Valmaseda
Congratulations, Harsh, you deserve this election.
Regards and best wishes

2011/9/16 a00902702 

>
> many congratulations & wish you all the best Harsh!!! :)
>
>
> -Original Message-
> From: t...@cloudera.com [mailto:t...@cloudera.com] On Behalf Of Todd
> Lipcon
> Sent: Friday, September 16, 2011 12:04 PM
> To: general@hadoop.apache.org
> Subject: Welcoming Harsh J as a Hadoop committer
>
> On behalf of the PMC, I am pleased to announce that Harsh J Chouraria has
> been elected a committer in the Apache Hadoop Common, HDFS, and MapReduce
> projects. Anyone subscribed to the mailing list or JIRA will undoubtedly
> recognize Harsh's name as one of the most helpful community members and an
> author of increasingly many code contributions. The Hadoop PMC and
> community
> appreciates Harsh's involvement and looks forward to continuing
> contributions!
>
> Welcome, Harsh!
>
> -Todd and the Hadoop Project Management Committee
>
>



-- 
Marcos Luis Ortíz Valmaseda
 Linux Infrastructure Engineer && IT Consultant (PDVSA)
 Linux User # 418229
 http://marcosluis2186.posterous.com
 http://www.linkedin.com/in/marcosluis2186
 Twitter: @marcosluis2186


Re: Welcoming Harsh J as a Hadoop committer

2011-09-16 Thread Uma Maheswara Rao G 72686

Congratulations Harsh, Keep it up your good contributions to Hadoop
All the Best!

Regards,
Uma

- Original Message -
From: Marcos Luis Ortiz Valmaseda 
Date: Friday, September 16, 2011 7:04 pm
Subject: Re: Welcoming Harsh J as a Hadoop committer
To: general@hadoop.apache.org, abhijit.shing...@huawei.com

> Congratulations, Harsh, you deserve this election.
> Regards and best wishes
> 
> 2011/9/16 a00902702 
> 
> >
> > many congratulations & wish you all the best Harsh!!! :)
> >
> >
> > -Original Message-
> > From: t...@cloudera.com [mailto:t...@cloudera.com] On Behalf Of Todd
> > Lipcon
> > Sent: Friday, September 16, 2011 12:04 PM
> > To: general@hadoop.apache.org
> > Subject: Welcoming Harsh J as a Hadoop committer
> >
> > On behalf of the PMC, I am pleased to announce that Harsh J 
> Chouraria has
> > been elected a committer in the Apache Hadoop Common, HDFS, and 
> MapReduce> projects. Anyone subscribed to the mailing list or JIRA 
> will undoubtedly
> > recognize Harsh's name as one of the most helpful community 
> members and an
> > author of increasingly many code contributions. The Hadoop PMC and
> > community
> > appreciates Harsh's involvement and looks forward to continuing
> > contributions!
> >
> > Welcome, Harsh!
> >
> > -Todd and the Hadoop Project Management Committee
> >
> >
> 
> 
> 
> -- 
> Marcos Luis Ortíz Valmaseda
> Linux Infrastructure Engineer && IT Consultant (PDVSA)
> Linux User # 418229
> http://marcosluis2186.posterous.com
> http://www.linkedin.com/in/marcosluis2186
> Twitter: @marcosluis2186
>


Re: Welcoming Harsh J as a Hadoop committer

2011-09-16 Thread Sonal Goyal
Congrats Harsh, thanks for all your answers and hard work!

Best Regards,
Sonal
Crux: Reporting for HBase 
Nube Technologies 







On Fri, Sep 16, 2011 at 7:10 PM, Uma Maheswara Rao G 72686 <
mahesw...@huawei.com> wrote:

>
> Congratulations Harsh, Keep it up your good contributions to Hadoop
> All the Best!
>
> Regards,
> Uma
>
> - Original Message -
> From: Marcos Luis Ortiz Valmaseda 
> Date: Friday, September 16, 2011 7:04 pm
> Subject: Re: Welcoming Harsh J as a Hadoop committer
> To: general@hadoop.apache.org, abhijit.shing...@huawei.com
>
> > Congratulations, Harsh, you deserve this election.
> > Regards and best wishes
> >
> > 2011/9/16 a00902702 
> >
> > >
> > > many congratulations & wish you all the best Harsh!!! :)
> > >
> > >
> > > -Original Message-
> > > From: t...@cloudera.com [mailto:t...@cloudera.com] On Behalf Of Todd
> > > Lipcon
> > > Sent: Friday, September 16, 2011 12:04 PM
> > > To: general@hadoop.apache.org
> > > Subject: Welcoming Harsh J as a Hadoop committer
> > >
> > > On behalf of the PMC, I am pleased to announce that Harsh J
> > Chouraria has
> > > been elected a committer in the Apache Hadoop Common, HDFS, and
> > MapReduce> projects. Anyone subscribed to the mailing list or JIRA
> > will undoubtedly
> > > recognize Harsh's name as one of the most helpful community
> > members and an
> > > author of increasingly many code contributions. The Hadoop PMC and
> > > community
> > > appreciates Harsh's involvement and looks forward to continuing
> > > contributions!
> > >
> > > Welcome, Harsh!
> > >
> > > -Todd and the Hadoop Project Management Committee
> > >
> > >
> >
> >
> >
> > --
> > Marcos Luis Ortíz Valmaseda
> > Linux Infrastructure Engineer && IT Consultant (PDVSA)
> > Linux User # 418229
> > http://marcosluis2186.posterous.com
> > http://www.linkedin.com/in/marcosluis2186
> > Twitter: @marcosluis2186
> >
>


Re: Welcoming Harsh J as a Hadoop committer

2011-09-16 Thread rajesh putta
Hi Harsh,
you deserve this

Thanks & Regards
Rajesh Putta

On Fri, Sep 16, 2011 at 7:12 PM, Sonal Goyal  wrote:

> Congrats Harsh, thanks for all your answers and hard work!
>
> Best Regards,
> Sonal
> Crux: Reporting for HBase 
> Nube Technologies 
>
> 
>
>
>
>
>
> On Fri, Sep 16, 2011 at 7:10 PM, Uma Maheswara Rao G 72686 <
> mahesw...@huawei.com> wrote:
>
> >
> > Congratulations Harsh, Keep it up your good contributions to Hadoop
> > All the Best!
> >
> > Regards,
> > Uma
> >
> > - Original Message -
> > From: Marcos Luis Ortiz Valmaseda 
> > Date: Friday, September 16, 2011 7:04 pm
> > Subject: Re: Welcoming Harsh J as a Hadoop committer
> > To: general@hadoop.apache.org, abhijit.shing...@huawei.com
> >
> > > Congratulations, Harsh, you deserve this election.
> > > Regards and best wishes
> > >
> > > 2011/9/16 a00902702 
> > >
> > > >
> > > > many congratulations & wish you all the best Harsh!!! :)
> > > >
> > > >
> > > > -Original Message-
> > > > From: t...@cloudera.com [mailto:t...@cloudera.com] On Behalf Of Todd
> > > > Lipcon
> > > > Sent: Friday, September 16, 2011 12:04 PM
> > > > To: general@hadoop.apache.org
> > > > Subject: Welcoming Harsh J as a Hadoop committer
> > > >
> > > > On behalf of the PMC, I am pleased to announce that Harsh J
> > > Chouraria has
> > > > been elected a committer in the Apache Hadoop Common, HDFS, and
> > > MapReduce> projects. Anyone subscribed to the mailing list or JIRA
> > > will undoubtedly
> > > > recognize Harsh's name as one of the most helpful community
> > > members and an
> > > > author of increasingly many code contributions. The Hadoop PMC and
> > > > community
> > > > appreciates Harsh's involvement and looks forward to continuing
> > > > contributions!
> > > >
> > > > Welcome, Harsh!
> > > >
> > > > -Todd and the Hadoop Project Management Committee
> > > >
> > > >
> > >
> > >
> > >
> > > --
> > > Marcos Luis Ortíz Valmaseda
> > > Linux Infrastructure Engineer && IT Consultant (PDVSA)
> > > Linux User # 418229
> > > http://marcosluis2186.posterous.com
> > > http://www.linkedin.com/in/marcosluis2186
> > > Twitter: @marcosluis2186
> > >
> >
>


Re: Welcoming Harsh J as a Hadoop committer

2011-09-16 Thread Abhishek Mehta
the best from tresata on the election Harsh!

Cheers

Abhishek Mehta ('Abhi')
(e) abhis...@tresata.com
(v) 980.355.9855



On Sep 16, 2011, at 2:33 AM, Todd Lipcon wrote:

> On behalf of the PMC, I am pleased to announce that Harsh J Chouraria
> has been elected a committer in the Apache Hadoop Common, HDFS, and
> MapReduce projects. Anyone subscribed to the mailing list or JIRA will
> undoubtedly recognize Harsh's name as one of the most helpful
> community members and an author of increasingly many code
> contributions. The Hadoop PMC and community appreciates Harsh's
> involvement and looks forward to continuing contributions!
> 
> Welcome, Harsh!
> 
> -Todd and the Hadoop Project Management Committee



Re: Rejuvenate Hadoop 0.22 effort

2011-09-16 Thread Owen O'Malley
Konst,
   You should take a look at the evaluate, not just the things that
were marked as blockers 6 months ago, but also look at the things that
have gone out in the 0.20.2xx line that aren't in 0.22.

Areas of work that leap to mind:
  1. fixes to the linux task controller.
  2. rpm work
  3. mr scheduler limits
  4. capacity and fair share improvements
  5. har improvements

-- Owen


Re: Rejuvenate Hadoop 0.22 effort

2011-09-16 Thread Konstantin Shvachko
Thanks Owen. Will definitely look at those.
--Konstantin

On Fri, Sep 16, 2011 at 9:10 AM, Owen O'Malley  wrote:
> Konst,
>   You should take a look at the evaluate, not just the things that
> were marked as blockers 6 months ago, but also look at the things that
> have gone out in the 0.20.2xx line that aren't in 0.22.
>
> Areas of work that leap to mind:
>  1. fixes to the linux task controller.
>  2. rpm work
>  3. mr scheduler limits
>  4. capacity and fair share improvements
>  5. har improvements
>
> -- Owen
>