Re: [VOTE] Release Apache Hadoop 2.6.4 RC0

[Chang Li]

Thanks Junping!
+1 non-binding.

Verified signatures.
Built and deployed a single node cluster successfully.
Ran some MR jobs successfully.
Checked UIs.
Ran basic commands successfully.

Best,
Chang Li

On Mon, Feb 8, 2016 at 9:34 PM, Chen He <airb...@gmail.com> wrote:

> Thank you Junping for the release work.
>
> +1 non-binding
>
> - built from source code using Java7 and deploy to a two-node cluster;
> - run WC and loadgen, passed;
>
> Regards!
>
> Chen
>
> On Mon, Feb 8, 2016 at 6:11 PM, Mit Desai <mitdesa...@gmail.com> wrote:
>
> > +1 (non-binding)
> > - verified signatures
> > - built from source and deployed to a single node cluster.
> > - ran sample map reduce jobs successfully
> >
> > Thanks Jinping Du for putting up the work to prepare the release.
> >
> > -Mit Desai
> >
> >
> >
> > On Mon, Feb 8, 2016 at 5:35 PM, Sangjin Lee <sj...@apache.org> wrote:
> >
> > > +1 (not binding)
> > >
> > > - downloaded both the source and the binary tarballs, and checked the
> > > checksums and signatures
> > > - started a pseudo-distributed cluster and ran test MR jobs
> > > - spot checked the URI and the logs
> > >
> > > Sangjin
> > >
> > > On Mon, Feb 8, 2016 at 4:17 PM, Jason Lowe <jl...@yahoo-inc.com.invalid
> >
> > > wrote:
> > >
> > > > +1 (binding)
> > > > - verified signatures and digests- built native from source-
> deployed a
> > > > single-node cluster and ran some sample MapReduce jobs.
> > > > Jason
> > > >
> > > >
> > > >   From: Junping Du <j...@hortonworks.com>
> > > >  To: "hdfs-...@hadoop.apache.org" <hdfs-...@hadoop.apache.org>; "
> > > > yarn-...@hadoop.apache.org" <yarn-...@hadoop.apache.org>; "
> > > > mapreduce-...@hadoop.apache.org" <mapreduce-...@hadoop.apache.org>;
> "
> > > > common-dev@hadoop.apache.org" <common-dev@hadoop.apache.org>
> > > >  Sent: Wednesday, February 3, 2016 1:01 AM
> > > >  Subject: [VOTE] Release Apache Hadoop 2.6.4 RC0
> > > >
> > > > Hi community folks,
> > > >   I've created a release candidate RC0 for Apache Hadoop 2.6.4 (the
> > next
> > > > maintenance release to follow up 2.6.3.) according to email thread of
> > > > release plan 2.6.4 [1]. Below is details of this release candidate:
> > > >
> > > > The RC is available for validation at:
> > > > *http://people.apache.org/~junping_du/hadoop-2.6.4-RC0/
> > > > <http://people.apache.org/~junping_du/hadoop-2.6.4-RC0/>*
> > > >
> > > > The RC tag in git is: release-2.6.4-RC0
> > > >
> > > > The maven artifacts are staged via repository.apache.org at:
> > > > *
> > >
> https://repository.apache.org/content/repositories/orgapachehadoop-1028/
> > ?
> > > > <
> > >
> https://repository.apache.org/content/repositories/orgapachehadoop-1028/
> > > > >*
> > > >
> > > > You can find my public key at:
> > > > http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS
> > > >
> > > > Please try the release and vote. The vote will run for the usual 5
> > days.
> > > >
> > > > Thanks!
> > > >
> > > >
> > > > Cheers,
> > > >
> > > > Junping
> > > >
> > > >
> > > > [1]: 2.6.4 release plan:
> http://markmail.org/message/fk3ud3c665lscvx5?
> > > >
> > > >
> > > >
> > > >
> > >
> >
>

Re: [VOTE] Release Apache Hadoop 2.7.2 RC2

[Chang Li]

Thanks Vinod and Junping!
+1(non-binding)
-built and deployed on linux and mac successfully
-ran MR jobs successfully
-verified UIs work

Best,
Chang

On Mon, Jan 18, 2016 at 11:46 PM, Arpit Agarwal 
wrote:

> +1 (binding)
>
> - verified signatures
> - Installed pseudo-cluster from binary distribution and ran example
> MapReduce jobs
> - Built from sources and reran tests on pseudo-cluster
>
>
>
>
> On 1/14/16, 8:57 PM, "Vinod Kumar Vavilapalli"  wrote:
>
> >Hi all,
> >
> >I've created an updated release candidate RC2 for Apache Hadoop 2.7.2.
> >
> >As discussed before, this is the next maintenance release to follow up
> 2.7.1.
> >
> >The RC is available for validation at:
> http://people.apache.org/~vinodkv/hadoop-2.7.2-RC2/
> >
> >The RC tag in git is: release-2.7.2-RC2
> >
> >The maven artifacts are available via repository.apache.org <
> http://repository.apache.org/> at
> https://repository.apache.org/content/repositories/orgapachehadoop-1027 <
> https://repository.apache.org/content/repositories/orgapachehadoop-1027>
> >
> >The release-notes are inside the tar-balls at location
> hadoop-common-project/hadoop-common/src/main/docs/releasenotes.html. I
> hosted this at
> http://people.apache.org/~vinodkv/hadoop-2.7.2-RC2/releasenotes.html <
> http://people.apache.org/~vinodkv/hadoop-2.7.2-RC1/releasenotes.html> for
> your quick perusal.
> >
> >As you may have noted,
> > - I terminated the RC1 related voting thread after finding out that we
> didn’t have a bunch of patches that are already in the released 2.6.3
> version. After a brief discussion, we decided to keep the parallel 2.6.x
> and 2.7.x releases incremental, see [4] for this discussion.
> > - The RC0 related voting thread got halted due to some critical issues.
> It took a while again for getting all those blockers out of the way. See
> the previous voting thread [3] for details.
> > - Before RC0, an unusually long 2.6.3 release caused 2.7.2 to slip by
> quite a bit. This release's related discussion threads are linked below:
> [1] and [2].
> >
> >Please try the release and vote; the vote will run for the usual 5 days.
> >
> >Thanks,
> >Vinod
> >
> >[1]: 2.7.2 release plan: http://markmail.org/message/oozq3gvd4nhzsaes <
> http://markmail.org/message/oozq3gvd4nhzsaes>
> >[2]: Planning Apache Hadoop 2.7.2
> http://markmail.org/message/iktqss2qdeykgpqk <
> http://markmail.org/message/iktqss2qdeykgpqk>
> >[3]: [VOTE] Release Apache Hadoop 2.7.2 RC0:
> http://markmail.org/message/5txhvr2qdiqglrwc <
> http://markmail.org/message/5txhvr2qdiqglrwc>
> >[4] Retracted [VOTE] Release Apache Hadoop 2.7.2 RC1:
> http://markmail.org/thread/n7ljbsnquihn3wlw
>

Re: [VOTE] Release Apache Hadoop 2.7.2 RC1

[Chang Li]

+1 (non binding)
Downloaed src and built on single node cluster.
Ran some MR jobs successfully.
Verified signature.

Thanks,
Chang

On Mon, Dec 21, 2015 at 9:34 PM, Tsuyoshi Ozawa  wrote:

> +1
>
> - downloaded src and bin tar balls and verified signatures.
> - built Tez and Spark with 2.7.2 artifacts and JDK7.
> - ran tests of Tez with 2.7.2 artifacts, it passed.
>
> FYI: YARN-4348, reported by Jian, is one of critical issues of 2.7.2
> release.It's better to release 2.7.3 as soon as possible after this
> release.
>
> Thanks,
> - Tsuyoshi
>
> On Tue, Dec 22, 2015 at 4:51 AM, Wangda Tan  wrote:
> > +1 (binding)
> >
> > - Build & deploy single-node Hadoop from source code
> > - Add/Remove node labels to queues/nodes
> > - Run distributed shell commanding using default/specified node labels
> >
> > Thanks,
> > Wangda
> >
> >
> > On Mon, Dec 21, 2015 at 9:58 AM, Masatake Iwasaki <
> > iwasak...@oss.nttdata.co.jp> wrote:
> >
> >> +1(non-binding)
> >>
> >> - verified mds and signature of source and binary tarball
> >> - started 3 node cluster and ran example jobs such as wordcount and
> >> terasort
> >> - built from source tarball with -Pnative on CentOS 7 and OpenJDK 7
> >> - built site documentation and skimmed the contents
> >>
> >> Thanks,
> >> Masatake Iwasaki
> >>
> >>
> >>
> >> On 12/17/15 11:49, Vinod Kumar Vavilapalli wrote:
> >>
> >>> Hi all,
> >>>
> >>> I've created a release candidate RC1 for Apache Hadoop 2.7.2.
> >>>
> >>> As discussed before, this is the next maintenance release to follow up
> >>> 2.7.1.
> >>>
> >>> The RC is available for validation at:
> >>> http://people.apache.org/~vinodkv/hadoop-2.7.2-RC1/ <
> >>> http://people.apache.org/~vinodkv/hadoop-2.7.2-RC1/>
> >>>
> >>> The RC tag in git is: release-2.7.2-RC1
> >>>
> >>> The maven artifacts are available via repository.apache.org <
> >>> http://repository.apache.org/> at
> >>>
> https://repository.apache.org/content/repositories/orgapachehadoop-1026/
> >>> <
> https://repository.apache.org/content/repositories/orgapachehadoop-1026/
> >>> >
> >>>
> >>> The release-notes are inside the tar-balls at location
> >>> hadoop-common-project/hadoop-common/src/main/docs/releasenotes.html. I
> >>> hosted this at
> >>> http://people.apache.org/~vinodkv/hadoop-2.7.2-RC1/releasenotes.html
> for
> >>> quick perusal.
> >>>
> >>> As you may have noted,
> >>>   - The RC0 related voting thread got halted due to some critical
> issues.
> >>> It took a while again for getting all those blockers out of the way.
> See
> >>> the previous voting thread [3] for details.
> >>>   - Before RC0, an unusually long 2.6.3 release caused 2.7.2 to slip by
> >>> quite a bit. This release's related discussion threads are linked
> below:
> >>> [1] and [2].
> >>>
> >>> Please try the release and vote; the vote will run for the usual 5
> days.
> >>>
> >>> Thanks,
> >>> Vinod
> >>>
> >>> [1]: 2.7.2 release plan: http://markmail.org/message/oozq3gvd4nhzsaes
> <
> >>> http://markmail.org/message/oozq3gvd4nhzsaes>
> >>> [2]: Planning Apache Hadoop 2.7.2
> >>> http://markmail.org/message/iktqss2qdeykgpqk <
> >>> http://markmail.org/message/iktqss2qdeykgpqk>
> >>> [3]: [VOTE] Release Apache Hadoop 2.7.2 RC0:
> >>> http://markmail.org/message/5txhvr2qdiqglrwc
> >>>
> >>>
> >>>
> >>
>

[jira] [Created] (HADOOP-12645) Add option to allow multiple threads making calls on same RPC client not retry serially

[Chang Li (JIRA)]

Chang Li created HADOOP-12645:
-

 Summary: Add option to allow multiple threads making calls on same 
RPC client not retry serially
 Key: HADOOP-12645
 URL: https://issues.apache.org/jira/browse/HADOOP-12645
 Project: Hadoop Common
  Issue Type: Improvement
Reporter: Chang Li
Assignee: Chang Li


Current multiple threads making calls on same RPC client retry serially. For 
example, when a first call starts for retrying for 10 minutes, second and third 
and fourth calls called in during this time will get queued up. After 1st call 
fail, those second, third and fourth call will still unwisely go ahead serially 
to do the 10 minutes retry and fail. Propose to add a optional setting, default 
to false, but when enabled will allow those queued up following calls to fail 
without wasting time to retry.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: [VOTE] Release Apache Hadoop 2.6.3 RC0

[Chang Li]

Thanks Junping, + 1(non binding). Downloaded the tarball, compiled and
built locally. Ran some MR jobs successfully.

Best,
Chang

On Tue, Dec 15, 2015 at 3:17 PM, Wangda Tan  wrote:

> Thanks Junping,
>
> +1 (binding). Deploy a cluster locally, run distributed shell and MR job,
> both successfully finished.
>
> Regards,
> Wangda
>
>
> On Tue, Dec 15, 2015 at 12:43 PM, Naganarasimha Garla <
> naganarasimha...@gmail.com> wrote:
>
> > Hi Junping,
> >
> > +0 (non binding)
> >
> > Though everything else is working  fine (downloaded the tar ball and
> > installed single node cluster setup and  verified  few MR jobs),
> > submission of Unmanaged AM is getting the RM down. YARN-4452 has
> > already been raised and i am working on it. Will provide the patch for
> > the trunk and the 2.6.3 version asap
> >
> > Regards,
> >
> > + Naga
> >
> > 
> >
> > Thanks for the work Junping! Downloaded the src tarball. Built locally
> > and successfully ran
> > in single node mode with a few map reduce jobs. LGTM.
> >
> > Li Lu
> >
> > On Dec 14, 2015, at 04:23, Junping Du
> > >
> > wrote:
> >
> > ?Thanks Sarjeet and Tsuyoshi for reporting this. I just fix permission
> > issue and download
> > should work now. Please try to download it again. Thanks!
> >
> >
> > Thanks,
> >
> >
> > Junping
> >
> >
> > 
> > From: sarjeet singh >
> > Sent: Sunday, December 13, 2015 6:44 PM
> > To: common-dev@hadoop.apache.org
> > Cc: mapreduce-...@hadoop.apache.org mapreduce-...@hadoop.apache.org
> > >;
> > hdfs-...@hadoop.apache.org;
> > yarn-...@hadoop.apache.org;
> > junping...@apache.org
> > Subject: Re: [VOTE] Release Apache Hadoop 2.6.3 RC0
> >
> > I am also getting the same error when downloading tar.gz:
> >
> > "You don't have permission to access
> > /~junping_du/hadoop-2.6.3-RC0/hadoop-2.6.3-RC0-src.tar.gz
> > on this server."
> >
> > - Sarjeet Singh
> >
> > On Sat, Dec 12, 2015 at 4:17 PM, Tsuyoshi Ozawa
> > >
> > wrote:
> > Hi Junping,
> >
> > Thank you for starting the voting.
> > I cannot access the tar.gz file because of permission error. Could you
> > check the permission to access the files?
> >
> > Forbidden
> > You don't have permission to access
> > /~junping_du/hadoop-2.6.3-RC0/hadoop-2.6.3-RC0-src.tar.gz
> > on this server.
> >
> > Thanks,
> > - Tsuyoshi
> >
> > On Sat, Dec 12, 2015 at 9:16 AM, Junping Du
> >  > j...@hortonworks.com>>
> > wrote:
> >
> > Hi all developers in hadoop community,
> >   I've created a release candidate RC0 for Apache Hadoop 2.6.3 (the
> > next maintenance release
> > to follow up 2.6.2.) according to email thread of release plan 2.6.3
> > [1]. Sorry for this RC
> > coming a bit late as several blocker issues were getting committed
> > until yesterday. Below
> > is the details:
> >
> > The RC is available for validation at:
> > *http://people.apache.org/~junping_du/hadoop-2.6.3-RC0/
> > *
> >
> > The RC tag in git is: release-2.6.3-RC0
> >
> > The maven artifacts are staged via
> > repository.apache.org<
> > http://repository.apache.org>
> > at:
> > *
> https://repository.apache.org/content/repositories/orgapachehadoop-1025/?
> > <
> https://repository.apache.org/content/repositories/orgapachehadoop-1025/
> > >*
> >
> > You can find my public key
> > at:http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS
> >
> > Please try the release and vote. The vote will run for the usual 5 days.
> >
> > Thanks and happy weekend!
> >
> >
> > Cheers,
> >
> > Junping
> >
> >
> > [1]: 2.6.3 release plan: http://markmail.org/thread/nc2jogbgni37vu6y
> >
>

[jira] [Resolved] (HADOOP-12595) Remove the support of the deprecated dfs.umask

[Chang Li (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HADOOP-12595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Chang Li resolved HADOOP-12595.
---
Resolution: Duplicate

> Remove the support of the deprecated dfs.umask 
> ---
>
> Key: HADOOP-12595
> URL: https://issues.apache.org/jira/browse/HADOOP-12595
> Project: Hadoop Common
>  Issue Type: Bug
>        Reporter: Chang Li
>    Assignee: Chang Li
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (HADOOP-12595) Remove the support of the deprecated dfs.umask

[Chang Li (JIRA)]

Chang Li created HADOOP-12595:
-

 Summary: Remove the support of the deprecated dfs.umask 
 Key: HADOOP-12595
 URL: https://issues.apache.org/jira/browse/HADOOP-12595
 Project: Hadoop Common
  Issue Type: Bug
Reporter: Chang Li
Assignee: Chang Li






--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: Github integration for Hadoop

[Chang Li]

+1 (non-binding)

On Thu, Oct 29, 2015 at 1:54 PM, Ashish  wrote:

> +1
>
> On Thu, Oct 29, 2015 at 11:51 AM, Mingliang Liu 
> wrote:
> > +1 (non-binding)
> >
> > Mingliang Liu
> > Member of Technical Staff - HDFS,
> > Hortonworks Inc.
> > m...@hortonworks.com
> >
> >
> >
> >> On Oct 29, 2015, at 10:55 AM, Hitesh Shah  wrote:
> >>
> >> +1 on supporting patch contributions through github pull requests.
> >>
> >> — Hitesh
> >>
> >> On Oct 29, 2015, at 10:47 AM, Owen O'Malley  wrote:
> >>
> >>> All,
> >>>  For code & patch review, many of the newer projects are using the
> Github
> >>> pull request integration. You can read about it here:
> >>>
> >>>
> https://blogs.apache.org/infra/entry/improved_integration_between_apache_and
> >>>
> >>> It basically lets you:
> >>> * have mirroring between comments on pull requests and jira
> >>> * lets you close pull requests
> >>> * have mirroring between pull request comments and the Apache mail
> lists
> >>>
> >>> Thoughts?
> >>> .. Owen
> >>
> >>
> >
>
>
>
> --
> thanks
> ashish
>
> Blog: http://www.ashishpaliwal.com/blog
> My Photo Galleries: http://www.pbase.com/ashishpaliwal
>

Re: [VOTE] Release Apache Hadoop 2.6.2

[Chang Li]

Thanks all!
+ 1(non binding)
-downloaded, compiled source
-deploy two node cluster on mac and linux
-ran MR wordcount and verified result

Re: [VOTE] Release Apache Hadoop 2.6.1 RC1

[Chang Li]

Thanks everyone who helped on this release!
Have run compilation and run various job on single node cluster. Have also
test my contribution for YARN-3267
<https://issues.apache.org/jira/browse/YARN-3267> and verified that all
related unit tests pass.

Thank you,
Chang Li

[jira] [Created] (HADOOP-12296) when setnetgrent returns 0 in linux, exception should be thrown

[Chang Li (JIRA)]

Chang Li created HADOOP-12296:
-

 Summary: when setnetgrent returns 0 in linux, exception should be 
thrown
 Key: HADOOP-12296
 URL: https://issues.apache.org/jira/browse/HADOOP-12296
 Project: Hadoop Common
  Issue Type: Bug
Reporter: Chang Li
Assignee: Chang Li


In linux, setnetgrent returns 0 in linux when something wrong is happen, such 
as out of memory, unknown group, unavailable service, etc. So errorMessage 
should be set and exception should be thrown



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (HADOOP-12294) provide better visibility of parsing configuration failure

[Chang Li (JIRA)]

Chang Li created HADOOP-12294:
-

 Summary: provide better visibility of parsing configuration failure
 Key: HADOOP-12294
 URL: https://issues.apache.org/jira/browse/HADOOP-12294
 Project: Hadoop Common
  Issue Type: Bug
Reporter: Chang Li
Assignee: Chang Li


provide better visibility of parsing configuration failure by logging full 
error message and propagate error message of parsing configuration back to 
client



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)