Re: [VOTE] Release Apache Hadoop 2.3.0
+1 (binding) - Verified signatures and digests - Built from source with native support - Deployed a single-node cluster and ran some sample jobs Jason On 02/11/2014 08:49 AM, Arun C Murthy wrote: Folks, I've created a release candidate (rc0) for hadoop-2.3.0 that I would like to get released. The RC is available at: http://people.apache.org/~acmurthy/hadoop-2.3.0-rc0 The RC tag in svn is here: https://svn.apache.org/repos/asf/hadoop/common/tags/release-2.3.0-rc0 The maven artifacts are available via repository.apache.org. Please try the release and vote; the vote will run for the usual 7 days. thanks, Arun PS: Thanks to Andrew, Vinod Alejandro for all their help in various release activities.
Re: [VOTE] Release Apache Hadoop 2.3.0
+1 (binding) - Verified signatures and digests - Built from source with native support - Deployed a single-node cluster and ran some sample jobs On Tue, Feb 18, 2014 at 8:41 AM, Jason Lowe jl...@yahoo-inc.com wrote: +1 (binding) - Verified signatures and digests - Built from source with native support - Deployed a single-node cluster and ran some sample jobs Jason On 02/11/2014 08:49 AM, Arun C Murthy wrote: Folks, I've created a release candidate (rc0) for hadoop-2.3.0 that I would like to get released. The RC is available at: http://people.apache.org/~ acmurthy/hadoop-2.3.0-rc0 The RC tag in svn is here: https://svn.apache.org/repos/ asf/hadoop/common/tags/release-2.3.0-rc0 The maven artifacts are available via repository.apache.org. Please try the release and vote; the vote will run for the usual 7 days. thanks, Arun PS: Thanks to Andrew, Vinod Alejandro for all their help in various release activities.
Re: [VOTE] Release Apache Hadoop 2.3.0
+1 (binding) Verified checksum, signature. Built from src, poked at single-node cluster, ran some unit tests. -C On Tue, Feb 11, 2014 at 6:49 AM, Arun C Murthy a...@hortonworks.com wrote: Folks, I've created a release candidate (rc0) for hadoop-2.3.0 that I would like to get released. The RC is available at: http://people.apache.org/~acmurthy/hadoop-2.3.0-rc0 The RC tag in svn is here: https://svn.apache.org/repos/asf/hadoop/common/tags/release-2.3.0-rc0 The maven artifacts are available via repository.apache.org. Please try the release and vote; the vote will run for the usual 7 days. thanks, Arun PS: Thanks to Andrew, Vinod Alejandro for all their help in various release activities. -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You.
Re: [VOTE] Release Apache Hadoop 2.3.0
Trying to run the PI MapReduce example using RC0 the job is failing,
looking at the NM logs I'm getting the following.
I believe it may be something in my setup as many already test MR jobs with
this RC successfully, but couldn't figure out yet. Running on OSX 10.9.1
using JDK7.
Thanks.
--
2014-02-13 13:12:06,092 INFO
org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor:
Initializing user tucu
2014-02-13 13:12:06,184 INFO
org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Copying
from
/tmp/hadoop-tucu/nm-local-dir/nmPrivate/container_1392325918406_0001_01_01.tokens
to
/tmp/hadoop-tucu/nm-local-dir/usercache/tucu/appcache/application_1392325918406_0001/container_1392325918406_0001_01_01.tokens
2014-02-13 13:12:06,184 INFO
org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: CWD set
to
/tmp/hadoop-tucu/nm-local-dir/usercache/tucu/appcache/application_1392325918406_0001
=
file:/tmp/hadoop-tucu/nm-local-dir/usercache/tucu/appcache/application_1392325918406_0001
2014-02-13 13:12:06,957 INFO
org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService:
DEBUG: FAILED {
hdfs://localhost:9000/tmp/hadoop-yarn/staging/tucu/.staging/job_1392325918406_0001/job.jar,
1392325925016, PATTERN, (?:classes/|lib/).* }, rename destination
/tmp/hadoop-tucu/nm-local-dir/usercache/tucu/appcache/application_1392325918406_0001/filecache/10
already exists.
2014-02-13 13:12:06,959 INFO
org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.LocalizedResource:
Resource
hdfs://localhost:9000/tmp/hadoop-yarn/staging/tucu/.staging/job_1392325918406_0001/job.jar
transitioned from DOWNLOADING to FAILED
--
On Thu, Feb 13, 2014 at 1:06 PM, Sandy Ryza sandy.r...@cloudera.com wrote:
+1 (non-binding)
Built from source and ran jobs on a pseudo-distributed cluster with the
Fair Scheduler
On Wed, Feb 12, 2014 at 7:56 PM, Xuan Gong xg...@hortonworks.com wrote:
+1 (non-binding)
downloaded the source tar ball, built, ran a number of MR jobs on a
single-node cluster and checked the job history from job history server.
On Wed, Feb 12, 2014 at 7:53 PM, Gera Shegalov g...@shegalov.com
wrote:
+1 non-binding
- checked out the rc tag and built from source
- deployed a pseudo-distributed cluster with
yarn.resourcemanager.recovery.enabled=true
- ran a sleep job with multiple map waves and a long reducer
-- SIGKILL'd AM at various points and verified AM restart
-- SIGKILL'd RM at various points and verified RM restart
- checked some ui issues we had fixed.
- verified the new restful plain text container log NM-WS
Thanks,
Gera
On Tue, Feb 11, 2014 at 6:49 AM, Arun C Murthy a...@hortonworks.com
wrote:
Folks,
I've created a release candidate (rc0) for hadoop-2.3.0 that I would
like
to get released.
The RC is available at:
http://people.apache.org/~acmurthy/hadoop-2.3.0-rc0
The RC tag in svn is here:
https://svn.apache.org/repos/asf/hadoop/common/tags/release-2.3.0-rc0
The maven artifacts are available via repository.apache.org.
Please try the release and vote; the vote will run for the usual 7
days.
thanks,
Arun
PS: Thanks to Andrew, Vinod Alejandro for all their help in various
release activities.
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or
entity
to
which it is addressed and may contain information that is
confidential,
privileged and exempt from disclosure under applicable law. If the
reader
of this message is not the intended recipient, you are hereby
notified
that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender
immediately
and delete it from your system. Thank You.
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity
to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified
that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender
immediately
and delete it from your system. Thank You.
--
Alejandro
Re: [VOTE] Release Apache Hadoop 2.3.0
I suspect it's your setup because I'm able to run the PI example without
errors. Running on RHEL 6.3 w/ JDK7.
On Feb 13, 2014, at 3:05 PM, Alejandro Abdelnur t...@cloudera.com
wrote:
Trying to run the PI MapReduce example using RC0 the job is failing,
looking at the NM logs I'm getting the following.
I believe it may be something in my setup as many already test MR jobs with
this RC successfully, but couldn't figure out yet. Running on OSX 10.9.1
using JDK7.
Thanks.
--
2014-02-13 13:12:06,092 INFO
org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor:
Initializing user tucu
2014-02-13 13:12:06,184 INFO
org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Copying
from
/tmp/hadoop-tucu/nm-local-dir/nmPrivate/container_1392325918406_0001_01_01.tokens
to
/tmp/hadoop-tucu/nm-local-dir/usercache/tucu/appcache/application_1392325918406_0001/container_1392325918406_0001_01_01.tokens
2014-02-13 13:12:06,184 INFO
org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: CWD set
to
/tmp/hadoop-tucu/nm-local-dir/usercache/tucu/appcache/application_1392325918406_0001
=
file:/tmp/hadoop-tucu/nm-local-dir/usercache/tucu/appcache/application_1392325918406_0001
2014-02-13 13:12:06,957 INFO
org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService:
DEBUG: FAILED {
hdfs://localhost:9000/tmp/hadoop-yarn/staging/tucu/.staging/job_1392325918406_0001/job.jar,
1392325925016, PATTERN, (?:classes/|lib/).* }, rename destination
/tmp/hadoop-tucu/nm-local-dir/usercache/tucu/appcache/application_1392325918406_0001/filecache/10
already exists.
2014-02-13 13:12:06,959 INFO
org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.LocalizedResource:
Resource
hdfs://localhost:9000/tmp/hadoop-yarn/staging/tucu/.staging/job_1392325918406_0001/job.jar
transitioned from DOWNLOADING to FAILED
--
On Thu, Feb 13, 2014 at 1:06 PM, Sandy Ryza sandy.r...@cloudera.com wrote:
+1 (non-binding)
Built from source and ran jobs on a pseudo-distributed cluster with the
Fair Scheduler
On Wed, Feb 12, 2014 at 7:56 PM, Xuan Gong xg...@hortonworks.com wrote:
+1 (non-binding)
downloaded the source tar ball, built, ran a number of MR jobs on a
single-node cluster and checked the job history from job history server.
On Wed, Feb 12, 2014 at 7:53 PM, Gera Shegalov g...@shegalov.com
wrote:
+1 non-binding
- checked out the rc tag and built from source
- deployed a pseudo-distributed cluster with
yarn.resourcemanager.recovery.enabled=true
- ran a sleep job with multiple map waves and a long reducer
-- SIGKILL'd AM at various points and verified AM restart
-- SIGKILL'd RM at various points and verified RM restart
- checked some ui issues we had fixed.
- verified the new restful plain text container log NM-WS
Thanks,
Gera
On Tue, Feb 11, 2014 at 6:49 AM, Arun C Murthy a...@hortonworks.com
wrote:
Folks,
I've created a release candidate (rc0) for hadoop-2.3.0 that I would
like
to get released.
The RC is available at:
http://people.apache.org/~acmurthy/hadoop-2.3.0-rc0
The RC tag in svn is here:
https://svn.apache.org/repos/asf/hadoop/common/tags/release-2.3.0-rc0
The maven artifacts are available via repository.apache.org.
Please try the release and vote; the vote will run for the usual 7
days.
thanks,
Arun
PS: Thanks to Andrew, Vinod Alejandro for all their help in various
release activities.
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or
entity
to
which it is addressed and may contain information that is
confidential,
privileged and exempt from disclosure under applicable law. If the
reader
of this message is not the intended recipient, you are hereby
notified
that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender
immediately
and delete it from your system. Thank You.
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity
to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified
that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender
immediately
and delete it from your system. Thank You.
--
Alejandro
signature.asc
Description: Message signed with OpenPGP using GPGMail
Re: [VOTE] Release Apache Hadoop 2.3.0
+1 (non-binding)
Regards
JB
On 02/14/2014 12:17 AM, Travis Thompson wrote:
I suspect it's your setup because I'm able to run the PI example without
errors. Running on RHEL 6.3 w/ JDK7.
On Feb 13, 2014, at 3:05 PM, Alejandro Abdelnur t...@cloudera.com
wrote:
Trying to run the PI MapReduce example using RC0 the job is failing,
looking at the NM logs I'm getting the following.
I believe it may be something in my setup as many already test MR jobs with
this RC successfully, but couldn't figure out yet. Running on OSX 10.9.1
using JDK7.
Thanks.
--
2014-02-13 13:12:06,092 INFO
org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor:
Initializing user tucu
2014-02-13 13:12:06,184 INFO
org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Copying
from
/tmp/hadoop-tucu/nm-local-dir/nmPrivate/container_1392325918406_0001_01_01.tokens
to
/tmp/hadoop-tucu/nm-local-dir/usercache/tucu/appcache/application_1392325918406_0001/container_1392325918406_0001_01_01.tokens
2014-02-13 13:12:06,184 INFO
org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: CWD set
to
/tmp/hadoop-tucu/nm-local-dir/usercache/tucu/appcache/application_1392325918406_0001
=
file:/tmp/hadoop-tucu/nm-local-dir/usercache/tucu/appcache/application_1392325918406_0001
2014-02-13 13:12:06,957 INFO
org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService:
DEBUG: FAILED {
hdfs://localhost:9000/tmp/hadoop-yarn/staging/tucu/.staging/job_1392325918406_0001/job.jar,
1392325925016, PATTERN, (?:classes/|lib/).* }, rename destination
/tmp/hadoop-tucu/nm-local-dir/usercache/tucu/appcache/application_1392325918406_0001/filecache/10
already exists.
2014-02-13 13:12:06,959 INFO
org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.LocalizedResource:
Resource
hdfs://localhost:9000/tmp/hadoop-yarn/staging/tucu/.staging/job_1392325918406_0001/job.jar
transitioned from DOWNLOADING to FAILED
--
On Thu, Feb 13, 2014 at 1:06 PM, Sandy Ryza sandy.r...@cloudera.com wrote:
+1 (non-binding)
Built from source and ran jobs on a pseudo-distributed cluster with the
Fair Scheduler
On Wed, Feb 12, 2014 at 7:56 PM, Xuan Gong xg...@hortonworks.com wrote:
+1 (non-binding)
downloaded the source tar ball, built, ran a number of MR jobs on a
single-node cluster and checked the job history from job history server.
On Wed, Feb 12, 2014 at 7:53 PM, Gera Shegalov g...@shegalov.com
wrote:
+1 non-binding
- checked out the rc tag and built from source
- deployed a pseudo-distributed cluster with
yarn.resourcemanager.recovery.enabled=true
- ran a sleep job with multiple map waves and a long reducer
-- SIGKILL'd AM at various points and verified AM restart
-- SIGKILL'd RM at various points and verified RM restart
- checked some ui issues we had fixed.
- verified the new restful plain text container log NM-WS
Thanks,
Gera
On Tue, Feb 11, 2014 at 6:49 AM, Arun C Murthy a...@hortonworks.com
wrote:
Folks,
I've created a release candidate (rc0) for hadoop-2.3.0 that I would
like
to get released.
The RC is available at:
http://people.apache.org/~acmurthy/hadoop-2.3.0-rc0
The RC tag in svn is here:
https://svn.apache.org/repos/asf/hadoop/common/tags/release-2.3.0-rc0
The maven artifacts are available via repository.apache.org.
Please try the release and vote; the vote will run for the usual 7
days.
thanks,
Arun
PS: Thanks to Andrew, Vinod Alejandro for all their help in various
release activities.
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or
entity
to
which it is addressed and may contain information that is
confidential,
privileged and exempt from disclosure under applicable law. If the
reader
of this message is not the intended recipient, you are hereby
notified
that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender
immediately
and delete it from your system. Thank You.
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity
to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified
that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender
immediately
and delete it from your system. Thank You.
--
Alejandro
--
Jean-Baptiste Onofré
jbono...@apache.org
http://blog.nanthrax.net
Talend - http://www.talend.com
Re: [VOTE] Release Apache Hadoop 2.3.0
+1 (non-binding) * Built from source. * Ran a pseudo-cluster with manual RM HA. * Ran a few MR examples as tests. Thanks, Tsuyoshi On Tue, Feb 11, 2014 at 6:49 AM, Arun C Murthy a...@hortonworks.com wrote: Folks, I've created a release candidate (rc0) for hadoop-2.3.0 that I would like to get released. The RC is available at: http://people.apache.org/~acmurthy/hadoop-2.3.0-rc0 The RC tag in svn is here: https://svn.apache.org/repos/asf/hadoop/common/tags/release-2.3.0-rc0 The maven artifacts are available via repository.apache.org. Please try the release and vote; the vote will run for the usual 7 days. thanks, Arun PS: Thanks to Andrew, Vinod Alejandro for all their help in various release activities. -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You. -- - Tsuyoshi
Re: [VOTE] Release Apache Hadoop 2.3.0
+1 (non-binding) - Upgraded HDFS including snapshots from 2.2. - Ran a few sample jobs. - WebUI looks good. Thanks, Akira (2014/02/12 7:09), Karthik Kambatla wrote: +1 (non-binding) Built source. Brought up a pseudo-cluster with manual RM HA. Ran a few MR examples. On Tue, Feb 11, 2014 at 10:40 PM, Roman Shaposhnik r...@apache.org wrote: Very nice! I'll take it for the usual round of testing in Bigtop. Should take a few days, but I'll keep you guys posted! Thanks, Roman. On Tue, Feb 11, 2014 at 6:49 AM, Arun C Murthy a...@hortonworks.com wrote: Folks, I've created a release candidate (rc0) for hadoop-2.3.0 that I would like to get released. The RC is available at: http://people.apache.org/~acmurthy/hadoop-2.3.0-rc0 The RC tag in svn is here: https://svn.apache.org/repos/asf/hadoop/common/tags/release-2.3.0-rc0 The maven artifacts are available via repository.apache.org. Please try the release and vote; the vote will run for the usual 7 days. thanks, Arun PS: Thanks to Andrew, Vinod Alejandro for all their help in various release activities. -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You.
Re: [VOTE] Release Apache Hadoop 2.3.0
+1 Downloaded, deployed to small cluster, and then ran an hbase loading on top of it. Looks good. Packaging wise, is it intentional that some jars show up a few times? I can understand webapps bundling a copy but doesn't mapreduce depend on commons? share/hadoop/mapreduce/lib/hadoop-annotations-2.3.0.jar share/hadoop/httpfs/tomcat/webapps/webhdfs/WEB-INF/lib/hadoop-annotations-2.3.0.jar share/hadoop/common/lib/hadoop-annotations-2.3.0.jar If not intentional, I can make up a better report and file an issue. Thanks, St.Ack On Tue, Feb 11, 2014 at 6:49 AM, Arun C Murthy a...@hortonworks.com wrote: Folks, I've created a release candidate (rc0) for hadoop-2.3.0 that I would like to get released. The RC is available at: http://people.apache.org/~acmurthy/hadoop-2.3.0-rc0 The RC tag in svn is here: https://svn.apache.org/repos/asf/hadoop/common/tags/release-2.3.0-rc0 The maven artifacts are available via repository.apache.org. Please try the release and vote; the vote will run for the usual 7 days. thanks, Arun PS: Thanks to Andrew, Vinod Alejandro for all their help in various release activities. -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You.
Re: [VOTE] Release Apache Hadoop 2.3.0
To add to this, we saw this on pretty big cluster with multiple pool/queues and different users. At one point ResourceManager was no longer handing out containers and cluster throughput dropped to 20% utilization. Once we restarted ResourceManager things were back to normal. 2014-02-12 11:56 GMT-08:00 Sangjin Lee sj...@apache.org: If it's not too late, I'd like to bring your attention to YARN-1692. We get a ConcurrentModificationException with the fair scheduler when it updates demand, and we saw RM get into a pretty bad shape around the time this happened. It would be great if this could make 2.3.0. I provided a patch for this fix already. Thoughts? Thanks, Sangjin On Wed, Feb 12, 2014 at 11:41 AM, Stack st...@duboce.net wrote: +1 Downloaded, deployed to small cluster, and then ran an hbase loading on top of it. Looks good. Packaging wise, is it intentional that some jars show up a few times? I can understand webapps bundling a copy but doesn't mapreduce depend on commons? share/hadoop/mapreduce/lib/hadoop-annotations-2.3.0.jar share/hadoop/httpfs/tomcat/webapps/webhdfs/WEB-INF/lib/hadoop-annotations-2.3.0.jar share/hadoop/common/lib/hadoop-annotations-2.3.0.jar If not intentional, I can make up a better report and file an issue. Thanks, St.Ack On Tue, Feb 11, 2014 at 6:49 AM, Arun C Murthy a...@hortonworks.com wrote: Folks, I've created a release candidate (rc0) for hadoop-2.3.0 that I would like to get released. The RC is available at: http://people.apache.org/~acmurthy/hadoop-2.3.0-rc0 The RC tag in svn is here: https://svn.apache.org/repos/asf/hadoop/common/tags/release-2.3.0-rc0 The maven artifacts are available via repository.apache.org. Please try the release and vote; the vote will run for the usual 7 days. thanks, Arun PS: Thanks to Andrew, Vinod Alejandro for all their help in various release activities. -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You. -- Have a Nice Day! Lohit
Re: [VOTE] Release Apache Hadoop 2.3.0
+1 (binding) I downloaded the source tar ball, checked signatures, built from the source, ran a few of the sample jobs on a pseudo cluster. Everything was as expected. -- Aaron T. Myers Software Engineer, Cloudera On Tue, Feb 11, 2014 at 6:49 AM, Arun C Murthy a...@hortonworks.com wrote: Folks, I've created a release candidate (rc0) for hadoop-2.3.0 that I would like to get released. The RC is available at: http://people.apache.org/~acmurthy/hadoop-2.3.0-rc0 The RC tag in svn is here: https://svn.apache.org/repos/asf/hadoop/common/tags/release-2.3.0-rc0 The maven artifacts are available via repository.apache.org. Please try the release and vote; the vote will run for the usual 7 days. thanks, Arun PS: Thanks to Andrew, Vinod Alejandro for all their help in various release activities. -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You.
Re: [VOTE] Release Apache Hadoop 2.3.0
+1 (non-binding) I download the source tar ball, built from it, ran a number of MR jobs on a single-node cluster, checked the job history from job history server. On Wed, Feb 12, 2014 at 2:47 PM, Jian He j...@hortonworks.com wrote: +1 (non-binding) Built from source. Ran a few MR sample jobs on a pseudo cluster. Everything works fine. Jian On Wed, Feb 12, 2014 at 2:32 PM, Aaron T. Myers a...@cloudera.com wrote: +1 (binding) I downloaded the source tar ball, checked signatures, built from the source, ran a few of the sample jobs on a pseudo cluster. Everything was as expected. -- Aaron T. Myers Software Engineer, Cloudera On Tue, Feb 11, 2014 at 6:49 AM, Arun C Murthy a...@hortonworks.com wrote: Folks, I've created a release candidate (rc0) for hadoop-2.3.0 that I would like to get released. The RC is available at: http://people.apache.org/~acmurthy/hadoop-2.3.0-rc0 The RC tag in svn is here: https://svn.apache.org/repos/asf/hadoop/common/tags/release-2.3.0-rc0 The maven artifacts are available via repository.apache.org. Please try the release and vote; the vote will run for the usual 7 days. thanks, Arun PS: Thanks to Andrew, Vinod Alejandro for all their help in various release activities. -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You. -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You. -- Zhijie Shen Hortonworks Inc. http://hortonworks.com/ -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You.
Re: [VOTE] Release Apache Hadoop 2.3.0
Running pseudo cluster out of the box (expanding the binary tar, or building from source) does not work, you have to go an set the MR framework to yarn, the default FS URI to hdfs://localhost:8020, and so on. While I don't see this as showstopper (for the knowledgeable user), it will make may users to fail miserably. Plus, running a an example MR job out of the box uses the local runner. If the user does not pay attention to the output will think the job run in the cluster. Should we do a new RC fixing this? Thanks. On Wed, Feb 12, 2014 at 5:10 PM, Zhijie Shen zs...@hortonworks.com wrote: +1 (non-binding) I download the source tar ball, built from it, ran a number of MR jobs on a single-node cluster, checked the job history from job history server. On Wed, Feb 12, 2014 at 2:47 PM, Jian He j...@hortonworks.com wrote: +1 (non-binding) Built from source. Ran a few MR sample jobs on a pseudo cluster. Everything works fine. Jian On Wed, Feb 12, 2014 at 2:32 PM, Aaron T. Myers a...@cloudera.com wrote: +1 (binding) I downloaded the source tar ball, checked signatures, built from the source, ran a few of the sample jobs on a pseudo cluster. Everything was as expected. -- Aaron T. Myers Software Engineer, Cloudera On Tue, Feb 11, 2014 at 6:49 AM, Arun C Murthy a...@hortonworks.com wrote: Folks, I've created a release candidate (rc0) for hadoop-2.3.0 that I would like to get released. The RC is available at: http://people.apache.org/~acmurthy/hadoop-2.3.0-rc0 The RC tag in svn is here: https://svn.apache.org/repos/asf/hadoop/common/tags/release-2.3.0-rc0 The maven artifacts are available via repository.apache.org. Please try the release and vote; the vote will run for the usual 7 days. thanks, Arun PS: Thanks to Andrew, Vinod Alejandro for all their help in various release activities. -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You. -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You. -- Zhijie Shen Hortonworks Inc. http://hortonworks.com/ -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You. -- Alejandro
Re: [VOTE] Release Apache Hadoop 2.3.0
+1 (non-binding) I downloaded the source tarball, built it, started pseudo distrubuted cluster, run wordcount example job. The RC is available at: http://people.apache.org/~acmurthy/hadoop-2.3.0-rc0 Though the hadoop-2.3.0.tar.gz downloaded from above URL contains site documentation in share/hadoop dir, building from the source tar ball results in no inclusion of site docs in binary tarball. Regards, Masatake Iwasaki (2014/02/11 6:49), Arun C Murthy wrote: Folks, I've created a release candidate (rc0) for hadoop-2.3.0 that I would like to get released. The RC is available at: http://people.apache.org/~acmurthy/hadoop-2.3.0-rc0 The RC tag in svn is here: https://svn.apache.org/repos/asf/hadoop/common/tags/release-2.3.0-rc0 The maven artifacts are available via repository.apache.org. Please try the release and vote; the vote will run for the usual 7 days. thanks, Arun PS: Thanks to Andrew, Vinod Alejandro for all their help in various release activities.
Re: [VOTE] Release Apache Hadoop 2.3.0
I don't think any of what you describe below is a regression in behavior from earlier releases. The fs.defaultFS has been set to file:/// for a long time, and likewise you've similarly had to set up your YARN configs. Given that, I don't think this warrants a new RC. -- Aaron T. Myers Software Engineer, Cloudera On Wed, Feb 12, 2014 at 5:37 PM, Alejandro Abdelnur t...@cloudera.comwrote: Running pseudo cluster out of the box (expanding the binary tar, or building from source) does not work, you have to go an set the MR framework to yarn, the default FS URI to hdfs://localhost:8020, and so on. While I don't see this as showstopper (for the knowledgeable user), it will make may users to fail miserably. Plus, running a an example MR job out of the box uses the local runner. If the user does not pay attention to the output will think the job run in the cluster. Should we do a new RC fixing this? Thanks. On Wed, Feb 12, 2014 at 5:10 PM, Zhijie Shen zs...@hortonworks.com wrote: +1 (non-binding) I download the source tar ball, built from it, ran a number of MR jobs on a single-node cluster, checked the job history from job history server. On Wed, Feb 12, 2014 at 2:47 PM, Jian He j...@hortonworks.com wrote: +1 (non-binding) Built from source. Ran a few MR sample jobs on a pseudo cluster. Everything works fine. Jian On Wed, Feb 12, 2014 at 2:32 PM, Aaron T. Myers a...@cloudera.com wrote: +1 (binding) I downloaded the source tar ball, checked signatures, built from the source, ran a few of the sample jobs on a pseudo cluster. Everything was as expected. -- Aaron T. Myers Software Engineer, Cloudera On Tue, Feb 11, 2014 at 6:49 AM, Arun C Murthy a...@hortonworks.com wrote: Folks, I've created a release candidate (rc0) for hadoop-2.3.0 that I would like to get released. The RC is available at: http://people.apache.org/~acmurthy/hadoop-2.3.0-rc0 The RC tag in svn is here: https://svn.apache.org/repos/asf/hadoop/common/tags/release-2.3.0-rc0 The maven artifacts are available via repository.apache.org. Please try the release and vote; the vote will run for the usual 7 days. thanks, Arun PS: Thanks to Andrew, Vinod Alejandro for all their help in various release activities. -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You. -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You. -- Zhijie Shen Hortonworks Inc. http://hortonworks.com/ -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You. -- Alejandro
Re: [VOTE] Release Apache Hadoop 2.3.0
+1 non-binding - checked out the rc tag and built from source - deployed a pseudo-distributed cluster with yarn.resourcemanager.recovery.enabled=true - ran a sleep job with multiple map waves and a long reducer -- SIGKILL'd AM at various points and verified AM restart -- SIGKILL'd RM at various points and verified RM restart - checked some ui issues we had fixed. - verified the new restful plain text container log NM-WS Thanks, Gera On Tue, Feb 11, 2014 at 6:49 AM, Arun C Murthy a...@hortonworks.com wrote: Folks, I've created a release candidate (rc0) for hadoop-2.3.0 that I would like to get released. The RC is available at: http://people.apache.org/~acmurthy/hadoop-2.3.0-rc0 The RC tag in svn is here: https://svn.apache.org/repos/asf/hadoop/common/tags/release-2.3.0-rc0 The maven artifacts are available via repository.apache.org. Please try the release and vote; the vote will run for the usual 7 days. thanks, Arun PS: Thanks to Andrew, Vinod Alejandro for all their help in various release activities. -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You.
[VOTE] Release Apache Hadoop 2.3.0
Folks, I've created a release candidate (rc0) for hadoop-2.3.0 that I would like to get released. The RC is available at: http://people.apache.org/~acmurthy/hadoop-2.3.0-rc0 The RC tag in svn is here: https://svn.apache.org/repos/asf/hadoop/common/tags/release-2.3.0-rc0 The maven artifacts are available via repository.apache.org. Please try the release and vote; the vote will run for the usual 7 days. thanks, Arun PS: Thanks to Andrew, Vinod Alejandro for all their help in various release activities. -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You.
Re: [VOTE] Release Apache Hadoop 2.3.0
Thanks Arun for the initiative. +1 non-binding. I tested the followings: 1. Build package from the source tar. 2. Verified with md5sum 3. Verified with gpg 4. Basic testing Overall, good to go. Regards, Mohammad On Tuesday, February 11, 2014 2:07 PM, Chen He airb...@gmail.com wrote: +1, non-binding successful compiled on MacOS 10.7 deployed to Fedora 7 and run test job without any problem. On Tue, Feb 11, 2014 at 8:49 AM, Arun C Murthy a...@hortonworks.com wrote: Folks, I've created a release candidate (rc0) for hadoop-2.3.0 that I would like to get released. The RC is available at: http://people.apache.org/~acmurthy/hadoop-2.3.0-rc0 The RC tag in svn is here: https://svn.apache.org/repos/asf/hadoop/common/tags/release-2.3.0-rc0 The maven artifacts are available via repository.apache.org. Please try the release and vote; the vote will run for the usual 7 days. thanks, Arun PS: Thanks to Andrew, Vinod Alejandro for all their help in various release activities. -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You.
Re: [VOTE] Release Apache Hadoop 2.3.0
Everything looks good so far, running on 100 nodes with security enabled. I've found two minor issues I've found with the new Namenode UI so far and will work on them over the next few days: HDFS-5934 HDFS-5935 Thanks, Travis On Feb 11, 2014, at 4:53 PM, Mohammad Islam misla...@yahoo.com wrote: Thanks Arun for the initiative. +1 non-binding. I tested the followings: 1. Build package from the source tar. 2. Verified with md5sum 3. Verified with gpg 4. Basic testing Overall, good to go. Regards, Mohammad On Tuesday, February 11, 2014 2:07 PM, Chen He airb...@gmail.com wrote: +1, non-binding successful compiled on MacOS 10.7 deployed to Fedora 7 and run test job without any problem. On Tue, Feb 11, 2014 at 8:49 AM, Arun C Murthy a...@hortonworks.com wrote: Folks, I've created a release candidate (rc0) for hadoop-2.3.0 that I would like to get released. The RC is available at: http://people.apache.org/~acmurthy/hadoop-2.3.0-rc0 The RC tag in svn is here: https://svn.apache.org/repos/asf/hadoop/common/tags/release-2.3.0-rc0 The maven artifacts are available via repository.apache.org. Please try the release and vote; the vote will run for the usual 7 days. thanks, Arun PS: Thanks to Andrew, Vinod Alejandro for all their help in various release activities. -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You. signature.asc Description: Message signed with OpenPGP using GPGMail
Re: [VOTE] Release Apache Hadoop 2.3.0
Thanks Arun for another release! +1 non-binding Verified signatures, deployed a single node cluster and ran sleep and wordcount. Everything looks fine. Regards Ravi On Tuesday, February 11, 2014 5:36 PM, Travis Thompson tthomp...@linkedin.com wrote: Everything looks good so far, running on 100 nodes with security enabled. I've found two minor issues I've found with the new Namenode UI so far and will work on them over the next few days: HDFS-5934 HDFS-5935 Thanks, Travis On Feb 11, 2014, at 4:53 PM, Mohammad Islam misla...@yahoo.com wrote: Thanks Arun for the initiative. +1 non-binding. I tested the followings: 1. Build package from the source tar. 2. Verified with md5sum 3. Verified with gpg 4. Basic testing Overall, good to go. Regards, Mohammad On Tuesday, February 11, 2014 2:07 PM, Chen He airb...@gmail.com wrote: +1, non-binding successful compiled on MacOS 10.7 deployed to Fedora 7 and run test job without any problem. On Tue, Feb 11, 2014 at 8:49 AM, Arun C Murthy a...@hortonworks.com wrote: Folks, I've created a release candidate (rc0) for hadoop-2.3.0 that I would like to get released. The RC is available at: http://people.apache.org/~acmurthy/hadoop-2.3.0-rc0 The RC tag in svn is here: https://svn.apache.org/repos/asf/hadoop/common/tags/release-2.3.0-rc0 The maven artifacts are available via repository.apache.org. Please try the release and vote; the vote will run for the usual 7 days. thanks, Arun PS: Thanks to Andrew, Vinod Alejandro for all their help in various release activities. -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You.
Re: [VOTE] Release Apache Hadoop 2.3.0
Thanks for putting this together Arun. +1 non-binding Downloaded source tarball Verified signature and digests Ran apache-rat:check Built with mvn clean package install -Pdist -Dtar Started a one-node cluster and ran wordcount Best, Andrew On Tue, Feb 11, 2014 at 5:40 PM, Ravi Prakash ravi...@ymail.com wrote: Thanks Arun for another release! +1 non-binding Verified signatures, deployed a single node cluster and ran sleep and wordcount. Everything looks fine. Regards Ravi On Tuesday, February 11, 2014 5:36 PM, Travis Thompson tthomp...@linkedin.com wrote: Everything looks good so far, running on 100 nodes with security enabled. I've found two minor issues I've found with the new Namenode UI so far and will work on them over the next few days: HDFS-5934 HDFS-5935 Thanks, Travis On Feb 11, 2014, at 4:53 PM, Mohammad Islam misla...@yahoo.com wrote: Thanks Arun for the initiative. +1 non-binding. I tested the followings: 1. Build package from the source tar. 2. Verified with md5sum 3. Verified with gpg 4. Basic testing Overall, good to go. Regards, Mohammad On Tuesday, February 11, 2014 2:07 PM, Chen He airb...@gmail.com wrote: +1, non-binding successful compiled on MacOS 10.7 deployed to Fedora 7 and run test job without any problem. On Tue, Feb 11, 2014 at 8:49 AM, Arun C Murthy a...@hortonworks.com wrote: Folks, I've created a release candidate (rc0) for hadoop-2.3.0 that I would like to get released. The RC is available at: http://people.apache.org/~acmurthy/hadoop-2.3.0-rc0 The RC tag in svn is here: https://svn.apache.org/repos/asf/hadoop/common/tags/release-2.3.0-rc0 The maven artifacts are available via repository.apache.org. Please try the release and vote; the vote will run for the usual 7 days. thanks, Arun PS: Thanks to Andrew, Vinod Alejandro for all their help in various release activities. -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You.
Re: [VOTE] Release Apache Hadoop 2.3.0
Looks good. +1, also non-binding. I downloaded the source tarball, checked md5, built, ran some unit tests, ran an HDFS cluster. cheers, Colin On Tue, Feb 11, 2014 at 6:53 PM, Andrew Wang andrew.w...@cloudera.com wrote: Thanks for putting this together Arun. +1 non-binding Downloaded source tarball Verified signature and digests Ran apache-rat:check Built with mvn clean package install -Pdist -Dtar Started a one-node cluster and ran wordcount Best, Andrew On Tue, Feb 11, 2014 at 5:40 PM, Ravi Prakash ravi...@ymail.com wrote: Thanks Arun for another release! +1 non-binding Verified signatures, deployed a single node cluster and ran sleep and wordcount. Everything looks fine. Regards Ravi On Tuesday, February 11, 2014 5:36 PM, Travis Thompson tthomp...@linkedin.com wrote: Everything looks good so far, running on 100 nodes with security enabled. I've found two minor issues I've found with the new Namenode UI so far and will work on them over the next few days: HDFS-5934 HDFS-5935 Thanks, Travis On Feb 11, 2014, at 4:53 PM, Mohammad Islam misla...@yahoo.com wrote: Thanks Arun for the initiative. +1 non-binding. I tested the followings: 1. Build package from the source tar. 2. Verified with md5sum 3. Verified with gpg 4. Basic testing Overall, good to go. Regards, Mohammad On Tuesday, February 11, 2014 2:07 PM, Chen He airb...@gmail.com wrote: +1, non-binding successful compiled on MacOS 10.7 deployed to Fedora 7 and run test job without any problem. On Tue, Feb 11, 2014 at 8:49 AM, Arun C Murthy a...@hortonworks.com wrote: Folks, I've created a release candidate (rc0) for hadoop-2.3.0 that I would like to get released. The RC is available at: http://people.apache.org/~acmurthy/hadoop-2.3.0-rc0 The RC tag in svn is here: https://svn.apache.org/repos/asf/hadoop/common/tags/release-2.3.0-rc0 The maven artifacts are available via repository.apache.org. Please try the release and vote; the vote will run for the usual 7 days. thanks, Arun PS: Thanks to Andrew, Vinod Alejandro for all their help in various release activities. -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You.
