Re: [VOTE] Release Apache Hadoop 3.0.0-alpha1 RC0
Thanks Andrew for the great work. +1 (binding) - Downloaded source and verified checksum and signature - Compiled with -Pnative @ CentOS 7.2 and OpenJDK 8u101 - Ran some MapReduce jobs successfully - Checked Web UIs and logs - hdfs/yarn/mapred "--daemon" option works as expected Regards, Akira On 9/4/16 09:06, Eric Payne wrote: Thank you very much, Andrew. +1 (non-binding) - Downloaded source and built native - Installed on 3-node, non-secure cluster - Ran sleep jobs - Ensured preemption works as expected -Eric Payne - Original Message - From: Andrew WangTo: "common-dev@hadoop.apache.org" ; "hdfs-...@hadoop.apache.org" ; "mapreduce-...@hadoop.apache.org" ; "yarn-...@hadoop.apache.org" Sent: Tuesday, August 30, 2016 10:51 AM Subject: [VOTE] Release Apache Hadoop 3.0.0-alpha1 RC0 Hi all, Thanks to the combined work of many, many contributors, here's an RC0 for 3.0.0-alpha1: http://home.apache.org/~wang/3.0.0-alpha1-RC0/ alpha1 is the first in a series of planned alpha releases leading up to GA. The objective is to get an artifact out to downstreams for testing and to iterate quickly based on their feedback. So, please keep that in mind when voting; hopefully most issues can be addressed by future alphas rather than future RCs. Sorry for getting this out on a Tuesday, but I'd still like this vote to run the normal 5 days, thus ending Saturday (9/3) at 9AM PDT. I'll extend if we lack the votes. Please try it out and let me know what you think. Best, Andrew - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.0.0-alpha1 RC0
Thank you very much, Andrew. +1 (non-binding) - Downloaded source and built native - Installed on 3-node, non-secure cluster - Ran sleep jobs - Ensured preemption works as expected -Eric Payne - Original Message - From: Andrew WangTo: "common-dev@hadoop.apache.org" ; "hdfs-...@hadoop.apache.org" ; "mapreduce-...@hadoop.apache.org" ; "yarn-...@hadoop.apache.org" Sent: Tuesday, August 30, 2016 10:51 AM Subject: [VOTE] Release Apache Hadoop 3.0.0-alpha1 RC0 Hi all, Thanks to the combined work of many, many contributors, here's an RC0 for 3.0.0-alpha1: http://home.apache.org/~wang/3.0.0-alpha1-RC0/ alpha1 is the first in a series of planned alpha releases leading up to GA. The objective is to get an artifact out to downstreams for testing and to iterate quickly based on their feedback. So, please keep that in mind when voting; hopefully most issues can be addressed by future alphas rather than future RCs. Sorry for getting this out on a Tuesday, but I'd still like this vote to run the normal 5 days, thus ending Saturday (9/3) at 9AM PDT. I'll extend if we lack the votes. Please try it out and let me know what you think. Best, Andrew - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.0.0-alpha1 RC0
+1(binding) * Compiling source code. * Verified checksums. * Running RM-HA cluster with ZooKeeper 3.4.8 and ran MR job with native libraries. It worked well. Again, I'm very happy to move 3.0.0 release forward :-) Thanks, Andrew! FYI: > In fact, I hit an error similar to Eric's one regardless of configuring yarn.app.mapreduce.am.env and mapreduce.admin.user.env... does anyone hit same error? This was because of completely my wrong configuration. Please ignore this. Best, - Tsuyoshi On Sat, Sep 3, 2016 at 1:53 AM, Tsuyoshi Ozawawrote: > Thanks for making this forward hardly, Andrew! > > In fact, I hit an error similar to Eric's one regardless of > configuring yarn.app.mapreduce.am.env and mapreduce.admin.user.env... > does anyone hit same error? > > > 2016-09-02 16:49:35,223 INFO mapreduce.Job: The url to track the job: > http://ip-172-31-7-124.ap-northeast-1.compute.internal:23188/proxy/application_1472832909785_0013/ > > 2016-09-02 16:49:35,224 INFO mapreduce.Job: Running job: > job_1472832909785_0013 > > 2016-09-02 16:49:48,282 INFO mapreduce.Job: Job job_1472832909785_0013 > running in uber mode : false > > 2016-09-02 16:49:48,283 INFO mapreduce.Job: map 0% reduce 0% > > 2016-09-02 16:49:48,293 INFO mapreduce.Job: Job job_1472832909785_0013 > failed with state FAILED due to: Application > application_1472832909785_0013 failed 2 times due to AM Container for > appattempt_1472832909785_0013_02 exited with exitCode: 1 > > Failing this attempt.Diagnostics: Exception from container-launch. > > Container id: container_e02_1472832909785_0013_02_01 > > Exit code: 1 > > Stack trace: ExitCodeException exitCode=1: > > at org.apache.hadoop.util.Shell.runCommand(Shell.java:974) > > at org.apache.hadoop.util.Shell.run(Shell.java:878) > > at > org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1172) > > at > org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:237) > > at > org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:419) > > at > org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:284) > > at > org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:88) > > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) > > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > > at java.lang.Thread.run(Thread.java:745) > > Best, > - Tsuyoshi > > On Wed, Aug 31, 2016 at 12:51 AM, Andrew Wang > wrote: >> Hi all, >> >> Thanks to the combined work of many, many contributors, here's an RC0 for >> 3.0.0-alpha1: >> >> http://home.apache.org/~wang/3.0.0-alpha1-RC0/ >> >> alpha1 is the first in a series of planned alpha releases leading up to GA. >> The objective is to get an artifact out to downstreams for testing and to >> iterate quickly based on their feedback. So, please keep that in mind when >> voting; hopefully most issues can be addressed by future alphas rather than >> future RCs. >> >> Sorry for getting this out on a Tuesday, but I'd still like this vote to >> run the normal 5 days, thus ending Saturday (9/3) at 9AM PDT. I'll extend >> if we lack the votes. >> >> Please try it out and let me know what you think. >> >> Best, >> Andrew - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/153/ [Sep 2, 2016 10:32:01 AM] (vvasudev) YARN-. Scheduler UI: "% of Queue" is inaccurate if leaf queue is [Sep 2, 2016 4:03:18 PM] (kihwal) HADOOP-13547. Optimize IPC client protobuf decoding. Contributed by [Sep 2, 2016 6:01:13 PM] (lei) HDFS-10822. Log DataNodes in the write pipeline. John Zhuge via Lei Xu [Sep 2, 2016 6:14:35 PM] (rchiang) YARN-5549. AMLauncher#createAMContainerLaunchContext() should not log [Sep 2, 2016 9:50:34 PM] (wang) HDFS-10833. Fix JSON errors in WebHDFS.md examples. [Sep 2, 2016 9:56:29 PM] (kasha) YARN-5264. Store all queue-specific information in FSQueue. (Yufei Gu [Sep 2, 2016 10:33:11 PM] (xiao) HDFS-9781. FsDatasetImpl#getBlockReports can occasionally throw -1 overall The following subsystems voted -1: asflicense unit The following subsystems voted -1 but were configured to be filtered/ignored: cc checkstyle javac javadoc pylint shellcheck shelldocs whitespace The following subsystems are considered long running: (runtime bigger than 1h 0m 0s) unit Specific tests: Failed CTEST tests : test_test_libhdfs_threaded_hdfs_static test_test_libhdfs_zerocopy_hdfs_static Failed junit tests : hadoop.portmap.TestPortmap hadoop.yarn.server.nodemanager.containermanager.queuing.TestQueuingContainerManager hadoop.yarn.server.applicationhistoryservice.webapp.TestAHSWebServices hadoop.yarn.server.TestContainerManagerSecurity hadoop.yarn.server.TestMiniYarnClusterNodeUtilization cc: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/153/artifact/out/diff-compile-cc-root.txt [4.0K] javac: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/153/artifact/out/diff-compile-javac-root.txt [168K] checkstyle: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/153/artifact/out/diff-checkstyle-root.txt [16M] pylint: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/153/artifact/out/diff-patch-pylint.txt [16K] shellcheck: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/153/artifact/out/diff-patch-shellcheck.txt [20K] shelldocs: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/153/artifact/out/diff-patch-shelldocs.txt [16K] whitespace: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/153/artifact/out/whitespace-eol.txt [12M] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/153/artifact/out/whitespace-tabs.txt [1.3M] javadoc: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/153/artifact/out/diff-javadoc-javadoc-root.txt [2.2M] CTEST: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/153/artifact/out/patch-hadoop-hdfs-project_hadoop-hdfs-native-client-ctest.txt [24K] unit: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/153/artifact/out/patch-unit-hadoop-common-project_hadoop-nfs.txt [8.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/153/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs-native-client.txt [8.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/153/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager.txt [36K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/153/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-applicationhistoryservice.txt [12K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/153/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-tests.txt [268K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/153/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-nativetask.txt [120K] asflicense: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/153/artifact/out/patch-asflicense-problems.txt [4.0K] Powered by Apache Yetus 0.4.0-SNAPSHOT http://yetus.apache.org - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org