[jira] [Resolved] (MAPREDUCE-6802) TestKill.testKillJob() fails intermittently on Power
[ https://issues.apache.org/jira/browse/MAPREDUCE-6802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen resolved MAPREDUCE-6802. --- Resolution: Duplicate > TestKill.testKillJob() fails intermittently on Power > > > Key: MAPREDUCE-6802 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-6802 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: mrv2 >Affects Versions: 2.7.3 > Environment: # uname -a > Linux pts00452-vm10 3.10.0-327.el7.ppc64le #1 SMP Thu Oct 29 17:31:13 EDT > 2015 ppc64le ppc64le ppc64le GNU/Linux > # cat /etc/redhat-release > Red Hat Enterprise Linux Server release 7.2 (Maipo) >Reporter: Yussuf Shaikh > > Running org.apache.hadoop.mapreduce.v2.app.TestKill > Tests run: 5, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 9.86 sec <<< > FAILURE! - in org.apache.hadoop.mapreduce.v2.app.TestKill > testKillJob(org.apache.hadoop.mapreduce.v2.app.TestKill) Time elapsed: 0.377 > sec <<< FAILURE! > java.lang.AssertionError: Task state not correct expected: but > was: >at org.junit.Assert.fail(Assert.java:88) >at org.junit.Assert.failNotEquals(Assert.java:743) >at org.junit.Assert.assertEquals(Assert.java:118) >at > org.apache.hadoop.mapreduce.v2.app.TestKill.testKillJob(TestKill.java:99) > Results : > Failed tests: > TestKill.testKillJob:99 Task state not correct expected: but > was: > Tests run: 5, Failures: 1, Errors: 0, Skipped: 0 -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: mapreduce-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-dev-h...@hadoop.apache.org
[jira] [Created] (MAPREDUCE-6812) Capacity Scheduler: Support user-specific minimum user limit percent
Eric Payne created MAPREDUCE-6812: - Summary: Capacity Scheduler: Support user-specific minimum user limit percent Key: MAPREDUCE-6812 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6812 Project: Hadoop Map/Reduce Issue Type: Improvement Components: yarn, capacity-sched Reporter: Eric Payne Currently, in the capacity scheduler, the {{minimum-user-limit-percent}} property is per queue. A cluster admin should be able to set the minimum user limit percent on a per-user basis within the queue. This functionality is needed so that when intra-queue preemption is enabled (YARN-4945 / YARN-2113), some users can be deemed as more important than other users, and resources from VIP users won't be as likely to be preempted. For example, if the {{getstuffdone}} queue has a MULP of 25 percent, but user {{jane}} is a power user of queue {{getstuffdone}} and needs to be guaranteed 75 percent, the properties for {{getstuffdone}} and {{jane}} would look like this: {code} yarn.scheduler.capacity.root.getstuffdone.minimum-user-limit-percent 25 yarn.scheduler.capacity.root.getstuffdone.jane.minimum-user-limit-percent 75 {code} NOTE: This should be implemented in a way that user-limit-percent-intra-queue preemption (YARN-2113) should not be affected. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: mapreduce-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-dev-h...@hadoop.apache.org
Apache Hadoop qbt Report: trunk+JDK8 on Linux/ppc64le
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/157/ [Nov 15, 2016 3:56:25 PM] (Arun Suresh) YARN-4597. Introduce ContainerScheduler and a SCHEDULED state to [Nov 15, 2016 6:57:00 PM] (liuml07) HADOOP-13427. Eliminate needless uses of FileSystem#{exists(), isFile(), [Nov 15, 2016 8:47:53 PM] (kihwal) HDFS-8870. Lease is leaked on write failure. Contributed by Kuhu Shukla. [Nov 15, 2016 9:01:57 PM] (templedf) YARN-5736 Addendum. Fixes segfault due to unterminated string. [Nov 15, 2016 9:58:11 PM] (xiao) YARN-5875. TestTokenClientRMService#testTokenRenewalWrongUser fails. [Nov 16, 2016 12:26:27 AM] (xiao) HADOOP-13815. TestKMS#testDelegationTokensOpsSimple and [Nov 16, 2016 9:44:00 AM] (rohithsharmaks) YARN-5375. invoke MockRM#drainEvents implicitly in MockRM methods to -1 overall The following subsystems voted -1: compile unit The following subsystems voted -1 but were configured to be filtered/ignored: cc javac The following subsystems are considered long running: (runtime bigger than 1h 0m 0s) unit Specific tests: Failed junit tests : hadoop.hdfs.TestEncryptionZones hadoop.hdfs.TestDFSRemove hadoop.hdfs.TestEncryptedTransfer hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewer hadoop.hdfs.web.TestWebHdfsTimeouts hadoop.yarn.server.nodemanager.recovery.TestNMLeveldbStateStoreService hadoop.yarn.server.nodemanager.TestNodeManagerShutdown hadoop.yarn.server.timeline.TestRollingLevelDB hadoop.yarn.server.timeline.TestTimelineDataManager hadoop.yarn.server.timeline.TestLeveldbTimelineStore hadoop.yarn.server.timeline.recovery.TestLeveldbTimelineStateStore hadoop.yarn.server.timeline.TestRollingLevelDBTimelineStore hadoop.yarn.server.applicationhistoryservice.TestApplicationHistoryServer hadoop.yarn.server.timelineservice.storage.common.TestRowKeys hadoop.yarn.server.timelineservice.storage.common.TestKeyConverters hadoop.yarn.server.timelineservice.storage.common.TestSeparator hadoop.yarn.server.resourcemanager.scheduler.fair.TestContinuousScheduling hadoop.yarn.server.resourcemanager.recovery.TestLeveldbRMStateStore hadoop.yarn.server.resourcemanager.TestRMRestart hadoop.yarn.server.resourcemanager.TestResourceTrackerService hadoop.yarn.server.TestMiniYarnClusterNodeUtilization hadoop.yarn.server.TestContainerManagerSecurity hadoop.yarn.server.timeline.TestLevelDBCacheTimelineStore hadoop.yarn.server.timeline.TestOverrideTimelineStoreYarnClient hadoop.yarn.server.timeline.TestEntityGroupFSTimelineStore hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorageApps hadoop.yarn.server.timelineservice.storage.flow.TestHBaseStorageFlowRunCompaction hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorageEntities hadoop.yarn.server.timelineservice.storage.flow.TestHBaseStorageFlowRun hadoop.yarn.server.timelineservice.storage.TestPhoenixOfflineAggregationWriterImpl hadoop.yarn.server.timelineservice.reader.TestTimelineReaderWebServicesHBaseStorage hadoop.yarn.server.timelineservice.storage.flow.TestHBaseStorageFlowActivity hadoop.yarn.applications.distributedshell.TestDistributedShell hadoop.mapred.TestShuffleHandler hadoop.mapreduce.v2.hs.TestHistoryServerLeveldbStateStoreService hadoop.mapred.pipes.TestPipeApplication Timed out junit tests : org.apache.hadoop.hdfs.server.datanode.TestFsDatasetCache org.apache.hadoop.yarn.server.resourcemanager.TestLeaderElectorService org.apache.hadoop.mapred.TestMRIntermediateDataEncryption compile: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/157/artifact/out/patch-compile-root.txt [164K] cc: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/157/artifact/out/patch-compile-root.txt [164K] javac: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/157/artifact/out/patch-compile-root.txt [164K] unit: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/157/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt [248K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/157/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager.txt [52K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/157/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-applicationhistoryservice.txt [52K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/157/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-timelineservice.txt [20K]
Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/227/ [Nov 15, 2016 7:57:37 AM] (naganarasimha_gr) Reverted due to issue YARN-5765. Revert "YARN-5287. [Nov 15, 2016 10:11:56 AM] (naganarasimha_gr) YARN-4355. NPE while processing localizer heartbeat. Contributed by [Nov 15, 2016 3:56:25 PM] (Arun Suresh) YARN-4597. Introduce ContainerScheduler and a SCHEDULED state to [Nov 15, 2016 6:57:00 PM] (liuml07) HADOOP-13427. Eliminate needless uses of FileSystem#{exists(), isFile(), [Nov 15, 2016 8:47:53 PM] (kihwal) HDFS-8870. Lease is leaked on write failure. Contributed by Kuhu Shukla. [Nov 15, 2016 9:01:57 PM] (templedf) YARN-5736 Addendum. Fixes segfault due to unterminated string. [Nov 15, 2016 9:58:11 PM] (xiao) YARN-5875. TestTokenClientRMService#testTokenRenewalWrongUser fails. [Nov 16, 2016 12:26:27 AM] (xiao) HADOOP-13815. TestKMS#testDelegationTokensOpsSimple and -1 overall The following subsystems voted -1: asflicense findbugs unit The following subsystems voted -1 but were configured to be filtered/ignored: cc checkstyle javac javadoc pylint shellcheck shelldocs whitespace The following subsystems are considered long running: (runtime bigger than 1h 0m 0s) unit Specific tests: Failed junit tests : hadoop.hdfs.TestMaintenanceState hadoop.yarn.server.TestDiskFailures hadoop.yarn.server.TestContainerManagerSecurity hadoop.yarn.server.TestMiniYarnClusterNodeUtilization hadoop.mapred.pipes.TestPipeApplication cc: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/227/artifact/out/diff-compile-cc-root.txt [4.0K] javac: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/227/artifact/out/diff-compile-javac-root.txt [164K] checkstyle: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/227/artifact/out/diff-checkstyle-root.txt [16M] pylint: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/227/artifact/out/diff-patch-pylint.txt [20K] shellcheck: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/227/artifact/out/diff-patch-shellcheck.txt [20K] shelldocs: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/227/artifact/out/diff-patch-shelldocs.txt [16K] whitespace: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/227/artifact/out/whitespace-eol.txt [11M] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/227/artifact/out/whitespace-tabs.txt [1.3M] findbugs: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/227/artifact/out/branch-findbugs-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-tests.txt [4.0K] javadoc: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/227/artifact/out/diff-javadoc-javadoc-root.txt [2.2M] unit: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/227/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt [148K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/227/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-tests.txt [316K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/227/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt [92K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/227/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-nativetask.txt [124K] asflicense: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/227/artifact/out/patch-asflicense-problems.txt [4.0K] Powered by Apache Yetus 0.4.0-SNAPSHOT http://yetus.apache.org - To unsubscribe, e-mail: mapreduce-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-dev-h...@hadoop.apache.org
[jira] [Created] (MAPREDUCE-6811) TestPipeApplication#testSubmitter fails after HADOOP-13802
Brahma Reddy Battula created MAPREDUCE-6811: --- Summary: TestPipeApplication#testSubmitter fails after HADOOP-13802 Key: MAPREDUCE-6811 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6811 Project: Hadoop Map/Reduce Issue Type: Bug Components: test Reporter: Brahma Reddy Battula {noformat} java.lang.AssertionError: null at org.junit.Assert.fail(Assert.java:86) at org.junit.Assert.assertTrue(Assert.java:41) at org.junit.Assert.assertTrue(Assert.java:52) at org.apache.hadoop.mapred.pipes.TestPipeApplication.testSubmitter(TestPipeApplication.java:302) {noformat} *Reference* https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/226/ https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6811/testReport/ -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: mapreduce-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-dev-h...@hadoop.apache.org