[jira] [Resolved] (MAPREDUCE-6802) TestKill.testKillJob() fails intermittently on Power

2016-11-16 Thread Haibo Chen (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-6802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Haibo Chen resolved MAPREDUCE-6802.
---
Resolution: Duplicate

> TestKill.testKillJob() fails intermittently on Power
> 
>
> Key: MAPREDUCE-6802
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-6802
> Project: Hadoop Map/Reduce
>  Issue Type: Bug
>  Components: mrv2
>Affects Versions: 2.7.3
> Environment: # uname -a
> Linux pts00452-vm10 3.10.0-327.el7.ppc64le #1 SMP Thu Oct 29 17:31:13 EDT 
> 2015 ppc64le ppc64le ppc64le GNU/Linux
> # cat /etc/redhat-release
> Red Hat Enterprise Linux Server release 7.2 (Maipo)
>Reporter: Yussuf Shaikh
>
> Running org.apache.hadoop.mapreduce.v2.app.TestKill
> Tests run: 5, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 9.86 sec <<< 
> FAILURE! - in org.apache.hadoop.mapreduce.v2.app.TestKill
> testKillJob(org.apache.hadoop.mapreduce.v2.app.TestKill)  Time elapsed: 0.377 
> sec  <<< FAILURE!
> java.lang.AssertionError: Task state not correct expected: but 
> was:
>at org.junit.Assert.fail(Assert.java:88)
>at org.junit.Assert.failNotEquals(Assert.java:743)
>at org.junit.Assert.assertEquals(Assert.java:118)
>at 
> org.apache.hadoop.mapreduce.v2.app.TestKill.testKillJob(TestKill.java:99)
> Results :
> Failed tests:
>  TestKill.testKillJob:99 Task state not correct expected: but 
> was:
> Tests run: 5, Failures: 1, Errors: 0, Skipped: 0



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: mapreduce-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-dev-h...@hadoop.apache.org



[jira] [Created] (MAPREDUCE-6812) Capacity Scheduler: Support user-specific minimum user limit percent

2016-11-16 Thread Eric Payne (JIRA)
Eric Payne created MAPREDUCE-6812:
-

 Summary: Capacity Scheduler: Support user-specific minimum user 
limit percent
 Key: MAPREDUCE-6812
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6812
 Project: Hadoop Map/Reduce
  Issue Type: Improvement
  Components: yarn, capacity-sched
Reporter: Eric Payne


Currently, in the capacity scheduler, the {{minimum-user-limit-percent}} 
property is per queue. A cluster admin should be able to set the minimum user 
limit percent on a per-user basis within the queue.

This functionality is needed so that when intra-queue preemption is enabled 
(YARN-4945 / YARN-2113), some users can be deemed as more important than other 
users, and resources from VIP users won't be as likely to be preempted.

For example, if the {{getstuffdone}} queue has a MULP of 25 percent, but user 
{{jane}} is a power user of queue {{getstuffdone}} and needs to be guaranteed 
75 percent, the properties for {{getstuffdone}} and {{jane}} would look like 
this:

{code}
  

yarn.scheduler.capacity.root.getstuffdone.minimum-user-limit-percent
25
  

  

yarn.scheduler.capacity.root.getstuffdone.jane.minimum-user-limit-percent
75
  
{code}

NOTE: This should be implemented in a way that user-limit-percent-intra-queue 
preemption (YARN-2113) should not be affected.




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: mapreduce-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-dev-h...@hadoop.apache.org



Apache Hadoop qbt Report: trunk+JDK8 on Linux/ppc64le

2016-11-16 Thread Apache Jenkins Server
For more details, see 
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/157/

[Nov 15, 2016 3:56:25 PM] (Arun Suresh) YARN-4597. Introduce ContainerScheduler 
and a SCHEDULED state to
[Nov 15, 2016 6:57:00 PM] (liuml07) HADOOP-13427. Eliminate needless uses of 
FileSystem#{exists(), isFile(),
[Nov 15, 2016 8:47:53 PM] (kihwal) HDFS-8870. Lease is leaked on write failure. 
Contributed by Kuhu Shukla.
[Nov 15, 2016 9:01:57 PM] (templedf) YARN-5736 Addendum. Fixes segfault due to 
unterminated string.
[Nov 15, 2016 9:58:11 PM] (xiao) YARN-5875. 
TestTokenClientRMService#testTokenRenewalWrongUser fails.
[Nov 16, 2016 12:26:27 AM] (xiao) HADOOP-13815. 
TestKMS#testDelegationTokensOpsSimple and
[Nov 16, 2016 9:44:00 AM] (rohithsharmaks) YARN-5375. invoke MockRM#drainEvents 
implicitly in MockRM methods to




-1 overall


The following subsystems voted -1:
compile unit


The following subsystems voted -1 but
were configured to be filtered/ignored:
cc javac


The following subsystems are considered long running:
(runtime bigger than 1h  0m  0s)
unit


Specific tests:

Failed junit tests :

   hadoop.hdfs.TestEncryptionZones 
   hadoop.hdfs.TestDFSRemove 
   hadoop.hdfs.TestEncryptedTransfer 
   hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewer 
   hadoop.hdfs.web.TestWebHdfsTimeouts 
   hadoop.yarn.server.nodemanager.recovery.TestNMLeveldbStateStoreService 
   hadoop.yarn.server.nodemanager.TestNodeManagerShutdown 
   hadoop.yarn.server.timeline.TestRollingLevelDB 
   hadoop.yarn.server.timeline.TestTimelineDataManager 
   hadoop.yarn.server.timeline.TestLeveldbTimelineStore 
   hadoop.yarn.server.timeline.recovery.TestLeveldbTimelineStateStore 
   hadoop.yarn.server.timeline.TestRollingLevelDBTimelineStore 
   
hadoop.yarn.server.applicationhistoryservice.TestApplicationHistoryServer 
   hadoop.yarn.server.timelineservice.storage.common.TestRowKeys 
   hadoop.yarn.server.timelineservice.storage.common.TestKeyConverters 
   hadoop.yarn.server.timelineservice.storage.common.TestSeparator 
   
hadoop.yarn.server.resourcemanager.scheduler.fair.TestContinuousScheduling 
   hadoop.yarn.server.resourcemanager.recovery.TestLeveldbRMStateStore 
   hadoop.yarn.server.resourcemanager.TestRMRestart 
   hadoop.yarn.server.resourcemanager.TestResourceTrackerService 
   hadoop.yarn.server.TestMiniYarnClusterNodeUtilization 
   hadoop.yarn.server.TestContainerManagerSecurity 
   hadoop.yarn.server.timeline.TestLevelDBCacheTimelineStore 
   hadoop.yarn.server.timeline.TestOverrideTimelineStoreYarnClient 
   hadoop.yarn.server.timeline.TestEntityGroupFSTimelineStore 
   hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorageApps 
   
hadoop.yarn.server.timelineservice.storage.flow.TestHBaseStorageFlowRunCompaction
 
   
hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorageEntities 
   hadoop.yarn.server.timelineservice.storage.flow.TestHBaseStorageFlowRun 
   
hadoop.yarn.server.timelineservice.storage.TestPhoenixOfflineAggregationWriterImpl
 
   
hadoop.yarn.server.timelineservice.reader.TestTimelineReaderWebServicesHBaseStorage
 
   
hadoop.yarn.server.timelineservice.storage.flow.TestHBaseStorageFlowActivity 
   hadoop.yarn.applications.distributedshell.TestDistributedShell 
   hadoop.mapred.TestShuffleHandler 
   hadoop.mapreduce.v2.hs.TestHistoryServerLeveldbStateStoreService 
   hadoop.mapred.pipes.TestPipeApplication 

Timed out junit tests :

   org.apache.hadoop.hdfs.server.datanode.TestFsDatasetCache 
   org.apache.hadoop.yarn.server.resourcemanager.TestLeaderElectorService 
   org.apache.hadoop.mapred.TestMRIntermediateDataEncryption 
  

   compile:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/157/artifact/out/patch-compile-root.txt
  [164K]

   cc:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/157/artifact/out/patch-compile-root.txt
  [164K]

   javac:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/157/artifact/out/patch-compile-root.txt
  [164K]

   unit:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/157/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt
  [248K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/157/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager.txt
  [52K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/157/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-applicationhistoryservice.txt
  [52K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/157/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-timelineservice.txt
  [20K]
   

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2016-11-16 Thread Apache Jenkins Server
For more details, see 
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/227/

[Nov 15, 2016 7:57:37 AM] (naganarasimha_gr) Reverted due to issue YARN-5765. 
Revert "YARN-5287.
[Nov 15, 2016 10:11:56 AM] (naganarasimha_gr) YARN-4355. NPE while processing 
localizer heartbeat. Contributed by
[Nov 15, 2016 3:56:25 PM] (Arun Suresh) YARN-4597. Introduce ContainerScheduler 
and a SCHEDULED state to
[Nov 15, 2016 6:57:00 PM] (liuml07) HADOOP-13427. Eliminate needless uses of 
FileSystem#{exists(), isFile(),
[Nov 15, 2016 8:47:53 PM] (kihwal) HDFS-8870. Lease is leaked on write failure. 
Contributed by Kuhu Shukla.
[Nov 15, 2016 9:01:57 PM] (templedf) YARN-5736 Addendum. Fixes segfault due to 
unterminated string.
[Nov 15, 2016 9:58:11 PM] (xiao) YARN-5875. 
TestTokenClientRMService#testTokenRenewalWrongUser fails.
[Nov 16, 2016 12:26:27 AM] (xiao) HADOOP-13815. 
TestKMS#testDelegationTokensOpsSimple and




-1 overall


The following subsystems voted -1:
asflicense findbugs unit


The following subsystems voted -1 but
were configured to be filtered/ignored:
cc checkstyle javac javadoc pylint shellcheck shelldocs whitespace


The following subsystems are considered long running:
(runtime bigger than 1h  0m  0s)
unit


Specific tests:

Failed junit tests :

   hadoop.hdfs.TestMaintenanceState 
   hadoop.yarn.server.TestDiskFailures 
   hadoop.yarn.server.TestContainerManagerSecurity 
   hadoop.yarn.server.TestMiniYarnClusterNodeUtilization 
   hadoop.mapred.pipes.TestPipeApplication 
  

   cc:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/227/artifact/out/diff-compile-cc-root.txt
  [4.0K]

   javac:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/227/artifact/out/diff-compile-javac-root.txt
  [164K]

   checkstyle:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/227/artifact/out/diff-checkstyle-root.txt
  [16M]

   pylint:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/227/artifact/out/diff-patch-pylint.txt
  [20K]

   shellcheck:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/227/artifact/out/diff-patch-shellcheck.txt
  [20K]

   shelldocs:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/227/artifact/out/diff-patch-shelldocs.txt
  [16K]

   whitespace:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/227/artifact/out/whitespace-eol.txt
  [11M]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/227/artifact/out/whitespace-tabs.txt
  [1.3M]

   findbugs:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/227/artifact/out/branch-findbugs-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-tests.txt
  [4.0K]

   javadoc:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/227/artifact/out/diff-javadoc-javadoc-root.txt
  [2.2M]

   unit:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/227/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt
  [148K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/227/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-tests.txt
  [316K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/227/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt
  [92K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/227/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-nativetask.txt
  [124K]

   asflicense:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/227/artifact/out/patch-asflicense-problems.txt
  [4.0K]

Powered by Apache Yetus 0.4.0-SNAPSHOT   http://yetus.apache.org



-
To unsubscribe, e-mail: mapreduce-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-dev-h...@hadoop.apache.org

[jira] [Created] (MAPREDUCE-6811) TestPipeApplication#testSubmitter fails after HADOOP-13802

2016-11-16 Thread Brahma Reddy Battula (JIRA)
Brahma Reddy Battula created MAPREDUCE-6811:
---

 Summary: TestPipeApplication#testSubmitter fails after HADOOP-13802
 Key: MAPREDUCE-6811
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6811
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: test
Reporter: Brahma Reddy Battula


{noformat}
java.lang.AssertionError: null
at org.junit.Assert.fail(Assert.java:86)
at org.junit.Assert.assertTrue(Assert.java:41)
at org.junit.Assert.assertTrue(Assert.java:52)
at 
org.apache.hadoop.mapred.pipes.TestPipeApplication.testSubmitter(TestPipeApplication.java:302)
{noformat}

 *Reference* 

https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/226/
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6811/testReport/



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: mapreduce-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-dev-h...@hadoop.apache.org