[jira] [Created] (YARN-6469) Extending Synthetic Load Generator for recurring reservation

[Carlo Curino (JIRA)]

Carlo Curino created YARN-6469:
--

 Summary: Extending Synthetic Load Generator for recurring 
reservation
 Key: YARN-6469
 URL: https://issues.apache.org/jira/browse/YARN-6469
 Project: Hadoop YARN
  Issue Type: Sub-task
Reporter: Carlo Curino






--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

-
To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org

[jira] [Created] (YARN-6468) Add

[Yufei Gu (JIRA)]

Yufei Gu created YARN-6468:
--

 Summary: Add 
 Key: YARN-6468
 URL: https://issues.apache.org/jira/browse/YARN-6468
 Project: Hadoop YARN
  Issue Type: Bug
Reporter: Yufei Gu






--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

-
To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org

Re: Apache Hadoop 2.8.1 Release Plan

[Junping Du]

I just cut off branch-2.8.1 from branch-2.8 for 2.8.1 release. So from now, all 
patch target for 2.8.1 need to be checked into branch-2.8.1 in addition to 
branch-2.8.

Thanks,

Junping

From: Junping Du 
Sent: Monday, April 03, 2017 1:41 PM
To: common-...@hadoop.apache.org; hdfs-...@hadoop.apache.org; 
mapreduce-...@hadoop.apache.org; yarn-dev@hadoop.apache.org
Subject: Apache Hadoop 2.8.1 Release Plan

Hi all,
   We just released Apache Hadoop 2.8.0 recently [1] but it is not for 
production yet due to some issues identified. Now, we should work towards 2.8.1 
release which aim for production deployment. The focus obviously is to fix 
blocker/critical issues [2], bug-fixes and *no* features / improvements.

   I plan to cut an RC in a month - target for releasing at mid of May, to give 
enough time for outstanding blocker / critical issues. Will start moving out 
any tickets that are not blockers and/or won't fit the timeline - there are 2 
blockers and 9 critical tickets outstanding as of now. For progress of 
releasing effort, please refer our release wiki [3].

   Please share thoughts if you have any. Thanks!

Thanks,

Junping

[1] 2.8.0 release announcement: 
http://www.mail-archive.com/general@hadoop.apache.org/msg07443.html
[2] 2.8.1 release Blockers/Criticals: https://s.apache.org/KGxC
[3] 2.8 Release wiki: 
https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+2.8+Release


-
To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org

Apache Hadoop qbt Report: trunk+JDK8 on Linux/ppc64le

[Apache Jenkins Server]

For more details, see 
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/285/

[Apr 10, 2017 4:59:53 PM] (templedf) YARN-6343. Docker docs MR example is 
broken (Contributed by Prashant Jha
[Apr 10, 2017 6:37:01 PM] (wang) HADOOP-14293. Initialize FakeTimer with a less 
trivial value.
[Apr 10, 2017 6:48:40 PM] (cdouglas) HADOOP-14225. Remove xmlenc dependency
[Apr 10, 2017 9:56:42 PM] (templedf) YARN-6372. Add default value for NM disk 
validator (Contributed by Yufei
[Apr 10, 2017 10:34:44 PM] (kkaranasos) YARN-6344. Add parameter for rack 
locality delay in CapacityScheduler.
[Apr 11, 2017 5:29:48 AM] (aajisaka) HADOOP-13545. Update HSQLDB to 2.3.4. 
Contributed by Giovanni Matteo
[Apr 11, 2017 11:40:09 AM] (yqlin) HDFS-11637. Fix javac warning caused by the 
deprecated key used in




-1 overall


The following subsystems voted -1:
compile mvninstall unit


The following subsystems voted -1 but
were configured to be filtered/ignored:
cc javac


The following subsystems are considered long running:
(runtime bigger than 1h  0m  0s)
unit


Specific tests:

Failed junit tests :

   hadoop.hdfs.TestEncryptedTransfer 
   hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewer 
   hadoop.hdfs.server.datanode.TestDataNodeVolumeFailureReporting 
   hadoop.hdfs.server.blockmanagement.TestBlockTokenWithDFSStriped 
   hadoop.hdfs.web.TestWebHdfsTimeouts 
   hadoop.mapreduce.v2.hs.TestHistoryServerLeveldbStateStoreService 
   hadoop.mapred.TestShuffleHandler 
   hadoop.tools.TestHadoopArchiveLogsRunner 
   hadoop.metrics2.impl.TestKafkaMetrics 
   hadoop.yarn.applications.distributedshell.TestDistributedShell 
   hadoop.yarn.server.timeline.TestRollingLevelDB 
   hadoop.yarn.server.timeline.TestTimelineDataManager 
   hadoop.yarn.server.timeline.TestLeveldbTimelineStore 
   hadoop.yarn.server.timeline.recovery.TestLeveldbTimelineStateStore 
   hadoop.yarn.server.timeline.TestRollingLevelDBTimelineStore 
   
hadoop.yarn.server.applicationhistoryservice.TestApplicationHistoryServer 
   hadoop.yarn.server.resourcemanager.security.TestDelegationTokenRenewer 
   hadoop.yarn.server.resourcemanager.recovery.TestLeveldbRMStateStore 
   hadoop.yarn.server.TestMiniYarnClusterNodeUtilization 
   hadoop.yarn.server.TestContainerManagerSecurity 
   hadoop.yarn.server.timeline.TestLevelDBCacheTimelineStore 
   hadoop.yarn.server.timeline.TestOverrideTimelineStoreYarnClient 
   hadoop.yarn.server.timeline.TestEntityGroupFSTimelineStore 

Timed out junit tests :

   org.apache.hadoop.hdfs.server.datanode.TestFsDatasetCache 
  

   mvninstall:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/285/artifact/out/patch-mvninstall-root.txt
  [500K]

   compile:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/285/artifact/out/patch-compile-root.txt
  [20K]

   cc:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/285/artifact/out/patch-compile-root.txt
  [20K]

   javac:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/285/artifact/out/patch-compile-root.txt
  [20K]

   unit:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/285/artifact/out/patch-unit-hadoop-assemblies.txt
  [4.0K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/285/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt
  [336K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/285/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-hs.txt
  [16K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/285/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-nativetask.txt
  [40K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/285/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-shuffle.txt
  [8.0K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/285/artifact/out/patch-unit-hadoop-tools_hadoop-archive-logs.txt
  [8.0K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/285/artifact/out/patch-unit-hadoop-tools_hadoop-kafka.txt
  [8.0K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/285/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-applications-distributedshell.txt
  [12K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/285/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-applicationhistoryservice.txt
  [52K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/285/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager.txt
  [16K]
   

[jira] [Created] (YARN-6467) CSQueueMetrics needs to update the current metrics for default partition only

[Naganarasimha G R (JIRA)]

Naganarasimha G R created YARN-6467:
---

 Summary: CSQueueMetrics needs to update the current metrics for 
default partition only
 Key: YARN-6467
 URL: https://issues.apache.org/jira/browse/YARN-6467
 Project: Hadoop YARN
  Issue Type: Bug
  Components: capacity scheduler
Affects Versions: 3.0.0-alpha2, 2.7.3, 2.8.0
Reporter: Naganarasimha G R


As a followup to YARN-6195, we need to update existing metrics to only default 
Partition.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

-
To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org

[jira] [Created] (YARN-6466) Provide shaded framework jar for containers

[Sean Busbey (JIRA)]

Sean Busbey created YARN-6466:
-

 Summary: Provide shaded framework jar for containers
 Key: YARN-6466
 URL: https://issues.apache.org/jira/browse/YARN-6466
 Project: Hadoop YARN
  Issue Type: New Feature
  Components: build, yarn
Reporter: Sean Busbey


We should build on the existing shading work to provide a jar with all of the 
bits needed within a YARN application's container to talk to the resource 
manager and node manager.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

-
To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org

[jira] [Created] (YARN-6465) FairScheduler preempt should consider task progress

[darion yaphet (JIRA)]

darion yaphet created YARN-6465:
---

 Summary: FairScheduler preempt should consider task progress
 Key: YARN-6465
 URL: https://issues.apache.org/jira/browse/YARN-6465
 Project: Hadoop YARN
  Issue Type: Improvement
  Components: scheduler preemption
Reporter: darion yaphet






--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

-
To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org

[jira] [Created] (YARN-6464) Rename the API Application to Service

[Jian He (JIRA)]

Jian He created YARN-6464:
-

 Summary: Rename the API Application to Service
 Key: YARN-6464
 URL: https://issues.apache.org/jira/browse/YARN-6464
 Project: Hadoop YARN
  Issue Type: Sub-task
Reporter: Jian He


Given that we consider service as first-class citizen in YARN, we may call the 
abstraction as Service, instead of Application ?
The native-service UI also now has a differentiation of service vs application.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

-
To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org