[jira] [Created] (YARN-7617) Add a flag in distributed shell to automatically prompt opportunistic containers to guaranteed once they are started
Weiwei Yang created YARN-7617:
-
Summary: Add a flag in distributed shell to automatically prompt
opportunistic containers to guaranteed once they are started
Key: YARN-7617
URL: https://issues.apache.org/jira/browse/YARN-7617
Project: Hadoop YARN
Issue Type: Sub-task
Components: applications/distributed-shell
Affects Versions: 2.9.0
Reporter: Weiwei Yang
Assignee: Weiwei Yang
Priority: Minor
Per discussion in YARN-7610, it would be good to add such a flag, e.g
{{container_prompt_on_start=true}}. This is for the purpose of demonstrating
how container promotion works.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
-
To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org
[jira] [Created] (YARN-7616) App status does not return state STABLE for a running and stable service
Gour Saha created YARN-7616: --- Summary: App status does not return state STABLE for a running and stable service Key: YARN-7616 URL: https://issues.apache.org/jira/browse/YARN-7616 Project: Hadoop YARN Issue Type: Sub-task Reporter: Gour Saha state currently returns null for a running and stable service. Looks like the code does not return ServiceState.STABLE under any circumstance. Will need to wire this in. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org
[jira] [Created] (YARN-7614) Support Reservation APIs in Federation Router
Carlo Curino created YARN-7614: -- Summary: Support Reservation APIs in Federation Router Key: YARN-7614 URL: https://issues.apache.org/jira/browse/YARN-7614 Project: Hadoop YARN Issue Type: Sub-task Reporter: Carlo Curino -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org
[jira] [Created] (YARN-7615) Federation StateStore: support storage/retrieval of reservations
Carlo Curino created YARN-7615: -- Summary: Federation StateStore: support storage/retrieval of reservations Key: YARN-7615 URL: https://issues.apache.org/jira/browse/YARN-7615 Project: Hadoop YARN Issue Type: Sub-task Reporter: Carlo Curino -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org
[jira] [Created] (YARN-7613) Implement Planning algorithms for rich placement
Arun Suresh created YARN-7613: - Summary: Implement Planning algorithms for rich placement Key: YARN-7613 URL: https://issues.apache.org/jira/browse/YARN-7613 Project: Hadoop YARN Issue Type: Sub-task Reporter: Arun Suresh Assignee: Panagiotis Garefalakis -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org
[jira] [Created] (YARN-7612) Add Placement Processor and planner framework
Arun Suresh created YARN-7612: - Summary: Add Placement Processor and planner framework Key: YARN-7612 URL: https://issues.apache.org/jira/browse/YARN-7612 Project: Hadoop YARN Issue Type: Sub-task Reporter: Arun Suresh Assignee: Arun Suresh This introduces a Placement Processor and a Planning algorithm framework to handle placement constraints and scheduling requests from an app and places them on nodes. The actual planning algorithm(s) will be handled in a separate JIRA. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org
[jira] [Resolved] (YARN-7092) Render application specific log under application tab in new YARN UI
[ https://issues.apache.org/jira/browse/YARN-7092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G resolved YARN-7092. --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.1.0 Thanks [~akhilpb] for working on this patch and thanks [~skmvasu] for helping in rebasing and review. Committed to trunk > Render application specific log under application tab in new YARN UI > > > Key: YARN-7092 > URL: https://issues.apache.org/jira/browse/YARN-7092 > Project: Hadoop YARN > Issue Type: Sub-task > Components: yarn-ui-v2 >Reporter: Akhil PB >Assignee: Akhil PB > Fix For: 3.1.0 > > Attachments: YARN-7092.001.patch > > > Feature to view application logs in new yarn-ui. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org
[jira] [Created] (YARN-7611) Node manager web UI should display container type in containers page
Weiwei Yang created YARN-7611:
-
Summary: Node manager web UI should display container type in
containers page
Key: YARN-7611
URL: https://issues.apache.org/jira/browse/YARN-7611
Project: Hadoop YARN
Issue Type: Improvement
Components: nodemanager, webapp
Affects Versions: 2.9.0
Reporter: Weiwei Yang
Assignee: Weiwei Yang
Currently node manager UI page
[http://:/node/allContainers] lists all containers, but it
doesn't contain {{ExecutionType}} column. To figure out the type, user has to
click each container link which is quite cumbersome. We should add a column to
display this info to give a more straightforward view.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
-
To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org
[VOTE] Release Apache Hadoop 2.8.3 (RC0)
Hi all, I've created the first release candidate (RC0) for Apache Hadoop 2.8.3. This is our next maint release to follow up 2.8.2. It includes 79 important fixes and improvements. The RC artifacts are available at: http://home.apache.org/~junping_du/hadoop-2.8.3-RC0 The RC tag in git is: release-2.8.3-RC0 The maven artifacts are available via repository.apache.org at: https://repository.apache.org/content/repositories/orgapachehadoop-1072 Please try the release and vote; the vote will run for the usual 5 working days, ending on 12/12/2017 PST time. Thanks, Junping
Apache Hadoop qbt Report: branch2+JDK7 on Linux/x86
For more details, see https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/60/ No changes -1 overall The following subsystems voted -1: asflicense unit xml The following subsystems voted -1 but were configured to be filtered/ignored: cc checkstyle javac javadoc pylint shellcheck shelldocs whitespace The following subsystems are considered long running: (runtime bigger than 1h 0m 0s) unit Specific tests: Unreaped Processes : hadoop-common:1 hadoop-hdfs:16 bkjournal:5 hadoop-yarn-server-nodemanager:1 hadoop-yarn-server-timelineservice:1 hadoop-yarn-client:6 hadoop-yarn-applications-distributedshell:1 hadoop-mapreduce-client-app:2 hadoop-mapreduce-client-jobclient:12 hadoop-streaming:1 hadoop-distcp:4 Failed junit tests : hadoop.http.TestHttpServer hadoop.hdfs.web.TestWebHdfsWithAuthenticationFilter hadoop.hdfs.web.TestWebHdfsWithMultipleNameNodes hadoop.hdfs.web.TestFSMainOperationsWebHdfs hadoop.yarn.server.nodemanager.webapp.TestNMWebServer hadoop.yarn.server.resourcemanager.reservation.TestCapacityOverTimePolicy hadoop.yarn.applications.distributedshell.TestDistributedShellWithNodeLabels hadoop.mapred.TestReduceFetch hadoop.mapreduce.security.TestBinaryTokenFile hadoop.mapreduce.security.TestJHSSecurity hadoop.fs.TestFileSystem hadoop.mapreduce.security.TestMRCredentials hadoop.conf.TestNoDefaultsJobConf hadoop.fs.TestDFSIO hadoop.mapred.TestJobSysDirWithDFS hadoop.tools.TestIntegration hadoop.tools.TestDistCpViewFs hadoop.resourceestimator.solver.impl.TestLpSolver hadoop.resourceestimator.service.TestResourceEstimatorService Timed out junit tests : org.apache.hadoop.log.TestLogLevel org.apache.hadoop.hdfs.TestLeaseRecovery2 org.apache.hadoop.hdfs.TestRead org.apache.hadoop.security.TestPermission org.apache.hadoop.hdfs.TestDFSInotifyEventInputStream org.apache.hadoop.hdfs.TestDatanodeLayoutUpgrade org.apache.hadoop.hdfs.TestFileAppendRestart org.apache.hadoop.hdfs.web.TestWebHdfsWithRestCsrfPreventionFilter org.apache.hadoop.hdfs.TestDFSMkdirs org.apache.hadoop.hdfs.TestDFSOutputStream org.apache.hadoop.hdfs.web.TestWebHDFS org.apache.hadoop.hdfs.web.TestWebHDFSXAttr org.apache.hadoop.metrics2.sink.TestRollingFileSystemSinkWithHdfs org.apache.hadoop.hdfs.TestDistributedFileSystem org.apache.hadoop.hdfs.TestReplaceDatanodeFailureReplication org.apache.hadoop.hdfs.TestDFSShell org.apache.hadoop.contrib.bkjournal.TestBootstrapStandbyWithBKJM org.apache.hadoop.contrib.bkjournal.TestBookKeeperJournalManager org.apache.hadoop.contrib.bkjournal.TestBookKeeperHACheckpoints org.apache.hadoop.contrib.bkjournal.TestBookKeeperAsHASharedDir org.apache.hadoop.contrib.bkjournal.TestBookKeeperSpeculativeRead org.apache.hadoop.yarn.server.nodemanager.TestNodeStatusUpdater org.apache.hadoop.yarn.server.timelineservice.reader.TestTimelineReaderWebServices org.apache.hadoop.yarn.client.TestRMFailover org.apache.hadoop.yarn.client.cli.TestYarnCLI org.apache.hadoop.yarn.client.TestApplicationClientProtocolOnHA org.apache.hadoop.yarn.client.api.impl.TestYarnClientWithReservation org.apache.hadoop.yarn.client.api.impl.TestYarnClient org.apache.hadoop.yarn.client.api.impl.TestAMRMClient org.apache.hadoop.yarn.applications.distributedshell.TestDistributedShell org.apache.hadoop.mapreduce.v2.app.TestStagingCleanup org.apache.hadoop.mapreduce.v2.app.TestJobEndNotifier org.apache.hadoop.mapred.lib.TestDelegatingInputFormat org.apache.hadoop.mapred.TestMiniMRClasspath org.apache.hadoop.mapred.TestClusterMapReduceTestCase org.apache.hadoop.mapreduce.TestMapCollection org.apache.hadoop.mapred.TestMRIntermediateDataEncryption org.apache.hadoop.mapred.TestMRTimelineEventHandling org.apache.hadoop.mapred.join.TestDatamerge org.apache.hadoop.mapreduce.security.ssl.TestEncryptedShuffle org.apache.hadoop.mapreduce.TestMapReduce org.apache.hadoop.mapred.TestReduceFetchFromPartialMem org.apache.hadoop.mapred.TestLazyOutput org.apache.hadoop.streaming.TestMultipleCachefiles org.apache.hadoop.tools.TestDistCpSync org.apache.hadoop.tools.TestDistCpWithXAttrs org.apache.hadoop.tools.TestDistCpSyncReverseFromTarget org.apache.hadoop.tools.TestDistCpSyncReverseFromSource cc: https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/60/artifact/out/diff-compile-cc-root.txt [4.0K] javac:
[jira] [Created] (YARN-7610) Extend Distributed Shell to support launching job with opportunistic containers
Weiwei Yang created YARN-7610:
-
Summary: Extend Distributed Shell to support launching job with
opportunistic containers
Key: YARN-7610
URL: https://issues.apache.org/jira/browse/YARN-7610
Project: Hadoop YARN
Issue Type: Sub-task
Components: applications/distributed-shell
Reporter: Weiwei Yang
Assignee: Weiwei Yang
Per doc in
[https://hadoop.apache.org/docs/current/hadoop-yarn/hadoop-yarn-site/OpportunisticContainers.html#Running_a_Sample_Job],
user can run some of PI job mappers as O containers. Similarly, propose to
extend distributed shell to support specifying the container type, it will be
very helpful for testing. Propose to add following argument
{code}
$./bin/yarn org.apache.hadoop.yarn.applications.distributedshell.Client
-container_type Container execution type,
GUARANTEED or
OPPORTUNISTIC
{code}
Implication: all containers in a distributed shell job will be launching as
user-specified container type (except for AM), if not given, default type is
{{GUARANTEED}}. AM is always launched as {{GUARANTEED}} container.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
-
To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org
