[
https://issues.apache.org/jira/browse/YARN-8851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16656188#comment-16656188
]
Zhankun Tang edited comment on YARN-8851 at 10/19/18 3:07 AM:
--------------------------------------------------------------
[~leftnoteasy] , a lot thanks for the offline discussion. Agreed that we remove
the unnecessary APIVersion field since we can throw an exception if the plugin
is not compatible.
For the Factory pattern involved to create device adapter or device plugin
instance, we'll keep it for the future plan if we encounter huge complexity in
current design. So we'll go with the current DevicePlugn interface (keep
adapter invisible to vendor developer) and shared device local scheduler. But
try to leave the vendor interface to insert their own device scheduling logic.
Correct me if I missed something.
was (Author: tangzhankun):
[~leftnoteasy] , a lot thanks for the offline discussion. Agreed that we remove
the unnecessary APIVersion field since we can throw an exception if the plugin
is not compatible.
For the Factory pattern involved to create device adapter or device plugin
instance, we'll keep it for the future plan if we encounter huge complexity in
current design. So we'll go with the current DevicePlugn interface (keep
adapter invisible to vendor developer) and shared device local scheduler. But
try to leave the vendor interface to insert their own device scheduling logic.
> [Umbrella] A new pluggable device plugin framework to ease vendor plugin
> development
> ------------------------------------------------------------------------------------
>
> Key: YARN-8851
> URL: https://issues.apache.org/jira/browse/YARN-8851
> Project: Hadoop YARN
> Issue Type: New Feature
> Components: yarn
> Reporter: Zhankun Tang
> Assignee: Zhankun Tang
> Priority: Major
> Attachments: YARN-8851-WIP2-trunk.001.patch,
> YARN-8851-WIP3-trunk.001.patch, YARN-8851-WIP4-trunk.001.patch, [YARN-8851]
> YARN_New_Device_Plugin_Framework_Design_Proposal-3.pdf, [YARN-8851]
> YARN_New_Device_Plugin_Framework_Design_Proposal.pdf
>
>
> At present, we support GPU/FPGA device in YARN through a native, coupling
> way. But it's difficult for a vendor to implement such a device plugin
> because the developer needs much knowledge of YARN internals. And this brings
> burden to the community to maintain both YARN core and vendor-specific code.
> Here we propose a new device plugin framework to ease vendor device plugin
> development and provide a more flexible way to integrate with YARN NM.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
