[
https://issues.apache.org/jira/browse/MESOS-204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13290002#comment-13290002
]
Qinghe Jin commented on MESOS-204:
----------------------------------
Hi Charles, if the application is running upon dfs, it's really hard for us to
achieve QoS for it. And without dfs, many frameworks could not run, which makes
the IO bandwidth control meanless. What a bad news!
Actually, the priority inversion problem you mentioned maybe is not so serious
if the dfs is competing with some other applications running on a node. After
all, they are all processes and we can control their IO priorities. The real
tough problem, just as you have mentioned, is that dfs kill our locality of IO
access which I must rely on. And if I do the IO isolation, it can be only
useful when the applications access the native fs. Is there any applications
behave like this? May be that's the true difference between IO isolation and
Cpu/mem isolation.
> enable Frameworks level disk IO bandwidth support
> -------------------------------------------------
>
> Key: MESOS-204
> URL: https://issues.apache.org/jira/browse/MESOS-204
> Project: Mesos
> Issue Type: Brainstorming
> Reporter: Qinghe Jin
>
> I am considering to add Frameworks level disk IO bandwidth support to
> mesos，which behaves like ionice on the single node，but this time it‘s in
> multi-nodes。I believe this kind of disk QoS support will be more user
> friendly。My initial idea is to allow user to use an ioprio_set like api to
> set the io priority when they commit their job. At the same time, here may
> need some tools to display the disk IO usage per node/container on the webui.
> I have read the mesos paper carefully and I found that in the comment，it
> mentioned that in the future it will support disk and network bandwidth
> control。But，in my opinion，disk IO bandwidth is more feasible for it has more
> locality，and network bandwidth control may be more difficult for the
> complexity of the network environment。But I don't know why is there nobody
> going to add this feature。Is it useless？Or not feasible？Or just not
> interested？
> For this feature may need a lot of work，I‘d like to listen to your opinions
> before I start to work on it。Anybody who have any questions ,suggestions or
> ideas, please tell me and I appreciate it very much，Thanks！
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
