[jira] [Created] (MESOS-6510) Need to enhance APPC store to support APPC whitelist
Qian Zhang created MESOS-6510: - Summary: Need to enhance APPC store to support APPC whitelist Key: MESOS-6510 URL: https://issues.apache.org/jira/browse/MESOS-6510 Project: Mesos Issue Type: Improvement Reporter: Qian Zhang In [APPC image manifest schema | https://github.com/appc/spec/blob/master/spec/aci.md#image-manifest-schema], there is a field {{pathWhitelist}}: {quote} pathWhitelist (list of strings, optional) whitelist of absolute paths that will exist in the app's rootfs after rendering. This must be a complete and absolute set. An empty list is equivalent to an absent value and means that all files in this image and any dependencies will be available in the rootfs. {quote} But in Mesos protobuf message for the APPC image manifest schema {{include/mesos/appc/spec.proto}}, that field is missed. We need to add this field in the protobuf message and enhance APPC store to support the APPC whitelist. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (MESOS-6510) Need to enhance APPC store to support APPC whitelist
[ https://issues.apache.org/jira/browse/MESOS-6510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15619673#comment-15619673 ] Qian Zhang commented on MESOS-6510: --- When we enhance APPC store, we can convert APPC whitelist (i.e., the field {{pathWhitelist}}) to AUFS whiteout (if the backend is aufs/copy) or overlay whiteout (if the backend is overlay), please refer to the discussion in https://reviews.apache.org/r/53115/ for more details. > Need to enhance APPC store to support APPC whitelist > > > Key: MESOS-6510 > URL: https://issues.apache.org/jira/browse/MESOS-6510 > Project: Mesos > Issue Type: Improvement >Reporter: Qian Zhang > > In [APPC image manifest schema | > https://github.com/appc/spec/blob/master/spec/aci.md#image-manifest-schema], > there is a field {{pathWhitelist}}: > {quote} > pathWhitelist (list of strings, optional) whitelist of absolute paths that > will exist in the app's rootfs after rendering. This must be a complete and > absolute set. An empty list is equivalent to an absent value and means that > all files in this image and any dependencies will be available in the rootfs. > {quote} > But in Mesos protobuf message for the APPC image manifest schema > {{include/mesos/appc/spec.proto}}, that field is missed. We need to add this > field in the protobuf message and enhance APPC store to support the APPC > whitelist. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Assigned] (MESOS-6466) Add support for streaming HTTP requests in Mesos
[ https://issues.apache.org/jira/browse/MESOS-6466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anand Mazumdar reassigned MESOS-6466: - Assignee: Anand Mazumdar (was: Kevin Klues) > Add support for streaming HTTP requests in Mesos > > > Key: MESOS-6466 > URL: https://issues.apache.org/jira/browse/MESOS-6466 > Project: Mesos > Issue Type: Task >Reporter: Kevin Klues >Assignee: Anand Mazumdar > Labels: debugging, mesosphere > > We already have support for streaming HTTP responses in Mesos. We now also > need to add support for streaming HTTP requests. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (MESOS-6466) Add support for streaming HTTP requests in Mesos
[ https://issues.apache.org/jira/browse/MESOS-6466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anand Mazumdar updated MESOS-6466: -- Shepherd: Benjamin Mahler > Add support for streaming HTTP requests in Mesos > > > Key: MESOS-6466 > URL: https://issues.apache.org/jira/browse/MESOS-6466 > Project: Mesos > Issue Type: Task >Reporter: Kevin Klues >Assignee: Anand Mazumdar > Labels: debugging, mesosphere > > We already have support for streaming HTTP responses in Mesos. We now also > need to add support for streaming HTTP requests. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (MESOS-6512) Add support for cgroups hugetlb subsystem
haosdent created MESOS-6512: --- Summary: Add support for cgroups hugetlb subsystem Key: MESOS-6512 URL: https://issues.apache.org/jira/browse/MESOS-6512 Project: Mesos Issue Type: Task Reporter: haosdent Noted that cgroups blkio subsystem may have performance issue, refer to https://github.com/opencontainers/runc/issues/861 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (MESOS-6511) Add support for cgroups net_prio subsystem
haosdent created MESOS-6511: --- Summary: Add support for cgroups net_prio subsystem Key: MESOS-6511 URL: https://issues.apache.org/jira/browse/MESOS-6511 Project: Mesos Issue Type: Task Reporter: haosdent Noted that cgroups blkio subsystem may have performance issue, refer to https://github.com/opencontainers/runc/issues/861 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (MESOS-6513) Add support for cgroups pids subsystem
haosdent created MESOS-6513: --- Summary: Add support for cgroups pids subsystem Key: MESOS-6513 URL: https://issues.apache.org/jira/browse/MESOS-6513 Project: Mesos Issue Type: Task Reporter: haosdent Noted that cgroups blkio subsystem may have performance issue, refer to https://github.com/opencontainers/runc/issues/861 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (MESOS-6511) Add support for cgroups net_prio subsystem
[ https://issues.apache.org/jira/browse/MESOS-6511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] haosdent updated MESOS-6511: Description: (was: Noted that cgroups blkio subsystem may have performance issue, refer to https://github.com/opencontainers/runc/issues/861) > Add support for cgroups net_prio subsystem > -- > > Key: MESOS-6511 > URL: https://issues.apache.org/jira/browse/MESOS-6511 > Project: Mesos > Issue Type: Task >Reporter: haosdent > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (MESOS-6513) Add support for cgroups pids subsystem
[ https://issues.apache.org/jira/browse/MESOS-6513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] haosdent updated MESOS-6513: Description: (was: Noted that cgroups blkio subsystem may have performance issue, refer to https://github.com/opencontainers/runc/issues/861) > Add support for cgroups pids subsystem > -- > > Key: MESOS-6513 > URL: https://issues.apache.org/jira/browse/MESOS-6513 > Project: Mesos > Issue Type: Task >Reporter: haosdent > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (MESOS-6512) Add support for cgroups hugetlb subsystem
[ https://issues.apache.org/jira/browse/MESOS-6512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] haosdent updated MESOS-6512: Description: (was: Noted that cgroups blkio subsystem may have performance issue, refer to https://github.com/opencontainers/runc/issues/861) > Add support for cgroups hugetlb subsystem > - > > Key: MESOS-6512 > URL: https://issues.apache.org/jira/browse/MESOS-6512 > Project: Mesos > Issue Type: Task >Reporter: haosdent > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Assigned] (MESOS-6512) Add support for cgroups hugetlb subsystem
[ https://issues.apache.org/jira/browse/MESOS-6512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] haosdent reassigned MESOS-6512: --- Assignee: haosdent > Add support for cgroups hugetlb subsystem > - > > Key: MESOS-6512 > URL: https://issues.apache.org/jira/browse/MESOS-6512 > Project: Mesos > Issue Type: Task >Reporter: haosdent >Assignee: haosdent > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Assigned] (MESOS-6511) Add support for cgroups net_prio subsystem
[ https://issues.apache.org/jira/browse/MESOS-6511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] haosdent reassigned MESOS-6511: --- Assignee: haosdent > Add support for cgroups net_prio subsystem > -- > > Key: MESOS-6511 > URL: https://issues.apache.org/jira/browse/MESOS-6511 > Project: Mesos > Issue Type: Task >Reporter: haosdent >Assignee: haosdent > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Assigned] (MESOS-6513) Add support for cgroups pids subsystem
[ https://issues.apache.org/jira/browse/MESOS-6513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] haosdent reassigned MESOS-6513: --- Assignee: haosdent > Add support for cgroups pids subsystem > -- > > Key: MESOS-6513 > URL: https://issues.apache.org/jira/browse/MESOS-6513 > Project: Mesos > Issue Type: Task >Reporter: haosdent >Assignee: haosdent > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Assigned] (MESOS-6163) Add support for cgroups cpuset subsystem
[ https://issues.apache.org/jira/browse/MESOS-6163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] haosdent reassigned MESOS-6163: --- Assignee: haosdent > Add support for cgroups cpuset subsystem > > > Key: MESOS-6163 > URL: https://issues.apache.org/jira/browse/MESOS-6163 > Project: Mesos > Issue Type: Task >Reporter: haosdent >Assignee: haosdent > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (MESOS-5384) Improve error message for missing resources file
[ https://issues.apache.org/jira/browse/MESOS-5384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15620335#comment-15620335 ] Kris Paprocki commented on MESOS-5384: --- Hi Benjamin and John, thanks for the comments. I very much support the idea of not breaking backwards compatibility. However, just adding an error message at fetch/parse level is not going to work due to flags which contain directory path in format /path/to/directory (i.e. launcher_dir). There is a potential solution to that: flags with directory paths could be a type of Path (from ), currently these flags are type of std::string. Then, as flags::fetch is specialized for Path type, we could add the error message in generic flags::fetch when he finds '/' at the beginning of the string. But I'm not sure if there are any other cases in which flags may contain '/' at the beginning. Do you see any blocker for this approach? Going for this solution would involve a number of other changes in order to adapt existing code to Path type instead of std::string (for these flags which are directory paths). I'm willing to do the changes, but then maybe this shall be a part of a new ticket? As for this ticket, I could adapt the documentation. We could then later update this ticket when the proper solution is applied. > Improve error message for missing resources file > > > Key: MESOS-5384 > URL: https://issues.apache.org/jira/browse/MESOS-5384 > Project: Mesos > Issue Type: Bug > Components: general >Affects Versions: 0.28.1 > Environment: Centos 7 >Reporter: John Yost >Assignee: Kris Paprocki >Priority: Minor > Labels: easyfix, newbie > > Attempting to specify resources file via > --resources=/etc/mesos-slave/small-slave-config.json threw the following > error: > Failed to determine slave resources: Bad value for resources, missing or > extra ':' in /etc/mesos-slave/small-slave-config.json > I confirmed I had valid JSON: > [ > { > "name": "cpus", > "type": "SCALAR", > "scalar": { > "value": 0.5 > } > }, > { > "name": "mem", > "type": "SCALAR", > "scalar": { > "value": 512 > } > } > ] > In actuality, I misread to docs with my file pattern. Once I changed to > resources=file:///etc/mesos-slave/small-slave-config.json the mesos slave > started up fine. Just need a missing file check and corresponding error > message to fix this. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (MESOS-6163) Add support for cgroups cpuset subsystem
[ https://issues.apache.org/jira/browse/MESOS-6163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15620353#comment-15620353 ] haosdent commented on MESOS-6163: - {code} diff --git a/include/mesos/mesos.proto b/include/mesos/mesos.proto index 905a34b..fb142d7 100644 --- a/include/mesos/mesos.proto +++ b/include/mesos/mesos.proto @@ -2064,6 +2064,8 @@ message CapabilityInfo { message LinuxInfo { // Represents the capability whitelist. optional CapabilityInfo capability_info = 1; + + optional CgroupInfo cgroup_info = 2; } @@ -2214,7 +2216,17 @@ message CgroupInfo { optional uint32 classid = 1; } + message Cpuset { +xxx + } + + message Blkio { +xxx + } + optional NetCls net_cls = 1; + optional Cpuset cpuset = 2; + optional Blkio blkio = 3; } {code} Hi, [~jieyu] I think we need to update {{LinuxInfo}} to support rest cgroups subsystems, if the above changes OK for you? I am going to write a document for further discussion. cc [~jlai] > Add support for cgroups cpuset subsystem > > > Key: MESOS-6163 > URL: https://issues.apache.org/jira/browse/MESOS-6163 > Project: Mesos > Issue Type: Task >Reporter: haosdent >Assignee: haosdent > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (MESOS-6163) Add support for cgroups cpuset subsystem
[ https://issues.apache.org/jira/browse/MESOS-6163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15620919#comment-15620919 ] Jie Yu commented on MESOS-6163: --- I'd suggest we don't expose those to the framework just yet. Let's add the subsystem first. I'll probably consider adding 'status' and 'usage' impl for those subsystems first. > Add support for cgroups cpuset subsystem > > > Key: MESOS-6163 > URL: https://issues.apache.org/jira/browse/MESOS-6163 > Project: Mesos > Issue Type: Task >Reporter: haosdent >Assignee: haosdent > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (MESOS-6163) Add support for cgroups cpuset subsystem
[ https://issues.apache.org/jira/browse/MESOS-6163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1562#comment-1562 ] haosdent commented on MESOS-6163: - Got it, let me create stubs first. > Add support for cgroups cpuset subsystem > > > Key: MESOS-6163 > URL: https://issues.apache.org/jira/browse/MESOS-6163 > Project: Mesos > Issue Type: Task >Reporter: haosdent >Assignee: haosdent > -- This message was sent by Atlassian JIRA (v6.3.4#6332)