[jira] [Created] (MESOS-6510) Need to enhance APPC store to support APPC whitelist

2016-10-30 Thread Qian Zhang (JIRA)
Qian Zhang created MESOS-6510:
-

 Summary: Need to enhance APPC store to support APPC whitelist
 Key: MESOS-6510
 URL: https://issues.apache.org/jira/browse/MESOS-6510
 Project: Mesos
  Issue Type: Improvement
Reporter: Qian Zhang


In [APPC image manifest schema | 
https://github.com/appc/spec/blob/master/spec/aci.md#image-manifest-schema], 
there is a field {{pathWhitelist}}:
{quote}
pathWhitelist (list of strings, optional) whitelist of absolute paths that will 
exist in the app's rootfs after rendering. This must be a complete and absolute 
set. An empty list is equivalent to an absent value and means that all files in 
this image and any dependencies will be available in the rootfs.
{quote}

But in Mesos protobuf message for the APPC image manifest schema 
{{include/mesos/appc/spec.proto}}, that field is missed. We need to add this 
field in the protobuf message and enhance APPC store to support the APPC 
whitelist.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (MESOS-6510) Need to enhance APPC store to support APPC whitelist

2016-10-30 Thread Qian Zhang (JIRA)

[ 
https://issues.apache.org/jira/browse/MESOS-6510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15619673#comment-15619673
 ] 

Qian Zhang commented on MESOS-6510:
---

When we enhance APPC store, we can convert APPC whitelist (i.e., the field 
{{pathWhitelist}}) to AUFS whiteout (if the backend is aufs/copy) or overlay 
whiteout (if the backend is overlay), please refer to the discussion in 
https://reviews.apache.org/r/53115/ for more details.

> Need to enhance APPC store to support APPC whitelist
> 
>
> Key: MESOS-6510
> URL: https://issues.apache.org/jira/browse/MESOS-6510
> Project: Mesos
>  Issue Type: Improvement
>Reporter: Qian Zhang
>
> In [APPC image manifest schema | 
> https://github.com/appc/spec/blob/master/spec/aci.md#image-manifest-schema], 
> there is a field {{pathWhitelist}}:
> {quote}
> pathWhitelist (list of strings, optional) whitelist of absolute paths that 
> will exist in the app's rootfs after rendering. This must be a complete and 
> absolute set. An empty list is equivalent to an absent value and means that 
> all files in this image and any dependencies will be available in the rootfs.
> {quote}
> But in Mesos protobuf message for the APPC image manifest schema 
> {{include/mesos/appc/spec.proto}}, that field is missed. We need to add this 
> field in the protobuf message and enhance APPC store to support the APPC 
> whitelist.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Assigned] (MESOS-6466) Add support for streaming HTTP requests in Mesos

2016-10-30 Thread Anand Mazumdar (JIRA)

 [ 
https://issues.apache.org/jira/browse/MESOS-6466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Anand Mazumdar reassigned MESOS-6466:
-

Assignee: Anand Mazumdar  (was: Kevin Klues)

> Add support for streaming HTTP requests in Mesos
> 
>
> Key: MESOS-6466
> URL: https://issues.apache.org/jira/browse/MESOS-6466
> Project: Mesos
>  Issue Type: Task
>Reporter: Kevin Klues
>Assignee: Anand Mazumdar
>  Labels: debugging, mesosphere
>
> We already have support for streaming HTTP responses in Mesos. We now also 
> need to add support for streaming HTTP requests.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (MESOS-6466) Add support for streaming HTTP requests in Mesos

2016-10-30 Thread Anand Mazumdar (JIRA)

 [ 
https://issues.apache.org/jira/browse/MESOS-6466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Anand Mazumdar updated MESOS-6466:
--
Shepherd: Benjamin Mahler

> Add support for streaming HTTP requests in Mesos
> 
>
> Key: MESOS-6466
> URL: https://issues.apache.org/jira/browse/MESOS-6466
> Project: Mesos
>  Issue Type: Task
>Reporter: Kevin Klues
>Assignee: Anand Mazumdar
>  Labels: debugging, mesosphere
>
> We already have support for streaming HTTP responses in Mesos. We now also 
> need to add support for streaming HTTP requests.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (MESOS-6512) Add support for cgroups hugetlb subsystem

2016-10-30 Thread haosdent (JIRA)
haosdent created MESOS-6512:
---

 Summary: Add support for cgroups hugetlb subsystem
 Key: MESOS-6512
 URL: https://issues.apache.org/jira/browse/MESOS-6512
 Project: Mesos
  Issue Type: Task
Reporter: haosdent


Noted that cgroups blkio subsystem may have performance issue, refer to 
https://github.com/opencontainers/runc/issues/861



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (MESOS-6511) Add support for cgroups net_prio subsystem

2016-10-30 Thread haosdent (JIRA)
haosdent created MESOS-6511:
---

 Summary: Add support for cgroups net_prio subsystem
 Key: MESOS-6511
 URL: https://issues.apache.org/jira/browse/MESOS-6511
 Project: Mesos
  Issue Type: Task
Reporter: haosdent


Noted that cgroups blkio subsystem may have performance issue, refer to 
https://github.com/opencontainers/runc/issues/861



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (MESOS-6513) Add support for cgroups pids subsystem

2016-10-30 Thread haosdent (JIRA)
haosdent created MESOS-6513:
---

 Summary: Add support for cgroups pids subsystem
 Key: MESOS-6513
 URL: https://issues.apache.org/jira/browse/MESOS-6513
 Project: Mesos
  Issue Type: Task
Reporter: haosdent


Noted that cgroups blkio subsystem may have performance issue, refer to 
https://github.com/opencontainers/runc/issues/861



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (MESOS-6511) Add support for cgroups net_prio subsystem

2016-10-30 Thread haosdent (JIRA)

 [ 
https://issues.apache.org/jira/browse/MESOS-6511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

haosdent updated MESOS-6511:

Description: (was: Noted that cgroups blkio subsystem may have 
performance issue, refer to https://github.com/opencontainers/runc/issues/861)

> Add support for cgroups net_prio subsystem
> --
>
> Key: MESOS-6511
> URL: https://issues.apache.org/jira/browse/MESOS-6511
> Project: Mesos
>  Issue Type: Task
>Reporter: haosdent
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (MESOS-6513) Add support for cgroups pids subsystem

2016-10-30 Thread haosdent (JIRA)

 [ 
https://issues.apache.org/jira/browse/MESOS-6513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

haosdent updated MESOS-6513:

Description: (was: Noted that cgroups blkio subsystem may have 
performance issue, refer to https://github.com/opencontainers/runc/issues/861)

> Add support for cgroups pids subsystem
> --
>
> Key: MESOS-6513
> URL: https://issues.apache.org/jira/browse/MESOS-6513
> Project: Mesos
>  Issue Type: Task
>Reporter: haosdent
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (MESOS-6512) Add support for cgroups hugetlb subsystem

2016-10-30 Thread haosdent (JIRA)

 [ 
https://issues.apache.org/jira/browse/MESOS-6512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

haosdent updated MESOS-6512:

Description: (was: Noted that cgroups blkio subsystem may have 
performance issue, refer to https://github.com/opencontainers/runc/issues/861)

> Add support for cgroups hugetlb subsystem
> -
>
> Key: MESOS-6512
> URL: https://issues.apache.org/jira/browse/MESOS-6512
> Project: Mesos
>  Issue Type: Task
>Reporter: haosdent
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Assigned] (MESOS-6512) Add support for cgroups hugetlb subsystem

2016-10-30 Thread haosdent (JIRA)

 [ 
https://issues.apache.org/jira/browse/MESOS-6512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

haosdent reassigned MESOS-6512:
---

Assignee: haosdent

> Add support for cgroups hugetlb subsystem
> -
>
> Key: MESOS-6512
> URL: https://issues.apache.org/jira/browse/MESOS-6512
> Project: Mesos
>  Issue Type: Task
>Reporter: haosdent
>Assignee: haosdent
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Assigned] (MESOS-6511) Add support for cgroups net_prio subsystem

2016-10-30 Thread haosdent (JIRA)

 [ 
https://issues.apache.org/jira/browse/MESOS-6511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

haosdent reassigned MESOS-6511:
---

Assignee: haosdent

> Add support for cgroups net_prio subsystem
> --
>
> Key: MESOS-6511
> URL: https://issues.apache.org/jira/browse/MESOS-6511
> Project: Mesos
>  Issue Type: Task
>Reporter: haosdent
>Assignee: haosdent
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Assigned] (MESOS-6513) Add support for cgroups pids subsystem

2016-10-30 Thread haosdent (JIRA)

 [ 
https://issues.apache.org/jira/browse/MESOS-6513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

haosdent reassigned MESOS-6513:
---

Assignee: haosdent

> Add support for cgroups pids subsystem
> --
>
> Key: MESOS-6513
> URL: https://issues.apache.org/jira/browse/MESOS-6513
> Project: Mesos
>  Issue Type: Task
>Reporter: haosdent
>Assignee: haosdent
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Assigned] (MESOS-6163) Add support for cgroups cpuset subsystem

2016-10-30 Thread haosdent (JIRA)

 [ 
https://issues.apache.org/jira/browse/MESOS-6163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

haosdent reassigned MESOS-6163:
---

Assignee: haosdent

> Add support for cgroups cpuset subsystem
> 
>
> Key: MESOS-6163
> URL: https://issues.apache.org/jira/browse/MESOS-6163
> Project: Mesos
>  Issue Type: Task
>Reporter: haosdent
>Assignee: haosdent
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (MESOS-5384) Improve error message for missing resources file

2016-10-30 Thread Kris Paprocki (JIRA)

[ 
https://issues.apache.org/jira/browse/MESOS-5384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15620335#comment-15620335
 ] 

Kris Paprocki  commented on MESOS-5384:
---

Hi Benjamin and John,

thanks for the comments.

I very much support the idea of not breaking backwards compatibility. However, 
just adding an error message at fetch/parse level is not going to work due to 
flags which contain directory path in format /path/to/directory (i.e. 
launcher_dir).

There is a potential solution to that: flags with directory paths could be a 
type of Path (from ), currently these flags are type of 
std::string. 
Then, as flags::fetch is specialized for Path type, we could add the error 
message in generic flags::fetch when he finds '/' at the beginning of the 
string. But I'm not sure if there are any other cases in which flags may 
contain '/' at the beginning. Do you see any blocker for this approach?

Going for this solution would involve a number of other changes in order to 
adapt existing code to Path type instead of std::string (for these flags which 
are directory paths). I'm willing to do the changes, but then maybe this shall 
be a part of a new ticket?

As for this ticket, I could adapt the documentation. We could then later update 
this ticket when the proper solution is applied.

> Improve error message for missing resources file
> 
>
> Key: MESOS-5384
> URL: https://issues.apache.org/jira/browse/MESOS-5384
> Project: Mesos
>  Issue Type: Bug
>  Components: general
>Affects Versions: 0.28.1
> Environment: Centos 7
>Reporter: John Yost
>Assignee: Kris Paprocki
>Priority: Minor
>  Labels: easyfix, newbie
>
> Attempting to specify resources file via 
> --resources=/etc/mesos-slave/small-slave-config.json threw the following 
> error:
> Failed to determine slave resources: Bad value for resources, missing or 
> extra ':' in /etc/mesos-slave/small-slave-config.json
> I confirmed I had valid JSON: 
> [
>   {
> "name": "cpus",
> "type": "SCALAR",
> "scalar": {
>   "value": 0.5
> }
>   },
>   {
> "name": "mem",
> "type": "SCALAR",
> "scalar": {
>   "value": 512
> }
>   }
> ]
> In actuality, I misread to docs with my file pattern. Once I changed to 
> resources=file:///etc/mesos-slave/small-slave-config.json the mesos slave 
> started up fine. Just need a missing file check and corresponding error 
> message to fix this.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (MESOS-6163) Add support for cgroups cpuset subsystem

2016-10-30 Thread haosdent (JIRA)

[ 
https://issues.apache.org/jira/browse/MESOS-6163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15620353#comment-15620353
 ] 

haosdent commented on MESOS-6163:
-

{code}
diff --git a/include/mesos/mesos.proto b/include/mesos/mesos.proto
index 905a34b..fb142d7 100644
--- a/include/mesos/mesos.proto
+++ b/include/mesos/mesos.proto
@@ -2064,6 +2064,8 @@ message CapabilityInfo {
 message LinuxInfo {
   // Represents the capability whitelist.
   optional CapabilityInfo capability_info = 1;
+
+  optional CgroupInfo cgroup_info = 2;
 }


@@ -2214,7 +2216,17 @@ message CgroupInfo {
 optional uint32 classid = 1;
   }

+  message Cpuset {
+xxx
+  }
+
+  message Blkio {
+xxx
+  }
+
   optional NetCls net_cls = 1;
+  optional Cpuset cpuset = 2;
+  optional Blkio blkio = 3;
 }
{code}

Hi, [~jieyu] I think we need to update {{LinuxInfo}} to support rest cgroups 
subsystems, if the above changes OK for you? I am going to write a document for 
further discussion. cc [~jlai]

> Add support for cgroups cpuset subsystem
> 
>
> Key: MESOS-6163
> URL: https://issues.apache.org/jira/browse/MESOS-6163
> Project: Mesos
>  Issue Type: Task
>Reporter: haosdent
>Assignee: haosdent
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (MESOS-6163) Add support for cgroups cpuset subsystem

2016-10-30 Thread Jie Yu (JIRA)

[ 
https://issues.apache.org/jira/browse/MESOS-6163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15620919#comment-15620919
 ] 

Jie Yu commented on MESOS-6163:
---

I'd suggest we don't expose those to the framework just yet. Let's add the 
subsystem first. I'll probably consider adding 'status' and 'usage' impl for 
those subsystems first.

> Add support for cgroups cpuset subsystem
> 
>
> Key: MESOS-6163
> URL: https://issues.apache.org/jira/browse/MESOS-6163
> Project: Mesos
>  Issue Type: Task
>Reporter: haosdent
>Assignee: haosdent
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (MESOS-6163) Add support for cgroups cpuset subsystem

2016-10-30 Thread haosdent (JIRA)

[ 
https://issues.apache.org/jira/browse/MESOS-6163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1562#comment-1562
 ] 

haosdent commented on MESOS-6163:
-

Got it, let me create stubs first.

> Add support for cgroups cpuset subsystem
> 
>
> Key: MESOS-6163
> URL: https://issues.apache.org/jira/browse/MESOS-6163
> Project: Mesos
>  Issue Type: Task
>Reporter: haosdent
>Assignee: haosdent
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)