[Containerization WG] Notes 06/01/2017

2017-06-01 Thread Jie Yu
Hi Today, we went over the design proposal (CPU pinning in Mesos) from Dmitry. Please find today's notes in the following doc. https://docs.google.com/document/d/1z55a7tLZFoRWVuUxz1FZwgxkHeugt c2nHR89skFXSpU/edit?usp=sharing The recording can be found here: https://drive.google.com/file/d/0B78Xy

Mesos Containerization WG meeting tomorrow

2017-05-31 Thread Jie Yu
Hi folks, Mesos Containerization WG is scheduled for tomorrow (9AM PST). Dmitry will present the design proposal for "CPU pinning in Mesos ". Please join us if you're interested! The full agenda and

CSI spec repository

2017-05-25 Thread Jie Yu
Hi, The CSI working group moved the current draft (in google doc) to the following github repo so that it will be much easier to collaborate and track revision history. It's also in a state we believe that it won't be too much change to the spec for v0.1. https://github.com/container-storage-inte

Welcome Gilbert Song as a new committer and PMC member!

2017-05-24 Thread Jie Yu
Hi folks, I' happy to announce that the PMC has voted Gilbert Song as a new committer and member of PMC for the Apache Mesos project. Please join me to congratulate him! Gilbert has been working on Mesos project for 1.5 years now. His main contribution is his work on unified containerizer, nested

Re: New YouTube channel to house working group recordings?

2017-05-18 Thread Jie Yu
Mpark, i think Judith didn't know that there is already a YouTube Channel. We should just use the one you created. - Jie On Thu, May 18, 2017 at 4:53 PM, Michael Park wrote: > Is there a reason why you want to use new YouTube channel? I think I would > prefer to use the existing channel and hou

[Containerization WG] Notes 05/18/2017

2017-05-18 Thread Jie Yu
Hi We had our first WG meeting today. We went over the feature "wish list", and tag them with different urgency and effort required. We tried to assign high urgency features to folks in the working group and assign the reviewers. *We still need help on some of the items. So if you're willing to h

Mesos Containerization Working Group

2017-05-17 Thread Jie Yu
Hi folks, We're starting a Mesos Containerization WG with the goal to make containerization in Mesos insanely great :) Our first meeting will happen tomorrow morning (9am PST). Please see the following doc for instructions how to join the meeting: https://docs.google.com/document/d/1z55a7tLZFoRWV

Re: Container Storage Interface (CSI)

2017-05-12 Thread Jie Yu
The CSI spec doc has been updated after collecting feedbacks from the community. Please take a look https://docs.google.com/document/d/1JMNVNP-ZHz8cGlnqckOnpJmHF-DNY7IYP-Di7iuVhQI/edit?usp=sharing - Jie On Wed, Mar 22, 2017 at 10:00 PM, Jie Yu wrote: > Dave, > > This is the publ

Re: [VOTE] Release Apache Mesos 1.1.2 (rc1)

2017-05-09 Thread Jie Yu
-1 I suggest we include this fix in 1.1.2 https://issues.apache.org/jira/browse/MESOS-7471 On Thu, May 4, 2017 at 12:07 PM, Alex Rukletsov wrote: > Hi all, > > Please vote on releasing the following candidate as Apache Mesos 1.1.2. > > 1.1.2 includes the following: > ---

Re: [VOTE] Release Apache Mesos 1.3.0 (rc1)

2017-05-09 Thread Jie Yu
-1 I want to get this fix into 1.3.0 https://issues.apache.org/jira/browse/MESOS-7471 - Jie On Tue, May 9, 2017 at 1:14 AM, Yan Xu wrote: > We work around autotools and protobuf bugs and glibc is only harder for > users and developers to upgrade. :) > > I agree that we can establish the minimu

Re: Allowed whitelist devices in Mesos

2017-04-17 Thread Jie Yu
s discuss the API changes first. > > On Tue, Apr 18, 2017 at 9:02 AM, Jie Yu wrote: > >> Hi, >> >> I noticed this recent commit: >> https://reviews.apache.org/r/58337/ >> >> First of all, thanks for the patch and the review. But I think there is >&g

Re: 1.0.4 release

2017-04-11 Thread Jie Yu
Also, looks like 1.0.3 is still showing "unreleased" in JIRA. On Tue, Apr 11, 2017 at 4:51 PM, Jie Yu wrote: > Thanks Vinod. This sounds good. > > I don't see any additional patch on top of 1.0.3, at least in the > changelog. Can you make sure to update the changelog

Re: 1.0.4 release

2017-04-11 Thread Jie Yu
Thanks Vinod. This sounds good. I don't see any additional patch on top of 1.0.3, at least in the changelog. Can you make sure to update the changelog for that? (or you forgot to update the master changelog?) - Jie On Tue, Apr 11, 2017 at 12:33 PM, Vinod Kone wrote: > Hi folks, > > Though, we

Re: [4/4] mesos git commit: Removed unnecesary break statements in local approver.

2017-04-11 Thread Jie Yu
d42c3b > Tree: http://git-wip-us.apache.org/repos/asf/mesos/tree/76d42c3b > Diff: http://git-wip-us.apache.org/repos/asf/mesos/diff/76d42c3b > > Branch: refs/heads/master > Commit: 76d42c3bb8404b68656dfff4ed31cff9750f3e65 > Parents: 8e15963 > Author: Alexander Rojas > Author

Re: RFC: constraining UPIDs in libprocess messages

2017-04-07 Thread Jie Yu
+ BenM James, I don't have immediate context on this issue. BenM will be back next week and he should be able to give you more accurate feedback. - Jie On Fri, Apr 7, 2017 at 8:37 AM, James Peach wrote: > > > On Apr 5, 2017, at 5:42 PM, Jie Yu wrote: > > > >

Re: CPU affinity

2017-04-06 Thread Jie Yu
Hi Dmitry, Thank you for sending this out for comments! I'd love to participate in the discussion! Are you available for some f2f meetings (or remote hangout) for this? Thought it'll be more efficient if we can discuss that way than over emails. We can invite others in the community that are inte

Re: RFC: constraining UPIDs in libprocess messages

2017-04-05 Thread Jie Yu
One comment here is that: We plan to support libprocess communication using domain socket. In other words, we plan to make UPID a socket addr. Can we make sure this approach also works for the case where UPID is a unix address in the future? For instance, what will `socket->peer();` returns for do

MesosCon Asia CFP deadline extended

2017-03-27 Thread Jie Yu
Chinese version below/ 中文详情请见下文 In order to allow for more submissions, we have extended the CFP deadline for MesosCon Asia until April 5th 11:59pm PDT. http://events.linuxfoundation.org/events/mesoscon-asia/program/cfp None of the other submission dates have changed. Community voting on submissi

Re: [Design Doc] Improve Storage Support in Mesos using Resources Provider

2017-03-23 Thread Jie Yu
e CREATE_INTERFACE, with some given options about the ENI, > giving us a raw interface. Subsequently, we would want to do a > CREATE_IPVLAN, as a subinterface that we can assign an actual IP to. > The IPVLAN interface is a descendant of the raw interface, just as > volumes are descendants o

Re: Container Storage Interface (CSI)

2017-03-22 Thread Jie Yu
> Hi Jie, > > Who are the original author(s) of this document? Normally spec work > attributes authors, and I don't see that here -- revision history on the > doc is also turned off. > > Dave > > On 2017-03-22 12:02 (-0700), Jie Yu wrote: > > Hi, >

Container Storage Interface (CSI)

2017-03-22 Thread Jie Yu
Hi, Container Storage Interface (CSI) is a joint work between container orchestrators (Mesos, Kubernetes, Docker and Cloud Foundry) trying to standardize the interface between container orchestrator and storage platforms. The goal is to let storag

[Design Doc] Improve Storage Support in Mesos using Resources Provider

2017-03-12 Thread Jie Yu
Hi, Currently, Mesos supports both local persistent volumes as well as external persistent volumes. However, both of them are not ideal. Local persistent volumes do not support offering physical or logical block devices directly. Also, frameworks do not have choices to select filesystems for thei

Re: [VOTE] Release Apache Mesos 1.2.0 (rc2)

2017-03-06 Thread Jie Yu
-0 I wanna fix MESOS-7208 which affects all tasks that are launched as non-root using container image. But this is not a new regression because it exists in 1.1.0, thus I am a -0 - Jie On Fri, Mar 3, 2017 at 4:08 PM, Vinod Kone wrote: > +1 (b

Re: Welcome Kevin Klues as a Mesos Committer and PMC member!

2017-03-01 Thread Jie Yu
Congrats! Kevin! Well deserved! On Wed, Mar 1, 2017 at 2:05 PM, Benjamin Mahler wrote: > Hi all, > > Please welcome Kevin Klues as the newest committer and PMC member of the > Apache Mesos project. > > Kevin has been an active contributor in the project for over a year, and in > this time he mad

Re: Task id length restrictions

2017-02-24 Thread Jie Yu
The problem referred in the ticket does not exist any more. We now use Mesos generated container ID as the cgroup path (since 0.18?). That reminds me that the nested container ID might have this restriction because it's generated by the executor. We should add a validation in the agent. - Jie On

Re: mesos git commit: Upgrade leveldb to 1.19.

2017-02-20 Thread Jie Yu
mek Janiszewski wrote: > Test summary and comparison between 1.4 and 1.19 > https://docs.google.com/document/d/1fv2OMvH6hVm6waacOejSrTJwUuDQe > XlqqPDZjBmbcKU/edit#heading=h.ewfisffoslz3 > > pon., 20 lut 2017 o 11:28 użytkownik Jie Yu napisał: > > > Do we have some benchm

Re: mesos git commit: Upgrade leveldb to 1.19.

2017-02-20 Thread Jie Yu
Do we have some benchmark numbers to vet this change? We have some replicated log benchmarks. Sent from my iPhone > On Feb 19, 2017, at 11:37 PM, haosd...@apache.org wrote: > > Repository: mesos > Updated Branches: > refs/heads/master 86ea327ae -> 74878e255 > > > Upgrade leveldb to 1.19. >

Re: 3 way merge support in apply-reviews.py committed

2017-02-03 Thread Jie Yu
very cool! I used to do that manually. - Jie On Fri, Feb 3, 2017 at 2:10 PM, Michael Park wrote: > Thanks Zhitao for pushing this! This is awesome. > > Note that we made the flag opt-in so that you know to pay more attention > when using this flag. > Albeit rarely, it might not merge to what yo

Re: mesos git commit: Fixed bug allowing IOSwitchboard::connect() after container destruction.

2017-01-24 Thread Jie Yu
If 'cleanup' is invoked twice, that might cause signal being sent twice? - Jie On Tue, Jan 24, 2017 at 2:58 PM, wrote: > Repository: mesos > Updated Branches: > refs/heads/master 26923a1de -> 7f83b6e34 > > > Fixed bug allowing IOSwitchboard::connect() after container destruction. > > Review:

Re: Welcome Neil Conway as Mesos Committer and PMC member!

2017-01-22 Thread Jie Yu
Congrats! Neil! Well deserved! On Sun, Jan 22, 2017 at 6:56 PM, haosdent wrote: > Congrats Neil !! > > On Sun, Jan 22, 2017 at 3:29 AM, Gabriel Hartmann > wrote: > >> Congrats Neil. >> >> On Sat, Jan 21, 2017 at 7:08 AM Deepak Vij (A) >> wrote: >> >>> Congrats Neil. >>> >>> Deepak Vij >>> >>>

Re: Providing end-user feedback on Docker image download progress

2017-01-09 Thread Jie Yu
Frank, Thanks for reaching out! I think this is definitely something we've thought about, just don't have the cycle to get it prioritized. https://issues.apache.org/jira/browse/MESOS-2256 The idea is around re-using STAGING state with more information about the progress of the provisioning (and f

Re: Welcome Haosdent Huang as Mesos Committer and PMC member!

2016-12-19 Thread Jie Yu
Congrats! Well deserved!! Always wondering why you have so much time! - Jie On Mon, Dec 19, 2016 at 5:19 PM, Jay Guo wrote: > Congratulations Haosdent!!! > > /J > > On Mon, Dec 19, 2016 at 4:40 PM, Chengwei Yang > wrote: > > Congratulations! Well deserved. > > > > Haosdent helps me a lot! > >

Map support in proto2

2016-12-18 Thread Jie Yu
Looks like Map is already supported in proto2: https://developers.google.com/protocol-buffers/docs/reference/cpp-generated#map-fields It'll greatly simply our json parsing in a few cases (e.g., converting from OCI image configuration to a protobuf definition for key->value json object): "annotati

Welcome Guangya Liu as Mesos Committer and PMC member!

2016-12-16 Thread Jie Yu
Hi folks, Please join me in formally welcoming Guangya Liu as Mesos Committer and PMC member. Guangya has worked on the project for more than a year now and has been a very active contributor to the project. I think one of the most important contribution he has for the community is that he helped

Re: Building on OS X 10.12

2016-12-02 Thread Jie Yu
Another tip. If you are on macOS sierra, you might notice the linking is extremely slow using the default clang. Using CXXFLAGS `-fvisibility-inlines-hidden` will greatly speedup the linking. - Jie On Thu, Dec 1, 2016 at 5:05 PM, Michael Park wrote: > Thanks for writing this up! > > The remote

Slight change on Isolator interface on Linux

2016-11-29 Thread Jie Yu
Hi folks, I just landed MESOS-6648 , which greatly simplified the launch path in MesosContainerizer. The patch chain made MesosContainerizer launch helper to take ContainerLaunchInfo. Prior to this patch, the launch helper takes various flags from

Re: Proposal for mesos replicated log improvements

2016-11-02 Thread Jie Yu
Thanks for the design doc. Those graphs look awesome. We probably should get those into this doc: https://github.com/apache/mesos/blob/master/docs/replicated-log-internals.md Regarding the doc, I'd like to see some correctness argument about why the catchup process won't demote the current leader.

Re: [VOTE] Release Apache Mesos 1.0.2 (rc1)

2016-10-20 Thread Jie Yu
+0 If possible, would love to get this into 1.0.2: https://issues.apache.org/jira/browse/MESOS-6420 This just got fixed by Santhosh. - Jie On Tue, Oct 18, 2016 at 2:51 PM, Vinod Kone wrote: > Hi all, > > > Please vote on releasing the following candidate as Apache Mesos 1.0.2. > > > 1.0.2 inc

Re: LIBPROCSES_IP

2016-10-16 Thread Jie Yu
l not set any libprocess env > > variables. In this case, both CNI isolator and docker engine will > properly > > setup DNS in the container so hostname lookup should work properly. > > > > - Jie > > > > On Sat, Oct 15, 2016 at 4:01 PM, tommy xiao wrote: > > &

Re: LIBPROCSES_IP

2016-10-16 Thread Jie Yu
tainer). Mesos agent will not set any libprocess env variables. In this case, both CNI isolator and docker engine will properly setup DNS in the container so hostname lookup should work properly. - Jie On Sat, Oct 15, 2016 at 4:01 PM, tommy xiao wrote: > good point, +1 > > 201

Re: LIBPROCSES_IP

2016-10-12 Thread Jie Yu
ly at launch time. > > Please see https://issues.apache.org/jira/browse/MESOS-6281 for details. > > > On 12/10/16 06:42, "Avinash Sridharan" wrote: > > Valid point. Makes sense to drive this decision from the user and the > framework. > > On Tue, Oct 11, 2016 a

Re: LIBPROCSES_IP

2016-10-11 Thread Jie Yu
rks should be privy too and not left to the > agent. > > On Tue, Oct 11, 2016 at 7:31 PM, haosdent wrote: > > > > libprocess should always bind to 0.0.0.0 > > + 1 for this > > > > On Wed, Oct 12, 2016 at 2:33 AM, Jie Yu wrote: > > > > > Hi folks,

LIBPROCSES_IP

2016-10-11 Thread Jie Yu
Hi folks, I was in the process of cleaning up some tech debt related to env variables in our code base. I created an epic ticket to track. I searched relevant tickets fired previously, and found MESOS-3740

Welcome Qian Zhang as a new committer!

2016-10-08 Thread Jie Yu
Hi folks, I' happy to announce that the PMC has voted Qian Zhang as a new committer and member of PMC for the Apache Mesos project. Please join me to congratulate him! A little more about Qian Zhang: Qian Zhang has been working on the Apache Mesos project for about an year now. He designed and i

Re: Deprecate MESOS_DIRECTORY executor environment variable

2016-10-07 Thread Jie Yu
this path. Should > the host path be added to the result of GetExecutors call? (This being just > one example) > > On Fri, Oct 7, 2016 at 4:49 PM, Jie Yu wrote: > > > Hi, > > > > Want to initiate a discussion here. Before Mesos containerizer has > > container

Re: Deprecate MESOS_DIRECTORY executor environment variable

2016-10-07 Thread Jie Yu
at 5:28 PM, Zameer Manji wrote: > Jie, > > Without commenting on this deprecation, how is this going to work now that > Mesos is 1.0? > > What is the definition of "deprecate" being used here? Is it something that > will be removed in Mesos 2.0? > > On Fri,

Deprecate MESOS_DIRECTORY executor environment variable

2016-10-07 Thread Jie Yu
Hi, Want to initiate a discussion here. Before Mesos containerizer has container image support (all containers share the same host file system), $MESOS_DIRECTORY env variable is used to let executor know their sandbox location. Later, we introduced container image support to Mesos containerizer s

Re: LXC Container Support

2016-10-05 Thread Jie Yu
Tom, I'm looking to add LXC/LXD support, POC initially then hopefully bake it > into some Mesos libraries. From what I can tell Mesos doesn't have hooks > for LXC in the new container setup and also the External Shim that was > underdevelopment is Deprecated. Sound roughly accurate so far? Yup.

Re: Shepherd for MESOS-6207

2016-09-28 Thread Jie Yu
+ Till, Kevin who have more python experiences. Can you guys help on the review if possible? Thanks a lot! https://reviews.apache.org/r/52162/ - Jie On Mon, Sep 26, 2016 at 3:26 AM, Ilya Pronin wrote: > Hi, > > Can someone, please, shepherd MESOS-6207? It's about fixing Python > bindings build

Re: [jira] [Commented] (MESOS-6183) mesos's Unified Containerizer cannot set "--insecure-registry" when provisioning images

2016-09-18 Thread Jie Yu
Can u use port 80 or localhost? We will assume insecure registry in the above case. Sent from my iPhone > On Sep 16, 2016, at 11:14 PM, yongyu (JIRA) wrote: > > >[ > https://issues.apache.org/jira/browse/MESOS-6183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&foc

Unified cgroups isolator

2016-09-13 Thread Jie Yu
Hi, We just merged the unified cgroups isolator. Huge shout out to @haosdent and @qianzhang to make this happen! https://issues.apache.org/jira/browse/MESOS-4697 Just to give you some context. Previously, it's a huge pain to add a new cgroups subsystem to Mesos because it requires creating a new

Re: mesos per task monitoring/metrics

2016-08-24 Thread Jie Yu
OK, the reason we don't expose containerId currently is because I believe containerId is local to the agent, and shouldn't be exposed to the framework. However, looks like there are multiple legitimate use cases requesting to expose that information to the framework. I'll create a ticket to track

Re: Fail to get CNI with unified containerizer, job remains stuck on staging

2016-08-23 Thread Jie Yu
The DNS related logging means that the weave plugin does not return DNS information, the agent uses the host resolv.conf for the container. So I think is irrelevant to your problem. Mesos requires that executor can talk to agent. Can you see if there is a route from 10.32.0.1 to the agent IP? On

Re: Support for tasks groups aka pods in Mesos

2016-08-11 Thread Jie Yu
Aaron, an important feature of kubernetes for us is the ability to share mount and > network namespaces between containers in the pod (so containers can share > mounts etc) yes, this will be supported in MVP. it's described in the design doc. - Jie On Thu, Aug 11, 2016 at 6:32 AM, Aaron Carey

Re: cni / public port questions

2016-08-02 Thread Jie Yu
itly setup CNI to use bridge/port mapping. cc @avinash. - Jie On Fri, Jul 29, 2016 at 12:44 AM, Olivier Sallou wrote: > > > - Mail original ----- > > De: "Jie Yu" > > À: "dev" > > Cc: "Qian AZ Zhang" , "Avinash Sridhara

Re: cni / public port questions

2016-07-28 Thread Jie Yu
you can still use bridge with CNI (you'll need to use the built-in bridge plugin of CNI). Port mapping is still under development. Expecting this coming soon. - Jie On Thu, Jul 28, 2016 at 2:44 AM, haosdent wrote: > Hi, @Olivier. The port forwarding of mesos is still under implementing. You >

Re: [VOTE] Release Apache Mesos 1.0.0 (rc4)

2016-07-26 Thread Jie Yu
on the ticket, I feel that a short term fix shouldn't >> be more than a few lines to unblock the release. >> >>> On Jul 26, 2016, at 3:26 PM, Jie Yu wrote: >>> >>> Yan, are you going to shepherd the fix for this one? If yes, when do you >>> t

Re: [VOTE] Release Apache Mesos 1.0.0 (rc4)

2016-07-26 Thread Jie Yu
Yan, are you going to shepherd the fix for this one? If yes, when do you think it can be done? - Jie On Tue, Jul 26, 2016 at 3:05 PM, Yan Xu wrote: > -1 > > We tested it in our testing environment but webUI redirect didn't work. We > filed: https://issues.apache.org/jira/browse/MESOS-5911 > > G

Re: [VOTE] Release Apache Mesos 1.0.0 (rc4)

2016-07-26 Thread Jie Yu
+1 sudo make check on CentOS 6/7, Debian 8, Fedora 23, Ubuntu 12/14/15/16 - Jie On Tue, Jul 26, 2016 at 1:58 AM, haosdent wrote: > +1 > > * make check in CentOS 7.2 > * make check in Ubuntu 14.04 > * test upgrade from 0.28.2 to 1.0.0-rc4 > > > On Tue, Jul 26, 2016 at 8:33 AM, Kapil Arya wrote

Re: Disabling the --registry_strict flag in 1.0

2016-07-12 Thread Jie Yu
Hi Neil, Does this mean that we'll have to cut another 1.0 RC just for that? If we were to cut another RC (e.g., due to bugs, which is likely), I would be happy to include the patch that disables the flag in the new RC. But if not, personally, I don't think this is necessary. As far as I know, n

Re: Mesos docker image can't be started by docker-py

2016-07-12 Thread Jie Yu
Zhiwei, >From the log, looks like Mesos received a SIGTERM from containerd, thus terminating. Can you check Docker's log as well. Can you also create a ticket to paste the log there? Thanks! - Jie On Tue, Jul 12, 2016 at 3:20 AM, zhiwei wrote: > Hi team, > > I can use `docker run` command to s

[RESULT][VOTE] Release Apache Mesos 0.26.2 (rc1)

2016-06-27 Thread Jie Yu
Hi all, NOTE: This will be the last supported point release for 0.26.x. The vote for Mesos 0.26.2 (rc1) has passed with the following votes. +1 (Binding) -- Vinod Kone Kapil Arya Benjamin Mahler +1 (Non-binding) -- There were no 0 or -1

Re: Mesos CLI

2016-06-23 Thread Jie Yu
I am actually fine with Python as long as we can figure out a way to install python executable without any dependency during make install (and subsequently bundle it into rpm/deb packages). According to Kevin, looks like pyinstall can achieve that. If we go for the Python route, I'd like to have a

Re: [Protobuf] Why do we mark field as 'required'

2016-06-22 Thread Jie Yu
+1 Proto3 killed 'required' keyword. On Wed, Jun 22, 2016 at 5:15 PM, Jay JN Guo wrote: > > > Hi, > > I find marking protobuf field as 'required' sometimes causing trouble: > serializing a message without filling up required field generates errors > and this is hard to change due to backwards c

Re: Mesos CLI

2016-06-21 Thread Jie Yu
I personally prefer it being part of the Mesos repo so that when people install our package, they'll get the command line tools as well. That also avoids the potential version mismatch between Mesos and CLI (as you mentioned). What does others think? - Jie On Tue, Jun 21, 2016 at 10:20 AM, Kevin

Persistent volume ownership issue

2016-06-20 Thread Jie Yu
Hi folks, Currently, the ownership of the persistent volumes are set to be the same as the sandbox. In the implementation, we call `chown -R` on the persistent volume to match that of the sandbox each time before we mount it into the container. Recently, we realized that this behavior is not idea

Re: Executors no longer inherit environment variables from the agent

2016-06-20 Thread Jie Yu
onse of `Any environment variables > generated by Mesos (i.e., MESOS_, LIBPROCESS_) will not be affected.` > will still be honored, or explicitly call this out in UPGRADES.md? > > Thanks. > > On Mon, Jun 20, 2016 at 11:39 AM, Jie Yu wrote: > >> FYI, from Mesos 1.

Re: Executors no longer inherit environment variables from the agent

2016-06-20 Thread Jie Yu
FYI, from Mesos 1.0, the executors will no longer inherit environment variables from the agent by default. If you have environment environment variables that you want to pass in to executors, please use `-- executor_environment_variables` flag on the agent. commit ce4b3056164a804bea52810173dbd7a41

[VOTE] Release Apache Mesos 0.26.2 (rc1)

2016-06-20 Thread Jie Yu
Hi all, Please vote on releasing the following candidate as Apache Mesos 0.26.2. 0.26.2 is a bug fix release. It includes the following: [MESOS-4705] - Linux 'perf' parsing logic may fail when OS distribution has pe

Mesos working groups

2016-06-16 Thread Jie Yu
Hi, I am in the process of formalizing our working groups. We recently moved our working groups wiki to documentation in the repo (Thanks Tomasz!). That'll give us more visibility hopefully. https://github.com/apache/mesos/blob/master/docs/working-groups.md However, I realized that a lot of the w

Re: [1/5] mesos git commit: Added a metric to replicated log.

2016-06-16 Thread Jie Yu
cd2 > Diff: http://git-wip-us.apache.org/repos/asf/mesos/diff/14858cd2 > > Branch: refs/heads/metrics_replicated_log > Commit: 14858cd2a2bb55cacf6279059dd913a40971a284 > Parents: 161e049 > Author: Jie Yu > Authored: Wed Jun 15 22:28:02 2016

[RESULT][VOTE] Release Apache Mesos 0.27.3 (rc1)

2016-06-12 Thread Jie Yu
Hi all, The vote for Mesos 0.27.3 (rc1) has passed with thefollowing votes. +1 (Binding)--Kapil Arya Vinod Kone Benjamin Mahler +1 (Non-binding)--Jörg Schad There were no 0 or -1 votes. Please find the release at: https://dist.apache.org/rep

Re: Blog posts for 0.28.1, 0.28.2 releases?

2016-06-10 Thread Jie Yu
Apologies! Will write a blog post for 0.28.2. - Jie On Fri, Jun 10, 2016 at 2:50 AM, Neil Conway wrote: > Folks, > > It seems like https://mesos.apache.org/blog/ doesn't have blog posts > for the Mesos 0.28.1 or 0.28.2 releases. We generally try to have a > blog post for each release, right? >

Re: Proposal: move content in Wiki to docs in code repo

2016-06-08 Thread Jie Yu
>>>> IBM China Software Development Laboratory (CSDL) >>>> Notes ID:Zhou Z Xing/China/IBM >>>> Phone :86-10-82450442 >>>> e-Mail :xingz...@cn.ibm.com >>>> Address :Building No.28, ZhongGuanCun Software Park, No.8 Dong Bei Wang &g

Re: [Compilation Error][aufs] Getting erros compiling latest code on OSX

2016-06-07 Thread Jie Yu
+ Shuai Sent from my iPhone > On Jun 7, 2016, at 6:13 PM, Jay JN Guo wrote: > > > Hi, > > I'm getting this error when compiling latest code on OSX: > > In file included > from ../../src/tests/containerizer/provisioner_backend_tests.cpp:17: > In file included > from ../../3rdparty/libprocess/

[VOTE] Release Apache Mesos 0.27.3 (rc1)

2016-06-07 Thread Jie Yu
Hi all, Please vote on releasing the following candidate as Apache Mesos 0.27.3. NOTE: I fat fingered and accidentally released the 0.27.3 jar to maven repo and I have no permission to remove it (apologies!). If this vote passes, nothing needs to be done. If not, I'll see how I can update it. Sor

Proposal: move content in Wiki to docs in code repo

2016-06-06 Thread Jie Yu
Hi folks, I am proposing moving our content in Wiki (e.g., working groups, release tracking, etc.) to our docs in the code repo. I personally found that wiki is hard to use and there's no reviewing process for changes in the Wiki. The content in Wiki historically received less attention than that

0.28.2 has been released

2016-06-05 Thread Jie Yu
Hi folks, I just released Mesos 0.28.2 and updated the website. It includes some important bug fixes. The change log can be found here: https://git-wip-us.apache.org/repos/asf?p=mesos.git;a=blob_plain;f=CHANGELOG;hb=0.28.2 If you are considering using 0.28, please use 0.28.2! Thanks! - Jie

Re: Mesos HA does not work (Failed to recover registrar)

2016-06-04 Thread Jie Yu
Which version are you using? - Jie On Sat, Jun 4, 2016 at 4:34 PM, Qian Zhang wrote: > Thanks Vinod and Dick. > > I think my 3 ZK servers have formed a quorum, each of them has the > following config: > $ cat conf/zoo.cfg > server.1=192.168.122.132:2888:3888 > server.2=192.168.122.2

[RESULT][VOTE] Release Apache Mesos 0.28.2 (rc1)

2016-06-04 Thread Jie Yu
Hi all, The vote for Mesos 0.28.2 (rc1) has passed with the following votes. +1 (Binding) -- Vinod Kone Till Toenshoff Kapil Arya +1 (Non-binding) -- Guangya Liu haosdent There were no 0 or -1 votes. Please find the release at: https://di

[VOTE] Release Apache Mesos 0.28.2 (rc1)

2016-05-29 Thread Jie Yu
Hi all, Please vote on releasing the following candidate as Apache Mesos 0.28.2. 0.28.2 is a bug fix release. It includes the following: ** Bug * [MESOS-4705] - Linux 'perf' parsing logic may fail when OS distribu

Re: 0.28.2

2016-05-29 Thread Jie Yu
OK, looks like no one volunteer for 0.27.3 and 0.26.2. Therefore, I'll be the release manager for these two release as well. Will try to cut right after MesosCon. - Jie On Fri, May 27, 2016 at 9:38 AM, Jie Yu wrote: > Any other committers have cycles for point release 0.27.3 and 0.

Re: Newbie to Mesos contributors

2016-05-27 Thread Jie Yu
gt; Hi Cong, > > I'll post the patch later, hope you can be my first reviewer. : p > Thank you in advance for your help! > > > - Sha > > On Tue, May 17, 2016 at 7:37 PM, Jie Yu wrote: > > Sha, you can ask Cong Wang to take a look and I can help commit if he >

Re: Extracting a filesystem isolation utility?

2016-05-27 Thread Jie Yu
Joshua, Yep. That's what we've discussed yesterday. I think the short-term solution makes sense to me. Do you guys have any cycle to submit a patch for the short-term solution? I'd be happy to shepherd it. - Jie On Fri, May 27, 2016 at 7:09 AM, Joshua Cohen wrote: > Hi Gilbert, > > I talked to

Re: 0.28.2

2016-05-27 Thread Jie Yu
or this particular fix to land: > https://issues.apache.org/jira/browse/MESOS-4705. > > Thanks! > > -- Roger > > On Tue, May 24, 2016 at 9:04 AM, Jie Yu wrote: > >> Hi folks, >> >> According to our release schedule, we should be cutting point release for

Re: 1.0 Release Candidate

2016-05-25 Thread Jie Yu
Jeff, Yes, deprecating the docker containerizer will be post-1.0. The plan has not changed. In fact, we are making very good progress on the unified containerizer side (see this doc ). We'll continue to support Docker containeri

Re: Memory leak in libmesos + patch

2016-05-24 Thread Jie Yu
Dario, Thanks for reporting. We'll take a look that asap. - Jie On Tue, May 24, 2016 at 5:56 PM, Dario Rexin wrote: > Hi all, > > we recently started observing abnormal memory growth in our schedulers > after deploying a new Mesos version and after looking into it discovered a > memory leak in

0.28.2

2016-05-24 Thread Jie Yu
Hi folks, According to our release schedule, we should be cutting point release for 0.28.x. I volunteer to be the release manager. Vinod and Ben already started a branch (0.28.x) in the repo, so it's just a matter of cutting it. If you have any patch that you want to backport into 0.28.2, please l

Re: Newbie to Mesos contributors

2016-05-17 Thread Jie Yu
in JIRA: > https://issues.apache.org/jira/browse/MESOS-5381, and want to try to > fix it, could anyone add me to the list of mesos "Contributors"? so I > can be assigned to this issue. : ) > > > Hi Jie Yu, > > Sorry for the interruption but could you please be my shepherd? : p > > > > -- > Thanks, > Sha >

Re: stable remote branches

2016-05-04 Thread Jie Yu
cifying a local docker > registry. > > On Wed, May 4, 2016 at 12:22 PM, Jie Yu wrote: > > > Thanks Ben! I've done with the backport for 0.28.2. > > > > Will do the rest later today. > > > > - Jie > > > > On Wed, May 4, 2016 at 10:20 AM, Benjami

Re: stable remote branches

2016-05-04 Thread Jie Yu
Thanks Ben! I've done with the backport for 0.28.2. Will do the rest later today. - Jie On Wed, May 4, 2016 at 10:20 AM, Benjamin Mahler wrote: > Jie I've highlighted in the doc the backports that remain from the initial > search of fix versions. > > Let me know if you'd like any help! > > On

Re: mesos git commit: Add /containers endpoint.

2016-04-22 Thread Jie Yu
apache.org/repos/asf/mesos/repo > > > > Commit: http://git-wip-us.apache.org/repos/asf/mesos/commit/90f7645c > > > > Tree: http://git-wip-us.apache.org/repos/asf/mesos/tree/90f7645c > > > > Diff: http://git-wip-us.apache.org/repos/asf/mesos/diff/9

[RESULT][VOTE] Release Apache Mesos 0.28.1 (rc2)

2016-04-13 Thread Jie Yu
Hi all, The vote for Mesos 0.28.1 (rc2) has passed with the following votes. +1 (Binding) -- Michael Park Vinod Kone Kapil Arya +1 (Non-binding) -- Greg Mann There were no 0 or -1 votes. Please find the release at: https://dist.apache.org

Re: [Proposal] Remove the default value for agent work_dir

2016-04-12 Thread Jie Yu
+1 On Tue, Apr 12, 2016 at 9:29 PM, James Peach wrote: > > > On Apr 12, 2016, at 3:58 PM, Greg Mann wrote: > > > > Hey folks! > > A number of situations have arisen in which the default value of the > Mesos agent `--work_dir` flag (/tmp/mesos) has caused problems on systems > in which the autom

[VOTE] Release Apache Mesos 0.28.1 (rc2)

2016-04-05 Thread Jie Yu
Hi all, Please vote on releasing the following candidate as Apache Mesos 0.28.1. 0.28.1 includes the following bug fixes: [MESOS-4662] - PortMapping network isolator should not assume BIND_MOUNT_ROOT is a realpath.

Re: [VOTE] Release Apache Mesos 0.28.1 (rc1)

2016-04-05 Thread Jie Yu
oops. I forgot to include the change log in the release. Please ignore this email. I'll cut rc2 :( - Jie On Tue, Apr 5, 2016 at 6:15 PM, Jie Yu wrote: > Hi all, > > Please vote on releasing the following candidate as Apache Mesos 0.28.1. > > > 0.28.1

[VOTE] Release Apache Mesos 0.28.1 (rc1)

2016-04-05 Thread Jie Yu
Hi all, Please vote on releasing the following candidate as Apache Mesos 0.28.1. 0.28.1 includes the following: *Announce major features here* *Announce major bug fixes here* The CHANGELOG for the r

Re: [Mesos Agent][Isolator][Storage] Docker Volume Driver Isolator Design is ready for review

2016-04-03 Thread Jie Yu
Thanks for the doc! I made some comments in the doc. Could you please make sure the doc is up-to-date according to our discussion last time? Thanks! - Jie On Sun, Apr 3, 2016 at 9:45 PM, Guangya Liu wrote: > Hi, > > A design document for MESOS-4355 >

Re: Correctly handle MOUNT type disk

2016-04-01 Thread Jie Yu
Zhitao, Typically, you need to enable this feature in a two phase manner: Phase 1: upgrade Mesos and scheduler, but not use this feature yet. Phase 2: turn on this feature To be safe, IMO i think the scheduler driver (or the scheduler itself if using HTTP api) should check for unknown tag number

Re: 0.28.1

2016-03-31 Thread Jie Yu
other patches for 0.28.1, please contact me asap. Thanks! - Jie On Wed, Mar 23, 2016 at 8:35 PM, Benjamin Mahler wrote: > Thanks Jie, I've added a fix version of 0.28.1 to: > https://issues.apache.org/jira/browse/MESOS-5021 > > On Fri, Mar 18, 2016 at 5:52 PM, Jie Yu wrote: >

<    1   2   3   4   5   6   7   8   9   10   >