Re: Dynamic Reservations

2017-03-13 Thread Dmitriy Shirchenko
Yup, working on addressing all of the comments! Thanks for leaving them, everyone. Also, as @serb correctly pointed out (and Josh found out) I submitted an updated patch [1] with updated design document [2] [1] https://reviews.apache.org/r/57487/ [2] https://docs.google.com/document/d/1L2EKEcKKBP

Re: Dynamic Reservations Update

2016-11-10 Thread Dmitriy Shirchenko
Update: If there are no major issues that get raised by tomorrow afternoon, then I will start cutting JIRA tasks for this feature. Thanks everyone! On Fri, Nov 4, 2016 at 10:23 AM Dmitriy Shirchenko wrote: > Hi everyone! > > I would like to share the DR design > <https://

Dynamic Reservations Update

2016-11-04 Thread Dmitriy Shirchenko
Hi everyone! I would like to share the DR design and the messy DR branch POC which I made to get things working and be able to res

Re: Aurora 0.16.0 release

2016-09-09 Thread Dmitriy Shirchenko
We discovered an issue with webhook today, so we may want to consider not releasing 0.16.0 until we fix this issue next week: https://issues.apache.org/jira/browse/AURORA-1769 On Tue, Sep 6, 2016 at 1:34 PM Maxim Khutornenko wrote: > I'd give it one more release as it may break any internal cons

Link to dynamic reservation POC

2016-09-07 Thread Dmitriy Shirchenko
During the meeting today I demoed my POC work which adds ability to dynamically reserve resources for tasks. Rough (but working) for the specific use case code: https://github.com/apache/aurora/compare/master...shirchen:dyn_reserv?expand=1 Dmitriy.

Re: Subscribing to Aurora's tasks' event changes

2016-04-28 Thread Dmitriy Shirchenko
; using Kafka. > > > > Or maybe even just a webhook API. You configure aurora with an HTTP > endpoint that must conform to a given api and Aurora tries, best effort > only, to post events to the endpoint, perhaps on a streaming connection. > This scales well for Aurora. > &g

Re: Subscribing to Aurora's tasks' event changes

2016-04-25 Thread Dmitriy Shirchenko
@wfarner Can you help me out and clarify what you mean by 'First-class mechanism'? An example would be awesome. On Mon, Apr 25, 2016 at 4:40 PM Dmitriy Shirchenko wrote: > Has anyone built something that can subscribe to events and then send them > to a pub/sub system? Maybe c

Subscribing to Aurora's tasks' event changes

2016-04-25 Thread Dmitriy Shirchenko
Has anyone built something that can subscribe to events and then send them to a pub/sub system? Maybe can give pointers on how you would approach this? Our use case is sending TaskStateChange`s into an internal Kafka topic. Thanks!

Re: PROPOSAL: Host and support nightly Aurora builds on Apache servers

2016-01-22 Thread Dmitriy Shirchenko
Awesome. Thanks everyone! On Fri, Jan 22, 2016 at 11:54 AM, Dmitriy Shirchenko wrote: > Hi everyone, > > This is a proposal to provide nightly builds in three Linux flavors: > Debian Jessie, Ubuntu Trusty and CentOS for public consumption. Exposing > them through Jenkins build jo

PROPOSAL: Host and support nightly Aurora builds on Apache servers

2016-01-22 Thread Dmitriy Shirchenko
Hi everyone, This is a proposal to provide nightly builds in three Linux flavors: Debian Jessie, Ubuntu Trusty and CentOS for public consumption. Exposing them through Jenkins build job is one option and would be enough. Reason for nightlies is to allow us quicker testing in production for featur

Re: Health checks for non-HTTP protocols

2015-12-08 Thread Dmitriy Shirchenko
submit a patch with that. And great points about graceful shutdown. I guess in the future support for that would need to get added as well since those require HTTP. Thanks! On Mon, Nov 9, 2015 at 11:45 AM, Dmitriy Shirchenko wrote: > Hi everyone! > > As we are trying to adopt Aurora, o

Health checks for non-HTTP protocols

2015-11-09 Thread Dmitriy Shirchenko
Hi everyone! As we are trying to adopt Aurora, one of the things we need is support for health checking applications interacting via non-HTTP protocols. Has this been brought up before or can someone please give us guidance on how to make this work? Thanks for your help, Dmitriy!