Re: Proposal: Scheduled tasks

2020-12-08 Thread Chad Dombrova
Thanks! On Tue, Dec 8, 2020 at 6:54 AM Pablo Estrada wrote: > Hi Chad! > I've been meaning to review this, I've just not carved up the time. I'll > try to get back to you this week with some thoughts! > Thanks! > -P. > > On Wed, Dec 2, 2020 at 10:31 AM Chad Dombrova wrote: > >> Hi everyone, >>

Re: Proposal: Scheduled tasks

2020-12-08 Thread Pablo Estrada
Hi Chad! I've been meaning to review this, I've just not carved up the time. I'll try to get back to you this week with some thoughts! Thanks! -P. On Wed, Dec 2, 2020 at 10:31 AM Chad Dombrova wrote: > Hi everyone, > Beam's niche is low latency, high throughput workloads, but Beam has >

Proposal: Scheduled tasks

2020-12-02 Thread Chad Dombrova
Hi everyone, Beam's niche is low latency, high throughput workloads, but Beam has incredible promise as an orchestrator of long running work that gets sent to a scheduler. We've created a modified version of Beam that allows the python SDK worker to outsource tasks to a scheduler, like Kubernetes