Re: [ANNOUNCE] Please welcome new Airflow committer Kevin Yang

Welcome, Kevin!! On Sat, May 4, 2019 at 9:29 PM Bolke de Bruin wrote: > Welcome! > > Sent from my iPhone > > > On 2 May 2019, at 11:59, Szymon Przedwojski < > szymon.przedwoj...@polidea.com> wrote: > > > > Congratulations Kevin! > > > > Szymon Przedwojski > > Polidea | Software Engineer > > > >

Operator for syncing s3 buckets (and recursively copying)?

Hi Airflow Devs, I am not having any luck finding some S3 functionality that I would like to use. Specifically the ability to sync buckets. And, the ability to recursively copy. `aws s3 sync s3://source-bucket/ s3://destination-bucket` or `aws s3 cp s3://source-bucket/folder/ s3://destination

Re: Deadlock at DAG SubDAG Execution at LocalExecutor

Thanks airflowuser for response. Hello Bolke, Do you any observations... On Sat, May 4, 2019 at 1:01 AM Chetan Khatri wrote: > What I am guessing is, > > 1) Increase the concurrency to 56 at airflow.cfg and don't overwrite > attribute in DAG Constructor. > 2) Change subdag's LocalExecutor to s

Re: [ANNOUNCE] Please welcome new Airflow committer Kevin Yang

Welcome! Sent from my iPhone > On 2 May 2019, at 11:59, Szymon Przedwojski > wrote: > > Congratulations Kevin! > > Szymon Przedwojski > Polidea | Software Engineer > > M: +48 500 330 790 > E: szymon.przedwoj...@polidea.com > >> On 2 May 2019, at 07:35, Maxime Beauchemin >> wrote: >> >>