Re: [DISCUSS] Moving to the ASF slack?

Hi Kaxil, As Austin mentioned above, it is possible to create separate channels per topic in the ASF. You can see in the first screenshot that I attached. And yes, ASF slacks keep full history and ASF pays to have that feature. However slack history is not used as platform for decision making. It

Re: Help SparkJDBCOperator

On Sun, Feb 10, 2019 at 12:45:33PM +0100, Driesprong, Fokko wrote: > Since there is also Pyspark support, it should be relative straightforward > to invoke the spark-postgres library from Airflow. yes pyspark is supported. In version 3 of spark-postgres library, I will improve the pyspark API whic

Re: [DISCUSS] Moving to the ASF slack?

Hi Kaxil, Not suggesting that a migration to ASF slack is the right move (don't have a strong opinion). I disagree with your premise that separation of channels per topic is impossible in the ASF Seems could have channels in the ASF Slack : #Airflow-announce #Airflow-users-bay-area #Airflow-gith

Re: [DISCUSS]: Remove Mesos Executor from Airflow 2.0.0?

>From memory, I think MesosExecutor depends on pickling to get DAG definitions to workers, which we should also deprecate. About CeleryExecutor, we never had the intention to make it the recommended option for production early on. The intent back in 2014 was to write a YarnExecutor quickly (that w

Re: Help SparkJDBCOperator

thanks for sharing. I will analyze your postgres solution Thanks! Regards, Iván El dom., 10 feb. 2019 a las 12:45, Driesprong, Fokko () escribió: > Looking good Nicolas, thanks for sharing. > > Since there is also Pyspark support, it should be relative straightforward > to invoke the spark-po

Re: CLI: Use nested commands instead of flags

+1, I like the general idea of refactoring this and the new command suggestions by Kamil look nice and coherent to me. Szymon Przedwojski Polidea | Software Engineer M: +48 500 330 790 E: szymon.przedwoj...@polidea.com > On 8 Feb 2019, at 11:50, Kamil Breguła wrote: > > I think that it is wo

Re: [DISCUSS] Moving to the ASF slack?

Currently, we have a good separation of channels per topic. A separate channel for announcement etc. This won't be possible if we move to ASF slack. On Mon, Feb 11, 2019, 07:45 Aizhamal Nurmamat kyzy wrote: > Hello everybody! > > I was wondering what the community thinks of migrating Apache Ai