Fokko - It's marshmallow-sqlalchemy - it's been fixed in master and v1-10-test branch in https://issues.apache.org/jira/browse/AIRFLOW-5430 (to be released in 1.10.6). It was a problem for both 3.5 and 2.7. Hopefully with some ways to dependency-pin release versions.
Maxime - 3.5 is still officially supported by Airflow. The previous LTS Debian shipped with 3.5 so we decided to stay with 3.5 as a base (though I would also welcome 3.6 and f-strings especially). The new Debian (buster) comes with 3.7. And indeed 3.7 is picking up significantly. 3.6 is the most popular. We still have quite significant amount of downloads from 3.5 so I think just removing it is not a good idea: https://photos.google.com/share/AF1QipPHqi5M1GT9K5k0Y-bPAC6o7SV4sx79pEjo2cc_Mfp5atmu33kiv_JJjM5npnOu6A?key=RV9BYzRvTFFuSGd2Uld0NkNpTzEtaWhEemN5T3hR J. On Mon, Sep 16, 2019 at 11:55 PM Maxime Beauchemin < maximebeauche...@gmail.com> wrote: > Fokko, surprised to see you use 3.5 . I thought most people went straight > to 3.6 as soon as it came out, as there are very little reasons to be on > the 3 to 3.5 range anymore > > I'd say we should go straight to 3.6+ for Airflow as we deprecate 2.7 > https://pythonclock.org/ > > On Mon, Sep 16, 2019 at 2:17 PM Driesprong, Fokko <fo...@driesprong.frl> > wrote: > > > Hi guys, > > > > While preparing a training, I think we have another incompatible > dependency > > that screws up Python 2.7 compatibility: > > > > MacBook-Pro-van-Fokko:airspark fokkodriesprong$ kubectl logs > > airflow-deployment-f55b986f-5tmt7 webserver > > > > [2019-09-16 21:10:40,045] {settings.py:213} INFO - > > settings.configure_orm(): Using pool settings. pool_size=5, > > max_overflow=10, pool_recycle=1800, pid=6 > > > > /usr/local/lib/python3.5/dist-packages/psycopg2/__init__.py:144: > > UserWarning: The psycopg2 wheel package will be renamed from release 2.8; > > in order to keep installing from binary please use "pip install > > psycopg2-binary" instead. For details see: < > > http://initd.org/psycopg/docs/install.html#binary-install-from-pypi>. > > > > """) > > > > [2019-09-16 21:10:41,188] {__init__.py:51} INFO - Using executor > > KubernetesExecutor > > > > Traceback (most recent call last): > > > > File "/usr/local/bin/airflow", line 22, in <module> > > > > from airflow.bin.cli import CLIFactory > > > > File "/usr/local/lib/python3.5/dist-packages/airflow/bin/cli.py", line > > 68, in <module> > > > > from airflow.www_rbac.app import cached_app as cached_app_rbac > > > > File "/usr/local/lib/python3.5/dist-packages/airflow/www_rbac/app.py", > > line 26, in <module> > > > > from flask_appbuilder import AppBuilder, SQLA > > > > File > > "/usr/local/lib/python3.5/dist-packages/flask_appbuilder/__init__.py", > line > > 5, in <module> > > > > from .base import AppBuilder > > > > File "/usr/local/lib/python3.5/dist-packages/flask_appbuilder/base.py", > > line 5, in <module> > > > > from .api.manager import OpenApiManager > > > > File > > > "/usr/local/lib/python3.5/dist-packages/flask_appbuilder/api/__init__.py", > > line 11, in <module> > > > > from marshmallow_sqlalchemy.fields import Related, RelatedList > > > > File > > > > > "/usr/local/lib/python3.5/dist-packages/marshmallow_sqlalchemy/__init__.py", > > line 1, in <module> > > > > from .schema import TableSchemaOpts, ModelSchemaOpts, TableSchema, > > ModelSchema > > > > File > > > "/usr/local/lib/python3.5/dist-packages/marshmallow_sqlalchemy/schema.py", > > line 3, in <module> > > > > from .convert import ModelConverter > > > > File > > > "/usr/local/lib/python3.5/dist-packages/marshmallow_sqlalchemy/convert.py", > > line 80 > > > > ): > > > > > > > > It looks like it is coming from the flask_appbuilder. I'll look into more > > details somewhere tomorrow, and provide a PR. Did more people run into > > this? > > > > Cheers, Fokko > > > -- Jarek Potiuk Polidea <https://www.polidea.com/> | Principal Software Engineer M: +48 660 796 129 <+48660796129> [image: Polidea] <https://www.polidea.com/>
