Hi Everyone, Following on form 1.10.3b1 I've pulled in another 84 (!) commits, mostly around doc fixes or code-reorg. I will start the RC process this week.
In order to distinguish it from an actual (apache) release it is: 1. Marked as beta (python package managers do not install beta versions by default - PEP 440) 2. It is not signed 3. It is not at an official Apache distribution location It can be installed with: pip install 'apache-airflow==1.10.3b2' (Don't worry, without asking for `--pre` or specifying the version `pip install apache-airflow` will still get 1.10.2) Included below is the extra commits since beta 1. Cheers, Ash [AIRFLOW-XXX] Version 1.10.3b2 [AIRFLOW-4172] Fix changes for driver class path option in Spark Submit (#4992) [AIRFLOW-3464] Move SkipMixin out of models.py (#4386) [AIRFLOW-3463] Move Log out of models.py (#4639) [AIRFLOW-3458] Move connection tests (#4680) [AIRFLOW-3476,3477] Move Kube classes out of models.py (#4443) [AIRFLOW-3461] Move TaskFail out of models.py (#4630) [AIRFLOW-3287] Moving database clean-up code into the CoreTest.tearDown() (#4122) [AIRFLOW-4058] Name models test file to get automatically picked up (#4901) [AIRFLOW-3830] Remove DagBag from /dag_details (#4831) [AIRFLOW-3596] Clean up undefined template variables. (#4401) [AIRFLOW-3573] Remove DagStat table (#4378) [AIRFLOW-3623] Fix bugs in Download task logs (#5005) [AIRFLOW-4173] Improve SchedulerJob.process_file() (#4993) [AIRFLOW-3540] Warn if old airflow.cfg file is found (#5006) [AIRFLOW-1526] Add dingding hook and operator (#4895) [AIRFLOW-4000] Return response when no file (#4822) [AIRFLOW-XXX] Add contents to cli (#4825) [AIRFLOW-3615] Preserve case of UNIX socket paths in Connections (#4591) [AIRFLOW-3383] Rotate fernet keys. (#4225) [AIRFLOW-3417] ECSOperator: pass platformVersion only for FARGATE launch type (#4256) [AIRFLOW-XXX] fix check docs failure on CI (#4998) [AIRFLOW-3811] automatic generation of API Reference in docs (#4788) [AIRFLOW-3884] Fixing doc checker, no warnings allowed anymore and fixed the current… (#4702) [AIRFLOW-XXX] Fix syntax docs errors (#4789) [AIRFLOW-XXX] Docs rendering improvement (#4684) [AIRFLOW-3490] Add BigQueryHook's Ability to Patch Table/View (#4299) [AIRFLOW-XXX] Automatically link Jira/GH on doc's changelog page (#4587) [AIRFLOW-XXX] Fix flaky test - test_execution_unlimited_parallelism (#4988) [AIRFLOW-XXX] Mention Oracle in the Extra Packages documentation (#4987) [AIRFLOW-3003] Pull the krb5 image instead of building (#3844) [AIRFLOW-3862] Check types with mypy. (#4685) [AIRFLOW-3462] Move TaskReschedule out of models.py (#4618) [AIRFLOW-3474] Move SlaMiss out of models.py (#4608) [AIRFLOW-3475] Move ImportError out of models.py (#4383) [AIRFLOW-3459] Move DagPickle to separate file (#4374) [AIRFLOW-251] Add option SQL_ALCHEMY_SCHEMA parameter to specify schema for metadata (#4199) [AIRFLOW-1814] : Temple PythonOperator {op_args,op_kwargs} fields (#4691) [AIRFLOW-2652] implement / enhance baseOperator deepcopy [AIRFLOW-3730] Standarization use of logs mechanisms (#4556) [AIRFLOW-XXX] Drop deprecated sudo option; use default docker compose on Travis. (#4732) [AIRFLOW-4001] Update docs about how to run tests (#4826) [AIRFLOW-3925] Don't pull docker-images on pretest (#4740) [AIRFLOW-3770] Validation of documentation on CI] (#4593) [AIRFLOW-3866] Run docker-compose pull silently in CI (#4688) [AIRFLOW-3699] Speed up Flake8 (#4515) [AIRFLOW-3685] Move licence header check (#4497) [AIRFLOW-3670] Add stages to Travis build (#4477) [AIRFLOW-3937] KubernetesPodOperator support for envFrom configMapRef and secretRef (#4772) [AIRFLOW-XXX] Update kubernetes.rst docs (#3875) [AIRFLOW-3918] Add ssh private-key support to git-sync for KubernetesExecutor (#4777) [AIRFLOW-XXX] Improvements to formatted content in documentation (#4835) [AIRFLOW-3408] Remove outdated info from Systemd Instructions (#4269) [AIRFLOW-4160] Fix redirecting of 'Trigger Dag' Button in DAG Page (#4982) [AIRFLOW-XXX] Add Daniel to committer list (#4961) [AIRFLOW-XXX] Add Xiaodong Deng to committers list [AIRFLOW-3659] Create Google Cloud Transfer Service Operators (#4792) [AIRFLOW-XXX] Add history become ASF top level project (#4757) [AIRFLOW-XXX] Move out the examples from integration.rst (#4672) [AIRFLOW-XXX] Extract reverse proxy info to a separate file (#4657) [AIRFLOW-3810] Remove duplicate autoclass directive (#4656) [AIRFLOW-3202] add missing documentation for AWS hooks/operator (#4048) [AIRFLOW-3908] Add more Google Cloud Vision operators (#4791) [AIRFLOW-2915] Add example DAG for GoogleCloudStorageToBigQueryOperator (#3763) [AIRFLOW-XXX] Reduction of the number of warnings in the documentation (#4585) [AIRFLOW-3062] Add Qubole in integration docs (#3946) [AIRFLOW-3288] Add SNS integration (#4123) [AIRFLOW-XXX] Fix GCS Operator docstrings (#4054) [AIRFLOW-3148] Remove unnecessary arg "parameters" in RedshiftToS3Transfer (#3995) [AIRFLOW-XXX] Fix Docstrings in Hooks, Sensors & Operators (#4137) [AIRFLOW-XXX] Split guide for operators to multiple files (#4814) [AIRFLOW-XXX] Split connection guide to multiple files (#4824) [AIRFLOW-XXX] Remove almost all warnings from building docs (#4588) [AIRFLOW-XXX] Add backreference in docs between operator and integration (#4671) [AIRFLOW-XXX] Improve linking to classes (#4655) [AIRFLOW-3049] Add extra operations for Mongo hook (#3890) [AIRFLOW-3559] Add missing options to DatadogHook. (#4362) [AIRFLOW-1191] Simplify override of spark submit command. (#4360) [AIRFLOW-3155] Add ability to filter by a last modified time in GCS Operator (#4008) [AIRFLOW-2864] Fix docstrings for SubDagOperator (#3712) [AIRFLOW-XXX] Mock optional modules when building docs (#4586) [AIRFLOW-3939] Add Google Cloud Translate operator (#4755) [AIRFLOW-4154] Correct string formatting in jobs.py (#4972) [AIRFLOW-XXX] Update plugin macros documentation (#4971) [AIRFLOW-XXX] Add missing docstring for 'autodetect' in GCS to BQ Operator (#4979)