James and I debugged a bit and we tracked down the problem to the multiprocessing.Manager process leaking. So I've removed the Manager entirely here https://github.com/apache/airflow/pull/5615 (whilst also not using a mp.Queue and the problems we had with unpredictable behaviour around it.)
Once this is reviewed and merged I will cut the next RC. -ash > On 22 Jul 2019, at 17:59, Ash Berlin-Taylor <[email protected]> wrote: > > Given these two issues I'm changing my vote to -1. > > Ugh, Mysql :( > > The "orphan" (they aren't zombie in the linux process sense) process is > massively exasperated but having a `--run-duration 600`, but we should try > and fix this if we can. > >> On 20 Jul 2019, at 14:55, Jarek Potiuk <[email protected]> wrote: >> >> I have another issue that might be nail-in-the-coffin for this RC3. This is >> "external" - not related to changes in RC3 but to MySQL new features. >> >> There is an issue: >> https://issues.apache.org/jira/projects/AIRFLOW/issues/AIRFLOW-4995?filter=allopenissues >> . >> created yesterday about not being able to create Airflow DB on MySQL. I >> took a look and it seems that recently released MySQL 8.0.16 added support >> for (previously ignored) CHECK constraints >> <https://mysqlserverteam.com/mysql-8-0-16-introducing-check-constraint/> >> and one of our CHECKS generates invalid BOOL check for mysql (MySQL does >> not really support BOOL columns - it emulates them with TINYINT). >> >> This means that currently stable (1.10.3) Airflow version cannot be >> installed on this latest release! The fix is rather easy (discussed in >> https://github.com/apache/airflow/pull/5614 ) but I don't think we should >> miss the opportunity to include it in 1.10.4. >> >> (BTW. And interesting point in discussion why you should not release even >> pretty much "backwards-compatible" feature in patch releases. I think it >> might hit a lot of other sqlalchemy/alembic projects). Thinking about >> writing some short blog post about it. >> >> J. >> >> >> >> >> On Sat, Jul 20, 2019 at 11:11 AM Driesprong, Fokko <[email protected]> >> wrote: >> >>> I've removed the run_duration and I'm in favor of removing num_runs as >>> well. I've noticed that the service not always exit cleanly, and left the >>> database in an inconsistent state. After restarting, some of the DagRuns >>> would not be picked up. This should not happen, but not sure if the root >>> cause is still in there since it was a while ago. For me, it feels like the >>> scheduler runs quite stable, but I don't have any numbers. >>> >>> Cheers, Fokko >>> >>> Op vr 19 jul. 2019 om 20:58 schreef Kaxil Naik <[email protected]>: >>> >>>> If you are using num_runs or run_duration, remove them. We have >>> deprecated >>>> run_duration in master (we should probably cherry-pick that in next >>>> release) - >>>> >>>> >>> https://github.com/apache/airflow/blob/30defe130df1399d8ff41a350f714af820113161/UPDATING.md#remove-run_duration >>>> (Note in updating.md) >>>> >>>> We should remove `num_runs` too and we have a jira open for that - >>>> https://jira.apache.org/jira/browse/AIRFLOW-3533 >>>> >>>> >>>> >>>> On Thu, Jul 18, 2019 at 11:15 PM James Meickle >>>> <[email protected]> wrote: >>>> >>>>> Yes, it's zombie processes owned by systemd. Here's a writeup with some >>>>> various logs: >>>>> https://gist.github.com/Eronarn/c5bc2df607d168d6fda3a70700c941d9 >>>>> >>>>> It's reproducible (lmk if you want to co-pilot on debugging), and we're >>>> up >>>>> to 3 zombies in the hour or two since our most recent reboot. So it >>> won't >>>>> immediately take a cluster down, but it is a steady resource leak that >>>>> isn't fixed by restarting the scheduler process. >>>>> >>>>> On Thu, Jul 18, 2019 at 12:31 PM Ash Berlin-Taylor <[email protected]> >>>> wrote: >>>>> >>>>>> Errk, that's not good. >>>>>> >>>>>> When you say orphaned do you mean zombie processes owned by pid 1, or >>>>> just >>>>>> "process that are hanging around?" >>>>>> >>>>>> https://github.com/apache/airflow/pull/5605 might help if it's the >>>> later >>>>>> (but I suspect it isn't) >>>>>> >>>>>> We've also had reports of the scheduler having a memory leak since >>>>> ~1.10.2 >>>>>> https://issues.apache.org/jira/browse/AIRFLOW-4593 so that may be >>> part >>>>> of >>>>>> the OOMing too. (If this is the cause of your problem then .4 isn't >>>> worse >>>>>> than .3 I don't think?) >>>>>> >>>>>> -ash >>>>>> >>>>>>> On 18 Jul 2019, at 15:54, James Meickle <[email protected] >>>>> .INVALID> >>>>>> wrote: >>>>>>> >>>>>>> Hi folks, >>>>>>> >>>>>>> Sorry to throw a wrench into this, but we're found that this >>> release >>>> is >>>>>>> leaving orphaned processes that eventually OOMing the scheduler. 4 >>>>>> clusters >>>>>>> have this problem post-upgrade, while 1 non-upgraded cluster >>> doesn't >>>>> have >>>>>>> this problem. >>>>>>> >>>>>>> In our case we're using Supervisor to manage scheduler restarts. I >>> am >>>>>> still >>>>>>> investigating whether this is an interaction with our unique >>>> Supervisor >>>>>>> config, or if it's actually purely an Airflow problem. This switch >>> to >>>>>>> multiprocessing.Manager looks like a promising avenue of >>>> investigation >>>>>>> though: >>>>>>> >>>>>> >>>>> >>>> >>> https://github.com/apache/airflow/compare/1.10.3...1.10.4rc3#diff-ced4fd65ce02db58eed692eef6e01d05L495 >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> On Wed, Jul 17, 2019 at 3:35 PM Bolke de Bruin <[email protected]> >>>>>> wrote: >>>>>>> >>>>>>>> +1, binding. >>>>>>>> >>>>>>>> Thanks ash! >>>>>>>> >>>>>>>> Verstuurd vanaf mijn iPad >>>>>>>> >>>>>>>>> Op 17 jul. 2019 om 20:45 heeft Kaxil Naik <[email protected]> >>>> het >>>>>>>> volgende geschreven: >>>>>>>>> >>>>>>>>> +1 (binding) Ran DAGs in both UIs. LGTM >>>>>>>>> >>>>>>>>> Great Job Ash. Appreciate all the effort you put into this. >>>>>>>>> >>>>>>>>> Regards, >>>>>>>>> Kaxil >>>>>>>>> >>>>>>>>> On Wed, Jul 17, 2019 at 10:30 PM Felix Uellendall >>>>>> <[email protected] >>>>>>>>> >>>>>>>>> wrote: >>>>>>>>> >>>>>>>>>> +1 (non-binding) flawlessly passed all my tests via rbac and >>>> classic >>>>>> ui. >>>>>>>>>> Also tested it on production-level dags. Great job Ash, thanks >>> :) >>>>>>>>>> >>>>>>>>>> Kind regards, >>>>>>>>>> Felix >>>>>>>>>> >>>>>>>>>> Sent from ProtonMail mobile >>>>>>>>>> >>>>>>>>>> -------- Original Message -------- >>>>>>>>>>> On Jul 17, 2019, 16:41, Ash Berlin-Taylor wrote: >>>>>>>>>>> >>>>>>>>>>> Thanks Andrii - I missed it to when reviewing the PR so it's my >>>>> fault >>>>>>>>>> too. Make the PR against the v[1-10](tel:110)-stable branch >>>> please. >>>>>>>>>>> >>>>>>>>>>> -ash >>>>>>>>>>> >>>>>>>>>>>> On 17 Jul [2019](tel:2019), at 14:25, Andrii Soldatenko < >>>>>>>>>> [email protected]> wrote: >>>>>>>>>>>> >>>>>>>>>>>> @Ash, i'll fix wrong section bug. >>>>>>>>>>>> >>>>>>>>>>>> Sorry about that. >>>>>>>>>>>> >>>>>>>>>>>> On Wed, Jul 17, [2019](tel:2019) at 4:11 PM Robin Edwards < >>>>>>>>>> [email protected]> wrote: >>>>>>>>>>>> >>>>>>>>>>>>> +1 (none binding) - been running in production since RC2. >>>>>>>>>>>>> >>>>>>>>>>>>> Thanks for all your hard work >>>>>>>>>>>>> >>>>>>>>>>>>> R >>>>>>>>>>>>> >>>>>>>>>>>>> On Tue, 16 Jul [2019](tel:2019) at 21:15, Ash Berlin-Taylor < >>>>>>>>>> [email protected]> wrote: >>>>>>>>>>>>>> >>>>>>>>>>>>>> Thanks for testing. >>>>>>>>>>>>>> >>>>>>>>>>>>>> On 1) everyone should run upgradedb on every upgrade. The >>>>>> behaviour >>>>>>>> of >>>>>>>>>>>>> not running it wasn't great. >>>>>>>>>>>>>> >>>>>>>>>>>>>> 2) I thought we set deprecation on the ES logging config >>> vars, >>>>>>>> except >>>>>>>>>> we >>>>>>>>>>>>> put the depreciation under the wrong section: >>>>>>>>>>>>> >>>>>>>>>> >>>>>>>> >>>>>> >>>>> >>>> >>> https://github.com/apache/airflow/blob/1.10.4rc3/airflow/configuration.py#L147-L153 >>>>>>>>>>>>> :( >>>>>>>>>>>>>> >>>>>>>>>>>>>> On 16 July [2019 21](tel:201921):06:40 BST, James Meickle < >>>>>>>>>> [email protected]> >>>>>>>>>>>>> wrote: >>>>>>>>>>>>>>> +1 (nonbinding) to the release, it fixes a lot of UI issues >>>>> we've >>>>>>>>>> been >>>>>>>>>>>>>>> seeing lately. Though two notes: >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> 1) Tasks were unscheduleable until I ran an upgradedb due >>> the >>>>>>>> default >>>>>>>>>>>>>>> pool >>>>>>>>>>>>>>> change. >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> 2) I got crash loops because I based our custom logging >>> file >>>>> off >>>>>> of >>>>>>>>>> the >>>>>>>>>>>>>>> previous version's template. The change to the >>> Elasticsearch >>>>> conf >>>>>>>>>>>>>>> variables >>>>>>>>>>>>>>> broke this, even though we don't directly use >>> Elasticsearch, >>>>>> since >>>>>>>> it >>>>>>>>>>>>>>> was >>>>>>>>>>>>>>> now looking for undefined conf variables. It was confusing >>>>> until >>>>>> I >>>>>>>>>>>>>>> hunted >>>>>>>>>>>>>>> around the diff and backported the changes in the default >>>>>> template >>>>>>>> to >>>>>>>>>>>>>>> the >>>>>>>>>>>>>>> template that lives in our repo. >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> On Mon, Jul 15, [2019](tel:2019) at 10:17 AM Ash >>>> Berlin-Taylor >>>>> < >>>>>>>>>> [email protected]> >>>>>>>>>>>>>>> wrote: >>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> Hello Airflow community, >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> This email is calling a vote on the release, which will >>> last >>>>> for >>>>>>>> 72 >>>>>>>>>>>>>>> hours >>>>>>>>>>>>>>>> (2019-07-08 15:15 Z), and until three binding votes have >>>> been >>>>>>>> cast. >>>>>>>>>>>>>>>> Consider this my (binding) +1. >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> Airflow [1.10.4](tel:1104) RC3 is available at: >>>>>>>>>>>>>>>> https://dist.apache.org/repos/dist/dev/airflow/1.10.4rc3/ >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> *apache-airflow-[1.10.4](tel:1104)rc3-source.tar.gz* is a >>>>> source >>>>>>>>>> release that >>>>>>>>>>>>>>> comes >>>>>>>>>>>>>>>> with INSTALL instructions. >>>>>>>>>>>>>>>> *apache-airflow-[1.10.4](tel:1104)rc3-bin.tar.gz* is the >>>>> binary >>>>>>>>>> Python "sdist" >>>>>>>>>>>>>>> release. >>>>>>>>>>>>>>>> >>> *apache_airflow-[1.10.4](tel:1104)rc3-py2.py3-none-any.whl* >>>> is >>>>>> the >>>>>>>>>> binary Python >>>>>>>>>>>>>>>> "wheel" release. >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> For connivence of testers the RC is on PYPI too. It can be >>>>>>>> installed >>>>>>>>>>>>>>> with: >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> pip install 'apache-airflow==[1.10.4](tel:1104)rc3' >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> Public keys are available at: >>>>>>>>>>>>>>>> https://dist.apache.org/repos/dist/release/airflow/KEYS >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> Only votes from PMC members are binding (sorry >>> committers), >>>>> but >>>>>>>>>>>>>>> members of >>>>>>>>>>>>>>>> the community are encouraged to test the release and vote >>>> with >>>>>>>>>>>>>>>> "(non-binding)". >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> Please note that the version number excludes the `rcX` >>>> string, >>>>>> so >>>>>>>>>>>>>>> it's now >>>>>>>>>>>>>>>> simply [1.10.4](tel:1104). This will allow us to rename >>> the >>>>>>>>>> artefact without >>>>>>>>>>>>>>> modifying >>>>>>>>>>>>>>>> the checksums when we actually release. >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> [ ] +1 Release this package as Apache Airflow >>>>> [1.10.4](tel:1104) >>>>>>>>>>>>>>>> [ ] 0 No opinion >>>>>>>>>>>>>>>> [ ] -1 Do not release this package because... >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> Changes since RC2: >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> [AIRFLOW-XXX] Update changelog for [1.10.4](tel:1104)rc3 >>>> [Ash >>>>>>>>>> Berlin-Taylor] >>>>>>>>>>>>>>>> [AIRFLOW-XXX] Disable intersphinx loading of `requests` >>>>> modules >>>>>>>>>>>>>>> (#[5590](tel:5590)) >>>>>>>>>>>>>>>> [Ash Berlin-Taylor] >>>>>>>>>>>>>>>> [AIRFLOW-[4797](tel:4797)] Improve performance and >>> behaviour >>>>> of >>>>>>>>>> zombie detection >>>>>>>>>>>>>>>> (#[5511](tel:5511)) [Stefan Seelmann] >>>>>>>>>>>>>>>> [AIRFLOW-[4911](tel:4911)] Silence the FORBIDDEN errors >>> from >>>>> the >>>>>>>>>>>>>>> KubernetesExecutor >>>>>>>>>>>>>>>> (#[5547](tel:5547)) [Andrii Soldatenko] >>>>>>>>>>>>>>>> [AIRFLOW-[4884](tel:4884)] Roll up import_errors in RBAC >>> UI >>>>>>>>>> (#[5516](tel:5516)) >>>>>>>>>>>>>>> [shuwen-zhang] >>>>>>>>>>>>>>>> [AIRFLOW-[4937](tel:4937)] Fix lodash security issue with >>>>>> version >>>>>>>>>> below [4.17.13](tel:41713) >>>>>>>>>>>>>>>> (#[5572](tel:5572)) [Jarek Potiuk] >>>>>>>>>>>>>>>> [AIRFLOW-[4934](tel:4934)] Bump Flask to resolve Werkzeug >>>>>> ProxyFix >>>>>>>>>> (#[5571](tel:5571)) >>>>>>>>>>>>>>> [Nathaniel >>>>>>>>>>>>>>>> Ritholtz] >>>>>>>>>>>>>>>> [AIRFLOW-[4934](tel:4934)] Fix ProxyFix due to Werkzeug >>>>> upgrade >>>>>>>>>> (#[5563](tel:5563)) >>>>>>>>>>>>>>> [Nathaniel >>>>>>>>>>>>>>>> Ritholtz] >>>>>>>>>>>>>>>> [AIRFLOW-[4136](tel:4136)] fix key_file of hook is >>>> overwritten >>>>>> by >>>>>>>>>> SSHHook >>>>>>>>>>>>>>> connection >>>>>>>>>>>>>>>> (#[5558](tel:5558)) [eladkal] >>>>>>>>>>>>>>>> [AIRFLOW-XXX] Correct BaseSensorOperator docs >>>>>> (#[5562](tel:5562)) >>>>>>>>>> [Matthew >>>>>>>>>>>>>>> Bowden] >>>>>>>>>>>>>>>> [AIRFLOW-[3495](tel:3495)] Validate one of query and >>>> query_uri >>>>>>>>>> passed to >>>>>>>>>>>>>>>> DataProcSparkSqlOperator (#[5510](tel:5510)) [eladkal] >>>>>>>>>>>>>>>> [AIRFLOW-[4868](tel:4868)] Fix typo in >>>>>> kubernetes/docker/build.sh >>>>>>>>>> (#[5505](tel:5505)) [Facu] >>>>>>>>>>>>>>>> [AIRFLOW-[4925](tel:4925)] Improve css style for Variables >>>>>> Import >>>>>>>>>> file field >>>>>>>>>>>>>>> (#[5552](tel:5552)) >>>>>>>>>>>>>>>> [Felix Uellendall] >>>>>>>>>>>>>>>> [AIRFLOW-[4906](tel:4906)] Improve debugging for the >>>>>>>>>> SparkSubmitHook (#[5542](tel:5542)) >>>>>>>>>>>>>>> [Fokko >>>>>>>>>>>>>>>> Driesprong] >>>>>>>>>>>>>>>> [AIRFLOW-[4904](tel:4904)] Retrieve test config file from >>>>>>>>>> $AIRFLOW_TEST_CONFIG >>>>>>>>>>>>>>> (#[5540](tel:5540)) >>>>>>>>>>>>>>>> [Matthew Rastovac] >>>>>>>>>>>>>>>> [AIRFLOW-[4926](tel:4926)] Fix example dags where its >>>>> start_date >>>>>>>> is >>>>>>>>>>>>>>> datetime.utcnow() >>>>>>>>>>>>>>>> (#[5553](tel:5553)) [Felix Uellendall] >>>>>>>>>>>>>>>> [AIRFLOW-[4587](tel:4587)] Replace self.conn with >>>>>> self.get_conn() >>>>>>>> in >>>>>>>>>>>>>>> AWSAthenaHook >>>>>>>>>>>>>>>> (#[5545](tel:5545)) [Bhavika Tekwani] >>>>>>>>>>>>>>>> [AIRFLOW-[1740](tel:1740)] Fix xcom creation and update >>> via >>>> UI >>>>>>>>>> (#[5530](tel:5530)) [Felix >>>>>>>>>>>>>>>> Uellendall] >>>>>>>>>>>>>>>> [AIRFLOW-[1740](tel:1740)] Fix xcom creation and update >>> via >>>>> RBAC >>>>>>>> UI >>>>>>>>>> (#[5561](tel:5561)) >>>>>>>>>>>>>>> [Felix >>>>>>>>>>>>>>>> Uellendall] >>>>>>>>>>>>>>>> [AIRFLOW-[4920](tel:4920)] Use html.escape instead of >>>>> cgi.escape >>>>>>>> to >>>>>>>>>> fix >>>>>>>>>>>>>>>> DeprecationWarning (#[5551](tel:5551)) [Xtreak] >>>>>>>>>>>>>>>> [AIRFLOW-[4919](tel:4919)] DataProcJobBaseOperator >>>>>>>>>> dataproc_*_properties >>>>>>>>>>>>>>> templated >>>>>>>>>>>>>>>> (#[5555](tel:5555)) [eladkal] >>>>>>>>>>>>>>>> [AIRFLOW-[4900](tel:4900)] Resolve incompatible version of >>>>>>>> Werkzeug >>>>>>>>>> (#[5535](tel:5535)) >>>>>>>>>>>>>>> [Luqman >>>>>>>>>>>>>>>> Abdul Mushawwir] >>>>>>>>>>>>>>>> [AIRFLOW-[4478](tel:4478)] Lazily instantiate default >>>>> resources >>>>>>>>>> objects. (#[5259](tel:5259)) >>>>>>>>>>>>>>>> [Joshua Carp] >>>>>>>>>>>>>>>> [AIRFLOW-[4510](tel:4510)] Don't mutate default_args >>> during >>>>> DAG >>>>>>>>>> initialization >>>>>>>>>>>>>>> (#[5277](tel:5277)) >>>>>>>>>>>>>>>> [Abhishek Ray] >>>>>>>>>>>>>>>> [AIRFLOW-[3360](tel:3360)] Make the DAGs search respect >>>> other >>>>>>>>>> querystring >>>>>>>>>>>>>>> parameters >>>>>>>>>>>>>>>> with url-search-params-polyfill for IE support >>>>>> (#[5503](tel:5503)) >>>>>>>>>> [Alex] >>>>>>>>>>>>>>>> [AIRFLOW-[4896](tel:4896)] Make KubernetesExecutorConfig's >>>>>> default >>>>>>>>>> args immutable >>>>>>>>>>>>>>>> (#[5534](tel:5534)) [Philippe Gagnon] >>>>>>>>>>>>>>>> [AIRFLOW-[4494](tel:4494)] Remove `shell=True` in >>>> DaskExecutor >>>>>>>>>> (#[5273](tel:5273)) [MisLink] >>>>>>>>>>>>>>>> [AIRFLOW-[4890](tel:4890)] Fix Log link in TaskInstance's >>>> View >>>>>> for >>>>>>>>>> Non-RBAC >>>>>>>>>>>>>>> (#[5525](tel:5525)) >>>>>>>>>>>>>>>> [Felix Uellendall] >>>>>>>>>>>>>>>> [AIRFLOW-[4892](tel:4892)] Fix connection creation via UIs >>>>>>>>>> (#[5527](tel:5527)) [Ash >>>>>>>>>>>>>>> Berlin-Taylor] >>>>>>>>>>>>>>>> [AIRFLOW-[4862](tel:4862)] Fix bug for earlier change to >>>> allow >>>>>>>>>> using IP as >>>>>>>>>>>>>>> hostname >>>>>>>>>>>>>>>> (#[5513](tel:5513)) [Xiaodong] >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> Full Changelog since [1.10.3](tel:1103): >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> Airflow [1.10.4](tel:1104), - [2019-07-18](tel:20190718) >>>>>>>>>>>>>>>> ---------------------------- >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> New Features >>>>>>>>>>>>>>>> """""""""""" >>>>>>>>>>>>>>>> - [AIRFLOW-[4884](tel:4884)] Roll up import_errors in RBAC >>>> UI >>>>>>>>>> (#[5516](tel:5516)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4871](tel:4871)] Allow creating DagRuns via >>> RBAC >>>>> UI >>>>>>>>>> (#[5507](tel:5507)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4591](tel:4591)] Make default_pool a real pool >>>>>>>>>> (#[5349](tel:5349)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4844](tel:4844)] Add optional >>>>>> is_paused_upon_creation >>>>>>>>>> argument to DAG >>>>>>>>>>>>>>>> (#[5473](tel:5473)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4456](tel:4456)] Add sub-classable >>>>>> BaseBranchOperator >>>>>>>>>> (#[5231](tel:5231)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4343](tel:4343)] Show warning in UI if >>> scheduler >>>>> is >>>>>>>> not >>>>>>>>>> running >>>>>>>>>>>>>>> (#[5127](tel:5127)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4739](tel:4739)] Add ability to arbitrarily >>>> define >>>>>>>>>> kubernetes worker >>>>>>>>>>>>>>> pod >>>>>>>>>>>>>>>> labels (#[5376](tel:5376)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4348](tel:4348)] Add GCP console link in >>>>>>>>>> BigQueryOperator (#[5195](tel:5195)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4306](tel:4306)] Global operator extra links >>>>>>>>>> (#[5094](tel:5094)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4812](tel:4812)] Add batch images annotation >>>>>>>>>> (#[5433](tel:5433)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4135](tel:4135)] Add Google Cloud Build >>> operator >>>>> and >>>>>>>>>> hook (#[5251](tel:5251)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4781](tel:4781)] Add the ability to specify >>>> ports >>>>> in >>>>>>>>>>>>>>> kubernetesOperator >>>>>>>>>>>>>>>> (#[5410](tel:5410)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4521](tel:4521)] Pause dag also pause its >>>> subdags >>>>>>>>>> (#[5283](tel:5283)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4738](tel:4738)] Enforce exampleinclude for >>>>> example >>>>>>>>>> DAGs (#[5375](tel:5375)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4326](tel:4326)] Airflow AWS SQS Operator >>>>>>>>>> (#[5110](tel:5110)) >>>>>>>>>>>>>>>> - [AIRFLOW-[3729](tel:3729)] Support "DownwardAPI" in env >>>>>>>> variables >>>>>>>>>> for >>>>>>>>>>>>>>>> KubernetesPodOperator (#[4554](tel:4554)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4585](tel:4585)] Implement Kubernetes Pod >>>> Mutation >>>>>>>> Hook >>>>>>>>>> (#[5359](tel:5359)) >>>>>>>>>>>>>>>> - [AIRFLOW-[161](tel:161)] New redirect route and extra >>>> links >>>>>>>>>> (#[5059](tel:5059)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4420](tel:4420)] Backfill respects >>>>> task_concurrency >>>>>>>>>> (#[5221](tel:5221)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4147](tel:4147)] Add Operator to publish event >>>> to >>>>>>>> Redis >>>>>>>>>> (#[4967](tel:4967)) >>>>>>>>>>>>>>>> - [AIRFLOW-[3359](tel:3359)] Add option to pass customer >>>>>>>> encryption >>>>>>>>>> keys to >>>>>>>>>>>>>>> Dataproc >>>>>>>>>>>>>>>> (#[4200](tel:4200)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4318](tel:4318)] Create Google Cloud Translate >>>>>> Speech >>>>>>>>>> Operator >>>>>>>>>>>>>>> (#[5102](tel:5102)) >>>>>>>>>>>>>>>> - [AIRFLOW-[3960](tel:3960)] Adds Google Cloud Speech >>>>> operators >>>>>>>>>> (#[4780](tel:4780)) >>>>>>>>>>>>>>>> - [AIRFLOW-[1501](tel:1501)] Add >>>>>> GoogleCloudStorageDeleteOperator >>>>>>>>>> (#[5230](tel:5230)) >>>>>>>>>>>>>>>> - [AIRFLOW-[3672](tel:3672)] Add support for Mongo DB DNS >>>>>> Seedlist >>>>>>>>>> Connection >>>>>>>>>>>>>>> Format >>>>>>>>>>>>>>>> (#[4481](tel:4481)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4397](tel:4397)] add integrations docs >>> manually >>>>> for >>>>>>>> gcs >>>>>>>>>> sensors >>>>>>>>>>>>>>> (#[5204](tel:5204)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4251](tel:4251)] Instrument DagRun schedule >>>> delay >>>>>>>>>> (#[5050](tel:5050)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4118](tel:4118)] instrument DagRun duration >>>>>>>>>> (#[4946](tel:4946)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4361](tel:4361)] Fix flaky >>>>>>>>>>>>>>> test_integration_run_dag_with_scheduler_failure >>>>>>>>>>>>>>>> (#[5182](tel:5182)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4361](tel:4361)] Fix flaky >>>>>>>>>>>>>>> test_integration_run_dag_with_scheduler_failure >>>>>>>>>>>>>>>> (#[5140](tel:5140)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4168](tel:4168)] Create Google Cloud Video >>>>>>>> Intelligence >>>>>>>>>> Operators >>>>>>>>>>>>>>> (#[4985](tel:4985)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4397](tel:4397)] Add >>>>> GCSUploadSessionCompleteSensor >>>>>>>>>> (#[5166](tel:5166)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4335](tel:4335)] Add default num_retries to >>> GCP >>>>>>>>>> connection (#[5117](tel:5117)) >>>>>>>>>>>>>>>> - [AIRFLOW-[3808](tel:3808)] Add cluster_fields to >>>>>> BigQueryHook's >>>>>>>>>>>>>>> create_empty_table >>>>>>>>>>>>>>>> (#[4654](tel:4654)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4362](tel:4362)] Fix >>>>>>>> test_execution_limited_parallelism >>>>>>>>>> (#[5141](tel:5141)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4307](tel:4307)] Backfill respects concurrency >>>>> limit >>>>>>>>>> (#[5128](tel:5128)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4268](tel:4268)] Add >>>>>> MsSqlToGoogleCloudStorageOperator >>>>>>>>>> (#[5077](tel:5077)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4169](tel:4169)] Add Google Cloud Vision >>> Detect >>>>>>>>>> Operators (#[4986](tel:4986)) >>>>>>>>>>>>>>>> - [AIRFLOW-XXX] Fix WS-[2019-0032](tel:20190032) >>>>>>>> (#[5384](tel:5384)) >>>>>>>>>>>>>>>> - [AIRFLOW-XXX] Fix CVE-[2019-11358](tel:201911358) >>>>>>>>>> (#[5197](tel:5197)) >>>>>>>>>>>>>>>> - [AIRFLOW-XXX] Change allowed version of Jinja2 to fix >>>>>>>>>>>>>>> CVE-[2019-10906](tel:201910906) >>>>>>>>>>>>>>>> (#[5075](tel:5075)) >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> Improvement >>>>>>>>>>>>>>>> """"""""""" >>>>>>>>>>>>>>>> - [AIRFLOW-[4797](tel:4797)] Improve performance and >>>> behaviour >>>>>> of >>>>>>>>>> zombie >>>>>>>>>>>>>>> detection >>>>>>>>>>>>>>>> (#[5511](tel:5511)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4911](tel:4911)] Silence the FORBIDDEN errors >>>> from >>>>>> the >>>>>>>>>>>>>>> KubernetesExecutor >>>>>>>>>>>>>>>> (#[5547](tel:5547)) >>>>>>>>>>>>>>>> - [AIRFLOW-[3495](tel:3495)] Validate one of query and >>>>> query_uri >>>>>>>>>> passed to >>>>>>>>>>>>>>>> DataProcSparkSqlOperator (#[5510](tel:5510)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4925](tel:4925)] Improve css style for >>> Variables >>>>>>>> Import >>>>>>>>>> file field >>>>>>>>>>>>>>> (#[5552](tel:5552)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4906](tel:4906)] Improve debugging for the >>>>>>>>>> SparkSubmitHook (#[5542](tel:5542)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4904](tel:4904)] unittest.cfg name and path >>> can >>>> be >>>>>>>>>> overriden by >>>>>>>>>>>>>>> setting >>>>>>>>>>>>>>>> $AIRFLOW_TEST_CONFIG (#[5540](tel:5540)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4920](tel:4920)] Use html.escape instead of >>>>>> cgi.escape >>>>>>>>>> to fix >>>>>>>>>>>>>>>> DeprecationWarning (#[5551](tel:5551)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4919](tel:4919)] DataProcJobBaseOperator >>>>>>>>>> dataproc_*_properties >>>>>>>>>>>>>>> templated >>>>>>>>>>>>>>>> (#[5555](tel:5555)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4478](tel:4478)] Lazily instantiate default >>>>>> resources >>>>>>>>>> objects. >>>>>>>>>>>>>>> (#[5259](tel:5259)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4564](tel:4564)] AzureContainerInstance >>> bugfixes >>>>> and >>>>>>>>>> improvements >>>>>>>>>>>>>>> (#[5319](tel:5319)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4237](tel:4237)] Including Try Number of Task >>> in >>>>>> Gantt >>>>>>>>>> Chart (#[5037](tel:5037)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4862](tel:4862)] Allow directly using IP >>> address >>>>> as >>>>>>>>>> hostname for >>>>>>>>>>>>>>> webserver >>>>>>>>>>>>>>>> logs (#[5501](tel:5501)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4857](tel:4857)] Add templated fields to >>>>>>>>>> SlackWebhookOperator (#[5490](tel:5490)) >>>>>>>>>>>>>>>> - [AIRFLOW-[3502](tel:3502)] Add celery config option for >>>>>> setting >>>>>>>>>> "pool" (#[4308](tel:4308)) >>>>>>>>>>>>>>>> - [AIRFLOW-[3217](tel:3217)] Button to toggle line >>> wrapping >>>> in >>>>>> log >>>>>>>>>> and code views >>>>>>>>>>>>>>>> (#[4277](tel:4277)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4491](tel:4491)] Add a "Jump to end" button >>> for >>>>> logs >>>>>>>>>> (#[5266](tel:5266)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4422](tel:4422)] Pool utilization stats >>>>>>>>>> (#[5453](tel:5453)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4805](tel:4805)] Add py_file as templated >>> field >>>> in >>>>>>>>>>>>>>> DataflowPythonOperator >>>>>>>>>>>>>>>> (#[5451](tel:5451)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4838](tel:4838)] Surface Athena errors in >>>>>>>>>> AWSAthenaOperator (#[5467](tel:5467)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4831](tel:4831)] conf.has_option no longer >>>> throws >>>>> if >>>>>>>>>> section is >>>>>>>>>>>>>>> missing. >>>>>>>>>>>>>>>> (#[5455](tel:5455)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4829](tel:4829)] More descriptive exceptions >>> for >>>>> EMR >>>>>>>>>> sensors (#[5452](tel:5452)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4414](tel:4414)] AWSAthenaOperator: Push >>>>>>>>>> QueryExecutionID to XCom >>>>>>>>>>>>>>> (#[5276](tel:5276)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4791](tel:4791)] add "schema" keyword arg to >>>>>>>>>> SnowflakeOperator >>>>>>>>>>>>>>> (#[5415](tel:5415)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4759](tel:4759)] Don't error when marking >>>>> sucessful >>>>>>>> run >>>>>>>>>> as failed >>>>>>>>>>>>>>> (#[5435](tel:5435)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4716](tel:4716)] Instrument dag loading time >>>>>> duration >>>>>>>>>> (#[5350](tel:5350)) >>>>>>>>>>>>>>>> - [AIRFLOW-[3958](tel:3958)] Support list tasks as >>> upstream >>>> in >>>>>>>>>> chain (#[4779](tel:4779)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4409](tel:4409)] Prevent task duration break >>> by >>>>> null >>>>>>>>>> value (#[5178](tel:5178)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4418](tel:4418)] Add "failed only" option to >>>> task >>>>>>>> modal >>>>>>>>>> (#[5193](tel:5193)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4740](tel:4740)] Accept string ``end_date`` in >>>> DAG >>>>>>>>>> default_args >>>>>>>>>>>>>>> (#[5381](tel:5381)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4423](tel:4423)] Improve date handling in >>> mysql >>>> to >>>>>> gcs >>>>>>>>>> operator. >>>>>>>>>>>>>>> (#[5196](tel:5196)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4447](tel:4447)] Display task duration as >>> human >>>>>>>>>> friendly format in UI >>>>>>>>>>>>>>>> (#[5218](tel:5218)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4377](tel:4377)] Remove needless object >>>> conversion >>>>>> in >>>>>>>>>> DAG.owner() >>>>>>>>>>>>>>> (#[5144](tel:5144)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4766](tel:4766)] Add autoscaling option for >>>>>>>>>>>>>>> DataprocClusterCreateOperator >>>>>>>>>>>>>>>> (#[5425](tel:5425)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4795](tel:4795)] Upgrade alembic to latest >>>>> release. >>>>>>>>>> (#[5411](tel:5411)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4793](tel:4793)] Add signature_name to >>> mlengine >>>>>>>>>> operator (#[5417](tel:5417)) >>>>>>>>>>>>>>>> - [AIRFLOW-[3211](tel:3211)] Reattach to GCP Dataproc jobs >>>>> upon >>>>>>>>>> Airflow restart >>>>>>>>>>>>>>>> (#[4083](tel:4083)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4750](tel:4750)] Log identified zombie task >>>>>> instances >>>>>>>>>> (#[5389](tel:5389)) >>>>>>>>>>>>>>>> - [AIRFLOW-[3870](tel:3870)] STFPOperator: Update log >>> level >>>>> and >>>>>>>>>> return value >>>>>>>>>>>>>>> (#[4355](tel:4355)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4759](tel:4759)] Batch queries in set_state >>> API. >>>>>>>>>> (#[5403](tel:5403)) >>>>>>>>>>>>>>>> - [AIRFLOW-[2737](tel:2737)] Restore original license >>> header >>>>> to >>>>>>>>>>>>>>>> airflow.api.auth.backend.kerberos_auth >>>>>>>>>>>>>>>> - [AIRFLOW-[3635](tel:3635)] Fix incorrect logic in >>>> detele_dag >>>>>>>>>> (introduced in >>>>>>>>>>>>>>> PR#[4406](tel:4406)) >>>>>>>>>>>>>>>> (#[4445](tel:4445)) >>>>>>>>>>>>>>>> - [AIRFLOW-[3599](tel:3599)] Removed Dagbag from delete >>> dag >>>>>>>>>> (#[4406](tel:4406)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4737](tel:4737)] Increase and document celery >>>>> queue >>>>>>>>>> name limit >>>>>>>>>>>>>>> (#[5383](tel:5383)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4505](tel:4505)] Correct Tag ALL for PY3 >>>>>>>>>> (#[5275](tel:5275)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4743](tel:4743)] Add environment variables >>>> support >>>>>> to >>>>>>>>>> SSHOperator >>>>>>>>>>>>>>> (#[5385](tel:5385)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4725](tel:4725)] Fix setup.py >>> PEP[440](tel:440) >>>> & >>>>>>>>>> Sphinx-PyPI-upload dependency >>>>>>>>>>>>>>>> (#[5363](tel:5363)) >>>>>>>>>>>>>>>> - [AIRFLOW-[3370](tel:3370)] Add stdout output options to >>>>>>>>>> Elasticsearch task log >>>>>>>>>>>>>>>> handler (#[5048](tel:5048)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4396](tel:4396)] Provide a link to external >>>>>>>>>> Elasticsearch logs in UI. >>>>>>>>>>>>>>>> (#[5164](tel:5164)) >>>>>>>>>>>>>>>> - [AIRFLOW-[1381](tel:1381)] Allow setting host temporary >>>>>>>> directory >>>>>>>>>> in >>>>>>>>>>>>>>> DockerOperator >>>>>>>>>>>>>>>> (#[5369](tel:5369)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4598](tel:4598)] Task retries are not >>> exhausted >>>>> for >>>>>>>> K8s >>>>>>>>>> executor >>>>>>>>>>>>>>> (#[5347](tel:5347)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4218](tel:4218)] Support to Provide http args >>> to >>>>>>>>>> K8executor while >>>>>>>>>>>>>>> calling >>>>>>>>>>>>>>>> k8 python client lib apis (#[5060](tel:5060)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4159](tel:4159)] Add support for additional >>>> static >>>>>> pod >>>>>>>>>> labels for >>>>>>>>>>>>>>>> K8sExecutor (#[5134](tel:5134)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4720](tel:4720)] Allow comments in >>>> .airflowignore >>>>>>>>>> files. (#[5355](tel:5355)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4486](tel:4486)] Add AWS IAM authenication in >>>>>>>> MySqlHook >>>>>>>>>> (#[5334](tel:5334)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4417](tel:4417)] Add AWS IAM authenication for >>>>>>>>>> PostgresHook (#[5223](tel:5223)) >>>>>>>>>>>>>>>> - [AIRFLOW-[3990](tel:3990)] Compile regular expressions. >>>>>>>>>> (#[4813](tel:4813)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4572](tel:4572)] Rename prepare_classpath() to >>>>>>>>>> prepare_syspath() >>>>>>>>>>>>>>> (#[5328](tel:5328)) >>>>>>>>>>>>>>>> - [AIRFLOW-[3869](tel:3869)] Raise consistent exception in >>>>>>>>>>>>>>>> AirflowConfigParser.getboolean (#[4692](tel:4692)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4571](tel:4571)] Add headers to templated >>> field >>>>> for >>>>>>>>>>>>>>> SimpleHttpOperator >>>>>>>>>>>>>>>> (#[5326](tel:5326)) >>>>>>>>>>>>>>>> - [AIRFLOW-[3867](tel:3867)] Rename GCP's subpackage >>>>>>>>>> (#[4690](tel:4690)) >>>>>>>>>>>>>>>> - [AIRFLOW-[3725](tel:3725)] Add private_key to >>>> bigquery_hook >>>>>>>>>> get_pandas_df >>>>>>>>>>>>>>> (#[4549](tel:4549)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4546](tel:4546)] Upgrade >>> google-cloud-bigtable. >>>>>>>>>> (#[5307](tel:5307)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4519](tel:4519)] Optimise operator classname >>>>> sorting >>>>>>>> in >>>>>>>>>> views (#[5282](tel:5282)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4503](tel:4503)] Support fully pig options >>>>>>>>>> (#[5271](tel:5271)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4468](tel:4468)] add sql_alchemy_max_overflow >>>>>>>> parameter >>>>>>>>>> (#[5249](tel:5249)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4467](tel:4467)] Add dataproc_jars to >>> templated >>>>>> fields >>>>>>>>>> in Dataproc >>>>>>>>>>>>>>> oper… >>>>>>>>>>>>>>>> (#[5248](tel:5248)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4381](tel:4381)] Use get_direct_relative_ids >>> get >>>>>> task >>>>>>>>>> relatives >>>>>>>>>>>>>>> (#[5147](tel:5147)) >>>>>>>>>>>>>>>> - [AIRFLOW-[3624](tel:3624)] Add masterType parameter to >>>>>>>>>> MLEngineTrainingOperator >>>>>>>>>>>>>>>> (#[4428](tel:4428)) >>>>>>>>>>>>>>>> - [AIRFLOW-[3143](tel:3143)] Support Auto-Zone in >>>>>>>>>> DataprocClusterCreateOperator >>>>>>>>>>>>>>> (#[5169](tel:5169)) >>>>>>>>>>>>>>>> - [AIRFLOW-[3874](tel:3874)] Improve >>>>>>>>>> BigQueryHook.run_with_configuration's >>>>>>>>>>>>>>> location >>>>>>>>>>>>>>>> support (#[4695](tel:4695)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4399](tel:4399)] Avoid duplicated >>>> os.path.isfile() >>>>>>>>>> check in >>>>>>>>>>>>>>> models.dagbag >>>>>>>>>>>>>>>> (#[5165](tel:5165)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4031](tel:4031)] Allow for key pair auth in >>>>>> snowflake >>>>>>>>>> hook (#[4875](tel:4875)) >>>>>>>>>>>>>>>> - [AIRFLOW-[3901](tel:3901)] add role as optional config >>>>>> parameter >>>>>>>>>> for >>>>>>>>>>>>>>> SnowflakeHook >>>>>>>>>>>>>>>> (#[4721](tel:4721)) >>>>>>>>>>>>>>>> - [AIRFLOW-[3455](tel:3455)] add region in snowflake >>>> connector >>>>>>>>>> (#[4285](tel:4285)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4073](tel:4073)] add template_ext for AWS >>> Athena >>>>>>>>>> operator (#[4907](tel:4907)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4093](tel:4093)] AWSAthenaOperator: Throw >>>>> exception >>>>>> if >>>>>>>>>> job >>>>>>>>>>>>>>>> failed/cancelled/reach max retries (#[4919](tel:4919)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4356](tel:4356)] Add extra RuntimeEnvironment >>>> keys >>>>>> to >>>>>>>>>> DataFlowHook >>>>>>>>>>>>>>> (#[5149](tel:5149)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4337](tel:4337)] Fix docker-compose >>> deprecation >>>>>>>> warning >>>>>>>>>> in CI (#[5119](tel:5119)) >>>>>>>>>>>>>>>> - [AIRFLOW-[3603](tel:3603)] QuboleOperator: Remove >>>> SQLCommand >>>>>>>> from >>>>>>>>>> SparkCmd >>>>>>>>>>>>>>>> documentation (#[4411](tel:4411)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4328](tel:4328)] Fix link to task instances >>> from >>>>>> Pool >>>>>>>>>> page (#[5124](tel:5124)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4255](tel:4255)] Make GCS Hook Backwards >>>>> compatible >>>>>>>>>> (#[5089](tel:5089)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4103](tel:4103)] Allow uppercase letters in >>>>> dataflow >>>>>>>>>> job names >>>>>>>>>>>>>>> (#[4925](tel:4925)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4255](tel:4255)] Replace Discovery based api >>>> with >>>>>>>>>> client based for >>>>>>>>>>>>>>> GCS >>>>>>>>>>>>>>>> (#[5054](tel:5054)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4311](tel:4311)] Remove sleep in localexecutor >>>>>>>>>> (#[5096](tel:5096)) >>>>>>>>>>>>>>>> - [AIRFLOW-[2836](tel:2836)] Minor >>>>>>>>>> improvement-contrib.sensors.FileSensor (#[3674](tel:3674)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4104](tel:4104)] Add type annotations to >>> common >>>>>>>>>> classes. (#[4926](tel:4926)) >>>>>>>>>>>>>>>> - [AIRFLOW-[3910](tel:3910)] Raise exception explicitly in >>>>>>>>>> Connection.get_hook() >>>>>>>>>>>>>>>> (#[4728](tel:4728)) >>>>>>>>>>>>>>>> - [AIRFLOW-[3322](tel:3322)] Update QuboleHook to fetch >>> args >>>>>>>>>> dynamically from >>>>>>>>>>>>>>> qds_sdk >>>>>>>>>>>>>>>> (#[4165](tel:4165)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4565](tel:4565)] instrument celery executor >>>>>>>>>> (#[5321](tel:5321)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4573](tel:4573)] Import airflow_local_settings >>>>> after >>>>>>>>>>>>>>> prepare_classpath >>>>>>>>>>>>>>>> (#[5330](tel:5330)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4448](tel:4448)] Don't bake ENV and _cmd into >>>> tmp >>>>>>>>>> config for non-sudo >>>>>>>>>>>>>>>> (#[4050](tel:4050)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4295](tel:4295)] Make ``method`` attribute >>> case >>>>>>>>>> insensitive in >>>>>>>>>>>>>>> HttpHook >>>>>>>>>>>>>>>> (#[5313](tel:5313)) >>>>>>>>>>>>>>>> - [AIRFLOW-[3703](tel:3703)] Add dnsPolicy option for >>>>>>>>>> KubernetesPodOperator >>>>>>>>>>>>>>> (#[4520](tel:4520)) >>>>>>>>>>>>>>>> - [AIRFLOW-[3057](tel:3057)] add prev_*_date_success to >>>>> template >>>>>>>>>> context (#[5372](tel:5372)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4336](tel:4336)] Stop showing entire GCS files >>>>> bytes >>>>>>>> in >>>>>>>>>> log for >>>>>>>>>>>>>>>> gcs_download_operator (#[5151](tel:5151)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4528](tel:4528)] Cancel DataProc task on >>> timeout >>>>>>>>>> (#[5293](tel:5293)) >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> Bug fixes >>>>>>>>>>>>>>>> """"""""" >>>>>>>>>>>>>>>> - [AIRFLOW-[4934](tel:4934)] Fix ProxyFix due to Werkzeug >>>>>> upgrade >>>>>>>>>> (#[5563](tel:5563)) (#[5571](tel:5571)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4136](tel:4136)] fix key_file of hook is >>>>> overwritten >>>>>>>> by >>>>>>>>>> SSHHook >>>>>>>>>>>>>>> connection >>>>>>>>>>>>>>>> (#[5558](tel:5558)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4587](tel:4587)] Replace self.conn with >>>>>>>> self.get_conn() >>>>>>>>>> in >>>>>>>>>>>>>>> AWSAthenaHook >>>>>>>>>>>>>>>> (#[5545](tel:5545)) >>>>>>>>>>>>>>>> - [AIRFLOW-[1740](tel:1740)] Fix xcom creation and update >>>> via >>>>> UI >>>>>>>>>> (#[5530](tel:5530)) (#[5531](tel:5531)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4900](tel:4900)] Resolve incompatible version >>> of >>>>>>>>>> Werkzeug (#[5535](tel:5535)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4510](tel:4510)] Don't mutate default_args >>>> during >>>>>> DAG >>>>>>>>>> initialization >>>>>>>>>>>>>>>> (#[5277](tel:5277)) >>>>>>>>>>>>>>>> - [AIRFLOW-[3360](tel:3360)] Make the DAGs search respect >>>>> other >>>>>>>>>> querystring >>>>>>>>>>>>>>> parameters >>>>>>>>>>>>>>>> with url-search-params-polyfill for IE support >>>>>> (#[5503](tel:5503)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4896](tel:4896)] Make >>> KubernetesExecutorConfig's >>>>>>>>>> default args >>>>>>>>>>>>>>> immutable >>>>>>>>>>>>>>>> (#[5534](tel:5534)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4494](tel:4494)] Remove ``shell=True`` in >>>>>> DaskExecutor >>>>>>>>>> (#[5273](tel:5273)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4890](tel:4890)] Fix Log link in >>> TaskInstance's >>>>> View >>>>>>>>>> for Non-RBAC >>>>>>>>>>>>>>> (#[5525](tel:5525)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4892](tel:4892)] Fix connection creation via >>> UIs >>>>>>>>>> (#[5527](tel:5527)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4406](tel:4406)] Fix a method name typo: >>>>>>>>>> NullFernet.decrpyt to >>>>>>>>>>>>>>> decrypt >>>>>>>>>>>>>>>> (#[5509](tel:5509)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4849](tel:4849)] Add gcp_conn_id to >>>>>> cloudsqldatabehook >>>>>>>>>> class to use >>>>>>>>>>>>>>>> correctly CloudSqlProxyRunner class (#[5478](tel:5478)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4769](tel:4769)] Pass gcp_conn_id to >>>> BigtableHook >>>>>>>>>> (#[5445](tel:5445)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4524](tel:4524)] Fix incorrect field names in >>>> view >>>>>> for >>>>>>>>>> Mark >>>>>>>>>>>>>>>> Success/Failure (#[5486](tel:5486)) >>>>>>>>>>>>>>>> - [AIRFLOW-[3671](tel:3671)] Remove arg ``replace`` of >>>>>>>>>> MongoToS3Operator from >>>>>>>>>>>>>>>> ``kwargs`` (#[4480](tel:4480)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4845](tel:4845)] Fix bug where runAsUser 0 >>>> doesn't >>>>>> get >>>>>>>>>> set in k8s >>>>>>>>>>>>>>> security >>>>>>>>>>>>>>>> context (#[5474](tel:5474)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4354](tel:4354)] Fix exception in "between" >>> date >>>>>>>> filter >>>>>>>>>> in classic UI >>>>>>>>>>>>>>>> (#[5480](tel:5480)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4587](tel:4587)] Replace self.conn with >>>>>>>> self.get_conn() >>>>>>>>>> in >>>>>>>>>>>>>>> AWSAthenaHook >>>>>>>>>>>>>>>> (#[5462](tel:5462)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4516](tel:4516)] K8s runAsUser and fsGroup >>>> cannot >>>>> be >>>>>>>>>> strings (#[5429](tel:5429)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4298](tel:4298)] Stop Scheduler repeatedly >>>> warning >>>>>>>>>> "connection >>>>>>>>>>>>>>>> invalidated" (#[5470](tel:5470)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4559](tel:4559)] JenkinsJobTriggerOperator >>>> bugfix >>>>>>>>>> (#[5318](tel:5318)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4841](tel:4841)] Pin Sphinx AutoApi to >>>>>>>> [1.0.0](tel:100) >>>>>>>>>> (#[5468](tel:5468)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4479](tel:4479)] Include s3_overwrite kwarg in >>>>>>>>>> load_bytes method >>>>>>>>>>>>>>> (#[5312](tel:5312)) >>>>>>>>>>>>>>>> - [AIRFLOW-[3746](tel:3746)] Fix DockerOperator missing >>>>>> container >>>>>>>>>> exit (#[4583](tel:4583)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4233](tel:4233)] Remove Template Extension >>> from >>>> Bq >>>>>> to >>>>>>>>>> GCS Operator >>>>>>>>>>>>>>> (#[5456](tel:5456)) >>>>>>>>>>>>>>>> - >>>>>>>>>> >>>>>>>> >>>>>> >>>>> >>>> >>> [AIRFLOW-[2141](tel:2141)][AIRFLOW-[3157](tel:3157)][AIRFLOW-[4170](tel:4170)] >>>>>>>>>> Serialize non-str value >>>>>>>>>>>>>>> by >>>>>>>>>>>>>>>> JSON when importing Variables (#[4991](tel:4991)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4826](tel:4826)] Remove warning from ``airflow >>>>>>>>>> resetdb`` command >>>>>>>>>>>>>>> (#[5447](tel:5447)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4148](tel:4148)] Fix editing DagRuns when >>>> clicking >>>>>>>>>> state column >>>>>>>>>>>>>>> (#[5436](tel:5436)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4455](tel:4455)] dag_details broken for >>> subdags >>>> in >>>>>>>> RBAC >>>>>>>>>> UI (#[5234](tel:5234)) >>>>>>>>>>>>>>>> - [AIRFLOW-[2955](tel:2955)] Fix kubernetes pod operator >>> to >>>>> set >>>>>>>>>> requests and >>>>>>>>>>>>>>> limits on >>>>>>>>>>>>>>>> task pods (#[4551](tel:4551)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4459](tel:4459)] Fix wrong DAG count in /home >>>> page >>>>>>>> when >>>>>>>>>> DAG count is >>>>>>>>>>>>>>> zero >>>>>>>>>>>>>>>> (#[5235](tel:5235)) >>>>>>>>>>>>>>>> - [AIRFLOW-[3876](tel:3876)] AttributeError: module >>>>> 'distutils' >>>>>>>> has >>>>>>>>>> no attribute >>>>>>>>>>>>>>> 'util' >>>>>>>>>>>>>>>> - [AIRFLOW-[4146](tel:4146)] Fix CgroupTaskRunner errors >>>>>>>>>> (#[5224](tel:5224)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4524](tel:4524)] Fix bug with "Ignore \*" >>>> toggles >>>>> in >>>>>>>>>> RBAC mode >>>>>>>>>>>>>>> (#[5378](tel:5378)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4765](tel:4765)] Fix DataProcPigOperator >>> execute >>>>>>>> method >>>>>>>>>> (#[5426](tel:5426)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4798](tel:4798)] obviate interdependencies for >>>>>> dagbag >>>>>>>>>> and TI tests >>>>>>>>>>>>>>> (#[5422](tel:5422)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4800](tel:4800)] fix GKEClusterHook ctor calls >>>>>>>>>> (#[5424](tel:5424)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4799](tel:4799)] don't mutate self.env in >>>>>> BashOperator >>>>>>>>>> execute method >>>>>>>>>>>>>>>> (#[5421](tel:5421)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4393](tel:4393)] Add retry logic when fetching >>>> pod >>>>>>>>>> status and/or logs >>>>>>>>>>>>>>> in >>>>>>>>>>>>>>>> KubernetesPodOperator (#[5284](tel:5284)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4174](tel:4174)] Fix HttpHook run with backoff >>>>>>>>>> (#[5213](tel:5213)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4463](tel:4463)] Handle divide-by-zero errors >>> in >>>>>> short >>>>>>>>>> retry >>>>>>>>>>>>>>> intervals >>>>>>>>>>>>>>>> (#[5243](tel:5243)) >>>>>>>>>>>>>>>> - [AIRFLOW-[2614](tel:2614)] Speed up trigger_dag API call >>>>> when >>>>>>>>>> lots of DAGs in >>>>>>>>>>>>>>> system >>>>>>>>>>>>>>>> - [AIRFLOW-[4756](tel:4756)] add ti.state to ti.start_date >>>> as >>>>>>>>>> criteria for gantt >>>>>>>>>>>>>>>> (#[5399](tel:5399)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4760](tel:4760)] Fix zip-packaged DAGs >>>>> disappearing >>>>>>>>>> from DagBag when >>>>>>>>>>>>>>>> reloaded (#[5404](tel:5404)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4731](tel:4731)] Fix GCS hook with >>>>>>>>>> google-storage-client [1.16](tel:116) (#[5368](tel:5368)) >>>>>>>>>>>>>>>> - [AIRFLOW-[3506](tel:3506)] use match_phrase to query >>>> log_id >>>>> in >>>>>>>>>> elasticsearch >>>>>>>>>>>>>>> (#[4342](tel:4342)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4084](tel:4084)] fix ElasticSearch log >>> download >>>>>>>>>> (#[5177](tel:5177)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4501](tel:4501)] Register pendulum datetime >>>>>> converter >>>>>>>>>> for >>>>>>>>>>>>>>> sqla+pymysql >>>>>>>>>>>>>>>> (#[5190](tel:5190)) >>>>>>>>>>>>>>>> - [AIRFLOW-[986](tel:986)] HiveCliHook ignores >>> 'proxy_user' >>>>>> value >>>>>>>>>> in a >>>>>>>>>>>>>>> connection's >>>>>>>>>>>>>>>> extra parameter (#[5305](tel:5305)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4442](tel:4442)] fix hive_tblproperties in >>>>>>>>>> HiveToDruidTransfer >>>>>>>>>>>>>>> (#[5211](tel:5211)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4557](tel:4557)] Add gcp_conn_id parameter to >>>>>>>>>> get_sqlproxy_runner() >>>>>>>>>>>>>>> of >>>>>>>>>>>>>>>> CloudSqlDatabaseHook (#[5314](tel:5314)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4545](tel:4545)] Upgrade FAB to latest version >>>>>>>>>> (#[4955](tel:4955)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4492](tel:4492)] Change Dataproc Cluster >>>> operators >>>>>> to >>>>>>>>>> poll Operations >>>>>>>>>>>>>>>> (#[5269](tel:5269)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4452](tel:4452)] Webserver and Scheduler keep >>>>>> crashing >>>>>>>>>> because of >>>>>>>>>>>>>>>> slackclient update (#[5225](tel:5225)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4450](tel:4450)] Fix request arguments in >>>>>>>>>> has_dag_access (#[5220](tel:5220)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4434](tel:4434)] Support Impala with the >>>>>>>>>> HiveServer2Hook (#[5206](tel:5206)) >>>>>>>>>>>>>>>> - [AIRFLOW-[3449](tel:3449)] Write local dag parsing logs >>>> when >>>>>>>>>> remote logging >>>>>>>>>>>>>>> enabled. >>>>>>>>>>>>>>>> (#[5175](tel:5175)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4300](tel:4300)] Fix graph modal call when DAG >>>> has >>>>>> not >>>>>>>>>> yet run >>>>>>>>>>>>>>> (#[5185](tel:5185)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4401](tel:4401)] Use managers for Queue >>>>>>>> synchronization >>>>>>>>>> (#[5200](tel:5200)) >>>>>>>>>>>>>>>> - [AIRFLOW-[3626](tel:3626)] Fixed triggering DAGs >>> contained >>>>>>>> within >>>>>>>>>> zip files >>>>>>>>>>>>>>> (#[4439](tel:4439)) >>>>>>>>>>>>>>>> - [AIRFLOW-[3720](tel:3720)] Fix missmatch while comparing >>>> GCS >>>>>> and >>>>>>>>>> S3 files >>>>>>>>>>>>>>> (#[4766](tel:4766)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4403](tel:4403)] search by ``dag_id`` or >>>>> ``owners`` >>>>>> in >>>>>>>>>> UI (#[5184](tel:5184)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4308](tel:4308)] Fix TZ-loop around DST on >>>> python >>>>>> 3.6+ >>>>>>>>>> (#[5095](tel:5095)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4324](tel:4324)] fix DAG fuzzy search in RBAC >>> UI >>>>>>>>>> (#[5131](tel:5131)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4297](tel:4297)] Temporary hot fix on >>>>> manage_slas() >>>>>>>> for >>>>>>>>>> [1.10.4](tel:1104) >>>>>>>>>>>>>>> release >>>>>>>>>>>>>>>> (#[5150](tel:5150)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4299](tel:4299)] Upgrade to Celery >>>>> [4.3.0](tel:430) >>>>>> to >>>>>>>>>> fix crashing workers >>>>>>>>>>>>>>> (#[5116](tel:5116)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4291](tel:4291)] Correctly render doc_md in >>> DAG >>>>>> graph >>>>>>>>>> page (#[5121](tel:5121)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4310](tel:4310)] Fix incorrect link on Dag >>>> Details >>>>>>>> page >>>>>>>>>> (#[5122](tel:5122)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4331](tel:4331)] Correct filter for Null-state >>>>> runs >>>>>>>>>> from Dag Detail >>>>>>>>>>>>>>> page >>>>>>>>>>>>>>>> (#[5123](tel:5123)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4294](tel:4294)] Fix missing dag & task runs >>> in >>>> UI >>>>>>>>>> dag_id contains a >>>>>>>>>>>>>>> dot >>>>>>>>>>>>>>>> (#[5111](tel:5111)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4332](tel:4332)] Upgrade sqlalchemy to remove >>>>>> security >>>>>>>>>> Vulnerability >>>>>>>>>>>>>>>> (#[5113](tel:5113)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4312](tel:4312)] Add template_fields & >>>>> template_ext >>>>>> to >>>>>>>>>>>>>>> BigQueryCheckO… >>>>>>>>>>>>>>>> (#[5097](tel:5097)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4293](tel:4293)] Fix downgrade in >>>>>>>>>>>>>>>> d4ecb8fbee3_add_schedule_interval_to_dag.py >>>>> (#[5086](tel:5086)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4267](tel:4267)] Fix TI duration in Graph View >>>>>>>>>> (#[5071](tel:5071)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4163](tel:4163)] IntervalCheckOperator >>> supports >>>>>>>>>> relative diff and not >>>>>>>>>>>>>>>> ignore 0 (#[4983](tel:4983)) >>>>>>>>>>>>>>>> - [AIRFLOW-[3938](tel:3938)] QuboleOperator Fixes and >>>> Support >>>>>> for >>>>>>>>>> SqlCommand >>>>>>>>>>>>>>> (#[4832](tel:4832)) >>>>>>>>>>>>>>>> - [AIRFLOW-[2903](tel:2903)] Change default owner to >>>>> ``airflow`` >>>>>>>>>> (#[4151](tel:4151)) >>>>>>>>>>>>>>>> - [aIRFLOW-[4136](tel:4136)] Fix overwrite of key_file by >>>>>>>>>> constructor (#[5155](tel:5155)) >>>>>>>>>>>>>>>> - [AIRFLOW-[3241](tel:3241)] Remove Invalid template ext >>> in >>>>> GCS >>>>>>>>>> Sensors (#[4076](tel:4076)) >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> Misc/Internal >>>>>>>>>>>>>>>> """"""""""""" >>>>>>>>>>>>>>>> - [AIRFLOW-[4937](tel:4937)] Fix lodash security issue >>> with >>>>>>>> version >>>>>>>>>> below [4.17.13](tel:41713) >>>>>>>>>>>>>>>> (#[5572](tel:5572)) (used only in build-pipeline, not >>>> runtime) >>>>>>>>>>>>>>>> - [AIRFLOW-[4868](tel:4868)] Fix typo in >>>>>>>> kubernetes/docker/build.sh >>>>>>>>>> (#[5505](tel:5505)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4211](tel:4211)] Add tests for WebHDFSHook >>>>>>>>>> (#[5015](tel:5015)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4320](tel:4320)] Add tests for >>>>>>>>>> SegmentTrackEventOperator (#[5104](tel:5104)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4319](tel:4319)] Add tests for Bigquery >>> related >>>>>>>>>> Operators (#[5101](tel:5101)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4014](tel:4014)] Change DatastoreHook and add >>>>> tests >>>>>>>>>> (#[4842](tel:4842)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4322](tel:4322)] Add test for VerticaOperator >>>>>>>>>> (#[5107](tel:5107)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4323](tel:4323)] Add 2 tests for WinRMOperator >>>>>>>>>> (#[5108](tel:5108)) >>>>>>>>>>>>>>>> - [AIRFLOW-[3677](tel:3677)] Improve CheckOperator test >>>>> coverage >>>>>>>>>> (#[4756](tel:4756)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4659](tel:4659)] Fix pylint problems for api >>>>> module >>>>>>>>>> (#[5398](tel:5398)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4358](tel:4358)] Speed up test_jobs by not >>>> running >>>>>>>>>> tasks (#[5162](tel:5162)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4394](tel:4394)] Don't test behaviour of >>>>> BackfillJob >>>>>>>>>> from CLI tests >>>>>>>>>>>>>>> (#[5160](tel:5160)) >>>>>>>>>>>>>>>> - [AIRFLOW-[3471](tel:3471)] Move XCom out of models.py >>>>>>>>>> (#[4629](tel:4629)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4379](tel:4379)] Remove duplicate code & Add >>>>>>>> validation >>>>>>>>>> in >>>>>>>>>>>>>>> gcs_to_gcs.py >>>>>>>>>>>>>>>> (#[5145](tel:5145)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4259](tel:4259)] Move models out of models.py >>>>>>>>>> (#[5056](tel:5056)) >>>>>>>>>>>>>>>> - [AIRFLOW-XXX] Speed up building of Cassanda module on >>>> Travis >>>>>>>>>>>>>>> (#[5233](tel:5233)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4535](tel:4535)] Break jobs.py into multiple >>>> files >>>>>>>>>> (#[5303](tel:5303)) >>>>>>>>>>>>>>>> - [AIRFLOW-[1464](tel:1464)] Batch update task_instance >>>> state >>>>>>>>>> (#[5323](tel:5323)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4554](tel:4554)] Test for sudo command, add >>> some >>>>>> other >>>>>>>>>> test docs >>>>>>>>>>>>>>> (#[5310](tel:5310)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4419](tel:4419)] Refine concurrency check in >>>>>> scheduler >>>>>>>>>> (#[5194](tel:5194)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4269](tel:4269)] Minor acceleration of >>>>>>>>>> jobs._process_task_instances() >>>>>>>>>>>>>>>> (#[5076](tel:5076)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4341](tel:4341)] Remove ``View.render()`` >>>> already >>>>>>>>>> exists in >>>>>>>>>>>>>>> fab.BaseView >>>>>>>>>>>>>>>> (#[5125](tel:5125)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4342](tel:4342)] Use @cached_property instead >>> of >>>>>>>>>> re-implementing it >>>>>>>>>>>>>>> each >>>>>>>>>>>>>>>> time (#[5126](tel:5126)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4256](tel:4256)] Remove noqa from migrations >>>>>>>>>> (#[5055](tel:5055)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4034](tel:4034)] Remove unnecessary string >>>>>> formatting >>>>>>>>>> with >>>>>>>>>>>>>>> ``**locals()`` >>>>>>>>>>>>>>>> (#[4861](tel:4861)) >>>>>>>>>>>>>>>> - [AIRFLOW-[3944](tel:3944)] Remove code smells >>>>>>>> (#[4762](tel:4762)) >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> Doc-only changes >>>>>>>>>>>>>>>> """""""""""""""" >>>>>>>>>>>>>>>> - [AIRFLOW-XXX] Correct BaseSensorOperator docs >>>>>>>> (#[5562](tel:5562)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4926](tel:4926)] Fix example dags where its >>>>>> start_date >>>>>>>>>> is >>>>>>>>>>>>>>>> datetime.utcnow() (#[5553](tel:5553)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4860](tel:4860)] Remove Redundant Information >>> in >>>>>>>>>> Example Dags (#[5497](tel:5497)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4767](tel:4767)] Fix errors in the >>> documentation >>>>> of >>>>>>>>>> Dataproc Operator >>>>>>>>>>>>>>>> (#[5487](tel:5487)) >>>>>>>>>>>>>>>> - [AIRFLOW-[1684](tel:1684)] Branching based on XCom >>>> variable >>>>>>>>>> (Docs) (#[4365](tel:4365)) >>>>>>>>>>>>>>>> - [AIRFLOW-[3341](tel:3341)] FAQ return DAG object example >>>>>>>>>> (#[4605](tel:4605)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4433](tel:4433)] Add missing type in >>>>> DockerOperator >>>>>>>> doc >>>>>>>>>> string >>>>>>>>>>>>>>> (#[5205](tel:5205)) >>>>>>>>>>>>>>>> - [AIRFLOW-[4321](tel:4321)] Replace incorrect info of Max >>>>> Size >>>>>>>>>> limit of GCS >>>>>>>>>>>>>>> Object >>>>>>>>>>>>>>>> Size (#[5106](tel:5106)) >>>>>>>>>>>>>>>> - [AIRFLOW-XXX] Add information about user list >>>>>>>> (#[5341](tel:5341)) >>>>>>>>>>>>>>>> - [AIRFLOW-XXX] Clarify documentation related to >>> autodetect >>>>>>>>>> parameter >>>>>>>>>>>>>>> in >>>>>>>>>>>>>>>> GCS_to_BQ Op (#[5294](tel:5294)) >>>>>>>>>>>>>>>> - [AIRFLOW-XXX] Remove mention of pytz compatibility from >>>>>> timezone >>>>>>>>>>>>>>>> documentation (#[5316](tel:5316)) >>>>>>>>>>>>>>>> - [AIRFLOW-XXX] Add missing docs for >>>>>>>>>> GoogleCloudStorageDeleteOperator >>>>>>>>>>>>>>>> (#[5274](tel:5274)) >>>>>>>>>>>>>>>> - [AIRFLOW-XXX] Remove incorrect note about Scopes of GCP >>>>>>>> connection >>>>>>>>>>>>>>>> (#[5242](tel:5242)) >>>>>>>>>>>>>>>> - [AIRFLOW-XXX] Fix mistakes in docs of Dataproc operators >>>>>>>>>> (#[5192](tel:5192)) >>>>>>>>>>>>>>>> - [AIRFLOW-XXX] Link to correct class for timedelta in >>>>>> macros.rst >>>>>>>>>>>>>>> (#[5226](tel:5226)) >>>>>>>>>>>>>>>> - [AIRFLOW-XXX] Add Kamil as committer (#[5216](tel:5216)) >>>>>>>>>>>>>>>> - [AIRFLOW-XXX] Add Joshua and Kevin as committer >>>>>>>>>> (#[5207](tel:5207)) >>>>>>>>>>>>>>>> - [AIRFLOW-XXX] Reduce log spam in tests >>> (#[5174](tel:5174)) >>>>>>>>>>>>>>>> - [AIRFLOW-XXX] Speed up tests for PythonSensor >>>>>>>> (#[5158](tel:5158)) >>>>>>>>>>>>>>>> - [AIRFLOW-XXX] Add Bas Harenslak to committer list >>>>>>>>>> (#[5157](tel:5157)) >>>>>>>>>>>>>>>> - [AIRFLOW-XXX] Add Jarek Potiuk to commiter list >>>>>>>>>> (#[5132](tel:5132)) >>>>>>>>>>>>>>>> - [AIRFLOW-XXX] Update docstring for SchedulerJob >>>>>>>>>> (#[5105](tel:5105)) >>>>>>>>>>>>>>>> - [AIRFLOW-XXX] Fix docstrings for >>>>>>>>>>>>>>> CassandraToGoogleCloudStorageOperator >>>>>>>>>>>>>>>> (#[5103](tel:5103)) >>>>>>>>>>>>>>>> - [AIRFLOW-XXX] update SlackWebhookHook and >>>>> SlackWebhookOperator >>>>>>>>>>>>>>> docstring >>>>>>>>>>>>>>>> (#[5074](tel:5074)) >>>>>>>>>>>>>>>> - [AIRFLOW-XXX] Ignore python files under node_modules in >>>> docs >>>>>>>>>>>>>>> (#[5063](tel:5063)) >>>>>>>>>>>>>>>> - [AIRFLOW-XXX] Build a universal wheel with LICNESE files >>>>>>>>>> (#[5052](tel:5052)) >>>>>>>>>>>>>>>> - [AIRFLOW-XXX] Fix docstrings of SQSHook >>>> (#[5099](tel:5099)) >>>>>>>>>>>>>>>> - [AIRFLOW-XXX] Use Py3.7 on readthedocs >>>>>>>>>>>>>>>> - [AIRFLOW-[4446](tel:4446)] Fix typos (#[5217](tel:5217)) >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> -- >>>>>>>>>>>> Best regards, >>>>>>>>>>>> >>>>>>>>>>>> Andrii Soldatenko >>>>>>>>>>>> Python Developer >>>>>>>>>>>> >>>>>>>>>>>> skype: andrii.soldatenko >>>>>>>>>>>> [email protected] >>>>>>>>>>>> http://asoldatenko.com >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> -- >>>>>>>>> *Kaxil Naik* >>>>>>>>> *Big Data Consultant | DevOps Data Engineer* >>>>>>>>> *Certified *Google Cloud Data Engineer | *Certified* Apache >>> Spark & >>>>>> Neo4j >>>>>>>>> Developer >>>>>>>>> *LinkedIn*: https://www.linkedin.com/in/kaxil >>>>>>>> >>>>>>>> >>>>>> >>>>>> >>>>> >>>> >>>> >>>> -- >>>> *Kaxil Naik* >>>> *Big Data Consultant | DevOps Data Engineer* >>>> *Certified *Google Cloud Data Engineer | *Certified* Apache Spark & Neo4j >>>> Developer >>>> *LinkedIn*: https://www.linkedin.com/in/kaxil >>>> >>> >> >> >> -- >> >> Jarek Potiuk >> Polidea <https://www.polidea.com/> | Principal Software Engineer >> >> M: +48 660 796 129 <+48660796129> >> [image: Polidea] <https://www.polidea.com/> >
