[GitHub] [airflow] ginevragaudioso opened a new issue #15171: scheduler does not apply ordering when querying which task instances to schedule

2021-04-02 Thread GitBox
ginevragaudioso opened a new issue #15171: URL: https://github.com/apache/airflow/issues/15171 Issue type: Bug Airflow version: 2.0.1 (although bug may have existed earlier, and master still has the bug) Issue: The scheduler sometimes schedules tasks in alphabetical or

[GitHub] [airflow] ephraimbuddy commented on issue #15150: "duplicate key value violates unique constraint "dag_run_dag_id_execution_date_key" when triggering a DAG

2021-04-02 Thread GitBox
ephraimbuddy commented on issue #15150: URL: https://github.com/apache/airflow/issues/15150#issuecomment-812820764 > @kaxil I would like to work on this issue @vikramcse I have assigned it to you -- This is an automated message from the Apache Git Service. To respond to the message

[GitHub] [airflow] vikramcse commented on issue #15150: "duplicate key value violates unique constraint "dag_run_dag_id_execution_date_key" when triggering a DAG

2021-04-02 Thread GitBox
vikramcse commented on issue #15150: URL: https://github.com/apache/airflow/issues/15150#issuecomment-812819336 @kaxil I would like to work on this issue -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above t

[GitHub] [airflow] namiops edited a comment on issue #8467: ImportError: cannot import name 'bytes_type' from 'oauthlib.common'

2021-04-02 Thread GitBox
namiops edited a comment on issue #8467: URL: https://github.com/apache/airflow/issues/8467#issuecomment-812809887 > hey @namiops what version of airflow are you using? and python version? hi @snigdhasaikam30, I'm using Airfllow 1.10.15 with python 3.8. -- This is an automated

[GitHub] [airflow] namiops commented on issue #8467: ImportError: cannot import name 'bytes_type' from 'oauthlib.common'

2021-04-02 Thread GitBox
namiops commented on issue #8467: URL: https://github.com/apache/airflow/issues/8467#issuecomment-812809887 > hey @namiops what version of airflow are you using? and python version? hi @snigdhasaikam30, I'm using Airfllow 1.10.15 with python 3.8. -- This is an automated message fro

[GitHub] [airflow] github-actions[bot] commented on pull request #15169: Replace new url for Stable Airflow Docs

2021-04-02 Thread GitBox
github-actions[bot] commented on pull request #15169: URL: https://github.com/apache/airflow/pull/15169#issuecomment-812779146 [The Workflow run](https://github.com/apache/airflow/actions/runs/713286074) is cancelling this PR. It has some failed jobs matching ^Pylint$,^Static checks,^Build

[GitHub] [airflow] eladkal closed pull request #14887: Update BashOperator import

2021-04-02 Thread GitBox
eladkal closed pull request #14887: URL: https://github.com/apache/airflow/pull/14887 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, plea

[GitHub] [airflow] github-actions[bot] closed pull request #13930: WIP: POC of Timetable feature. Includes AbstractTimetable and CronTimetable classes.

2021-04-02 Thread GitBox
github-actions[bot] closed pull request #13930: URL: https://github.com/apache/airflow/pull/13930 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this s

[GitHub] [airflow] github-actions[bot] closed pull request #14121: Correction in 'Relationship Builders' section

2021-04-02 Thread GitBox
github-actions[bot] closed pull request #14121: URL: https://github.com/apache/airflow/pull/14121 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this s

[airflow] branch master updated (77ab986 -> 9ac1d0a)

2021-04-02 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git. from 77ab986 Add Guidelines about releasing Providers (#15168) add 9ac1d0a Close issues that are pending respon

[GitHub] [airflow] kaxil merged pull request #15170: Close issues that are pending response from the issue author

2021-04-02 Thread GitBox
kaxil merged pull request #15170: URL: https://github.com/apache/airflow/pull/15170 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please

[GitHub] [airflow] github-actions[bot] commented on pull request #15170: Close issues that are pending response from the issue author

2021-04-02 Thread GitBox
github-actions[bot] commented on pull request #15170: URL: https://github.com/apache/airflow/pull/15170#issuecomment-812770316 The PR most likely needs to run full matrix of tests because it modifies parts of the core of Airflow. However, committers might decide to merge it quickly and tak

[GitHub] [airflow] kaxil opened a new pull request #15170: Close issues that are pending response from the issue author

2021-04-02 Thread GitBox
kaxil opened a new pull request #15170: URL: https://github.com/apache/airflow/pull/15170 Based on the meeting notes in https://docs.google.com/document/d/1Fx46SoOnNLiqZKtrC-tOHj3zFlZfQwWuR2LRFXJnWqw/ we had decided that we will automate closing the issues if an issue does not receive res

[GitHub] [airflow] eladkal commented on a change in pull request #15169: Replace new url for Stable Airflow Docs

2021-04-02 Thread GitBox
eladkal commented on a change in pull request #15169: URL: https://github.com/apache/airflow/pull/15169#discussion_r606543708 ## File path: docs/apache-airflow-providers-microsoft-azure/operators/azure_blob_to_gcs.rst ## @@ -31,7 +31,7 @@ Please follow Azure to do it. TOKE

[GitHub] [airflow] ephraimbuddy commented on issue #14422: on_failure_callback does not seem to fire on pod deletion/eviction

2021-04-02 Thread GitBox
ephraimbuddy commented on issue #14422: URL: https://github.com/apache/airflow/issues/14422#issuecomment-812765167 I have investigated this and fixed a solution but I'm not sure if we want it. Basically when a pod is deleted, it sends a SIGTERM signal to the task which gets killed wh

[GitHub] [airflow] kaxil opened a new pull request #15169: Replace new url for Stable Airflow Docs

2021-04-02 Thread GitBox
kaxil opened a new pull request #15169: URL: https://github.com/apache/airflow/pull/15169 `https://airflow.apache.org/docs/stable/` -> `https://airflow.apache.org/docs/apache-airflow/stable` --- **^ Add meaningful description above** Read the **[Pull Request Guidel

[GitHub] [airflow] hsheth2 commented on pull request #14146: Restore base lineage backend

2021-04-02 Thread GitBox
hsheth2 commented on pull request #14146: URL: https://github.com/apache/airflow/pull/14146#issuecomment-812763729 Hi @JPonte / @turbaszek - do you have a sense of when this might be merged in? Seems like the build failures are unrelated - "GitHub Actions has encountered an internal

[airflow] branch master updated (3a38134 -> 77ab986)

2021-04-02 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git. from 3a38134 Deactivate trigger, refresh, and delete controls on dag detail view. (#14144) add 77ab986 Add Gui

[GitHub] [airflow] kaxil merged pull request #15168: Add Guidelines about releasing Providers

2021-04-02 Thread GitBox
kaxil merged pull request #15168: URL: https://github.com/apache/airflow/pull/15168 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please

[GitHub] [airflow] kaxil commented on issue #12985: PythonVirtualenvOperator with provide_context=True does not have 'ti' keyword

2021-04-02 Thread GitBox
kaxil commented on issue #12985: URL: https://github.com/apache/airflow/issues/12985#issuecomment-812762009 I have un-assigned myself so it is up for grabs :) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL a

[GitHub] [airflow] kaxil commented on issue #15150: "duplicate key value violates unique constraint "dag_run_dag_id_execution_date_key" when triggering a DAG

2021-04-02 Thread GitBox
kaxil commented on issue #15150: URL: https://github.com/apache/airflow/issues/15150#issuecomment-812761779 > @kaxil Thanks for your reply. I got your point, but the client gets a 500 HTTP code now, and I think it better if it returns 400 or 409 or any other suitable code. Agreed.

[airflow] branch master updated (610aea9 -> 3a38134)

2021-04-02 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git. from 610aea9 Fix documentation error in `git_sync_template.yaml` (#13197) add 3a38134 Deactivate trigger, refre

[GitHub] [airflow] kaxil merged pull request #14144: Deactivate trigger, refresh, and delete controls on dag detail view.

2021-04-02 Thread GitBox
kaxil merged pull request #14144: URL: https://github.com/apache/airflow/pull/14144 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please

[GitHub] [airflow] kaxil commented on pull request #13199: Create dag dependencies view

2021-04-02 Thread GitBox
kaxil commented on pull request #13199: URL: https://github.com/apache/airflow/pull/13199#issuecomment-812759581 > @ms32035 Since we are both in the UK it's probably easier to co-ordinate a more real time session to work on this, though I am off all next week. @kaxil is probably also avail

[GitHub] [airflow] kaxil commented on a change in pull request #14946: Standardize default fab perms

2021-04-02 Thread GitBox
kaxil commented on a change in pull request #14946: URL: https://github.com/apache/airflow/pull/14946#discussion_r606513352 ## File path: airflow/www/views.py ## @@ -3806,3 +3822,204 @@ def autocomplete(self, session=None): payload = [row[0] for row in dag_ids_query.u

[GitHub] [airflow] kaxil commented on a change in pull request #14946: Standardize default fab perms

2021-04-02 Thread GitBox
kaxil commented on a change in pull request #14946: URL: https://github.com/apache/airflow/pull/14946#discussion_r606511153 ## File path: airflow/www/views.py ## @@ -3806,3 +3822,204 @@ def autocomplete(self, session=None): payload = [row[0] for row in dag_ids_query.u

[GitHub] [airflow] kaojunsong commented on issue #15150: "duplicate key value violates unique constraint "dag_run_dag_id_execution_date_key" when triggering a DAG

2021-04-02 Thread GitBox
kaojunsong commented on issue #15150: URL: https://github.com/apache/airflow/issues/15150#issuecomment-812757758 @kaxil Thanks for your reply. I got your point, but the client gets a 500 HTTP code now, and I think it better if it returns 400 or 409 or any other suitable code. -- This is

[airflow] branch master updated: Fix documentation error in `git_sync_template.yaml` (#13197)

2021-04-02 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/master by this push: new 610aea9 Fix documentation error in `git_syn

[GitHub] [airflow] kaxil merged pull request #13197: Fix documentation error in git_sync_template.yaml

2021-04-02 Thread GitBox
kaxil merged pull request #13197: URL: https://github.com/apache/airflow/pull/13197 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please

[GitHub] [airflow] boring-cyborg[bot] commented on pull request #13197: Fix documentation error in git_sync_template.yaml

2021-04-02 Thread GitBox
boring-cyborg[bot] commented on pull request #13197: URL: https://github.com/apache/airflow/pull/13197#issuecomment-812754350 Awesome work, congrats on your first merged pull request! -- This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [airflow] kaxil commented on issue #11851: Inherit AirflowNotFound from connextion.NotFound to make the code simpler

2021-04-02 Thread GitBox
kaxil commented on issue #11851: URL: https://github.com/apache/airflow/issues/11851#issuecomment-812753985 I have assigned this issue to you @ankh6 -- please go for it :) re your other point, I am not exactly sure what you mean -- can you raise a new Github Issue as a feature reques

[GitHub] [airflow] github-actions[bot] commented on pull request #15168: Add Guidelines about releasing Providers

2021-04-02 Thread GitBox
github-actions[bot] commented on pull request #15168: URL: https://github.com/apache/airflow/pull/15168#issuecomment-812753540 The PR is likely ready to be merged. No tests are needed as no important environment files, nor python files were modified by it. However, committers might decide

[GitHub] [airflow] kaxil opened a new pull request #15168: Add Guidelines about releasing Providers

2021-04-02 Thread GitBox
kaxil opened a new pull request #15168: URL: https://github.com/apache/airflow/pull/15168 Based on the discussion in https://lists.apache.org/thread.html/rc72dbb2ac6773c1cb1dd573c60fcce191943b5f56dbfb2c98f87f461%40%3Cdev.airflow.apache.org%3E we have agreed to the three guidelines that I h

[GitHub] [airflow] eladkal commented on pull request #14767: Use resource types in AzureDataFactoryHook

2021-04-02 Thread GitBox
eladkal commented on pull request #14767: URL: https://github.com/apache/airflow/pull/14767#issuecomment-812747664 @flvndh can you take a look at the test failures? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[airflow] branch v1-10-stable updated: Skip `DatabaseVersionCheckRule` check if invalid version is detected (#15122)

2021-04-02 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a commit to branch v1-10-stable in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/v1-10-stable by this push: new 4aec433 Skip `DatabaseVersionCh

[GitHub] [airflow] kaxil merged pull request #15122: Skip `DatabaseVersionCheckRule` check if invalid version is detected

2021-04-02 Thread GitBox
kaxil merged pull request #15122: URL: https://github.com/apache/airflow/pull/15122 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please

[GitHub] [airflow] kaxil commented on a change in pull request #15142: Add support for labelling DAG edges (WIP)

2021-04-02 Thread GitBox
kaxil commented on a change in pull request #15142: URL: https://github.com/apache/airflow/pull/15142#discussion_r606464589 ## File path: airflow/models/edgemodifier.py ## @@ -0,0 +1,126 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor lic

[airflow] branch master updated (8cc8d11 -> 730037a)

2021-04-02 Thread jhtimmins
This is an automated email from the ASF dual-hosted git repository. jhtimmins pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git. from 8cc8d11 Store inventories in GitHub Action cache (#15109) add 730037a Add core-operators label to boring c

[GitHub] [airflow] jhtimmins merged pull request #15167: Add core-operators label to boring cyborg automation

2021-04-02 Thread GitBox
jhtimmins merged pull request #15167: URL: https://github.com/apache/airflow/pull/15167 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, pl

[airflow] branch constraints-master updated: Updating constraints. Build id:712911113

2021-04-02 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-master in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-master by this push: new 68595a6 Updating

[GitHub] [airflow] github-actions[bot] commented on pull request #15167: Add core-operators label to boring cyborg automation

2021-04-02 Thread GitBox
github-actions[bot] commented on pull request #15167: URL: https://github.com/apache/airflow/pull/15167#issuecomment-812745358 The PR is likely ready to be merged. No tests are needed as no important environment files, nor python files were modified by it. However, committers might decide

[GitHub] [airflow] github-actions[bot] commented on pull request #15122: Skip `DatabaseVersionCheckRule` check if invalid version is detected

2021-04-02 Thread GitBox
github-actions[bot] commented on pull request #15122: URL: https://github.com/apache/airflow/pull/15122#issuecomment-812743697 The PR most likely needs to run full matrix of tests because it modifies parts of the core of Airflow. However, committers might decide to merge it quickly and tak

[GitHub] [airflow] kaxil edited a comment on issue #13542: Task stuck in "scheduled" or "queued" state, pool has all slots queued, nothing is executing

2021-04-02 Thread GitBox
kaxil edited a comment on issue #13542: URL: https://github.com/apache/airflow/issues/13542#issuecomment-812743460 We have changed the default `min_file_process_interval` to `30` from Airflow 2.0.1 https://github.com/apache/airflow/blob/8cc8d11fb87d0ad5b3b80907874f695a77533bfa/UPDAT

[GitHub] [airflow] kaxil commented on issue #13542: Task stuck in "scheduled" or "queued" state, pool has all slots queued, nothing is executing

2021-04-02 Thread GitBox
kaxil commented on issue #13542: URL: https://github.com/apache/airflow/issues/13542#issuecomment-812743460 We have changed the default `min_file_process_interval` to `30` from Airflow 2.0.1 https://github.com/apache/airflow/blob/8cc8d11fb87d0ad5b3b80907874f695a77533bfa/UPDATING.md#

[GitHub] [airflow] eladkal opened a new pull request #15167: Add core-operators label to boring cyborg automation

2021-04-02 Thread GitBox
eladkal opened a new pull request #15167: URL: https://github.com/apache/airflow/pull/15167 recently we added `area:core-operators` label to mark issues related to core hooks/sensors/operators. This PR adds the label to the cyborg automation. --- **^ Add meaningful description

[GitHub] [airflow] SalmonTimo edited a comment on issue #13542: Task stuck in "scheduled" or "queued" state, pool has all slots queued, nothing is executing

2021-04-02 Thread GitBox
SalmonTimo edited a comment on issue #13542: URL: https://github.com/apache/airflow/issues/13542#issuecomment-812742063 I ran into this issue due to the scheduler over-utilizing CPU because our `min_file_process_interval` was set to 0 (the default prior to 2.0), which in airflow 2.0 causes

[GitHub] [airflow] SalmonTimo edited a comment on issue #13542: Task stuck in "scheduled" or "queued" state, pool has all slots queued, nothing is executing

2021-04-02 Thread GitBox
SalmonTimo edited a comment on issue #13542: URL: https://github.com/apache/airflow/issues/13542#issuecomment-812742063 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For

[GitHub] [airflow] SalmonTimo edited a comment on issue #13542: Task stuck in "scheduled" or "queued" state, pool has all slots queued, nothing is executing

2021-04-02 Thread GitBox
SalmonTimo edited a comment on issue #13542: URL: https://github.com/apache/airflow/issues/13542#issuecomment-812742063 I ran into this issue due to the scheduler over-utilizing CPU because our `min_file_process_interval` was set to 0 (the default prior to 2.0), which in airflow 2.0 causes

[GitHub] [airflow] SalmonTimo edited a comment on issue #13542: Task stuck in "scheduled" or "queued" state, pool has all slots queued, nothing is executing

2021-04-02 Thread GitBox
SalmonTimo edited a comment on issue #13542: URL: https://github.com/apache/airflow/issues/13542#issuecomment-812742063 I ran into this issue due to the scheduler over-utilizing CPU because our `min_file_process_interval` was set to 0 (the default prior to 2.0), which in airflow 2.0 causes

[GitHub] [airflow] SalmonTimo edited a comment on issue #13542: Task stuck in "scheduled" or "queued" state, pool has all slots queued, nothing is executing

2021-04-02 Thread GitBox
SalmonTimo edited a comment on issue #13542: URL: https://github.com/apache/airflow/issues/13542#issuecomment-812742063 I ran into this issue due to the scheduler over-utilizing CPU because our `min_file_process_interval` was set to 0 (the default prior to 2.0), which in airflow 2.0 causes

[GitHub] [airflow] SalmonTimo commented on issue #13542: Task stuck in "scheduled" or "queued" state, pool has all slots queued, nothing is executing

2021-04-02 Thread GitBox
SalmonTimo commented on issue #13542: URL: https://github.com/apache/airflow/issues/13542#issuecomment-812742063 I ran into this issue due to the scheduler over-utilizing CPU because our `min_file_process_interval` was set to 0 (the default prior to 2.0), which in airflow 2.0 causes a ton

[airflow] branch master updated (2ac4638 -> 8cc8d11)

2021-04-02 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git. from 2ac4638 Minor Helm Chart doc enhancements (#15124) add 8cc8d11 Store inventories in GitHub Action cache (#

[GitHub] [airflow] kaxil merged pull request #15109: Store inventories in GitHub Action cache

2021-04-02 Thread GitBox
kaxil merged pull request #15109: URL: https://github.com/apache/airflow/pull/15109 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please

[GitHub] [airflow] kaxil closed issue #14989: Make Docs builds fallback in case external docs sources are missing

2021-04-02 Thread GitBox
kaxil closed issue #14989: URL: https://github.com/apache/airflow/issues/14989 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please cont

[GitHub] [airflow] kaxil commented on pull request #15117: Remove user_id from API schema

2021-04-02 Thread GitBox
kaxil commented on pull request #15117: URL: https://github.com/apache/airflow/pull/15117#issuecomment-812736051 Can you take a look at the failing tests please @uranusjr -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and u

[GitHub] [airflow] kaxil commented on a change in pull request #15134: add loggin.info when poke in SFTP,FTP and Filesystem sensor to show last modified

2021-04-02 Thread GitBox
kaxil commented on a change in pull request #15134: URL: https://github.com/apache/airflow/pull/15134#discussion_r606449285 ## File path: airflow/sensors/filesystem.py ## @@ -57,6 +58,9 @@ def poke(self, context): for path in glob(full_path): if os.path.

[airflow] branch master updated: Minor Helm Chart doc enhancements (#15124)

2021-04-02 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/master by this push: new 2ac4638 Minor Helm Chart doc enhancements (

[GitHub] [airflow] kaxil merged pull request #15124: Minor Helm Chart doc enhancements

2021-04-02 Thread GitBox
kaxil merged pull request #15124: URL: https://github.com/apache/airflow/pull/15124 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please

[GitHub] [airflow] kaxil merged pull request #15120: Do not log info when ssm secret not found

2021-04-02 Thread GitBox
kaxil merged pull request #15120: URL: https://github.com/apache/airflow/pull/15120 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please

[GitHub] [airflow] github-actions[bot] commented on pull request #15120: Do not log info when ssm secret not found

2021-04-02 Thread GitBox
github-actions[bot] commented on pull request #15120: URL: https://github.com/apache/airflow/pull/15120#issuecomment-812733161 The PR is likely OK to be merged with just subset of tests for default Python and Database versions without running the full matrix of tests, because it does not m

[airflow] branch master updated: AWS: Do not log info when SSM & SecretsManager secret not found (#15120)

2021-04-02 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/master by this push: new eda538f AWS: Do not log info when SSM & Sec

[GitHub] [airflow] kaxil closed issue #14543: string templated fields are not rendered literally

2021-04-02 Thread GitBox
kaxil closed issue #14543: URL: https://github.com/apache/airflow/issues/14543 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please cont

[GitHub] [airflow] kaxil merged pull request #15130: A bunch of template_fields_renderers additions

2021-04-02 Thread GitBox
kaxil merged pull request #15130: URL: https://github.com/apache/airflow/pull/15130 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please

[airflow] branch master updated: A bunch of template_fields_renderers additions (#15130)

2021-04-02 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/master by this push: new 9b76b94 A bunch of template_fields_renderer

[GitHub] [airflow] kaxil commented on a change in pull request #15163: Fix exception caused by missing keys in the ES Record

2021-04-02 Thread GitBox
kaxil commented on a change in pull request #15163: URL: https://github.com/apache/airflow/pull/15163#discussion_r606438807 ## File path: airflow/providers/elasticsearch/log/es_task_handler.py ## @@ -207,7 +207,7 @@ def _format_msg(self, log_line): if self.json_format:

[airflow] branch master updated (83d702c -> 56d4311)

2021-04-02 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git. from 83d702c Fixes failing docs upload on master (#15148) add 56d4311 fix year in CONTRIBUTING.rst (#15166) No

[GitHub] [airflow] kaxil merged pull request #15166: fix year in CONTRIBUTING.rst

2021-04-02 Thread GitBox
kaxil merged pull request #15166: URL: https://github.com/apache/airflow/pull/15166 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please

[GitHub] [airflow] github-actions[bot] commented on pull request #15165: Separate pod_launcher from core airflow

2021-04-02 Thread GitBox
github-actions[bot] commented on pull request #15165: URL: https://github.com/apache/airflow/pull/15165#issuecomment-812719502 [The Workflow run](https://github.com/apache/airflow/actions/runs/712801528) is cancelling this PR. It has some failed jobs matching ^Pylint$,^Static checks,^Build

[GitHub] [airflow] eladkal opened a new pull request #15166: fix year in CONTRIBUTING.rst

2021-04-02 Thread GitBox
eladkal opened a new pull request #15166: URL: https://github.com/apache/airflow/pull/15166 --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/master/CONTRIBUTING.rst#pull-request-guidelines)** for more i

[GitHub] [airflow] eladkal commented on pull request #15053: Adding a call for exit code and a terminate call on finished processors to prevent defunct processes in airflow scheduler

2021-04-02 Thread GitBox
eladkal commented on pull request #15053: URL: https://github.com/apache/airflow/pull/15053#issuecomment-812716876 @Narendra-Neerukonda why did you target 1-10 branch? is the issue 1.10 specific? see https://github.com/apache/airflow/blob/master/CONTRIBUTING.rst#airflow-git-branches --

[GitHub] [airflow] dimberman commented on a change in pull request #15165: Separate pod_launcher from core airflow

2021-04-02 Thread GitBox
dimberman commented on a change in pull request #15165: URL: https://github.com/apache/airflow/pull/15165#discussion_r606418206 ## File path: airflow/kubernetes/pod_launcher.py ## @@ -14,283 +15,16 @@ # KIND, either express or implied. See the License for the # specific lang

[GitHub] [airflow] turbaszek commented on pull request #15087: Show dagbag import errors in dag list command

2021-04-02 Thread GitBox
turbaszek commented on pull request #15087: URL: https://github.com/apache/airflow/pull/15087#issuecomment-812712084 @mik-laj how this should be represented in yaml/json format? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [airflow] eladkal commented on a change in pull request #15165: Separate pod_launcher from core airflow

2021-04-02 Thread GitBox
eladkal commented on a change in pull request #15165: URL: https://github.com/apache/airflow/pull/15165#discussion_r606416594 ## File path: airflow/kubernetes/pod_launcher.py ## @@ -14,283 +15,16 @@ # KIND, either express or implied. See the License for the # specific langua

[GitHub] [airflow] dimberman commented on pull request #15165: Separate pod_launcher from core airflow

2021-04-02 Thread GitBox
dimberman commented on pull request #15165: URL: https://github.com/apache/airflow/pull/15165#issuecomment-812703349 cc: @SamWheating -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specifi

[GitHub] [airflow] kaxil commented on issue #15149: Kubernetes Executor does not delete pods stuck at creating because of volume mount errors

2021-04-02 Thread GitBox
kaxil commented on issue #15149: URL: https://github.com/apache/airflow/issues/15149#issuecomment-812702178 Oh yea looks like it, https://github.com/apache/airflow/pull/14810 should fix it, which will be in 2.0.2. > is this the same issue as #14556 ? -- This is an automate

[GitHub] [airflow] kaxil edited a comment on issue #15150: "duplicate key value violates unique constraint "dag_run_dag_id_execution_date_key" when triggering a DAG

2021-04-02 Thread GitBox
kaxil edited a comment on issue #15150: URL: https://github.com/apache/airflow/issues/15150#issuecomment-812701161 The DagRun table has the following constraints: https://github.com/apache/airflow/blob/83d702c345f8f4ce16d32268f4f83ee508fea676/airflow/models/dagrun.py#L96-L97 w

[GitHub] [airflow] kaxil commented on issue #15150: "duplicate key value violates unique constraint "dag_run_dag_id_execution_date_key" when triggering a DAG

2021-04-02 Thread GitBox
kaxil commented on issue #15150: URL: https://github.com/apache/airflow/issues/15150#issuecomment-812701161 The DagRun table has the following constraints: https://github.com/apache/airflow/blob/83d702c345f8f4ce16d32268f4f83ee508fea676/airflow/models/dagrun.py#L96-L97 which is

[GitHub] [airflow] maganaluis commented on issue #10836: Add RBAC policy -> namespace allowance in the KubernetesExecutor

2021-04-02 Thread GitBox
maganaluis commented on issue #10836: URL: https://github.com/apache/airflow/issues/10836#issuecomment-812696164 @eladkal No, we switched to Kubeflow. I don't have the bandwidth to support both. Could you remove me from this task? -- This is an automated message from the Apache Git Servi

[GitHub] [airflow] Davide95 commented on issue #15108: PostgresHook do not use the specified cursor

2021-04-02 Thread GitBox
Davide95 commented on issue #15108: URL: https://github.com/apache/airflow/issues/15108#issuecomment-812695742 I have some issues regarding breeze. I've already posted a message on Slack to get some help If I will be able to have a working env, it would be great to contribute -- This

[GitHub] [airflow] eladkal commented on issue #10836: Add RBAC policy -> namespace allowance in the KubernetesExecutor

2021-04-02 Thread GitBox
eladkal commented on issue #10836: URL: https://github.com/apache/airflow/issues/10836#issuecomment-812695198 @maganaluis are you still working on this feature? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [airflow] SamWheating commented on issue #15164: Separate K8sPodOperator code from airflow core code

2021-04-02 Thread GitBox
SamWheating commented on issue #15164: URL: https://github.com/apache/airflow/issues/15164#issuecomment-812693088 > Hey @SamWheating I'm sorry to do this but I actually just put up a PR for this (I started hacking it out of curiosity and got a little carried away) No worries at all!

[GitHub] [airflow] dimberman commented on issue #15164: Separate K8sPodOperator code from airflow core code

2021-04-02 Thread GitBox
dimberman commented on issue #15164: URL: https://github.com/apache/airflow/issues/15164#issuecomment-812692307 Hey @SamWheating I'm sorry to do this but I actually just put up a PR for this (I started hacking it out of curiosity and got a little carried away) https://github.com/apache/air

[GitHub] [airflow] dimberman opened a new pull request #15165: Separate pod_launcher from core airflow

2021-04-02 Thread GitBox
dimberman opened a new pull request #15165: URL: https://github.com/apache/airflow/pull/15165 Currently, the KubernetesPodOperator uses the pod_launcher class in airflow core. This means that if we need to fix a bug in the KubernetesPodOperator such as #15137 then the new cncf.kubernetes p

[GitHub] [airflow] potiuk edited a comment on issue #15161: Container run do not obey the AIRFLOW_UID changed user

2021-04-02 Thread GitBox
potiuk edited a comment on issue #15161: URL: https://github.com/apache/airflow/issues/15161#issuecomment-812690758 Yeah. But it was not clear enough and other people head similar problems - it is not obvious - so checking it and failing if it is not (with redirecting to the docs) :) seems

[GitHub] [airflow] potiuk commented on issue #15161: Container run do not obey the AIRFLOW_UID changed user

2021-04-02 Thread GitBox
potiuk commented on issue #15161: URL: https://github.com/apache/airflow/issues/15161#issuecomment-812690758 Yeah. But it was not clear enough and other people head similar problems - it is not obvious - so checking it and failing if it is not (with redirecting to the docs) :) -- This i

[GitHub] [airflow] eladkal commented on issue #15149: Kubernetes Executor does not delete pods stuck at creating because of volume mount errors

2021-04-02 Thread GitBox
eladkal commented on issue #15149: URL: https://github.com/apache/airflow/issues/15149#issuecomment-812686924 is this the same issue as https://github.com/apache/airflow/issues/14556 ? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [airflow] SamWheating commented on issue #15164: Separate K8sPodOperator code from airflow core code

2021-04-02 Thread GitBox
SamWheating commented on issue #15164: URL: https://github.com/apache/airflow/issues/15164#issuecomment-812682954 I can take this one, since I'm already dealing with the linked k8spodoperator issue 👍 -- This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [airflow] dimberman commented on a change in pull request #15137: Adding retries when starting kubernetes pods

2021-04-02 Thread GitBox
dimberman commented on a change in pull request #15137: URL: https://github.com/apache/airflow/pull/15137#discussion_r606390160 ## File path: airflow/kubernetes/pod_launcher.py ## @@ -98,6 +98,12 @@ def delete_pod(self, pod: V1Pod): if e.status != 404:

[GitHub] [airflow] potiuk commented on pull request #15162: Better compatibility/diagnostics for arbitrary UID in docker image

2021-04-02 Thread GitBox
potiuk commented on pull request #15162: URL: https://github.com/apache/airflow/pull/15162#issuecomment-812681557 I added the umask and changed the description/subject of the commit to better describe the meaning of this now. Also I added a comment in the entrypoint explaining why umask is

[GitHub] [airflow] dimberman opened a new issue #15164: Separate K8sPodOperator code from airflow core code

2021-04-02 Thread GitBox
dimberman opened a new issue #15164: URL: https://github.com/apache/airflow/issues/15164 **Description** Currently, the KubernetesPodOperator uses the pod_launcher class in airflow core. This means that if we need to fix a bug in the KubernetesPodOperator such as https://git

[GitHub] [airflow] potiuk commented on a change in pull request #15162: Fail in case wrong UID or GID is used for prod image

2021-04-02 Thread GitBox
potiuk commented on a change in pull request #15162: URL: https://github.com/apache/airflow/pull/15162#discussion_r606385727 ## File path: scripts/in_container/prod/entrypoint_prod.sh ## @@ -244,6 +243,30 @@ function exec_to_bash_or_python_command_if_specified() { fi }

[GitHub] [airflow] potiuk commented on pull request #15162: Fail in case wrong UID or GID is used for prod image

2021-04-02 Thread GitBox
potiuk commented on pull request #15162: URL: https://github.com/apache/airflow/pull/15162#issuecomment-812677042 > I read that guide in openshift and come to the complete opposite conclusion: we should support running as whatever user id the user chooses. Yeah. I actually fully agre

[GitHub] [airflow] ashb commented on a change in pull request #15162: Fail in case wrong UID or GID is used for prod image

2021-04-02 Thread GitBox
ashb commented on a change in pull request #15162: URL: https://github.com/apache/airflow/pull/15162#discussion_r606376745 ## File path: scripts/in_container/prod/entrypoint_prod.sh ## @@ -244,6 +243,30 @@ function exec_to_bash_or_python_command_if_specified() { fi } +f

[GitHub] [airflow] gudata commented on issue #15161: Container run do not obey the AIRFLOW_UID changed user

2021-04-02 Thread GitBox
gudata commented on issue #15161: URL: https://github.com/apache/airflow/issues/15161#issuecomment-812668572 Thank you for pointing my problem. Actually, on the second read, it is written that the GID must 0. ``` mkdir ./dags ./logs ./plugins echo -e "AIRFLOW_UID=$(id -u)\nAIR

[GitHub] [airflow] ashb commented on pull request #15162: Fail in case wrong UID or GID is used for prod image

2021-04-02 Thread GitBox
ashb commented on pull request #15162: URL: https://github.com/apache/airflow/pull/15162#issuecomment-812667736 I read that guide in openshift and come to the complete opposite conclusion: we should support running as whatever user id the user chooses. I don't have a problem with thi

[GitHub] [airflow] potiuk edited a comment on pull request #15162: Fail in case wrong UID or GID is used for prod image

2021-04-02 Thread GitBox
potiuk edited a comment on pull request #15162: URL: https://github.com/apache/airflow/pull/15162#issuecomment-812643417 @ashb - do you have any concerns about this ? It's pretty standard problem with any docker images out there, how to make them run with arbitrary user ids and there are

[GitHub] [airflow] dinigo commented on issue #15129: Bump google-api-core package version to make apache-airflow-providers-google compatible with python3.6

2021-04-02 Thread GitBox
dinigo commented on issue #15129: URL: https://github.com/apache/airflow/issues/15129#issuecomment-812658691 @potiuk much clearer. Thanks -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spec

[GitHub] [airflow] mik-laj commented on pull request #15087: Show dagbag import errors in dag list command

2021-04-02 Thread GitBox
mik-laj commented on pull request #15087: URL: https://github.com/apache/airflow/pull/15087#issuecomment-812657020 I thought about it longer and I think that DAG file loading errors are different than DAG files and should be displayed separately. On this screen, we can add a message that p

[GitHub] [airflow] potiuk edited a comment on pull request #15157: Increase timeout for building the docs

2021-04-02 Thread GitBox
potiuk edited a comment on pull request #15157: URL: https://github.com/apache/airflow/pull/15157#issuecomment-812649784 Anyone else? Really small but improves stability of the build (I've seen the timeouts occurring several times already). -- This is an automated message from the Apache

[GitHub] [airflow] potiuk commented on pull request #15157: Increase timeout for building the docs

2021-04-02 Thread GitBox
potiuk commented on pull request #15157: URL: https://github.com/apache/airflow/pull/15157#issuecomment-812649784 Anyone else? Really small but improves stability of the build (I've seen the timeouts occuring several times already). -- This is an automated message from the Apache Git Ser

  1   2   3   >