[GitHub] [airflow] rsg17 edited a comment on pull request #21084: Add GCSToPrestoOperator

2022-02-15 Thread GitBox
rsg17 edited a comment on pull request #21084: URL: https://github.com/apache/airflow/pull/21084#issuecomment-1041193297 > static checks are still failing Yes - I was actually going to ask about the `providers.yaml` after checking it out once more tonight. In this context, what is 'l

[GitHub] [airflow] 2ps opened a new pull request #21604: [ISSUE-21603] Reenabled passing cmd configuration

2022-02-15 Thread GitBox
2ps opened a new pull request #21604: URL: https://github.com/apache/airflow/pull/21604 ## Problem? Not including `_cmd` configuration options broke configuration for `sql_alchemy_conn_cmd` and `fernet_key_cmd` which caused all tasks to fail with a mysterious sqlite error.

[GitHub] [airflow] boring-cyborg[bot] commented on pull request #21604: [ISSUE-21603] Reenabled passing cmd configuration

2022-02-15 Thread GitBox
boring-cyborg[bot] commented on pull request #21604: URL: https://github.com/apache/airflow/pull/21604#issuecomment-1041207236 Congratulations on your first Pull Request and welcome to the Apache Airflow community! If you have any issues or are unsure about any anything please check our Co

[GitHub] [airflow] rsg17 edited a comment on pull request #21084: Add GCSToPrestoOperator

2022-02-15 Thread GitBox
rsg17 edited a comment on pull request #21084: URL: https://github.com/apache/airflow/pull/21084#issuecomment-1041193297 > static checks are still failing Yes - I was actually going to ask about the `providers.yaml` after checking it out once more tonight. In this context, what is 'l

[GitHub] [airflow] kristoffern edited a comment on pull request #19769: Handle stuck queued tasks in Celery for db backend

2022-02-15 Thread GitBox
kristoffern edited a comment on pull request #19769: URL: https://github.com/apache/airflow/pull/19769#issuecomment-1041192298 @ephraimbuddy I'll see if I can find some time today to test it. Just to double check, would that only be the #21556 patch then that should be applied, or should i

[GitHub] [airflow] rsg17 commented on pull request #21084: Add GCSToPrestoOperator

2022-02-15 Thread GitBox
rsg17 commented on pull request #21084: URL: https://github.com/apache/airflow/pull/21084#issuecomment-1041193297 > static checks are still failing Yes - I was actually going to ask about the `providers.yaml` after checking it out once more tonight. In this context, what is 'left' an

[GitHub] [airflow] eladkal commented on issue #20419: Need clearer documentation on setting up Sendgrid to send emails

2022-02-15 Thread GitBox
eladkal commented on issue #20419: URL: https://github.com/apache/airflow/issues/20419#issuecomment-1041192770 @bhavaniravi are you still working on this issue? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [airflow] kristoffern commented on pull request #19769: Handle stuck queued tasks in Celery for db backend

2022-02-15 Thread GitBox
kristoffern commented on pull request #19769: URL: https://github.com/apache/airflow/pull/19769#issuecomment-1041192298 @ephraimbuddy I'll see if I can find some time today to test it. Just to double check, would that only be the #21556 patch then that should be applied, or should it be to

[GitHub] [airflow] eladkal commented on issue #18713: /roles stable API endpoint PATCH verb needs better documentation in the openapi spec

2022-02-15 Thread GitBox
eladkal commented on issue #18713: URL: https://github.com/apache/airflow/issues/18713#issuecomment-1041191150 @alex-astronomer are you still working on this? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL ab

[GitHub] [airflow] howardyoo commented on pull request #21433: added explaining concept of logical date in DAG run

2022-02-15 Thread GitBox
howardyoo commented on pull request #21433: URL: https://github.com/apache/airflow/pull/21433#issuecomment-1041189636 Ok, added those references on each of the files mentioned above. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to G

[GitHub] [airflow] lwyszomi commented on issue #11721: Dataflow operators - add user possibility to define expected terminal state

2022-02-15 Thread GitBox
lwyszomi commented on issue #11721: URL: https://github.com/apache/airflow/issues/11721#issuecomment-1041186153 @eladkal sorry I was very busy, I will try to find some time in this or next week to fix this issue -- This is an automated message from the Apache Git Service. To respond to t

[GitHub] [airflow] ephraimbuddy commented on pull request #19769: Handle stuck queued tasks in Celery for db backend

2022-02-15 Thread GitBox
ephraimbuddy commented on pull request #19769: URL: https://github.com/apache/airflow/pull/19769#issuecomment-1041172180 > @kristoffern I have made an adjustment to this change, see #21556, apply [the new changes](https://github.com/apache/airflow/pull/21556) and test? Hi @kristoffer

[GitHub] [airflow] 2ps opened a new issue #21603: base task runner fails when using `sql_alchemy_conn_cmd` in config file

2022-02-15 Thread GitBox
2ps opened a new issue #21603: URL: https://github.com/apache/airflow/issues/21603 ### Apache Airflow version 2.2.3 (latest released) ### What happened In the configuration file, we specified a `sql_alchemy_conn_cmd` so that the main sql alchemy connection is loaded fro

[GitHub] [airflow] boring-cyborg[bot] commented on issue #21603: base task runner fails when using `sql_alchemy_conn_cmd` in config file

2022-02-15 Thread GitBox
boring-cyborg[bot] commented on issue #21603: URL: https://github.com/apache/airflow/issues/21603#issuecomment-1041155886 Thanks for opening your first issue here! Be sure to follow the issue template! -- This is an automated message from the Apache Git Service. To respond to the mes

[GitHub] [airflow] eladkal commented on issue #13351: Some hacks in Google provider

2022-02-15 Thread GitBox
eladkal commented on issue #13351: URL: https://github.com/apache/airflow/issues/13351#issuecomment-1041151101 @pierrejeambrun maybe you'll be interested in trying to solve some of the hacks? (probably we can't solve all of them) -- This is an automated message from the Apache Git Servic

[GitHub] [airflow] eladkal closed issue #11673: Issue with GCS and GCStoGCSOperator when dropping file

2022-02-15 Thread GitBox
eladkal closed issue #11673: URL: https://github.com/apache/airflow/issues/11673 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr.

[GitHub] [airflow] eladkal commented on issue #11673: Issue with GCS and GCStoGCSOperator when dropping file

2022-02-15 Thread GitBox
eladkal commented on issue #11673: URL: https://github.com/apache/airflow/issues/11673#issuecomment-1041148030 This issue is reported against old version of Airflow and on backport provider. Please check against latest provider version. If the issue still happens please add reproduce st

[GitHub] [airflow] eladkal commented on issue #11721: Dataflow operators - add user possibility to define expected terminal state

2022-02-15 Thread GitBox
eladkal commented on issue #11721: URL: https://github.com/apache/airflow/issues/11721#issuecomment-1041146661 @lwyszomi are you still working on this issue? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abo

[GitHub] [airflow] eladkal commented on pull request #21084: Add GCSToPrestoOperator

2022-02-15 Thread GitBox
eladkal commented on pull request #21084: URL: https://github.com/apache/airflow/pull/21084#issuecomment-1041145071 static checks are still failing -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t

[GitHub] [airflow] eladkal commented on issue #21600: BigQueryCreateEmptyDatasetOperator: doesn't use the provided project_id

2022-02-15 Thread GitBox
eladkal commented on issue #21600: URL: https://github.com/apache/airflow/issues/21600#issuecomment-1041120613 @MichailParaskevopoulos assiged to you. Feel free to submit PR -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[jira] [Commented] (AIRFLOW-5071) Thousand os Executor reports task instance X finished (success) although the task says its queued. Was the task killed externally?

2022-02-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17493003#comment-17493003 ] ASF GitHub Bot commented on AIRFLOW-5071: - pbotros commented on issue #10790: U

[GitHub] [airflow] pbotros commented on issue #10790: Copy of [AIRFLOW-5071] JIRA: Thousands of Executor reports task instance X finished (success) although the task says its queued. Was the task kill

2022-02-15 Thread GitBox
pbotros commented on issue #10790: URL: https://github.com/apache/airflow/issues/10790#issuecomment-1041101221 We also run into this fairly often, despite not using any sensors. We only seemed to start getting this error once we changed our Airflow database to be in the cloud (AWS RDB); ou

[airflow] branch main updated (005cef0 -> 0ebd642)

2022-02-15 Thread uranusjr
This is an automated email from the ASF dual-hosted git repository. uranusjr pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from 005cef0 Reorder migrations to include bugfix in 2.2.4 (#21598) add 0ebd642 Switch XCom implementation to use

[GitHub] [airflow] uranusjr merged pull request #20975: Switch XCom implementation to use run_id

2022-02-15 Thread GitBox
uranusjr merged pull request #20975: URL: https://github.com/apache/airflow/pull/20975 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-uns

[airflow] branch constraints-2-2 updated: Updating constraints. Build id:1850297129

2022-02-15 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-2-2 in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-2-2 by this push: new 1a434c3 Updating constra

[GitHub] [airflow] wanlce commented on issue #21594: First scheduling issue after schedule interval change

2022-02-15 Thread GitBox
wanlce commented on issue #21594: URL: https://github.com/apache/airflow/issues/21594#issuecomment-1041006457 @uranusjr here -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment

[GitHub] [airflow] jedcunningham commented on pull request #21294: Adding missing login provider related methods from Flask-Appbuilder

2022-02-15 Thread GitBox
jedcunningham commented on pull request #21294: URL: https://github.com/apache/airflow/pull/21294#issuecomment-1040983642 @aa3pankaj, can you fix the conflict in `setup.cfg`? Also can you add a comment explaining why we are pinning FAB? @potiuk, do you think we should accept a range

[airflow] 01/03: Fix slow DAG deletion due to missing ``dag_id`` index for job table (#20282)

2022-02-15 Thread jedcunningham
This is an automated email from the ASF dual-hosted git repository. jedcunningham pushed a commit to branch v2-2-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 045f6ce79ae722c2f95d9980d664d1ff152f863f Author: Kush <3647166+kushsha...@users.noreply.github.com> AuthorDate

[airflow] branch v2-2-test updated (a520845 -> c03b086)

2022-02-15 Thread jedcunningham
This is an automated email from the ASF dual-hosted git repository. jedcunningham pushed a change to branch v2-2-test in repository https://gitbox.apache.org/repos/asf/airflow.git. from a520845 update tutorial_etl_dag notes (#21503) new 045f6ce Fix slow DAG deletion due to missing ``d

[airflow] 03/03: Add note about Variable precedence with env vars (#21568)

2022-02-15 Thread jedcunningham
This is an automated email from the ASF dual-hosted git repository. jedcunningham pushed a commit to branch v2-2-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit c03b086e488229857d6ca49a715f3120112ed3c8 Author: Madison Swain-Bowden AuthorDate: Tue Feb 15 13:56:00 2022 -0

[airflow] 02/03: Reorder migrations to include bugfix in 2.2.4 (#21598)

2022-02-15 Thread jedcunningham
This is an automated email from the ASF dual-hosted git repository. jedcunningham pushed a commit to branch v2-2-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 2aec9d86631621c2e76f202c9e5e66121d06cfef Author: Jed Cunningham <66968678+jedcunning...@users.noreply.github.c

[GitHub] [airflow] jedcunningham commented on pull request #21330: Update test connection functionality to use custom form fields

2022-02-15 Thread GitBox
jedcunningham commented on pull request #21330: URL: https://github.com/apache/airflow/pull/21330#issuecomment-1040970040 I'm going to kick this to 2.3.0 because of the number of other changes that have happened to connection testing since 2.2.x forked off. We can always reevaluate for 2.2

[GitHub] [airflow] ephraimbuddy commented on a change in pull request #20962: Support generating SQL script for upgrades

2022-02-15 Thread GitBox
ephraimbuddy commented on a change in pull request #20962: URL: https://github.com/apache/airflow/pull/20962#discussion_r807429788 ## File path: dev/README_RELEASE_AIRFLOW.md ## @@ -205,6 +205,7 @@ The Release Candidate artifacts we vote upon should be the exact ones we vote a

[GitHub] [airflow] github-actions[bot] commented on issue #13692: task failed with a null hostname

2022-02-15 Thread GitBox
github-actions[bot] commented on issue #13692: URL: https://github.com/apache/airflow/issues/13692#issuecomment-1040924209 This issue has been automatically marked as stale because it has been open for 30 days with no response from the author. It will be closed in next 7 days if no further

[airflow] branch main updated (3ba6630 -> 005cef0)

2022-02-15 Thread jedcunningham
This is an automated email from the ASF dual-hosted git repository. jedcunningham pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from 3ba6630 Adds ADRs resulting from discussions during internship (#21549) add 005cef0 Reorder migrations

[GitHub] [airflow] jedcunningham merged pull request #21598: Reorder migrations to include bugfix in 2.2.4

2022-02-15 Thread GitBox
jedcunningham merged pull request #21598: URL: https://github.com/apache/airflow/pull/21598 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commit

[GitHub] [airflow] pingzh opened a new pull request #21602: add celery.task_timeout_error metric

2022-02-15 Thread GitBox
pingzh opened a new pull request #21602: URL: https://github.com/apache/airflow/pull/21602 This metric can quickly tell the infra if there are non-zero exit codes while running celery tasks, especially failures happening before airflow process starts or dag file parsing failure on

[GitHub] [airflow] sungpeo commented on a change in pull request #21538: py files doesn't have to be checked is_zipfiles in process_files

2022-02-15 Thread GitBox
sungpeo commented on a change in pull request #21538: URL: https://github.com/apache/airflow/pull/21538#discussion_r807393371 ## File path: UPDATING.md ## @@ -80,6 +80,13 @@ https://developers.google.com/style/inclusive-documentation --> +### You can't name zip files as en

[GitHub] [airflow] rsg17 commented on pull request #20769: [Part 2] Calendar to GCS Operator

2022-02-15 Thread GitBox
rsg17 commented on pull request #20769: URL: https://github.com/apache/airflow/pull/20769#issuecomment-1040886865 > LGTM @rsg17 can you please rebase > > If no further comments i'll merge after Rebased. Thank you! -- This is an automated message from the Apache Git Service.

[GitHub] [airflow] thcidale0808 commented on issue #21381: Databricks: sensor for Delta events

2022-02-15 Thread GitBox
thcidale0808 commented on issue #21381: URL: https://github.com/apache/airflow/issues/21381#issuecomment-1040884303 I'm happy to contribute with this one. Can this be assigned to me? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to G

[GitHub] [airflow] ephraimbuddy commented on a change in pull request #20962: Support generating SQL script for upgrades

2022-02-15 Thread GitBox
ephraimbuddy commented on a change in pull request #20962: URL: https://github.com/apache/airflow/pull/20962#discussion_r807390685 ## File path: airflow/models/taskinstance.py ## @@ -354,7 +354,7 @@ class TaskInstance(Base, LoggingMixin): unixname = Column(String(1000))

[airflow] branch main updated (a55d714 -> 3ba6630)

2022-02-15 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from a55d714 Action log on Browse Views (#21569) add 3ba6630 Adds ADRs resulting from discussions during internship

[GitHub] [airflow] potiuk merged pull request #21549: Adds ADRs resulting from discussions during internship

2022-02-15 Thread GitBox
potiuk merged pull request #21549: URL: https://github.com/apache/airflow/pull/21549 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsub

[GitHub] [airflow] potiuk commented on issue #18582: Allow Pools to be set via ENV

2022-02-15 Thread GitBox
potiuk commented on issue #18582: URL: https://github.com/apache/airflow/issues/18582#issuecomment-1040876512 Adding whole functionality of syncing env/state/db in case it can be replaced with ``` airlfow pools import ``` is a hard no for me., -- This is an automated messag

[GitHub] [airflow] potiuk closed issue #18582: Allow Pools to be set via ENV

2022-02-15 Thread GitBox
potiuk closed issue #18582: URL: https://github.com/apache/airflow/issues/18582 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr..

[GitHub] [airflow] potiuk closed pull request #21223: Added Feature: Create Pools from Env Vars.

2022-02-15 Thread GitBox
potiuk closed pull request #21223: URL: https://github.com/apache/airflow/pull/21223 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsub

[GitHub] [airflow] potiuk commented on pull request #21223: Added Feature: Create Pools from Env Vars.

2022-02-15 Thread GitBox
potiuk commented on pull request #21223: URL: https://github.com/apache/airflow/pull/21223#issuecomment-1040875658 Does it mean now that instead of one place (DB) you want to keep state of pools in 3 different places (DB, Env, state file)? And modify scheduler job to sync pool every tim

[GitHub] [airflow] dstandish commented on a change in pull request #21601: Use yaml config for generation of migration reference

2022-02-15 Thread GitBox
dstandish commented on a change in pull request #21601: URL: https://github.com/apache/airflow/pull/21601#discussion_r807379534 ## File path: docs/apache-airflow/migrations-ref.rst ## @@ -20,218 +20,242 @@ Reference for Database Migrations Here's the list of all the Database

[GitHub] [airflow] potiuk edited a comment on pull request #21540: Fix logging JDBC SQL error when task fails

2022-02-15 Thread GitBox
potiuk edited a comment on pull request #21540: URL: https://github.com/apache/airflow/pull/21540#issuecomment-1040863702 > It looks like the exception that's happening during the handling of the first exception is actually Airflow filtering code (the secret masker specifically): >

[GitHub] [airflow] potiuk edited a comment on pull request #21540: Fix logging JDBC SQL error when task fails

2022-02-15 Thread GitBox
potiuk edited a comment on pull request #21540: URL: https://github.com/apache/airflow/pull/21540#issuecomment-1040863702 > It looks like the exception that's happening during the handling of the first exception is actually Airflow filtering code (the secret masker specifically): >

[GitHub] [airflow] potiuk commented on pull request #21540: Fix logging JDBC SQL error when task fails

2022-02-15 Thread GitBox
potiuk commented on pull request #21540: URL: https://github.com/apache/airflow/pull/21540#issuecomment-1040863702 > It looks like the exception that's happening during the handling of the first exception is actually Airflow filtering code (the secret masker specifically): > > ```

[GitHub] [airflow] dstandish opened a new pull request #21601: Use yaml config for generation of migration reference

2022-02-15 Thread GitBox
dstandish opened a new pull request #21601: URL: https://github.com/apache/airflow/pull/21601 To support downgrades to versions, we need to be able to map airflow versions to alembic revisions. By using yaml to generate the doc table we can reuse this yaml config for downgrade functionali

[GitHub] [airflow] ashb commented on a change in pull request #21501: Support different timeout value for dag file parsing

2022-02-15 Thread GitBox
ashb commented on a change in pull request #21501: URL: https://github.com/apache/airflow/pull/21501#discussion_r807364492 ## File path: docs/apache-airflow/faq.rst ## @@ -119,6 +119,34 @@ How do I trigger tasks based on another task's failure? You can achieve this with :ref

[GitHub] [airflow] jhtimmins commented on pull request #21294: Adding missing login provider related methods from Flask-Appbuilder

2022-02-15 Thread GitBox
jhtimmins commented on pull request #21294: URL: https://github.com/apache/airflow/pull/21294#issuecomment-1040844812 @aa3pankaj @potiuk The reason for copying FAB permission classes directly into Airflow is that it allowed us to dramatically simplify the code and standardize naming around

[GitHub] [airflow] boring-cyborg[bot] commented on issue #21600: BigQueryCreateEmptyDatasetOperator: doesn't use the provided project_id

2022-02-15 Thread GitBox
boring-cyborg[bot] commented on issue #21600: URL: https://github.com/apache/airflow/issues/21600#issuecomment-1040842765 Thanks for opening your first issue here! Be sure to follow the issue template! -- This is an automated message from the Apache Git Service. To respond to the mes

[GitHub] [airflow] MichailParaskevopoulos opened a new issue #21600: BigQueryCreateEmptyDatasetOperator: doesn't use the provided project_id

2022-02-15 Thread GitBox
MichailParaskevopoulos opened a new issue #21600: URL: https://github.com/apache/airflow/issues/21600 ### Apache Airflow Provider(s) google ### Versions of Apache Airflow Providers apache-airflow-providers-google==6.3.0 ### Apache Airflow version 2.1.1

[airflow] branch main updated (8d980cb -> a55d714)

2022-02-15 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from 8d980cb Implement multiple API auth backends (#21472) add a55d714 Action log on Browse Views (#21569) No ne

[airflow] branch main updated (5fdd6fa -> 8d980cb)

2022-02-15 Thread ash
This is an automated email from the ASF dual-hosted git repository. ash pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from 5fdd6fa Added retries to LivyHook #19384 (#21550) add 8d980cb Implement multiple API auth backends (#21472) No

[GitHub] [airflow] pingzh commented on a change in pull request #21501: Support different timeout value for dag file parsing

2022-02-15 Thread GitBox
pingzh commented on a change in pull request #21501: URL: https://github.com/apache/airflow/pull/21501#discussion_r807353056 ## File path: docs/apache-airflow/faq.rst ## @@ -119,6 +119,34 @@ How do I trigger tasks based on another task's failure? You can achieve this with :r

[airflow] branch main updated (f6e0ed0 -> 5fdd6fa)

2022-02-15 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from f6e0ed0 Add how-to guide for hive operator (#21590) add 5fdd6fa Added retries to LivyHook #19384 (#21550) No

[GitHub] [airflow] kaxil merged pull request #21569: Action log on Browse Views

2022-02-15 Thread GitBox
kaxil merged pull request #21569: URL: https://github.com/apache/airflow/pull/21569 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubs

[GitHub] [airflow] ashb merged pull request #21472: Implement multiple API auth backends

2022-02-15 Thread GitBox
ashb merged pull request #21472: URL: https://github.com/apache/airflow/pull/21472 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubsc

[GitHub] [airflow] potiuk merged pull request #21550: Added retries to LivyHook #19384

2022-02-15 Thread GitBox
potiuk merged pull request #21550: URL: https://github.com/apache/airflow/pull/21550 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsub

[GitHub] [airflow] potiuk closed issue #19384: Add retries to LivyOperator polling / LivyHook

2022-02-15 Thread GitBox
potiuk closed issue #19384: URL: https://github.com/apache/airflow/issues/19384 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr..

[airflow] branch main updated (7a268cb -> f6e0ed0)

2022-02-15 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from 7a268cb Add note about Variable precedence with env vars (#21568) add f6e0ed0 Add how-to guide for hive oper

[GitHub] [airflow] kaxil closed issue #8191: Guide for Apache Hive operators

2022-02-15 Thread GitBox
kaxil closed issue #8191: URL: https://github.com/apache/airflow/issues/8191 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@a

[GitHub] [airflow] kaxil merged pull request #21590: add how-to guide for hive operator

2022-02-15 Thread GitBox
kaxil merged pull request #21590: URL: https://github.com/apache/airflow/pull/21590 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubs

[GitHub] [airflow] ashb commented on a change in pull request #21501: Support different timeout value for dag file parsing

2022-02-15 Thread GitBox
ashb commented on a change in pull request #21501: URL: https://github.com/apache/airflow/pull/21501#discussion_r807351409 ## File path: docs/apache-airflow/faq.rst ## @@ -119,6 +119,34 @@ How do I trigger tasks based on another task's failure? You can achieve this with :ref

[airflow] branch main updated (1b568d7 -> 7a268cb)

2022-02-15 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from 1b568d7 Extract ClientInfo to module level (#21554) add 7a268cb Add note about Variable precedence with env

[GitHub] [airflow] kaxil merged pull request #21568: Add note about Variable precedence with env vars

2022-02-15 Thread GitBox
kaxil merged pull request #21568: URL: https://github.com/apache/airflow/pull/21568 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubs

[GitHub] [airflow] potiuk commented on pull request #21560: Add template_fields and constructor parameters to displaying

2022-02-15 Thread GitBox
potiuk commented on pull request #21560: URL: https://github.com/apache/airflow/pull/21560#issuecomment-1040834809 Can we see a screenshot of the docs generated with it please @chenglongyan ? -- This is an automated message from the Apache Git Service. To respond to the message, please lo

[GitHub] [airflow] eladkal opened a new issue #21599: Explore the possibility of generic `SqlToGcsOperator`

2022-02-15 Thread GitBox
eladkal opened a new issue #21599: URL: https://github.com/apache/airflow/issues/21599 ### Body Recently `SqlToS3Operator` was added in PR https://github.com/apache/airflow/pull/20807 (It also deprecated `MySqlToS3Operator`) In Google provider Currently we have [BaseSQLToGCS

[GitHub] [airflow] jedcunningham commented on a change in pull request #21501: Support different timeout value for dag file parsing

2022-02-15 Thread GitBox
jedcunningham commented on a change in pull request #21501: URL: https://github.com/apache/airflow/pull/21501#discussion_r807347602 ## File path: docs/apache-airflow/faq.rst ## @@ -119,6 +119,34 @@ How do I trigger tasks based on another task's failure? You can achieve this

[GitHub] [airflow] kaxil commented on a change in pull request #20962: Support generating SQL script for upgrades

2022-02-15 Thread GitBox
kaxil commented on a change in pull request #20962: URL: https://github.com/apache/airflow/pull/20962#discussion_r807341803 ## File path: airflow/cli/cli_parser.py ## @@ -224,6 +224,16 @@ def _check(value): default=ColorMode.AUTO, ) +# DB args +ARG_VERSION_RANGE = Arg(

[airflow] branch constraints-2-2 updated: Updating constraints. Build id:1849336834

2022-02-15 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-2-2 in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-2-2 by this push: new fd38ef0 Updating constra

[airflow] branch main updated (7cca824 -> 1b568d7)

2022-02-15 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from 7cca824 Updated Databricks docs for correct jobs 2.1 API and links (#21494) add 1b568d7 Extract ClientInfo to

[GitHub] [airflow] potiuk merged pull request #21554: Extract ClientInfo to module level

2022-02-15 Thread GitBox
potiuk merged pull request #21554: URL: https://github.com/apache/airflow/pull/21554 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsub

[GitHub] [airflow] potiuk closed issue #13231: One ClientInfo instance in Google provider

2022-02-15 Thread GitBox
potiuk closed issue #13231: URL: https://github.com/apache/airflow/issues/13231 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr..

[GitHub] [airflow] github-actions[bot] commented on pull request #21549: Adds ADRs resulting from discussions during internship

2022-02-15 Thread GitBox
github-actions[bot] commented on pull request #21549: URL: https://github.com/apache/airflow/pull/21549#issuecomment-1040819610 The PR most likely needs to run full matrix of tests because it modifies parts of the core of Airflow. However, committers might decide to merge it quickly and ta

[GitHub] [airflow] github-actions[bot] commented on pull request #21554: Extract ClientInfo to module level

2022-02-15 Thread GitBox
github-actions[bot] commented on pull request #21554: URL: https://github.com/apache/airflow/pull/21554#issuecomment-1040819433 The PR is likely OK to be merged with just subset of tests for default Python and Database versions without running the full matrix of tests, because it does not

[GitHub] [airflow] github-actions[bot] commented on pull request #21598: Reorder migrations to include bugfix in 2.2.4

2022-02-15 Thread GitBox
github-actions[bot] commented on pull request #21598: URL: https://github.com/apache/airflow/pull/21598#issuecomment-1040815892 The PR most likely needs to run full matrix of tests because it modifies parts of the core of Airflow. However, committers might decide to merge it quickly and ta

[airflow] branch main updated (0873ee7 -> 7cca824)

2022-02-15 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from 0873ee7 Fix test_clear_multiple_external_task_marker timing out (#21343) add 7cca824 Updated Databricks docs f

[GitHub] [airflow] potiuk merged pull request #21494: Updated Databricks docs for correct jobs 2.1 API and links

2022-02-15 Thread GitBox
potiuk merged pull request #21494: URL: https://github.com/apache/airflow/pull/21494 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsub

[GitHub] [airflow] kaxil commented on a change in pull request #21273: Add test to run DB downgrade in the CI

2022-02-15 Thread GitBox
kaxil commented on a change in pull request #21273: URL: https://github.com/apache/airflow/pull/21273#discussion_r807332894 ## File path: airflow/migrations/versions/5e3ec427fdd3_increase_length_of_email_and_username.py ## @@ -46,9 +46,11 @@ def upgrade(): def downgrade():

[GitHub] [airflow] boring-cyborg[bot] commented on pull request #21494: Updated Databricks docs for correct jobs 2.1 API and links

2022-02-15 Thread GitBox
boring-cyborg[bot] commented on pull request #21494: URL: https://github.com/apache/airflow/pull/21494#issuecomment-1040815137 Awesome work, congrats on your first merged pull request! -- This is an automated message from the Apache Git Service. To respond to the message, please log o

[GitHub] [airflow] potiuk commented on issue #21537: airflow/providers/google/cloud/transfers/sql_to_gcs.py partition parquet files

2022-02-15 Thread GitBox
potiuk commented on issue #21537: URL: https://github.com/apache/airflow/issues/21537#issuecomment-1040813498 Feel free. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [airflow] potiuk commented on pull request #21230: Fetch log file from multiple worker

2022-02-15 Thread GitBox
potiuk commented on pull request #21230: URL: https://github.com/apache/airflow/pull/21230#issuecomment-1040813073 You need to rebase -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specifi

[GitHub] [airflow] kaxil commented on a change in pull request #20838: Add `db clean` CLI command for purging old data

2022-02-15 Thread GitBox
kaxil commented on a change in pull request #20838: URL: https://github.com/apache/airflow/pull/20838#discussion_r807331051 ## File path: airflow/utils/metastore_cleanup.py ## @@ -0,0 +1,310 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor

[GitHub] [airflow] kaxil commented on a change in pull request #20838: Add `db clean` CLI command for purging old data

2022-02-15 Thread GitBox
kaxil commented on a change in pull request #20838: URL: https://github.com/apache/airflow/pull/20838#discussion_r807331051 ## File path: airflow/utils/metastore_cleanup.py ## @@ -0,0 +1,310 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor

[airflow] branch main updated (1884f22 -> 0873ee7)

2022-02-15 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from 1884f22 Pass Trino hook params to DbApiHook (#21479) add 0873ee7 Fix test_clear_multiple_external_task_marker t

[GitHub] [airflow] kaxil commented on a change in pull request #20838: Add `db clean` CLI command for purging old data

2022-02-15 Thread GitBox
kaxil commented on a change in pull request #20838: URL: https://github.com/apache/airflow/pull/20838#discussion_r807327758 ## File path: airflow/utils/metastore_cleanup.py ## @@ -0,0 +1,310 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor

[GitHub] [airflow] kaxil commented on a change in pull request #20838: Add `db clean` CLI command for purging old data

2022-02-15 Thread GitBox
kaxil commented on a change in pull request #20838: URL: https://github.com/apache/airflow/pull/20838#discussion_r807327511 ## File path: airflow/utils/metastore_cleanup.py ## @@ -0,0 +1,310 @@ +# Licensed to the Apache Software Foundation (ASF) under one Review comment:

[GitHub] [airflow] kazanzhy commented on issue #21597: replace `hql` references to `sql` in `TrinoHook` and `PrestoHook`

2022-02-15 Thread GitBox
kazanzhy commented on issue #21597: URL: https://github.com/apache/airflow/issues/21597#issuecomment-1040808001 I'm working on a few other PRs but could take this issue if nobody else will take it. -- This is an automated message from the Apache Git Service. To respond to the message, pl

[GitHub] [airflow] kaxil commented on a change in pull request #20838: Add `db clean` CLI command for purging old data

2022-02-15 Thread GitBox
kaxil commented on a change in pull request #20838: URL: https://github.com/apache/airflow/pull/20838#discussion_r807326376 ## File path: airflow/cli/commands/db_command.py ## @@ -94,3 +95,26 @@ def shell(args): def check(_): """Runs a check command that checks if db is a

[GitHub] [airflow] kaxil commented on a change in pull request #20838: Add `db clean` CLI command for purging old data

2022-02-15 Thread GitBox
kaxil commented on a change in pull request #20838: URL: https://github.com/apache/airflow/pull/20838#discussion_r807326376 ## File path: airflow/cli/commands/db_command.py ## @@ -94,3 +95,26 @@ def shell(args): def check(_): """Runs a check command that checks if db is a

[GitHub] [airflow] potiuk merged pull request #21343: Fix test_clear_multiple_external_task_marker timing out

2022-02-15 Thread GitBox
potiuk merged pull request #21343: URL: https://github.com/apache/airflow/pull/21343 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsub

[GitHub] [airflow] potiuk closed issue #11443: [Quarantine] test_clear_multiple_external_task_marker timing out

2022-02-15 Thread GitBox
potiuk closed issue #11443: URL: https://github.com/apache/airflow/issues/11443 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr..

[GitHub] [airflow] dstandish commented on a change in pull request #21273: Add test to run DB downgrade in the CI

2022-02-15 Thread GitBox
dstandish commented on a change in pull request #21273: URL: https://github.com/apache/airflow/pull/21273#discussion_r807315091 ## File path: airflow/migrations/versions/5e3ec427fdd3_increase_length_of_email_and_username.py ## @@ -46,9 +46,11 @@ def upgrade(): def downgrade

[GitHub] [airflow] jedcunningham opened a new pull request #21598: Reorder migrations to include bugfix in 2.2.4

2022-02-15 Thread GitBox
jedcunningham opened a new pull request #21598: URL: https://github.com/apache/airflow/pull/21598 Reordering db migrations so we can include #20282 in 2.2.4. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abo

[GitHub] [airflow] ephraimbuddy commented on pull request #20962: Support generating SQL script for upgrades

2022-02-15 Thread GitBox
ephraimbuddy commented on pull request #20962: URL: https://github.com/apache/airflow/pull/20962#issuecomment-1040784802 Using github rebase button just messed my local branch up while fixing conflicts. It was a lot -- This is an automated message from the Apache Git Service. To respond

  1   2   3   4   5   6   >