[GitHub] [airflow] uranusjr commented on a change in pull request #22583: Consider mapped upstream in TriggerRuleDep

2022-03-30 Thread GitBox
uranusjr commented on a change in pull request #22583: URL: https://github.com/apache/airflow/pull/22583#discussion_r839209079 ## File path: airflow/models/taskinstance.py ## @@ -2339,7 +2350,15 @@ def xcom_pull( .order_by(None)

[GitHub] [airflow] uranusjr commented on a change in pull request #22583: Consider mapped upstream in TriggerRuleDep

2022-03-30 Thread GitBox
uranusjr commented on a change in pull request #22583: URL: https://github.com/apache/airflow/pull/22583#discussion_r839209587 ## File path: airflow/models/taskinstance.py ## @@ -819,17 +819,25 @@ def refresh_from_task(self, task: "Operator", pool_override=None):

[GitHub] [airflow] uranusjr commented on a change in pull request #22583: Consider mapped upstream in TriggerRuleDep

2022-03-30 Thread GitBox
uranusjr commented on a change in pull request #22583: URL: https://github.com/apache/airflow/pull/22583#discussion_r839209079 ## File path: airflow/models/taskinstance.py ## @@ -2339,7 +2350,15 @@ def xcom_pull( .order_by(None)

[GitHub] [airflow] uranusjr commented on a change in pull request #22583: Consider mapped upstream in TriggerRuleDep

2022-03-30 Thread GitBox
uranusjr commented on a change in pull request #22583: URL: https://github.com/apache/airflow/pull/22583#discussion_r839209079 ## File path: airflow/models/taskinstance.py ## @@ -2339,7 +2350,15 @@ def xcom_pull( .order_by(None)

[GitHub] [airflow] github-actions[bot] commented on pull request #22635: Fixes ScheduleInterval api spec

2022-03-30 Thread GitBox
github-actions[bot] commented on pull request #22635: URL: https://github.com/apache/airflow/pull/22635#issuecomment-1084092293 The PR is likely OK to be merged with just subset of tests for default Python and Database versions without running the full matrix of tests, because it does not

[GitHub] [airflow-client-go] senthilkumarkj commented on pull request #21: Fix parsing of ScheduleInterval

2022-03-30 Thread GitBox
senthilkumarkj commented on pull request #21: URL: https://github.com/apache/airflow-client-go/pull/21#issuecomment-1084082874 New PR https://github.com/apache/airflow/pull/22635 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [airflow-client-go] senthilkumarkj edited a comment on issue #20: Parsing of Schedule Interval fails (possibly always)

2022-03-30 Thread GitBox
senthilkumarkj edited a comment on issue #20: URL: https://github.com/apache/airflow-client-go/issues/20#issuecomment-1083631057 FYI - I've opened a new PR here - https://github.com/apache/airflow/pull/22635 -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] dstandish commented on a change in pull request #22583: Consider mapped upstream in TriggerRuleDep

2022-03-30 Thread GitBox
dstandish commented on a change in pull request #22583: URL: https://github.com/apache/airflow/pull/22583#discussion_r839170638 ## File path: airflow/models/taskinstance.py ## @@ -2339,7 +2350,15 @@ def xcom_pull( .order_by(None)

[airflow] branch constraints-main updated: Updating constraints. Build id:2068709443

2022-03-30 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-main by this push: new d630d9b Updating

[GitHub] [airflow] boring-cyborg[bot] commented on issue #22638: 'dict' object has no attribute 'dump'

2022-03-30 Thread GitBox
boring-cyborg[bot] commented on issue #22638: URL: https://github.com/apache/airflow/issues/22638#issuecomment-1084032819 Thanks for opening your first issue here! Be sure to follow the issue template! -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] 11010cy opened a new issue #22638: 'dict' object has no attribute 'dump'

2022-03-30 Thread GitBox
11010cy opened a new issue #22638: URL: https://github.com/apache/airflow/issues/22638 ### Apache Airflow version 2.2.2 ### What happened get 500 while request 'api/v1/dags/{dag_id}/tasks'. It happens randomly. ``` AttributeError: 'dict' object has no

[airflow] branch main updated (c25ee43 -> 88165b3)

2022-03-30 Thread jedcunningham
This is an automated email from the ASF dual-hosted git repository. jedcunningham pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from c25ee43 Use "terminate-instances" instead of "stop-instances" (#22636) add 88165b3 Do not log the hook

[GitHub] [airflow] jedcunningham merged pull request #22627: Do not log the hook password even at DEBUG level

2022-03-30 Thread GitBox
jedcunningham merged pull request #22627: URL: https://github.com/apache/airflow/pull/22627 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] aljanson edited a comment on issue #21605: KubernetesPodOperator Fails on empty log line

2022-03-30 Thread GitBox
aljanson edited a comment on issue #21605: URL: https://github.com/apache/airflow/issues/21605#issuecomment-1084010727 Thanks @potiuk, however what fix/workaround can we use in the interim for this to prevent the errors and the crashing until the above is released? (as 2.3.0 release seems

[GitHub] [airflow] aljanson commented on issue #21605: KubernetesPodOperator Fails on empty log line

2022-03-30 Thread GitBox
aljanson commented on issue #21605: URL: https://github.com/apache/airflow/issues/21605#issuecomment-1084010727 Thanks @potiuk, however what fix/workaround can we use in the interim for this to prevent the errors and the crashing until the above is released? -- This is an automated

[GitHub] [airflow] Bowrna commented on pull request #22344: ci prepare-build-cache

2022-03-30 Thread GitBox
Bowrna commented on pull request #22344: URL: https://github.com/apache/airflow/pull/22344#issuecomment-1084010502 > @potiuk i want to know how we can pass the `CI` flag in python? In bash we set it as env var. Do we need to pass that as flag when we rewrite in python? > >

[GitHub] [airflow] Bowrna commented on pull request #22344: ci prepare-build-cache

2022-03-30 Thread GitBox
Bowrna commented on pull request #22344: URL: https://github.com/apache/airflow/pull/22344#issuecomment-1084010324 @potiuk I made changes specified in this https://github.com/apache/airflow/pull/22618 Please verify it -- This is an automated message from the Apache Git Service. To

[GitHub] [airflow] github-actions[bot] closed pull request #20583: ExternalTaskSensorAsync: Deferrable ("Async") version of ExternalTaskSensor

2022-03-30 Thread GitBox
github-actions[bot] closed pull request #20583: URL: https://github.com/apache/airflow/pull/20583 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] SasanAhmadi commented on pull request #22608: extra condition to check returned object not None

2022-03-30 Thread GitBox
SasanAhmadi commented on pull request #22608: URL: https://github.com/apache/airflow/pull/22608#issuecomment-1083786899 @eladkal could you take a look at this? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [airflow] yagodorea commented on issue #17054: Unable to trigger a DAG run via stable rest api

2022-03-30 Thread GitBox
yagodorea commented on issue #17054: URL: https://github.com/apache/airflow/issues/17054#issuecomment-1083721443 @AvniM did you solve this? I'm having the same problem here, is it a configuration issue? -- This is an automated message from the Apache Git Service. To respond to the

[airflow] branch main updated (97cf769 -> c25ee43)

2022-03-30 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from 97cf769 Fix: Add extra headers to all livy API requests instead of only to post_batch (#22510) add c25ee43

[GitHub] [airflow] potiuk merged pull request #22636: Use "terminate-instances" instead of "stop-instances"

2022-03-30 Thread GitBox
potiuk merged pull request #22636: URL: https://github.com/apache/airflow/pull/22636 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] ephraimbuddy opened a new pull request #22637: Add more fields to REST API get DAG(dags/dag_id) endpoint

2022-03-30 Thread GitBox
ephraimbuddy opened a new pull request #22637: URL: https://github.com/apache/airflow/pull/22637 The DagModel columns have increased since this endpoint was created. This PR improves the endpoint by including all the missing fields of the DagModel on the endpoint. This update also

[GitHub] [airflow] github-actions[bot] commented on pull request #22636: Use "terminate-instances" instead of "stop-instances"

2022-03-30 Thread GitBox
github-actions[bot] commented on pull request #22636: URL: https://github.com/apache/airflow/pull/22636#issuecomment-1083649876 The PR most likely needs to run full matrix of tests because it modifies parts of the core of Airflow. However, committers might decide to merge it quickly and

[GitHub] [airflow] pacharaphet commented on issue #18223: Cannot import name 'FlowerCommand' from 'flower.command'

2022-03-30 Thread GitBox
pacharaphet commented on issue #18223: URL: https://github.com/apache/airflow/issues/18223#issuecomment-1083648863 Why would it be done this way? I installed airflow using a constraint file with version 0.9.7 of flower but I am getting the same error. Just seems strange to provide the

[GitHub] [airflow] jedcunningham closed pull request #22627: Do not log the hook password even at DEBUG level

2022-03-30 Thread GitBox
jedcunningham closed pull request #22627: URL: https://github.com/apache/airflow/pull/22627 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow-client-go] senthilkumarkj closed issue #20: Parsing of Schedule Interval fails (possibly always)

2022-03-30 Thread GitBox
senthilkumarkj closed issue #20: URL: https://github.com/apache/airflow-client-go/issues/20 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow-client-go] senthilkumarkj commented on issue #20: Parsing of Schedule Interval fails (possibly always)

2022-03-30 Thread GitBox
senthilkumarkj commented on issue #20: URL: https://github.com/apache/airflow-client-go/issues/20#issuecomment-1083631057 FYI - I've opened a new PR here - https://github.com/apache/airflow/pull/22635 I'm closing this. Thanks for the help. -- This is an automated message from

[GitHub] [airflow] potiuk opened a new pull request #22636: Use "terminate-instances" instead of "stop-instances"

2022-03-30 Thread GitBox
potiuk opened a new pull request #22636: URL: https://github.com/apache/airflow/pull/22636 The spot instances need to be terminated and cannot be stopped. --- **^ Add meaningful description above** Read the **[Pull Request

[GitHub] [airflow] ferruzzi commented on a change in pull request #22517: Adds HiveToDynamoDB Transfer Sample DAG and Docs

2022-03-30 Thread GitBox
ferruzzi commented on a change in pull request #22517: URL: https://github.com/apache/airflow/pull/22517#discussion_r838967189 ## File path: airflow/providers/amazon/aws/example_dags/example_hive_to_dynamodb.py ## @@ -0,0 +1,137 @@ +# Licensed to the Apache Software Foundation

[GitHub] [airflow] boring-cyborg[bot] commented on pull request #22635: Fixes ScheduleInterval spec

2022-03-30 Thread GitBox
boring-cyborg[bot] commented on pull request #22635: URL: https://github.com/apache/airflow/pull/22635#issuecomment-1083621116 Congratulations on your first Pull Request and welcome to the Apache Airflow community! If you have any issues or are unsure about any anything please check our

[GitHub] [airflow] senthilkumarkj opened a new pull request #22635: Fixes ScheduleInterval spec

2022-03-30 Thread GitBox
senthilkumarkj opened a new pull request #22635: URL: https://github.com/apache/airflow/pull/22635 In the schedule interval, the data can actually match more than one schema and the `__type` should decide which type of the interval it actually matches. Fixes

[GitHub] [airflow] collinmcnulty commented on pull request #22627: Do not log the hook password even at DEBUG level

2022-03-30 Thread GitBox
collinmcnulty commented on pull request #22627: URL: https://github.com/apache/airflow/pull/22627#issuecomment-1083589295 I'll edit the PR to remove it entirely. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [airflow] potiuk commented on pull request #22627: Do not log the hook password even at DEBUG level

2022-03-30 Thread GitBox
potiuk commented on pull request #22627: URL: https://github.com/apache/airflow/pull/22627#issuecomment-1083581535 > The way `extra` is masked based on key covers the edge cases I'm aware of (in this case, MASK_SECRETS_IN_LOGS being False). There easily could be others though 路‍♂️. >

[GitHub] [airflow] jedcunningham edited a comment on pull request #22627: Do not log the hook password even at DEBUG level

2022-03-30 Thread GitBox
jedcunningham edited a comment on pull request #22627: URL: https://github.com/apache/airflow/pull/22627#issuecomment-1083561752 The way `extra` is masked based on key covers the edge cases I'm aware of (in this case, MASK_SECRETS_IN_LOGS being False). There easily could be others though

[GitHub] [airflow] jedcunningham commented on pull request #22627: Do not log the hook password even at DEBUG level

2022-03-30 Thread GitBox
jedcunningham commented on pull request #22627: URL: https://github.com/apache/airflow/pull/22627#issuecomment-1083561752 The way `extra` is masked based on key covers the edge cases I'm aware of (in this case, MASK_SECRETS_IN_LOGS being False). That said, I'm thinking we should

[GitHub] [airflow] potiuk edited a comment on pull request #22627: Do not log the hook password even at DEBUG level

2022-03-30 Thread GitBox
potiuk edited a comment on pull request #22627: URL: https://github.com/apache/airflow/pull/22627#issuecomment-1083553065 > `extra` does get masked based on key. I believe there are some edge ceses where it is not masked (for example when the Hook is called by Bash), and I think the

[GitHub] [airflow] potiuk commented on pull request #22627: Do not log the hook password even at DEBUG level

2022-03-30 Thread GitBox
potiuk commented on pull request #22627: URL: https://github.com/apache/airflow/pull/22627#issuecomment-1083553065 > `extra` does get masked based on key. I believe there are some edge ceses where it is not mased (for example when the Hook is called by Bash), and I think the whole

[GitHub] [airflow] jedcunningham commented on pull request #22627: Do not log the hook password even at DEBUG level

2022-03-30 Thread GitBox
jedcunningham commented on pull request #22627: URL: https://github.com/apache/airflow/pull/22627#issuecomment-1083549504 `extra` does get masked based on key. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[airflow] branch main updated (347e202 -> 97cf769)

2022-03-30 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from 347e202 Bump black version for other pre-commit hooks (#22599) add 97cf769 Fix: Add extra headers to all livy

[GitHub] [airflow] boring-cyborg[bot] commented on pull request #22510: Fix: Add extra headers to all livy API requests instead of only to post_batch

2022-03-30 Thread GitBox
boring-cyborg[bot] commented on pull request #22510: URL: https://github.com/apache/airflow/pull/22510#issuecomment-1083542234 Awesome work, congrats on your first merged pull request! -- This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [airflow] potiuk merged pull request #22510: Fix: Add extra headers to all livy API requests instead of only to post_batch

2022-03-30 Thread GitBox
potiuk merged pull request #22510: URL: https://github.com/apache/airflow/pull/22510 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] potiuk edited a comment on pull request #22625: Further improves image caching for Breeze

2022-03-30 Thread GitBox
potiuk edited a comment on pull request #22625: URL: https://github.com/apache/airflow/pull/22625#issuecomment-1083531675 I hope that one will make it finally solved with multi-staging and multi-platform builds. I've learned a TON about it and there are still some weird behaviours.

[GitHub] [airflow] potiuk edited a comment on pull request #22625: Further improves image caching for Breeze

2022-03-30 Thread GitBox
potiuk edited a comment on pull request #22625: URL: https://github.com/apache/airflow/pull/22625#issuecomment-1083531675 I hope that one will make it finally solved with multi-staging builds. I've learned a TON about it and there are still some weird behaviours. > There are 2 hard

[GitHub] [airflow] potiuk commented on pull request #22625: Further improves image caching for Breeze

2022-03-30 Thread GitBox
potiuk commented on pull request #22625: URL: https://github.com/apache/airflow/pull/22625#issuecomment-1083531675 I hope that one will make it finally solved with multi-staging builds. I've learned a TON about it and there are still some weird behaviours. | There are 2 hard

[airflow] branch main updated: Bump black version for other pre-commit hooks (#22599)

2022-03-30 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 347e202 Bump black version for other pre-commit

[GitHub] [airflow] potiuk merged pull request #22599: Bump black version for other pre-commit hooks

2022-03-30 Thread GitBox
potiuk merged pull request #22599: URL: https://github.com/apache/airflow/pull/22599 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] potiuk commented on pull request #22599: Bump black version for other pre-commit hooks

2022-03-30 Thread GitBox
potiuk commented on pull request #22599: URL: https://github.com/apache/airflow/pull/22599#issuecomment-1083529096 I am surprised :) . But Well.. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [airflow] bbovenzi opened a new pull request #22633: Only hide rendered button for mapped summaries

2022-03-30 Thread GitBox
bbovenzi opened a new pull request #22633: URL: https://github.com/apache/airflow/pull/22633 With https://github.com/apache/airflow/pull/22396 and https://github.com/apache/airflow/pull/22578. Rendered template links should now work for individual mapped task instances. Now, we will only

[airflow] 01/01: Only hide rendered button for mapped summaries

2022-03-30 Thread bbovenzi
This is an automated email from the ASF dual-hosted git repository. bbovenzi pushed a commit to branch Fix-rendered-btn-for-mapped-instances in repository https://gitbox.apache.org/repos/asf/airflow.git commit 9e447c1b0e54a93742f3b7e4fc929d37a8a4e8f2 Author: Brent Bovenzi AuthorDate: Wed Mar 30

[airflow] branch Fix-rendered-btn-for-mapped-instances created (now 9e447c1)

2022-03-30 Thread bbovenzi
This is an automated email from the ASF dual-hosted git repository. bbovenzi pushed a change to branch Fix-rendered-btn-for-mapped-instances in repository https://gitbox.apache.org/repos/asf/airflow.git. at 9e447c1 Only hide rendered button for mapped summaries This branch includes the

[GitHub] [airflow] vincbeck opened a new issue #22632: Missing doc and sample dag for ExasolToS3Operator

2022-03-30 Thread GitBox
vincbeck opened a new issue #22632: URL: https://github.com/apache/airflow/issues/22632 ### What do you see as an issue? The operator ``ExasolToS3Operator`` is missing a sample dag and documentation which would benefit users. In order to test the sample dag you need to have an

[GitHub] [airflow] boring-cyborg[bot] commented on issue #22632: Missing doc and sample dag for ExasolToS3Operator

2022-03-30 Thread GitBox
boring-cyborg[bot] commented on issue #22632: URL: https://github.com/apache/airflow/issues/22632#issuecomment-1083512986 Thanks for opening your first issue here! Be sure to follow the issue template! -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] github-actions[bot] commented on pull request #22627: Do not log the hook password even at DEBUG level

2022-03-30 Thread GitBox
github-actions[bot] commented on pull request #22627: URL: https://github.com/apache/airflow/pull/22627#issuecomment-1083499355 The PR most likely needs to run full matrix of tests because it modifies parts of the core of Airflow. However, committers might decide to merge it quickly and

[GitHub] [airflow] pbhuss commented on issue #21440: Dataflow Operator fails with Application Default credentials

2022-03-30 Thread GitBox
pbhuss commented on issue #21440: URL: https://github.com/apache/airflow/issues/21440#issuecomment-1083482032 https://stackoverflow.com/questions/59858003/using-airflow-with-bigquery-and-cloud-sdk-gives-error-user-must-be-authenticate This might be related. People noticed that

[GitHub] [airflow-client-go] senthilkumarkj commented on pull request #21: Fix parsing of ScheduleInterval

2022-03-30 Thread GitBox
senthilkumarkj commented on pull request #21: URL: https://github.com/apache/airflow-client-go/pull/21#issuecomment-1083474896 Thank you all and sorry for the delayed response. I think the issue is in this line -

[GitHub] [airflow] ferruzzi commented on a change in pull request #22517: Adds HiveToDynamoDB Transfer Sample DAG and Docs

2022-03-30 Thread GitBox
ferruzzi commented on a change in pull request #22517: URL: https://github.com/apache/airflow/pull/22517#discussion_r838786019 ## File path: airflow/providers/amazon/aws/example_dags/example_hive_to_dynamodb.py ## @@ -0,0 +1,137 @@ +# Licensed to the Apache Software Foundation

[GitHub] [airflow] mancunian1792 opened a new issue #22628: Enhancement: SQSSensor to stop polling after some pre-defined tries.

2022-03-30 Thread GitBox
mancunian1792 opened a new issue #22628: URL: https://github.com/apache/airflow/issues/22628 ### Description **Problem**: There can be days where this queue doesn't get any message. When that happens, my SQS Sensor continues to poll till it receives a message. Since i want it

[GitHub] [airflow] boring-cyborg[bot] commented on issue #22628: Enhancement: SQSSensor to stop polling after some pre-defined tries.

2022-03-30 Thread GitBox
boring-cyborg[bot] commented on issue #22628: URL: https://github.com/apache/airflow/issues/22628#issuecomment-1083468399 Thanks for opening your first issue here! Be sure to follow the issue template! -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] collinmcnulty opened a new pull request #22627: Do not log the hook password even at DEBUG level

2022-03-30 Thread GitBox
collinmcnulty opened a new pull request #22627: URL: https://github.com/apache/airflow/pull/22627 The BaseHook currently logs connection details including password at the DEBUG level. While the password is redacted under normal conditions in task logs, there are edge cases where this can

[GitHub] [airflow] uranusjr commented on a change in pull request #22583: Consider mapped upstream in TriggerRuleDep

2022-03-30 Thread GitBox
uranusjr commented on a change in pull request #22583: URL: https://github.com/apache/airflow/pull/22583#discussion_r838813708 ## File path: airflow/models/taskinstance.py ## @@ -819,17 +819,25 @@ def refresh_from_task(self, task: "Operator", pool_override=None):

[GitHub] [airflow] pingzh commented on a change in pull request #21877: AIP-45 Remove dag parsing in airflow run local

2022-03-30 Thread GitBox
pingzh commented on a change in pull request #21877: URL: https://github.com/apache/airflow/pull/21877#discussion_r838803481 ## File path: airflow/models/taskinstance.py ## @@ -710,6 +670,26 @@ def mark_success_url(self): "=success" ) +def

[GitHub] [airflow] pingzh commented on a change in pull request #21877: AIP-45 Remove dag parsing in airflow run local

2022-03-30 Thread GitBox
pingzh commented on a change in pull request #21877: URL: https://github.com/apache/airflow/pull/21877#discussion_r838802636 ## File path: airflow/models/serialized_dag.py ## @@ -250,6 +250,13 @@ def has_dag(cls, dag_id: str, session: Session = None) -> bool: """

[GitHub] [airflow] kaxil commented on pull request #22599: Bump black version for other pre-commit hooks

2022-03-30 Thread GitBox
kaxil commented on pull request #22599: URL: https://github.com/apache/airflow/pull/22599#issuecomment-1083426145 All passed :) @potiuk -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [airflow] pingzh commented on a change in pull request #21877: AIP-45 Remove dag parsing in airflow run local

2022-03-30 Thread GitBox
pingzh commented on a change in pull request #21877: URL: https://github.com/apache/airflow/pull/21877#discussion_r838802219 ## File path: airflow/jobs/scheduler_job.py ## @@ -779,6 +779,22 @@ def _execute(self) -> None: self.log.exception("Exception when

[GitHub] [airflow] pingzh commented on a change in pull request #22389: make operator's execution_timeout configurable

2022-03-30 Thread GitBox
pingzh commented on a change in pull request #22389: URL: https://github.com/apache/airflow/pull/22389#discussion_r838800949 ## File path: airflow/configuration.py ## @@ -608,6 +609,48 @@ def getjson(self, section, key, fallback=_UNSET, **kwargs) -> Union[dict, list,

[GitHub] [airflow] ferruzzi commented on a change in pull request #22517: Adds HiveToDynamoDB Transfer Sample DAG and Docs

2022-03-30 Thread GitBox
ferruzzi commented on a change in pull request #22517: URL: https://github.com/apache/airflow/pull/22517#discussion_r838786019 ## File path: airflow/providers/amazon/aws/example_dags/example_hive_to_dynamodb.py ## @@ -0,0 +1,137 @@ +# Licensed to the Apache Software Foundation

[GitHub] [airflow] josh-fell commented on a change in pull request #22517: Adds HiveToDynamoDB Transfer Sample DAG and Docs

2022-03-30 Thread GitBox
josh-fell commented on a change in pull request #22517: URL: https://github.com/apache/airflow/pull/22517#discussion_r838783758 ## File path: airflow/providers/amazon/aws/example_dags/example_hive_to_dynamodb.py ## @@ -0,0 +1,137 @@ +# Licensed to the Apache Software

[GitHub] [airflow] tronlightracer opened a new issue #22626: The command 'airflow dags test' is deadlocking tasks using AIP-42 features with the PythonVirtualenvOperator

2022-03-30 Thread GitBox
tronlightracer opened a new issue #22626: URL: https://github.com/apache/airflow/issues/22626 ### Apache Airflow version main (development) ### What happened When using the command airflow dags test tasks are put in the deadlock state. ### What you think should

[GitHub] [airflow] boring-cyborg[bot] commented on issue #22626: The command 'airflow dags test' is deadlocking tasks using AIP-42 features with the PythonVirtualenvOperator

2022-03-30 Thread GitBox
boring-cyborg[bot] commented on issue #22626: URL: https://github.com/apache/airflow/issues/22626#issuecomment-1083399842 Thanks for opening your first issue here! Be sure to follow the issue template! -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] dstandish commented on a change in pull request #22537: Consistent DB upgrade/downgrade arguments

2022-03-30 Thread GitBox
dstandish commented on a change in pull request #22537: URL: https://github.com/apache/airflow/pull/22537#discussion_r838765604 ## File path: airflow/utils/db.py ## @@ -742,7 +742,7 @@ def check_and_run_migrations(): if len(db_heads) < 1: db_command = initdb

[airflow] branch main updated (143702e -> 7e0e7c7)

2022-03-30 Thread uranusjr
This is an automated email from the ASF dual-hosted git repository. uranusjr pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from 143702e Fix /rendered-templates for mapped operator (#22396) add 7e0e7c7 Rewrite ti.xcom_pull() to consider

[GitHub] [airflow] uranusjr merged pull request #22609: Rewrite ti.xcom_pull() to consider map indexes

2022-03-30 Thread GitBox
uranusjr merged pull request #22609: URL: https://github.com/apache/airflow/pull/22609 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[airflow] branch main updated (91c958d -> 143702e)

2022-03-30 Thread uranusjr
This is an automated email from the ASF dual-hosted git repository. uranusjr pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from 91c958d Fix failing exec in Breeze (#22623) add 143702e Fix /rendered-templates for mapped operator (#22396)

[GitHub] [airflow] ferruzzi commented on a change in pull request #22517: Adds HiveToDynamoDB Transfer Sample DAG and Docs

2022-03-30 Thread GitBox
ferruzzi commented on a change in pull request #22517: URL: https://github.com/apache/airflow/pull/22517#discussion_r838749074 ## File path: airflow/providers/amazon/aws/example_dags/example_hive_to_dynamodb.py ## @@ -0,0 +1,137 @@ +# Licensed to the Apache Software Foundation

[GitHub] [airflow] ferruzzi commented on a change in pull request #22517: Adds HiveToDynamoDB Transfer Sample DAG and Docs

2022-03-30 Thread GitBox
ferruzzi commented on a change in pull request #22517: URL: https://github.com/apache/airflow/pull/22517#discussion_r838749074 ## File path: airflow/providers/amazon/aws/example_dags/example_hive_to_dynamodb.py ## @@ -0,0 +1,137 @@ +# Licensed to the Apache Software Foundation

[GitHub] [airflow] uranusjr merged pull request #22396: Fix /rendered-templates for mapped operator

2022-03-30 Thread GitBox
uranusjr merged pull request #22396: URL: https://github.com/apache/airflow/pull/22396 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] ferruzzi commented on a change in pull request #22517: Adds HiveToDynamoDB Transfer Sample DAG and Docs

2022-03-30 Thread GitBox
ferruzzi commented on a change in pull request #22517: URL: https://github.com/apache/airflow/pull/22517#discussion_r838749074 ## File path: airflow/providers/amazon/aws/example_dags/example_hive_to_dynamodb.py ## @@ -0,0 +1,137 @@ +# Licensed to the Apache Software Foundation

[GitHub] [airflow] potiuk commented on pull request #22625: Further improves image caching for Breeze

2022-03-30 Thread GitBox
potiuk commented on pull request #22625: URL: https://github.com/apache/airflow/pull/22625#issuecomment-1083359550 This will nicely handle moving "to" the new cache. The "inline" image cache should always be used from the remote image in `ghcr.io` to make sure latest version is used.

[airflow] branch main updated: Fix failing exec in Breeze (#22623)

2022-03-30 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 91c958d Fix failing exec in Breeze (#22623)

[GitHub] [airflow] potiuk merged pull request #22623: Fix failing exec in Breeze

2022-03-30 Thread GitBox
potiuk merged pull request #22623: URL: https://github.com/apache/airflow/pull/22623 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] potiuk opened a new pull request #22625: Further improves image caching for Breeze

2022-03-30 Thread GitBox
potiuk opened a new pull request #22625: URL: https://github.com/apache/airflow/pull/22625 In order to allow "big" rebuilds we remove the image tag before rebuilding, to make sure that the remote and not local image is used as source of cache. This is consequence of using inlined

[airflow] branch mapped-task-drawer updated (762f5fa -> 5abd094)

2022-03-30 Thread bbovenzi
This is an automated email from the ASF dual-hosted git repository. bbovenzi pushed a change to branch mapped-task-drawer in repository https://gitbox.apache.org/repos/asf/airflow.git. discard 762f5fa init_api_connexion in tests discard 43cb678 Fix undefined variables in tests discard

[GitHub] [airflow] dlesco commented on issue #22191: dag_processing code needs to handle OSError("handle is closed") in poll() and recv() calls

2022-03-30 Thread GitBox
dlesco commented on issue #22191: URL: https://github.com/apache/airflow/issues/22191#issuecomment-1083342338 This looks like a better approach than what I was thinking. One comment on the `_kill_process` change. self._process is an instance of multiprocessing.Process. An

[GitHub] [airflow] josh-fell commented on a change in pull request #22517: Adds HiveToDynamoDB Transfer Sample DAG and Docs

2022-03-30 Thread GitBox
josh-fell commented on a change in pull request #22517: URL: https://github.com/apache/airflow/pull/22517#discussion_r838714572 ## File path: airflow/providers/amazon/aws/example_dags/example_hive_to_dynamodb.py ## @@ -0,0 +1,137 @@ +# Licensed to the Apache Software

[airflow] branch mapped-task-drawer updated (43cb678 -> 762f5fa)

2022-03-30 Thread bbovenzi
This is an automated email from the ASF dual-hosted git repository. bbovenzi pushed a change to branch mapped-task-drawer in repository https://gitbox.apache.org/repos/asf/airflow.git. from 43cb678 Fix undefined variables in tests add 762f5fa init_api_connexion in tests No new

[airflow] branch constraints-main updated: Updating constraints. Build id:2065598806

2022-03-30 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-main by this push: new 6295c25 Updating

[GitHub] [airflow] github-actions[bot] commented on pull request #22609: Rewrite ti.xcom_pull() to consider map indexes

2022-03-30 Thread GitBox
github-actions[bot] commented on pull request #22609: URL: https://github.com/apache/airflow/pull/22609#issuecomment-1083314998 The PR most likely needs to run full matrix of tests because it modifies parts of the core of Airflow. However, committers might decide to merge it quickly and

[GitHub] [airflow] ajbosco commented on pull request #22261: allow annotations on helm dag pvc

2022-03-30 Thread GitBox
ajbosco commented on pull request #22261: URL: https://github.com/apache/airflow/pull/22261#issuecomment-1083302658 @jedcunningham any thoughts on this one? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [airflow] potix2 commented on issue #10742: Enable More PyDocStyle Checks

2022-03-30 Thread GitBox
potix2 commented on issue #10742: URL: https://github.com/apache/airflow/issues/10742#issuecomment-1083278639 @eladkal I gave up D400, because I got too many conflicts. I'm sorry for late reply. -- This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [airflow] github-actions[bot] commented on pull request #22396: Fix /rendered-templates for mapped operator

2022-03-30 Thread GitBox
github-actions[bot] commented on pull request #22396: URL: https://github.com/apache/airflow/pull/22396#issuecomment-1083263711 The PR most likely needs to run full matrix of tests because it modifies parts of the core of Airflow. However, committers might decide to merge it quickly and

[GitHub] [airflow] pateash commented on pull request #22548: Adding ArangoDB Provider

2022-03-30 Thread GitBox
pateash commented on pull request #22548: URL: https://github.com/apache/airflow/pull/22548#issuecomment-1083251267 > thanks @potiuk. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [airflow] github-actions[bot] commented on pull request #22623: Fix failing exec in Breeze

2022-03-30 Thread GitBox
github-actions[bot] commented on pull request #22623: URL: https://github.com/apache/airflow/pull/22623#issuecomment-1083251711 The PR most likely needs to run full matrix of tests because it modifies parts of the core of Airflow. However, committers might decide to merge it quickly and

[airflow] branch main updated (8240a44 -> d041dbe)

2022-03-30 Thread bbovenzi
This is an automated email from the ASF dual-hosted git repository. bbovenzi pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from 8240a44 Fix failing static check (#22621) add d041dbe Update modal buttons for mapped task instances

[GitHub] [airflow] HassanAlahmed commented on issue #22620: Ignoring class schema in airflow.hooks.dbapi

2022-03-30 Thread GitBox
HassanAlahmed commented on issue #22620: URL: https://github.com/apache/airflow/issues/22620#issuecomment-1083249291 I apologize, it turns out the passed scheme is being utilized correctly after all. I must have made a mistake somewhere else. -- This is an automated message from the

[GitHub] [airflow] HassanAlahmed closed issue #22620: Ignoring class schema in airflow.hooks.dbapi

2022-03-30 Thread GitBox
HassanAlahmed closed issue #22620: URL: https://github.com/apache/airflow/issues/22620 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] bbovenzi merged pull request #22578: Update modal buttons for mapped task instances

2022-03-30 Thread GitBox
bbovenzi merged pull request #22578: URL: https://github.com/apache/airflow/pull/22578 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] potiuk commented on pull request #22623: Fix failing exec in Breeze

2022-03-30 Thread GitBox
potiuk commented on pull request #22623: URL: https://github.com/apache/airflow/pull/22623#issuecomment-1083241429 Wait a minute with trying it I will have another change in a moment that hopefully will finally speed up all cases of breeze image build -- This is an automated message

[GitHub] [airflow] potiuk commented on pull request #22548: Adding ArangoDB Provider

2022-03-30 Thread GitBox
potiuk commented on pull request #22548: URL: https://github.com/apache/airflow/pull/22548#issuecomment-1083240173 Still puzzled :) but I am getting closer to solve it -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [airflow] potiuk opened a new pull request #22623: Fix failing exec in Breeze

2022-03-30 Thread GitBox
potiuk opened a new pull request #22623: URL: https://github.com/apache/airflow/pull/22623 --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/main/CONTRIBUTING.rst#pull-request-guidelines)** for more

  1   2   3   >