[GitHub] [airflow] laserpedro removed a comment on issue #17507: Task processes killed with WARNING - Recorded pid does not match the current pid

2021-09-09 Thread GitBox
laserpedro removed a comment on issue #17507: URL: https://github.com/apache/airflow/issues/17507#issuecomment-916670611 Update: I have increase the `scheduler_heartbeat_sec` to 60 sec instead of 5 sec and it seems to be "ok" for now so maybe a pb on the postgresql backend ... -- Th

[GitHub] [airflow] laserpedro commented on issue #17507: Task processes killed with WARNING - Recorded pid does not match the current pid

2021-09-09 Thread GitBox
laserpedro commented on issue #17507: URL: https://github.com/apache/airflow/issues/17507#issuecomment-916670611 Update: I have increase the `scheduler_heartbeat_sec` to 60 sec instead of 5 sec and it seems to be "ok" for now so maybe a pb on the postgresql backend ... -- This is an

[GitHub] [airflow] malthe commented on pull request #17576: Add pre/post execution hooks

2021-09-09 Thread GitBox
malthe commented on pull request #17576: URL: https://github.com/apache/airflow/pull/17576#issuecomment-916663394 @eladkal or in my case, instead of a "delay", it would be `trigger_rule={..., "start_time": time(7, 30)}`. @ashb and I agree about it ideally being explicit. @potiuk's co

[GitHub] [airflow] SamWheating commented on a change in pull request #17121: Deactivating DAGs which have been removed from files

2021-09-09 Thread GitBox
SamWheating commented on a change in pull request #17121: URL: https://github.com/apache/airflow/pull/17121#discussion_r705882789 ## File path: airflow/dag_processing/processor.py ## @@ -645,3 +648,12 @@ def process_file( self.log.exception("Error logging import er

[GitHub] [airflow] SamWheating commented on a change in pull request #17121: Deactivating DAGs which have been removed from files

2021-09-09 Thread GitBox
SamWheating commented on a change in pull request #17121: URL: https://github.com/apache/airflow/pull/17121#discussion_r705882789 ## File path: airflow/dag_processing/processor.py ## @@ -645,3 +648,12 @@ def process_file( self.log.exception("Error logging import er

[GitHub] [airflow] SamWheating commented on a change in pull request #17121: Deactivating DAGs which have been removed from files

2021-09-09 Thread GitBox
SamWheating commented on a change in pull request #17121: URL: https://github.com/apache/airflow/pull/17121#discussion_r705882789 ## File path: airflow/dag_processing/processor.py ## @@ -645,3 +648,12 @@ def process_file( self.log.exception("Error logging import er

[GitHub] [airflow] SamWheating commented on a change in pull request #18120: Handle DAGs with Parsing Errors

2021-09-09 Thread GitBox
SamWheating commented on a change in pull request #18120: URL: https://github.com/apache/airflow/pull/18120#discussion_r705880182 ## File path: airflow/dag_processing/processor.py ## @@ -647,3 +648,17 @@ def process_file( self.log.exception("Error logging import er

[GitHub] [airflow] SamWheating commented on a change in pull request #18120: Handle DAGs with Parsing Errors

2021-09-09 Thread GitBox
SamWheating commented on a change in pull request #18120: URL: https://github.com/apache/airflow/pull/18120#discussion_r705880182 ## File path: airflow/dag_processing/processor.py ## @@ -647,3 +648,17 @@ def process_file( self.log.exception("Error logging import er

[GitHub] [airflow] SamWheating commented on a change in pull request #17121: Deactivating DAGs which have been removed from files

2021-09-09 Thread GitBox
SamWheating commented on a change in pull request #17121: URL: https://github.com/apache/airflow/pull/17121#discussion_r705877189 ## File path: airflow/dag_processing/processor.py ## @@ -645,3 +648,12 @@ def process_file( self.log.exception("Error logging import er

[GitHub] [airflow] r-richmond commented on issue #18051: Airflow scheduling only 1 dag at a time leaving other dags in a queued state

2021-09-09 Thread GitBox
r-richmond commented on issue #18051: URL: https://github.com/apache/airflow/issues/18051#issuecomment-916603493 Ty @ephraimbuddy for the update. I was about to proceed with cherry picking #17945 and your comment saved me some extra experimentation work. -- This is an automated message f

[GitHub] [airflow] josh-fell opened a new pull request #18132: Updating Azure Data Explorer conn docs to reflect current fields and use

2021-09-09 Thread GitBox
josh-fell opened a new pull request #18132: URL: https://github.com/apache/airflow/pull/18132 The current connection doc for Azure Data Explorer do not align with the custom fields that were added in an earlier provider release. This PR updates the connection documentation with this infor

[airflow] branch v2-2-test updated (cc0e740 -> e6cb2f7)

2021-09-09 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch v2-2-test in repository https://gitbox.apache.org/repos/asf/airflow.git. from cc0e740 Update non-working example in documentation (#18067) add 9496235 Reapply "Build CI images for t

[GitHub] [airflow] rachelwigell commented on issue #18069: Move auto-refresh interval to config variable

2021-09-09 Thread GitBox
rachelwigell commented on issue #18069: URL: https://github.com/apache/airflow/issues/18069#issuecomment-916577592 Yeah I haven't quite been able to locally replicate the same severe effects on CPU we saw a few days ago. I do see that we are indeed making just one request to populate the t

[GitHub] [airflow] boring-cyborg[bot] commented on issue #18131: Airflow scheduler stuck with large DAG and concurrency limit

2021-09-09 Thread GitBox
boring-cyborg[bot] commented on issue #18131: URL: https://github.com/apache/airflow/issues/18131#issuecomment-916544319 Thanks for opening your first issue here! Be sure to follow the issue template! -- This is an automated message from the Apache Git Service. To respond to the mess

[GitHub] [airflow] zyong-moveworks opened a new issue #18131: Airflow scheduler stuck with large DAG and concurrency limit

2021-09-09 Thread GitBox
zyong-moveworks opened a new issue #18131: URL: https://github.com/apache/airflow/issues/18131 ### Apache Airflow version 2.1.3 (latest released) ### Operating System ubuntu ### Versions of Apache Airflow Providers apache-airflow-providers-amazon==2.1.0

[GitHub] [airflow] hpatel-higi commented on issue #18127: Fernet InvalidToken

2021-09-09 Thread GitBox
hpatel-higi commented on issue #18127: URL: https://github.com/apache/airflow/issues/18127#issuecomment-916540395 I actually have the crypto package installed in my airflow 1.10.8 docker container. here is the pip freeze: ``` alembic==1.7.1 amqp==2.6.1 apache-airflow=

[GitHub] [airflow] github-actions[bot] commented on pull request #18130: Add script that validate version fields in config.yaml

2021-09-09 Thread GitBox
github-actions[bot] commented on pull request #18130: URL: https://github.com/apache/airflow/pull/18130#issuecomment-916532539 The PR most likely needs to run full matrix of tests because it modifies parts of the core of Airflow. However, committers might decide to merge it quickly and tak

[GitHub] [airflow] mik-laj opened a new pull request #18130: Add script that validate version fields in config.yaml

2021-09-09 Thread GitBox
mik-laj opened a new pull request #18130: URL: https://github.com/apache/airflow/pull/18130 We sometimes release new versions of Airflow with new options, but we forget to update the config.yml file. In order to detect such situations, I add a simple script that compares relalased config.y

[GitHub] [airflow] github-actions[bot] commented on issue #10861: Improve Kubernetes Pod Operator Error Messages

2021-09-09 Thread GitBox
github-actions[bot] commented on issue #10861: URL: https://github.com/apache/airflow/issues/10861#issuecomment-916522724 This issue has been automatically marked as stale because it has been open for 30 days with no response from the author. It will be closed in next 7 days if no further

[GitHub] [airflow] github-actions[bot] commented on issue #11603: KubernetesExecutor with volumes and volume_mounts specified does not launch tasks

2021-09-09 Thread GitBox
github-actions[bot] commented on issue #11603: URL: https://github.com/apache/airflow/issues/11603#issuecomment-916522696 This issue has been automatically marked as stale because it has been open for 30 days with no response from the author. It will be closed in next 7 days if no further

[GitHub] [airflow] github-actions[bot] closed issue #17241: Python Operator on Apple M1, python 3.9.6, airflow 2.1.2

2021-09-09 Thread GitBox
github-actions[bot] closed issue #17241: URL: https://github.com/apache/airflow/issues/17241 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commi

[GitHub] [airflow] github-actions[bot] commented on issue #17241: Python Operator on Apple M1, python 3.9.6, airflow 2.1.2

2021-09-09 Thread GitBox
github-actions[bot] commented on issue #17241: URL: https://github.com/apache/airflow/issues/17241#issuecomment-916522592 This issue has been closed because it has not received response from the issue author. -- This is an automated message from the Apache Git Service. To respond to the

[airflow] branch main updated (a897076 -> e6cb2f7)

2021-09-09 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from a897076 Add Snowflake operators based on SQL Checks (#17741) add e6cb2f7 ECSOperator returns last logs when

[airflow] branch main updated (1945494 -> a897076)

2021-09-09 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from 1945494 Adding ``TaskGroup`` support in ``BaseOperator.chain()`` (#17456) add a897076 Add Snowflake operato

[GitHub] [airflow] kaxil closed issue #17038: ECSOperator returns last logs when ECS task fails

2021-09-09 Thread GitBox
kaxil closed issue #17038: URL: https://github.com/apache/airflow/issues/17038 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...

[GitHub] [airflow] kaxil merged pull request #17209: ECSOperator returns last logs when ECS task fails

2021-09-09 Thread GitBox
kaxil merged pull request #17209: URL: https://github.com/apache/airflow/pull/17209 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubs

[GitHub] [airflow] kaxil closed issue #17694: Add SQL Check Operators to Snowflake Provider

2021-09-09 Thread GitBox
kaxil closed issue #17694: URL: https://github.com/apache/airflow/issues/17694 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...

[GitHub] [airflow] kaxil merged pull request #17741: Add Snowflake DQ Operators

2021-09-09 Thread GitBox
kaxil merged pull request #17741: URL: https://github.com/apache/airflow/pull/17741 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubs

[airflow] branch main updated (b879550 -> 1945494)

2021-09-09 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from b879550 Aws secrets manager backend (#17448) add 1945494 Adding ``TaskGroup`` support in ``BaseOperator.chai

[GitHub] [airflow] kaxil commented on a change in pull request #17741: Add Snowflake DQ Operators

2021-09-09 Thread GitBox
kaxil commented on a change in pull request #17741: URL: https://github.com/apache/airflow/pull/17741#discussion_r705792140 ## File path: airflow/providers/snowflake/operators/snowflake.py ## @@ -100,28 +119,293 @@ def __init__( self.session_parameters = session_parame

[airflow] branch main updated (6e10131 -> b879550)

2021-09-09 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from 6e10131 Simplify s3 ``unify_bucket_name_and_key`` (#17325) add b879550 Aws secrets manager backend (#17448)

[airflow] branch main updated (969b239 -> 6e10131)

2021-09-09 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from 969b239 Test coverage on the autocomplete view (#15943) add 6e10131 Simplify s3 ``unify_bucket_name_and_key`

[GitHub] [airflow] kaxil merged pull request #17456: Adding TaskGroup support in chain()

2021-09-09 Thread GitBox
kaxil merged pull request #17456: URL: https://github.com/apache/airflow/pull/17456 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubs

[GitHub] [airflow] kaxil edited a comment on pull request #17448: Aws secrets manager backend

2021-09-09 Thread GitBox
kaxil edited a comment on pull request #17448: URL: https://github.com/apache/airflow/pull/17448#issuecomment-916511819 Argh :( I merged with the same PR title, we should have had a better Commit Message / PR Title -- This is an automated message from the Apache Git Service. To respond t

[GitHub] [airflow] kaxil edited a comment on pull request #17448: Aws secrets manager backend

2021-09-09 Thread GitBox
kaxil edited a comment on pull request #17448: URL: https://github.com/apache/airflow/pull/17448#issuecomment-916511819 Argh :( I merged with the same PR description, we should have had a better Commit Message / PR Title -- This is an automated message from the Apache Git Service. To res

[GitHub] [airflow] kaxil commented on pull request #17448: Aws secrets manager backend

2021-09-09 Thread GitBox
kaxil commented on pull request #17448: URL: https://github.com/apache/airflow/pull/17448#issuecomment-916511819 Argh :( Merged with the same PR description, we should have had a better Commit Message / PR Title -- This is an automated message from the Apache Git Service. To respond to t

[GitHub] [airflow] kaxil merged pull request #17448: Aws secrets manager backend

2021-09-09 Thread GitBox
kaxil merged pull request #17448: URL: https://github.com/apache/airflow/pull/17448 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubs

[GitHub] [airflow] kaxil merged pull request #17325: s3 unify_bucket_name_and_key simplify

2021-09-09 Thread GitBox
kaxil merged pull request #17325: URL: https://github.com/apache/airflow/pull/17325 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubs

[GitHub] [airflow] kaxil commented on a change in pull request #17121: Deactivating DAGs which have been removed from files

2021-09-09 Thread GitBox
kaxil commented on a change in pull request #17121: URL: https://github.com/apache/airflow/pull/17121#discussion_r705789095 ## File path: airflow/dag_processing/processor.py ## @@ -645,3 +648,12 @@ def process_file( self.log.exception("Error logging import errors!"

[GitHub] [airflow] kaxil commented on a change in pull request #17121: Deactivating DAGs which have been removed from files

2021-09-09 Thread GitBox
kaxil commented on a change in pull request #17121: URL: https://github.com/apache/airflow/pull/17121#discussion_r705788322 ## File path: airflow/dag_processing/processor.py ## @@ -645,3 +648,12 @@ def process_file( self.log.exception("Error logging import errors!"

[airflow] branch main updated (cfb602a -> 969b239)

2021-09-09 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from cfb602a Fix ``BigQuery`` data extraction in ``BigQueryToMySqlOperator`` (#18073) add 969b239 Test coverage

[airflow] branch main updated (2767781 -> cfb602a)

2021-09-09 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from 2767781 Update version added fields in airflow/config_templates/config.yml (#18128) add cfb602a Fix ``BigQu

[airflow] branch main updated (f97ddf1 -> 2767781)

2021-09-09 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from f97ddf1 Fix Sentry handler from LocalTaskJob causing error (#18119) add 2767781 Update version added fields

[GitHub] [airflow] kaxil merged pull request #15943: Test coverage on the autocomplete view

2021-09-09 Thread GitBox
kaxil merged pull request #15943: URL: https://github.com/apache/airflow/pull/15943 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubs

[GitHub] [airflow] kaxil closed issue #17198: BigQueryToMySqlOperator uses deprecated method and doesn't use keyword arguments

2021-09-09 Thread GitBox
kaxil closed issue #17198: URL: https://github.com/apache/airflow/issues/17198 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...

[GitHub] [airflow] kaxil merged pull request #18073: Fix BigQuery data extraction in BigQueryToMySqlOperator

2021-09-09 Thread GitBox
kaxil merged pull request #18073: URL: https://github.com/apache/airflow/pull/18073 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubs

[GitHub] [airflow] kaxil merged pull request #18128: Update version added fields in airflow/config_templates/config.yml

2021-09-09 Thread GitBox
kaxil merged pull request #18128: URL: https://github.com/apache/airflow/pull/18128 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubs

[airflow] branch main updated (c9d2946 -> f97ddf1)

2021-09-09 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from c9d2946 Fix deprecation error message rather than silencing it (#18126) add f97ddf1 Fix Sentry handler from

[airflow] branch main updated (2fd3f27 -> c9d2946)

2021-09-09 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from 2fd3f27 Make next_dagrun_info take a data interval (#18088) add c9d2946 Fix deprecation error message rather

[GitHub] [airflow] mik-laj commented on issue #18127: Fernet InvalidToken

2021-09-09 Thread GitBox
mik-laj commented on issue #18127: URL: https://github.com/apache/airflow/issues/18127#issuecomment-916503503 I don't understand why it worked in Airflow 1.10, but generating a new key every time the container is started will definitely not allow the data to be decrypted. You must use the

[GitHub] [airflow] kaxil closed issue #18118: Exception within LocalTaskJob._run_mini_scheduler_on_child_tasks brakes Sentry Handler

2021-09-09 Thread GitBox
kaxil closed issue #18118: URL: https://github.com/apache/airflow/issues/18118 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...

[GitHub] [airflow] kaxil merged pull request #18119: Fix Sentry handler from LocalTaskJob causing error

2021-09-09 Thread GitBox
kaxil merged pull request #18119: URL: https://github.com/apache/airflow/pull/18119 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubs

[GitHub] [airflow] kaxil merged pull request #18126: Fix deprecation error message rather than silencing it

2021-09-09 Thread GitBox
kaxil merged pull request #18126: URL: https://github.com/apache/airflow/pull/18126 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubs

[GitHub] [airflow] github-actions[bot] commented on pull request #18128: Update version added fields in airflow/config_templates/config.yml

2021-09-09 Thread GitBox
github-actions[bot] commented on pull request #18128: URL: https://github.com/apache/airflow/pull/18128#issuecomment-916498577 The PR most likely needs to run full matrix of tests because it modifies parts of the core of Airflow. However, committers might decide to merge it quickly and tak

[GitHub] [airflow] andrewgodwin commented on pull request #18129: Add heartbeat to TriggererJob

2021-09-09 Thread GitBox
andrewgodwin commented on pull request #18129: URL: https://github.com/apache/airflow/pull/18129#issuecomment-916498351 Note: I tried adding a test using threading, but unfortunately it's not easy to run the main `Job` execute loop in a test context right now, and our other option would be

[GitHub] [airflow] kaxil commented on a change in pull request #17100: Advanced Params using json-schema

2021-09-09 Thread GitBox
kaxil commented on a change in pull request #17100: URL: https://github.com/apache/airflow/pull/17100#discussion_r705732394 ## File path: airflow/cli/commands/dag_command.py ## @@ -106,21 +106,25 @@ def dag_backfill(args, dag=None): dag_run_state=State.NONE,

[GitHub] [airflow] github-actions[bot] commented on pull request #18129: Add heartbeat to TriggererJob

2021-09-09 Thread GitBox
github-actions[bot] commented on pull request #18129: URL: https://github.com/apache/airflow/pull/18129#issuecomment-916492508 The PR most likely needs to run full matrix of tests because it modifies parts of the core of Airflow. However, committers might decide to merge it quickly and tak

[GitHub] [airflow] andrewgodwin opened a new pull request #18129: Add heartbeat to TriggererJob

2021-09-09 Thread GitBox
andrewgodwin opened a new pull request #18129: URL: https://github.com/apache/airflow/pull/18129 Somehow, this got lost in one of my refactors and we only noticed while debugging the Helm chart. This adds a heartbeat to the TriggererJob to match SchedulerJob and the general job syst

[GitHub] [airflow] hpatel-higi commented on issue #18127: Fernet InvalidToken

2021-09-09 Thread GitBox
hpatel-higi commented on issue #18127: URL: https://github.com/apache/airflow/issues/18127#issuecomment-916486900 In my entrypoint.sh file i have this line of code to generate the fernet key ```: "${AIRFLOW__CORE__FERNET_KEY:=${FERNET_KEY:=$(python -c "from cryptography.fernet import

[GitHub] [airflow] mik-laj commented on a change in pull request #18128: Update version added fields in airflow/config_templates/config.yml

2021-09-09 Thread GitBox
mik-laj commented on a change in pull request #18128: URL: https://github.com/apache/airflow/pull/18128#discussion_r705752232 ## File path: airflow/config_templates/config.yml ## @@ -1635,7 +1635,7 @@ - name: worker_precheck description: | Worker initialisa

[GitHub] [airflow] mik-laj commented on a change in pull request #18128: Update version added fields in airflow/config_templates/config.yml

2021-09-09 Thread GitBox
mik-laj commented on a change in pull request #18128: URL: https://github.com/apache/airflow/pull/18128#discussion_r705750595 ## File path: airflow/config_templates/config.yml ## @@ -628,25 +628,25 @@ - name: statsd_on description: | Enables sending metrics

[GitHub] [airflow] mik-laj commented on a change in pull request #18128: Update version added fields in airflow/config_templates/config.yml

2021-09-09 Thread GitBox
mik-laj commented on a change in pull request #18128: URL: https://github.com/apache/airflow/pull/18128#discussion_r705750180 ## File path: airflow/config_templates/config.yml ## @@ -454,23 +454,23 @@ description: | The folder where airflow should store its log

[GitHub] [airflow] mik-laj commented on issue #18127: Fernet InvalidToken

2021-09-09 Thread GitBox
mik-laj commented on issue #18127: URL: https://github.com/apache/airflow/issues/18127#issuecomment-916484838 In case you do not set the fernet key, Airflow will generate a new key, which means that if you restart the container, you may lose access to the key. You should explicitly define

[GitHub] [airflow] mik-laj closed issue #18127: Fernet InvalidToken

2021-09-09 Thread GitBox
mik-laj closed issue #18127: URL: https://github.com/apache/airflow/issues/18127 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr.

[GitHub] [airflow] mik-laj opened a new pull request #18128: Update version added fields in airflow/config_templates/config.yml

2021-09-09 Thread GitBox
mik-laj opened a new pull request #18128: URL: https://github.com/apache/airflow/pull/18128 I have looked at all the fields carefully and noticed a few problems that I would like to correct. I used the script I wrote to check in what version the options were added. https://gist.github.c

[GitHub] [airflow] subkanthi commented on a change in pull request #17068: Influxdb Hook

2021-09-09 Thread GitBox
subkanthi commented on a change in pull request #17068: URL: https://github.com/apache/airflow/pull/17068#discussion_r705740566 ## File path: airflow/providers/influxdb/example_dags/example_influxdb.py ## @@ -0,0 +1,57 @@ +# Licensed to the Apache Software Foundation (ASF) unde

[GitHub] [airflow] boring-cyborg[bot] commented on issue #18127: Fernet InvalidToken

2021-09-09 Thread GitBox
boring-cyborg[bot] commented on issue #18127: URL: https://github.com/apache/airflow/issues/18127#issuecomment-916478979 Thanks for opening your first issue here! Be sure to follow the issue template! -- This is an automated message from the Apache Git Service. To respond to the mess

[GitHub] [airflow] hpatel-higi opened a new issue #18127: Fernet InvalidToken

2021-09-09 Thread GitBox
hpatel-higi opened a new issue #18127: URL: https://github.com/apache/airflow/issues/18127 ### Apache Airflow version 2.1.3 (latest released) ### Operating System Linux ### Versions of Apache Airflow Providers apache-airflow-providers-apache-hive==2.0.2

[airflow] branch main updated (046f02e -> 2fd3f27)

2021-09-09 Thread uranusjr
This is an automated email from the ASF dual-hosted git repository. uranusjr pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from 046f02e fix misspelling (#18121) add 2fd3f27 Make next_dagrun_info take a data interval (#18088) No new revi

[GitHub] [airflow] uranusjr merged pull request #18088: Make next_dagrun_info take a data interval

2021-09-09 Thread GitBox
uranusjr merged pull request #18088: URL: https://github.com/apache/airflow/pull/18088 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-uns

[GitHub] [airflow] potiuk edited a comment on pull request #17576: Add pre/post execution hooks

2021-09-09 Thread GitBox
potiuk edited a comment on pull request #17576: URL: https://github.com/apache/airflow/pull/17576#issuecomment-916426991 I think I even discussed it with @malthe that time based decision will be better done based on AIP-39. So I agree @ashb - this is likely not a good use of those pre/pos

[GitHub] [airflow] potiuk edited a comment on pull request #17576: Add pre/post execution hooks

2021-09-09 Thread GitBox
potiuk edited a comment on pull request #17576: URL: https://github.com/apache/airflow/pull/17576#issuecomment-916426991 I think I even discussed it with @malthe that time based decision will be better done based on AIP-39. So I agree @ashb - this is likely not a good use of those pre/pos

[GitHub] [airflow] eladkal edited a comment on pull request #17576: Add pre/post execution hooks

2021-09-09 Thread GitBox
eladkal edited a comment on pull request #17576: URL: https://github.com/apache/airflow/pull/17576#issuecomment-916429784 > I think that should be explicit in the dag +1 > I hadn't considered something like "give my stream processing up to X minutes to process the data for thi

[GitHub] [airflow] eladkal commented on pull request #17576: Add pre/post execution hooks

2021-09-09 Thread GitBox
eladkal commented on pull request #17576: URL: https://github.com/apache/airflow/pull/17576#issuecomment-916429784 > I think that should be explicit in the dag +1 > I hadn't considered something like "give my stream processing up to X minutes to process the data for this inter

[airflow] branch main updated (feb0a4b -> 046f02e)

2021-09-09 Thread ash
This is an automated email from the ASF dual-hosted git repository. ash pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from feb0a4b Change XCom class methods to accept run_id argument (#18084) add 046f02e fix misspelling (#18121) No new

[GitHub] [airflow] potiuk edited a comment on pull request #17576: Add pre/post execution hooks

2021-09-09 Thread GitBox
potiuk edited a comment on pull request #17576: URL: https://github.com/apache/airflow/pull/17576#issuecomment-916426991 I think I even discussed it with @malthe that time based decision will be better done based on AIP-39. So I agree @ashb - this is likely not a good use of those pre/pos

[GitHub] [airflow] ashb merged pull request #18121: [AIRFLOW-XXX] fix misspelling in docs/

2021-09-09 Thread GitBox
ashb merged pull request #18121: URL: https://github.com/apache/airflow/pull/18121 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubsc

[GitHub] [airflow] potiuk edited a comment on pull request #17576: Add pre/post execution hooks

2021-09-09 Thread GitBox
potiuk edited a comment on pull request #17576: URL: https://github.com/apache/airflow/pull/17576#issuecomment-916426991 I think I even discussed it with @malthe that time based decision will be better done based on AIP-39. So I agree @ashb - this is likely not a good use of those pre/pos

[GitHub] [airflow] potiuk commented on pull request #17576: Add pre/post execution hooks

2021-09-09 Thread GitBox
potiuk commented on pull request #17576: URL: https://github.com/apache/airflow/pull/17576#issuecomment-916426991 I think I even discussed it with @malthe that time based decision will be better done based on AIP-39. So I agree @ashb - this is likely not a good use of those pre/post_hooks

[GitHub] [airflow] ashb closed issue #16371: Make `XCom.get_one()` + `get_many()` accept run_id

2021-09-09 Thread GitBox
ashb closed issue #16371: URL: https://github.com/apache/airflow/issues/16371 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@

[GitHub] [airflow] ashb commented on issue #16371: Make `XCom.get_one()` + `get_many()` accept run_id

2021-09-09 Thread GitBox
ashb commented on issue #16371: URL: https://github.com/apache/airflow/issues/16371#issuecomment-916424567 Closed by https://github.com/apache/airflow/pull/18084 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [airflow] ashb commented on pull request #16849: Allow passing run_id to XCom.get_[one|many]

2021-09-09 Thread GitBox
ashb commented on pull request #16849: URL: https://github.com/apache/airflow/pull/16849#issuecomment-916424317 Closed in favour of https://github.com/apache/airflow/pull/18084 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [airflow] ashb closed pull request #16849: Allow passing run_id to XCom.get_[one|many]

2021-09-09 Thread GitBox
ashb closed pull request #16849: URL: https://github.com/apache/airflow/pull/16849 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubsc

[GitHub] [airflow] github-actions[bot] commented on pull request #17100: Advanced Params using json-schema

2021-09-09 Thread GitBox
github-actions[bot] commented on pull request #17100: URL: https://github.com/apache/airflow/pull/17100#issuecomment-916423794 The PR most likely needs to run full matrix of tests because it modifies parts of the core of Airflow. However, committers might decide to merge it quickly and tak

[GitHub] [airflow] ashb commented on a change in pull request #17100: Advanced Params using json-schema

2021-09-09 Thread GitBox
ashb commented on a change in pull request #17100: URL: https://github.com/apache/airflow/pull/17100#discussion_r705677631 ## File path: airflow/models/param.py ## @@ -0,0 +1,208 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agr

[GitHub] [airflow] mik-laj closed issue #18110: Airflow CORS issue with Angular

2021-09-09 Thread GitBox
mik-laj closed issue #18110: URL: https://github.com/apache/airflow/issues/18110 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr.

[GitHub] [airflow] mik-laj commented on issue #18110: Airflow CORS issue with Angular

2021-09-09 Thread GitBox
mik-laj commented on issue #18110: URL: https://github.com/apache/airflow/issues/18110#issuecomment-916420693 Support for CORS has been added in Airflow 2.1.0, so it is not available in Airflow 2.0.0. See: https://github.com/apache/airflow/pull/13620 > Airflow 2.1.0, 2021-05-21 >

[GitHub] [airflow] josh-fell commented on issue #18102: Snowflake provider not accepting private_key_file in extras

2021-09-09 Thread GitBox
josh-fell commented on issue #18102: URL: https://github.com/apache/airflow/issues/18102#issuecomment-916419483 This is a symptom of connections using both custom fields and the classic `Extras` field in the connection form. [This PR](https://github.com/apache/airflow/pull/17269) will fix

[GitHub] [airflow] mik-laj commented on issue #18125: Create pytest plugin for prepare test environment

2021-09-09 Thread GitBox
mik-laj commented on issue #18125: URL: https://github.com/apache/airflow/issues/18125#issuecomment-916416908 I think it would be a better idea to prepare a sample repository, which will contain example tests, that everyone can analyze to inspire themselves in their project. I even started

[airflow] branch main updated (47e8fa6 -> feb0a4b)

2021-09-09 Thread ash
This is an automated email from the ASF dual-hosted git repository. ash pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from 47e8fa6 Add "packaging" to core requirements (#18122) add feb0a4b Change XCom class methods to accept run_id argum

[GitHub] [airflow] ashb merged pull request #18084: Change XCom class methods to accept run_id argument

2021-09-09 Thread GitBox
ashb merged pull request #18084: URL: https://github.com/apache/airflow/pull/18084 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubsc

[GitHub] [airflow] collinmcnulty commented on pull request #18071: Change from dynamic date to fixed date in examples

2021-09-09 Thread GitBox
collinmcnulty commented on pull request #18071: URL: https://github.com/apache/airflow/pull/18071#issuecomment-916415028 I've run the Core and Other tests in breeze for Postgres 13 and Python 3.7 and all passed. -- This is an automated message from the Apache Git Service. To respond to t

[GitHub] [airflow] ashb commented on pull request #17576: Add pre/post execution hooks

2021-09-09 Thread GitBox
ashb commented on pull request #17576: URL: https://github.com/apache/airflow/pull/17576#issuecomment-916413420 @malthe Valid point -- I hadn't considered something like "give my stream processing up to X minutes to process the data for this interval and make it available". But I th

[GitHub] [airflow] malthe commented on pull request #17576: Add pre/post execution hooks

2021-09-09 Thread GitBox
malthe commented on pull request #17576: URL: https://github.com/apache/airflow/pull/17576#issuecomment-916406721 @ashb I do think there are often bad reasons behind wanting to start a task no earlier than some timestamp, but I will maintain that there can be good reasons too and it's not

[GitHub] [airflow] ashb opened a new pull request #18126: Fix deprecation error message rather than silencing it

2021-09-09 Thread GitBox
ashb opened a new pull request #18126: URL: https://github.com/apache/airflow/pull/18126 The PR description hopefully says it all :D -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the speci

[GitHub] [airflow] ashb edited a comment on pull request #17576: Add pre/post execution hooks

2021-09-09 Thread GitBox
ashb edited a comment on pull request #17576: URL: https://github.com/apache/airflow/pull/17576#issuecomment-916396684 Forgive me, it's late and been a long day, so I may not be as lucid as I'd hope. My main concern here is about being able to reason about what a DAG will do. By add

[airflow] branch main updated (9c7ae4d -> 47e8fa6)

2021-09-09 Thread uranusjr
This is an automated email from the ASF dual-hosted git repository. uranusjr pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from 9c7ae4d added TUD to INTHEWILD.md (#18123) add 47e8fa6 Add "packaging" to core requirements (#18122) No new

[GitHub] [airflow] ashb commented on pull request #17576: Add pre/post execution hooks

2021-09-09 Thread GitBox
ashb commented on pull request #17576: URL: https://github.com/apache/airflow/pull/17576#issuecomment-916396684 Forgive me, it's late and been a long day, so I may not be as lucid as I'd hope. My main concern here is about being able to reason about what a DAG will do. By adding the

[GitHub] [airflow] uranusjr merged pull request #18122: Add "packaging" to core requirements

2021-09-09 Thread GitBox
uranusjr merged pull request #18122: URL: https://github.com/apache/airflow/pull/18122 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-uns

[GitHub] [airflow] potiuk commented on pull request #17576: Add pre/post execution hooks

2021-09-09 Thread GitBox
potiuk commented on pull request #17576: URL: https://github.com/apache/airflow/pull/17576#issuecomment-916395891 Just to add one more thing @ashb - if there are other features in upcoming AIP's that might make it useless/obsolete/outdated/replaceable - I am all for it. We just simply migh

  1   2   3   >