[GitHub] [airflow] malthe commented on pull request #22503: PowerShell Remoting fail on non-zero exitcode

2022-03-27 Thread GitBox
malthe commented on pull request #22503: URL: https://github.com/apache/airflow/pull/22503#issuecomment-1080220957 @potiuk yes – I opened up an issue in the library repository to confirm this: https://github.com/jborean93/pypsrp/issues/146. -- This is an automated message from the

[GitHub] [airflow] pingzh commented on pull request #19769: Handle stuck queued tasks in Celery for db backend

2022-03-27 Thread GitBox
pingzh commented on pull request #19769: URL: https://github.com/apache/airflow/pull/19769#issuecomment-1080169023 @ephraimbuddy since we switched to SQS as our message broker from redis (it only happened when under high load) 2 years, we haven't experienced this issue. -- This is an

[GitHub] [airflow] bbovenzi commented on a change in pull request #22123: Add details drawer to Grid View

2022-03-27 Thread GitBox
bbovenzi commented on a change in pull request #22123: URL: https://github.com/apache/airflow/pull/22123#discussion_r836042491 ## File path: airflow/www/views.py ## @@ -527,6 +527,21 @@ def get_task_stats_from_query(qry): return data +def redirect_or_json(origin,

[GitHub] [airflow] eladkal commented on issue #22560: KubernetesExecutor does not work with exec authentication on kubernetes client >= 22.6.0

2022-03-27 Thread GitBox
eladkal commented on issue #22560: URL: https://github.com/apache/airflow/issues/22560#issuecomment-1080153353 @dszakallas can you open PR with the suggested fix? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [airflow] MatrixManAtYrService opened a new issue #22561: Scheduler crashes: "Cannot unmap a deserialized operator"

2022-03-27 Thread GitBox
MatrixManAtYrService opened a new issue #22561: URL: https://github.com/apache/airflow/issues/22561 ### Apache Airflow version main (development) ### What happened Here's a DAG: ```python3 @task def mynameis(arg, **context): ti: TaskInstance =

[GitHub] [airflow] dstandish commented on pull request #22546: Deprecate connection extra prefix

2022-03-27 Thread GitBox
dstandish commented on pull request #22546: URL: https://github.com/apache/airflow/pull/22546#issuecomment-1080124539 > I like the idea. Not sure if I have all the skills to review :). But once the errors are fixed I can do some manual testing :) jarek "lacking in skills" ...

[GitHub] [airflow] dstandish closed pull request #22546: Deprecate connection extra prefix

2022-03-27 Thread GitBox
dstandish closed pull request #22546: URL: https://github.com/apache/airflow/pull/22546 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] lrbsantos commented on issue #19104: airflow db reset throws error while initialising breeze with python version 3.8 and mysql as backend

2022-03-27 Thread GitBox
lrbsantos commented on issue #19104: URL: https://github.com/apache/airflow/issues/19104#issuecomment-1080113332 Hi @Bowrna, did you find the reason and a fix for this issue? I am facing the same problem right now. I checked the files as @potiuk recommended and each one of them seems to

[GitHub] [airflow] github-actions[bot] closed pull request #20578: Use KubernetesHook to create api client in KubernetesPodOperator

2022-03-27 Thread GitBox
github-actions[bot] closed pull request #20578: URL: https://github.com/apache/airflow/pull/20578 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] github-actions[bot] commented on issue #21007: Run task - crashed

2022-03-27 Thread GitBox
github-actions[bot] commented on issue #21007: URL: https://github.com/apache/airflow/issues/21007#issuecomment-1080052067 This issue has been automatically marked as stale because it has been open for 30 days with no response from the author. It will be closed in next 7 days if no

[GitHub] [airflow] dszakallas edited a comment on issue #22560: KubernetesExecutor does not work with exec authentication on kubernetes >= 22.6.0

2022-03-27 Thread GitBox
dszakallas edited a comment on issue #22560: URL: https://github.com/apache/airflow/issues/22560#issuecomment-1080038043 I did a bit more of debugging, it seems that the error is not specific to kubelogin and a much more general problem. I am renaming the ticket as it has little to do

[GitHub] [airflow] dszakallas commented on issue #22560: KubernetesExecutor does not work with kubelogin exec authentication

2022-03-27 Thread GitBox
dszakallas commented on issue #22560: URL: https://github.com/apache/airflow/issues/22560#issuecomment-1080038043 I did a bit more of debugging, it seems that the error is not specific to kubelogin. I am renaming the ticket as it has little to do with kubelogin and Azure. I found

[GitHub] [airflow] aljanson edited a comment on issue #21605: KubernetesPodOperator Fails on empty log line

2022-03-27 Thread GitBox
aljanson edited a comment on issue #21605: URL: https://github.com/apache/airflow/issues/21605#issuecomment-1080009323 @potiuk Just adding a little more context. I am using Airflow 2.x to spin up pods on an Azure Kubernetes Cluster using the KubernetesPodOperator operator. Its

[GitHub] [airflow] pcolladosoto commented on issue #22191: dag_processing code needs to handle OSError("handle is closed") in poll() and recv() calls

2022-03-27 Thread GitBox
pcolladosoto commented on issue #22191: URL: https://github.com/apache/airflow/issues/22191#issuecomment-1080033434 Hi @potiuk! I'm glad you found our investigation useful and that you had fun reading through it. Reading so may Agatha Christie books has to pay off at some point  I

[GitHub] [airflow] eladkal closed issue #8387: PostgresToGCSOperator doesn't convert DATE correctly

2022-03-27 Thread GitBox
eladkal closed issue #8387: URL: https://github.com/apache/airflow/issues/8387 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] pierrejeambrun edited a comment on issue #8387: PostgresToGCSOperator doesn't convert DATE correctly

2022-03-27 Thread GitBox
pierrejeambrun edited a comment on issue #8387: URL: https://github.com/apache/airflow/issues/8387#issuecomment-1080028377 Normally it does indeed solve this issue. In my tests I could export and then load into bigquery each of these different field types. -- This is an automated

[GitHub] [airflow] pierrejeambrun edited a comment on issue #8387: PostgresToGCSOperator doesn't convert DATE correctly

2022-03-27 Thread GitBox
pierrejeambrun edited a comment on issue #8387: URL: https://github.com/apache/airflow/issues/8387#issuecomment-1080028377 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [airflow] pierrejeambrun edited a comment on issue #8387: PostgresToGCSOperator doesn't convert DATE correctly

2022-03-27 Thread GitBox
pierrejeambrun edited a comment on issue #8387: URL: https://github.com/apache/airflow/issues/8387#issuecomment-1080028377 Normally it does indeed solve this issue. In my tests I could export and then load in bigquery each of these different fields. -- This is an automated message from

[GitHub] [airflow] pierrejeambrun commented on issue #8387: PostgresToGCSOperator doesn't convert DATE correctly

2022-03-27 Thread GitBox
pierrejeambrun commented on issue #8387: URL: https://github.com/apache/airflow/issues/8387#issuecomment-1080028377 Normally it does indeed solve this issue. In my test I could export and then load in bigquery each of these different fields. -- This is an automated message from the

[GitHub] [airflow] dszakallas opened a new issue #22560: KubernetesExecutor does not work with kubelogin exec authentication

2022-03-27 Thread GitBox
dszakallas opened a new issue #22560: URL: https://github.com/apache/airflow/issues/22560 ### Apache Airflow version 2.2.4 (latest released) ### What happened When using KubernetesExecutor with `in_cluster = False` in conjunction with a Config with an `exec` user using

[GitHub] [airflow] boring-cyborg[bot] commented on issue #22560: KubernetesExecutor does not work with kubelogin exec authentication

2022-03-27 Thread GitBox
boring-cyborg[bot] commented on issue #22560: URL: https://github.com/apache/airflow/issues/22560#issuecomment-1080026975 Thanks for opening your first issue here! Be sure to follow the issue template! -- This is an automated message from the Apache Git Service. To respond to the

[airflow] branch constraints-main updated: Updating constraints. Build id:2048903572

2022-03-27 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-main by this push: new 07c004e Updating

[GitHub] [airflow] eladkal commented on issue #8387: PostgresToGCSOperator doesn't convert DATE correctly

2022-03-27 Thread GitBox
eladkal commented on issue #8387: URL: https://github.com/apache/airflow/issues/8387#issuecomment-1080022910 https://github.com/apache/airflow/pull/22536 might have solved this. @pierrejeambrun can you confirm? -- This is an automated message from the Apache Git Service. To respond to

[GitHub] [airflow] eladkal commented on issue #8459: Add ability to sort dag list in the UI by Dag, Owner, Last Run

2022-03-27 Thread GitBox
eladkal commented on issue #8459: URL: https://github.com/apache/airflow/issues/8459#issuecomment-1080022006 Since @scrdest doesnt have the time to finish i assiged to you -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [airflow] pierrejeambrun commented on issue #8459: Add ability to sort dag list in the UI by Dag, Owner, Last Run

2022-03-27 Thread GitBox
pierrejeambrun commented on issue #8459: URL: https://github.com/apache/airflow/issues/8459#issuecomment-1080019653 Hello guys, Thank you @eladkal for pointing me to this issue. I would be glad to help on this one :) Best, -- This is an automated message from the Apache

[GitHub] [airflow] potiuk commented on pull request #22503: PowerShell Remoting fail on non-zero exitcode

2022-03-27 Thread GitBox
potiuk commented on pull request #22503: URL: https://github.com/apache/airflow/pull/22503#issuecomment-1080016768 Do you REALLY need to add host to capture RC of the task ? 路 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [airflow] github-actions[bot] commented on pull request #22556: If k8s is not installed, add if condition to exclude DAG(local_kubernetes_executor)

2022-03-27 Thread GitBox
github-actions[bot] commented on pull request #22556: URL: https://github.com/apache/airflow/pull/22556#issuecomment-1080014746 The PR most likely needs to run full matrix of tests because it modifies parts of the core of Airflow. However, committers might decide to merge it quickly and

[GitHub] [airflow] potiuk commented on pull request #22556: If k8s is not installed, add if condition to exclude DAG(local_kubernetes_executor)

2022-03-27 Thread GitBox
potiuk commented on pull request #22556: URL: https://github.com/apache/airflow/pull/22556#issuecomment-1080014721 Static checks @subkanthi :) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [airflow] github-actions[bot] commented on pull request #22557: Switch azure provider to azure-keyvault-secrets

2022-03-27 Thread GitBox
github-actions[bot] commented on pull request #22557: URL: https://github.com/apache/airflow/pull/22557#issuecomment-1080014457 The PR most likely needs to run full matrix of tests because it modifies parts of the core of Airflow. However, committers might decide to merge it quickly and

[GitHub] [airflow] ephraimbuddy commented on pull request #22557: Switch azure provider to azure-keyvault-secrets

2022-03-27 Thread GitBox
ephraimbuddy commented on pull request #22557: URL: https://github.com/apache/airflow/pull/22557#issuecomment-1080014420 Please rebase -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [airflow] potiuk commented on pull request #22280: Add links for BigQuery Data Transfer

2022-03-27 Thread GitBox
potiuk commented on pull request #22280: URL: https://github.com/apache/airflow/pull/22280#issuecomment-1080014319 Need to resolve conflicts first too. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [airflow] potiuk commented on pull request #22548: WIP: Add Arango hook

2022-03-27 Thread GitBox
potiuk commented on pull request #22548: URL: https://github.com/apache/airflow/pull/22548#issuecomment-1080014103 Can you fix static checks please. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [airflow] potiuk commented on pull request #22546: Deprecate connection extra prefix

2022-03-27 Thread GitBox
potiuk commented on pull request #22546: URL: https://github.com/apache/airflow/pull/22546#issuecomment-1080013917 I like the idea. Not sure if I have all the skills to review :). But once the errors are fixed I can do some manual testing :) -- This is an automated message from the

[airflow] branch main updated: Issue 20453 google common cloud fixes part 1 (#22213)

2022-03-27 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 2af13f2 Issue 20453 google common cloud fixes

[GitHub] [airflow] potiuk merged pull request #22213: Issue 20453 google common cloud fixes part 1

2022-03-27 Thread GitBox
potiuk merged pull request #22213: URL: https://github.com/apache/airflow/pull/22213 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[airflow] branch main updated: Add a link to Databricks Job Run (#22541)

2022-03-27 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 95169d1 Add a link to Databricks Job Run (#22541)

[GitHub] [airflow] potiuk merged pull request #22541: Add an UI link to Databricks Job Run

2022-03-27 Thread GitBox
potiuk merged pull request #22541: URL: https://github.com/apache/airflow/pull/22541 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[airflow] branch main updated (352d7f7 -> c0736de)

2022-03-27 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from 352d7f7 More operators for Databricks Repos (#22422) add c0736de Add max line length setting to .editorconfig

[GitHub] [airflow] potiuk merged pull request #22540: Add max line length setting to .editorconfig

2022-03-27 Thread GitBox
potiuk merged pull request #22540: URL: https://github.com/apache/airflow/pull/22540 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[airflow] branch main updated: More operators for Databricks Repos (#22422)

2022-03-27 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 352d7f7 More operators for Databricks Repos

[GitHub] [airflow] potiuk merged pull request #22422: More operators for Databricks Repos

2022-03-27 Thread GitBox
potiuk merged pull request #22422: URL: https://github.com/apache/airflow/pull/22422 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] potiuk closed pull request #22522: Update example_s3_bucket.py

2022-03-27 Thread GitBox
potiuk closed pull request #22522: URL: https://github.com/apache/airflow/pull/22522 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[airflow] branch main updated: Refactor: BigQuery to GCS Operator (#22506)

2022-03-27 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 02976be Refactor: BigQuery to GCS Operator

[GitHub] [airflow] boring-cyborg[bot] commented on pull request #22506: Refactor: BigQuery to GCS Operator

2022-03-27 Thread GitBox
boring-cyborg[bot] commented on pull request #22506: URL: https://github.com/apache/airflow/pull/22506#issuecomment-1080011688 Awesome work, congrats on your first merged pull request! -- This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [airflow] potiuk closed issue #22034: BigQueryToGCSOperator: Invalid dataset ID error

2022-03-27 Thread GitBox
potiuk closed issue #22034: URL: https://github.com/apache/airflow/issues/22034 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] potiuk merged pull request #22506: Refactor: BigQuery to GCS Operator

2022-03-27 Thread GitBox
potiuk merged pull request #22506: URL: https://github.com/apache/airflow/pull/22506 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[airflow] branch main updated: Add doc and example dag for AWS CloudFormation Operators (#22533)

2022-03-27 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 02526b3 Add doc and example dag for AWS

[GitHub] [airflow] potiuk merged pull request #22533: Add doc and example dag for AWS CloudFormation Operators

2022-03-27 Thread GitBox
potiuk merged pull request #22533: URL: https://github.com/apache/airflow/pull/22533 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] aljanson commented on issue #21605: KubernetesPodOperator Fails on empty log line

2022-03-27 Thread GitBox
aljanson commented on issue #21605: URL: https://github.com/apache/airflow/issues/21605#issuecomment-1080009323 Just adding a little more context. I am using Airflow 2.x to spin up pods on an Azure Kubernetes Cluster using the KubernetesPodOperator operator. Its interesting that I

[GitHub] [airflow] potiuk commented on issue #22459: Migrate Presto example DAGs to new design

2022-03-27 Thread GitBox
potiuk commented on issue #22459: URL: https://github.com/apache/airflow/issues/22459#issuecomment-1080008853 If there are Presto "owners" here to take on the task of migrating it - they should do it. It's not our task to decide on Presto vs. Trino. -- This is an automated message from

[airflow] branch main updated (bfc36fa -> df473d7)

2022-03-27 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from bfc36fa Fix bugs about timezone change (#22525) add df473d7 GoogleApiToS3Operator: update sample dag and doc

[GitHub] [airflow] potiuk merged pull request #22507: GoogleApiToS3Operator: update sample dag and doc

2022-03-27 Thread GitBox
potiuk merged pull request #22507: URL: https://github.com/apache/airflow/pull/22507 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] potiuk commented on issue #22529: Airflow Worker not picking up "cmd" in config file

2022-03-27 Thread GitBox
potiuk commented on issue #22529: URL: https://github.com/apache/airflow/issues/22529#issuecomment-1080007133 This is very unlikely to happen. There is no distinction vs. commands in Airflow. You must have a different configuration of your deployment tooling. -- This is an automated

[GitHub] [airflow] potiuk commented on pull request #21956: prod image build changes

2022-03-27 Thread GitBox
potiuk commented on pull request #21956: URL: https://github.com/apache/airflow/pull/21956#issuecomment-1080002230 Rebasing to re-run all tests :) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[airflow] branch main updated (85871eb -> bfc36fa)

2022-03-27 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from 85871eb Fix entire DAG stops when one task has end_date (#20920) add bfc36fa Fix bugs about timezone change

[GitHub] [airflow] potiuk merged pull request #22525: Fix bugs about timezone change

2022-03-27 Thread GitBox
potiuk merged pull request #22525: URL: https://github.com/apache/airflow/pull/22525 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] boring-cyborg[bot] commented on pull request #22525: Fix bugs about timezone change

2022-03-27 Thread GitBox
boring-cyborg[bot] commented on pull request #22525: URL: https://github.com/apache/airflow/pull/22525#issuecomment-1080001012 Awesome work, congrats on your first merged pull request! -- This is an automated message from the Apache Git Service. To respond to the message, please log

[airflow] branch main updated (f612a2f -> 85871eb)

2022-03-27 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from f612a2f Optimize Multiplatform cache builds (#22258) add 85871eb Fix entire DAG stops when one task has

[GitHub] [airflow] potiuk closed issue #19917: Task-level end_date stops entire DAG

2022-03-27 Thread GitBox
potiuk closed issue #19917: URL: https://github.com/apache/airflow/issues/19917 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] potiuk merged pull request #20920: Fix entire DAG stops when one task has end_date

2022-03-27 Thread GitBox
potiuk merged pull request #20920: URL: https://github.com/apache/airflow/pull/20920 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] potiuk commented on pull request #22503: PowerShell Remoting fail on non-zero exitcode

2022-03-27 Thread GitBox
potiuk commented on pull request #22503: URL: https://github.com/apache/airflow/pull/22503#issuecomment-108755 Tests are failing -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [airflow] potiuk commented on pull request #22374: Fix tasks being wrongly skipped by `schedule_after_task_execution`.

2022-03-27 Thread GitBox
potiuk commented on pull request #22374: URL: https://github.com/apache/airflow/pull/22374#issuecomment-108499 Just not seeing any tests added/changed makes me suspicius about the change. If there was no test coverage for this case - we should add them to avoid regressions. -- This

[airflow] branch constraints-main updated: Updating constraints. Build id:2048520282

2022-03-27 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-main by this push: new 40bee2d Updating

[GitHub] [airflow] raphaelauv commented on issue #22549: Status of testing of Apache Airflow 2.2.5rc1

2022-03-27 Thread GitBox
raphaelauv commented on issue #22549: URL: https://github.com/apache/airflow/issues/22549#issuecomment-1079996394 **https://github.com/apache/airflow/pull/18797 look good** with python 3.6 ``` [2022-03-27, 18:45:42 UTC] {kubernetes_pod.py:525} INFO - Creating pod

[GitHub] [airflow] boring-cyborg[bot] commented on pull request #22557: Switch azure provider to azure-keyvault-secrets

2022-03-27 Thread GitBox
boring-cyborg[bot] commented on pull request #22557: URL: https://github.com/apache/airflow/pull/22557#issuecomment-1079984486 Congratulations on your first Pull Request and welcome to the Apache Airflow community! If you have any issues or are unsure about any anything please check our

[GitHub] [airflow] xylar opened a new pull request #22557: Switch azure provider to azure-keyvault-secrets

2022-03-27 Thread GitBox
xylar opened a new pull request #22557: URL: https://github.com/apache/airflow/pull/22557 The only dependency actually used in the `microsoft-azure` provider appears to be `azure-keyvault-secrets`. This merge updates the provider to depend only on that package and not the full

[airflow] branch main updated (9cbab95 -> f612a2f)

2022-03-27 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from 9cbab95 Converts Dockerfiles to be standalone (#22492) add f612a2f Optimize Multiplatform cache builds

[GitHub] [airflow] potiuk merged pull request #22258: Optimize Multiplatform cache builds

2022-03-27 Thread GitBox
potiuk merged pull request #22258: URL: https://github.com/apache/airflow/pull/22258 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] github-actions[bot] commented on pull request #22258: Optimize Multiplatform cache builds

2022-03-27 Thread GitBox
github-actions[bot] commented on pull request #22258: URL: https://github.com/apache/airflow/pull/22258#issuecomment-1079982004 The PR most likely needs to run full matrix of tests because it modifies parts of the core of Airflow. However, committers might decide to merge it quickly and

[airflow] branch main updated (719135a -> 9cbab95)

2022-03-27 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from 719135a Remove references to deprecated operators/params in PubSub operators (#22519) add 9cbab95 Converts

[GitHub] [airflow] potiuk merged pull request #22492: Converts Dockerfiles to be standalone

2022-03-27 Thread GitBox
potiuk merged pull request #22492: URL: https://github.com/apache/airflow/pull/22492 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] github-actions[bot] commented on pull request #22492: Converts Dockerfiles to be standalone

2022-03-27 Thread GitBox
github-actions[bot] commented on pull request #22492: URL: https://github.com/apache/airflow/pull/22492#issuecomment-1079977630 The PR most likely needs to run full matrix of tests because it modifies parts of the core of Airflow. However, committers might decide to merge it quickly and

[GitHub] [airflow] potiuk commented on pull request #22509: Make `defer` more tolerant of signature differences in subclasses

2022-03-27 Thread GitBox
potiuk commented on pull request #22509: URL: https://github.com/apache/airflow/pull/22509#issuecomment-1079977563 Quite agree with @uranusjr on both accounts. Maybe just documenting those two patterns of making an "operator specific" way of defferal will be enough. I think inheritance

[GitHub] [airflow] potiuk commented on pull request #22510: Fix: Add extra headers to all livy API requests instead of only to post_batch

2022-03-27 Thread GitBox
potiuk commented on pull request #22510: URL: https://github.com/apache/airflow/pull/22510#issuecomment-1079972613 Static checks are failing -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [airflow] mik-laj commented on a change in pull request #22284: Move the database configuration to a new section

2022-03-27 Thread GitBox
mik-laj commented on a change in pull request #22284: URL: https://github.com/apache/airflow/pull/22284#discussion_r835935861 ## File path: docs/apache-airflow/start/docker-compose.yaml ## @@ -49,7 +49,7 @@ x-airflow-common: environment: AIRFLOW__CORE__EXECUTOR:

[GitHub] [airflow] mik-laj commented on issue #22551: Consider depending on `azure-keyvault-secrets` instead of `azure-keyvault` metapackage

2022-03-27 Thread GitBox
mik-laj commented on issue #22551: URL: https://github.com/apache/airflow/issues/22551#issuecomment-1079969378 @xylar Assigned! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [airflow] potiuk commented on pull request #21784: Add tags inside try block.

2022-03-27 Thread GitBox
potiuk commented on pull request #21784: URL: https://github.com/apache/airflow/pull/21784#issuecomment-1079968829 > Any idea in which release this is gonna be merged? We are just voting on 2.2.5 so most likely in 2.3.0 -- This is an automated message from the Apache Git Service.

[GitHub] [airflow] potiuk commented on pull request #21784: Add tags inside try block.

2022-03-27 Thread GitBox
potiuk commented on pull request #21784: URL: https://github.com/apache/airflow/pull/21784#issuecomment-1079968763 > Do we need to/can we add tests for this to prevent regression? I tihnk it's not worth to find a clever way to test it ? (But @jhtimmins maybe you can find one?) --

[GitHub] [airflow] github-actions[bot] commented on pull request #21784: Add tags inside try block.

2022-03-27 Thread GitBox
github-actions[bot] commented on pull request #21784: URL: https://github.com/apache/airflow/pull/21784#issuecomment-1079968659 The PR most likely needs to run full matrix of tests because it modifies parts of the core of Airflow. However, committers might decide to merge it quickly and

[airflow] branch main updated (ca4b8d1 -> 719135a)

2022-03-27 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from ca4b8d1 Create Endpoint and Model Service, Batch Prediction and Hyperparameter Tuning Jobs operators for Vertex AI

[GitHub] [airflow] potiuk merged pull request #22519: Remove references to deprecated operators/params in PubSub operators

2022-03-27 Thread GitBox
potiuk merged pull request #22519: URL: https://github.com/apache/airflow/pull/22519 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] potiuk commented on issue #22512: ECS Operator: Realtime container execution logs in Airflow task execution log

2022-03-27 Thread GitBox
potiuk commented on issue #22512: URL: https://github.com/apache/airflow/issues/22512#issuecomment-1079967035 Hopefully someone will take it - but if you want to make it happen, the fastest and most certain way is to become a contributor and submit it as a PR (which I heartily encourage

[GitHub] [airflow] stablum edited a comment on issue #19957: Airflow crashes with a psycopg2.errors.DeadlockDetected exception

2022-03-27 Thread GitBox
stablum edited a comment on issue #19957: URL: https://github.com/apache/airflow/issues/19957#issuecomment-1079965417 Unfortunately I'm still experiencing this bug with Airflow 2.2.4: ``` [2022-03-27 16:14:12,804] {scheduler_job.py:433} INFO - Setting the following tasks to

[GitHub] [airflow] stablum edited a comment on issue #19957: Airflow crashes with a psycopg2.errors.DeadlockDetected exception

2022-03-27 Thread GitBox
stablum edited a comment on issue #19957: URL: https://github.com/apache/airflow/issues/19957#issuecomment-1079965417 Unfortunately I'm still experiencing this bug with Airflow 2.2.4: ``` [2022-03-27 16:14:12,804] {scheduler_job.py:433} INFO - Setting the following tasks to

[GitHub] [airflow] stablum edited a comment on issue #19957: Airflow crashes with a psycopg2.errors.DeadlockDetected exception

2022-03-27 Thread GitBox
stablum edited a comment on issue #19957: URL: https://github.com/apache/airflow/issues/19957#issuecomment-1079965417 Unfortunately I'm still experiencing this bug with Airflow 2.2.4: ``` [2022-03-27 16:14:12,804] {scheduler_job.py:433} INFO - Setting the following tasks to

[GitHub] [airflow] subkanthi opened a new pull request #22556: If k8s is not installed, add if condition to exclude DAG

2022-03-27 Thread GitBox
subkanthi opened a new pull request #22556: URL: https://github.com/apache/airflow/pull/22556 Just like the example_kubernetes_executor.py, add `if k8s` so that the DAG does not throw an error. --- **^ Add meaningful description above** Read the **[Pull Request

[GitHub] [airflow] stablum commented on issue #19957: Airflow crashes with a psycopg2.errors.DeadlockDetected exception

2022-03-27 Thread GitBox
stablum commented on issue #19957: URL: https://github.com/apache/airflow/issues/19957#issuecomment-1079965417 Unfortunately I'm still experiencing this bug with Airflow 2.2.4: ``` [2022-03-27 16:14:12,804] {scheduler_job.py:433} INFO - Setting the following tasks to queued

[GitHub] [airflow] potiuk commented on issue #22485: KubernetesPodOperator matches the task pod and goes into deadlock

2022-03-27 Thread GitBox
potiuk commented on issue #22485: URL: https://github.com/apache/airflow/issues/22485#issuecomment-1079963090 Converting it into a discussion until we have more information. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [airflow] potiuk commented on issue #22485: KubernetesPodOperator matches the task pod and goes into deadlock

2022-03-27 Thread GitBox
potiuk commented on issue #22485: URL: https://github.com/apache/airflow/issues/22485#issuecomment-1079963039 > This has nothing to do with pods started in `3.0.2`. The KPO is not able to start new pods in `3.1.1`. @sushi30 - it is very likely something environmental for you. People

[GitHub] [airflow] potiuk commented on pull request #22492: Converts Dockerfiles to be standalone

2022-03-27 Thread GitBox
potiuk commented on pull request #22492: URL: https://github.com/apache/airflow/pull/22492#issuecomment-1079960228 I'd love to get that one and #5 in order to: a) speed up all PRs by 10 minutes (cache) b) make main succeed back (now all main builds are timing out on trying to

[GitHub] [airflow] potiuk commented on pull request #22492: Converts Dockerfiles to be standalone

2022-03-27 Thread GitBox
potiuk commented on pull request #22492: URL: https://github.com/apache/airflow/pull/22492#issuecomment-1079959880 I think we can merge this one (Regardless of the answer of legal). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[airflow] branch main updated (d91b833 -> ca4b8d1)

2022-03-27 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from d91b833 SalesforceToS3Operator: update sample dag and doc (#22489) add ca4b8d1 Create Endpoint and Model

[GitHub] [airflow] potiuk commented on pull request #22284: Move the database configuration to a new section

2022-03-27 Thread GitBox
potiuk commented on pull request #22284: URL: https://github.com/apache/airflow/pull/22284#issuecomment-1079959544 Need rebase unfortunately. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [airflow] potiuk merged pull request #22088: Create Endpoint and Model Service, Batch Prediction and Hyperparameter Tuning Jobs operators for Vertex AI service

2022-03-27 Thread GitBox
potiuk merged pull request #22088: URL: https://github.com/apache/airflow/pull/22088 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] potiuk edited a comment on issue #21817: Airflow Trigger And Scheduler DataBase DeadLock

2022-03-27 Thread GitBox
potiuk edited a comment on issue #21817: URL: https://github.com/apache/airflow/issues/21817#issuecomment-1079957006 Without full stack trace it is impossible to determine the root cause. Please submit full stack trace information (can be a link to gist) when it happens again. Converting

[GitHub] [airflow] potiuk commented on issue #21817: Airflow Trigger And Scheduler DataBase DeadLock

2022-03-27 Thread GitBox
potiuk commented on issue #21817: URL: https://github.com/apache/airflow/issues/21817#issuecomment-1079957006 Without full stack trace it is impossible to determine the root cause. Please submit full stack trace information (can be a link to gist) when it happens again. Converting it to a

[GitHub] [airflow] potiuk commented on pull request #21227: Allow list item to be rendered instead of showing as JSON

2022-03-27 Thread GitBox
potiuk commented on pull request #21227: URL: https://github.com/apache/airflow/pull/21227#issuecomment-1079956484 @peloyeje I guess it will be there as soon as the author (@avkirilishin ) rebaases it and fixes the static checks that were failing. Or if the author does not do it, maybe

[GitHub] [airflow] potiuk commented on issue #21605: KubernetesPodOperator Fails on empty log line

2022-03-27 Thread GitBox
potiuk commented on issue #21605: URL: https://github.com/apache/airflow/issues/21605#issuecomment-1079955383 @bhavaniravi I think the root cause of the problem is that you can't read the logs of the POD. This looks like misconfiguration of your service account. The root cause of

[GitHub] [airflow] potiuk commented on pull request #22391: Update the redshift sql operator to accept multiple sql statements

2022-03-27 Thread GitBox
potiuk commented on pull request #22391: URL: https://github.com/apache/airflow/pull/22391#issuecomment-1079948207 Static checks need fixing. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [airflow] potiuk commented on pull request #22331: Add import_notebook method to databricks hook

2022-03-27 Thread GitBox
potiuk commented on pull request #22331: URL: https://github.com/apache/airflow/pull/22331#issuecomment-1079947112 docs failing -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

  1   2   >