Re: [I] BigQueryValueCheckOperator does not accept non-default project_id, which lead to jobs with impersonation_chain to fail. [airflow]

2023-10-20 Thread via GitHub
vchiapaikeo commented on issue #32870: URL: https://github.com/apache/airflow/issues/32870#issuecomment-1773607615 Happy to take a look at this. Feel free to assign me! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use t

Re: [I] BigQueryValueCheckOperator does not accept non-default project_id, which lead to jobs with impersonation_chain to fail. [airflow]

2023-10-21 Thread via GitHub
vchiapaikeo commented on issue #32870: URL: https://github.com/apache/airflow/issues/32870#issuecomment-1773745424 @GaryLiuTelus , I know this is a bit old for you now but did you try changing the gcp_conn_id to one that defaults to `project_B` by any chance? That should allow the BQ query

Re: [I] BigQueryValueCheckOperator does not accept non-default project_id, which lead to jobs with impersonation_chain to fail. [airflow]

2023-10-23 Thread via GitHub
GaryLiuTelus commented on issue #32870: URL: https://github.com/apache/airflow/issues/32870#issuecomment-1775166922 @vchiapaikeo Can you please advise how to get gcp_conn_id? I only used default value so far. Thanks! -- This is an automated message from the Apache Git Service. To respond

Re: [I] BigQueryValueCheckOperator does not accept non-default project_id, which lead to jobs with impersonation_chain to fail. [airflow]

2023-10-23 Thread via GitHub
GaryLiuTelus commented on issue #32870: URL: https://github.com/apache/airflow/issues/32870#issuecomment-1775171369 And as I read the source code of other operators, they use a hook to pass impersonation chain, and send the request via the hook, instead of send the request directly. I guess

Re: [I] BigQueryValueCheckOperator does not accept non-default project_id, which lead to jobs with impersonation_chain to fail. [airflow]

2023-10-23 Thread via GitHub
vchiapaikeo commented on issue #32870: URL: https://github.com/apache/airflow/issues/32870#issuecomment-1775458002 > Can you please advise how to get gcp_conn_id? I only used default value so far. Thanks! So here's a simple dag example: ```py from airflow import DAG from

Re: [I] BigQueryValueCheckOperator does not accept non-default project_id, which lead to jobs with impersonation_chain to fail. [airflow]

2023-10-23 Thread via GitHub
GaryLiuTelus commented on issue #32870: URL: https://github.com/apache/airflow/issues/32870#issuecomment-1775731577 Thanks for the sharing. And it works! Appreciate! But still, I think this is more like a workaround. But I think if project_id can be provided as a parameter would be be

Re: [I] BigQueryValueCheckOperator does not accept non-default project_id, which lead to jobs with impersonation_chain to fail. [airflow]

2023-10-23 Thread via GitHub
vchiapaikeo commented on issue #32870: URL: https://github.com/apache/airflow/issues/32870#issuecomment-1776238735 There's actually a bit of inconsistency here and `project_id` doesn't always necessarily mean where BQ compute occurs. For example, with BigQueryUpsertTableOperator, the [proje

Re: [I] BigQueryValueCheckOperator does not accept non-default project_id, which lead to jobs with impersonation_chain to fail. [airflow]

2023-10-24 Thread via GitHub
GaryLiuTelus commented on issue #32870: URL: https://github.com/apache/airflow/issues/32870#issuecomment-1777082952 OK, this make sense. Thanks for the clarification. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

Re: [I] BigQueryValueCheckOperator does not accept non-default project_id, which lead to jobs with impersonation_chain to fail. [airflow]

2023-10-24 Thread via GitHub
eladkal commented on issue #32870: URL: https://github.com/apache/airflow/issues/32870#issuecomment-1777184481 Is there a task left on this issue? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

Re: [I] BigQueryValueCheckOperator does not accept non-default project_id, which lead to jobs with impersonation_chain to fail. [airflow]

2023-10-24 Thread via GitHub
GaryLiuTelus commented on issue #32870: URL: https://github.com/apache/airflow/issues/32870#issuecomment-1777186493 I am OK with this workaround for now. Thanks! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [I] BigQueryValueCheckOperator does not accept non-default project_id, which lead to jobs with impersonation_chain to fail. [airflow]

2023-10-24 Thread via GitHub
eladkal closed issue #32870: BigQueryValueCheckOperator does not accept non-default project_id, which lead to jobs with impersonation_chain to fail. URL: https://github.com/apache/airflow/issues/32870 -- This is an automated message from the Apache Git Service. To respond to the message, plea

Re: [I] BigQueryValueCheckOperator does not accept non-default project_id, which lead to jobs with impersonation_chain to fail. [airflow]

2023-10-05 Thread via GitHub
nathadfield commented on issue #32870: URL: https://github.com/apache/airflow/issues/32870#issuecomment-1748906778 @dzhigimont Are you going to be working on this anytime soon or should we un-assign you? -- This is an automated message from the Apache Git Service. To respond to the messag