stankiewicz commented on code in PR #35817:
URL: https://github.com/apache/beam/pull/35817#discussion_r2262183740
##########
sdks/python/apache_beam/io/gcp/bigquery_read_internal.py:
##########
@@ -303,7 +316,10 @@ def _setup_temporary_dataset(
element: 'ReadFromBigQueryRequest'):
location = bq.get_query_location(
self._get_project(), element.query, not element.use_standard_sql)
- bq.create_temporary_dataset(self._get_project(), location)
+ # Use the project from temp_dataset if it's a DatasetReference,
+ # otherwise use the pipeline project
+ temp_dataset_project = self._get_temp_dataset_project()
+ bq.create_temporary_dataset(temp_dataset_project, location)
def _execute_query(
Review Comment:
@liferoad _ececute_query id using bq wrapper and in line
`bq._start_query_job` implementation inserts job that has wrong destination
(project based on passed argument self._get_project() + temp_dataset.datasetId
)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
