The problem with that solution is that I would effectively use the vendor
resources every time I read the data (and they would incur GCP costs). I
know that GCP can support this such that I access the data in the vendor
project, but the execution happens in my project.
Thanks
Mark
On Tue, Oct 12, 2021 at 3:27 PM Luke Cwik <lc...@google.com> wrote:
> For #2, I believe you'll want to create an IAM role in your project that
> has the appropriate access to the vendor project. You should then launch
> your pipeline using the IAM role.
>
> On Tue, Oct 12, 2021 at 12:06 PM Ahmet Altay <al...@google.com> wrote:
>
>> /cc +Pablo Estrada <pabl...@google.com>
>>
>> On Tue, Oct 12, 2021 at 11:45 AM Mark Striebeck <mark.strieb...@gmail.com>
>> wrote:
>>
>>> Hi,
>>>
>>> We need to read from a BigQuery view from a data provider project. I run
>>> into two issues:
>>>
>>> 1. Is it possible to use beam.io.ReadFromBigQuery with a view (not a
>>> table)
>>> 2. In order to read, the user needs bigquery.jobs.create permissions.
>>> But we want to create the job in our project, not in the vendor project
>>> (otherwise they will get charged every time we read data)
>>>
>>> Is that possible with the beam API?
>>>
>>> Thanks
>>> Mark
>>>
>>
