Re: Staging a PCollection in Beam | Dataflow Runner

2022-10-19 Thread Israel Herraiz via dev
I think that would be a Reshuffle , but only within the context of the same job (e.g. if there is a failure and a retry, the retry would start from the checkpoint created by the reshuffle). In Dataflow,

More details about PR #9852: Add option to set a temp dataset in BigQueryIO

2020-02-02 Thread Israel Herraiz
Hi all, I have updated and polished a pull request I submitted some time ago, and I would like to bring it to the attention of this list, to see if I could get some feedback or review of the code. The PR is at https://github.com/apache/beam/pull/9852 It adds a new option withQueryTempDataset

BigtableIO: is it really experimental?

2020-01-20 Thread Israel Herraiz
Hi, I have been working lately quite a lot with Dataflow and Bigtable, using Beam's BigtableIO. The documentation ( https://beam.apache.org/releases/javadoc/2.17.0/org/apache/beam/sdk/io/gcp/bigtable/BigtableIO.html) shows that BigtableIO is annotated as experimental. The same docs also says

Re: Contributor permission for Beam Jira tickets

2019-10-22 Thread Israel Herraiz
Thank you! On Tue, Oct 22, 2019 at 4:52 PM Jean-Baptiste Onofré wrote: > Hi Israel, > > Welcome aboard ! > > I just added you in contributors on Jira. > > Regards > JB > > On 22/10/2019 21:43, Israel Herraiz wrote: > > Hi, > > > > My name is Isra

Contributor permission for Beam Jira tickets

2019-10-22 Thread Israel Herraiz
Hi, My name is Israel, and I work in the Professional Services team at Google. I have created a JIRA issue and submitted the corresponding pull request (see https://issues.apache.org/jira/browse/BEAM-8458), and I would like to be able to assign the issue to myself. That's my second pull request