BTW that blog post was written in terms of the old Dataflow 2.x API. The API is slightly different in Beam (though not too much).
Reuven On Thu, Sep 14, 2017 at 7:48 AM, Reuven Lax <[email protected]> wrote: > What sort of error? You can always put a try/catch inside your DoFns to > catch the majority of errors. A common pattern is to save records that > caused exceptions out to a separate output so you can debug them. This > blog post > <https://cloud.google.com/blog/big-data/2016/01/handling-invalid-inputs-in-dataflow> > explained > the pattern. > > Reuven > > On Thu, Sep 14, 2017 at 1:43 AM, Chaim Turkel <[email protected]> wrote: > >> Hi, >> >> In one pipeline I have multiple PCollections. If I have an error on >> one then the whole pipline is canceled, is there a way to catch the >> error and log it, and for all other PCollections to continue? >> >> >> chaim >> > >
