What sort of error? You can always put a try/catch inside your DoFns to catch the majority of errors. A common pattern is to save records that caused exceptions out to a separate output so you can debug them. This blog post <https://cloud.google.com/blog/big-data/2016/01/handling-invalid-inputs-in-dataflow> explained the pattern.
Reuven On Thu, Sep 14, 2017 at 1:43 AM, Chaim Turkel <[email protected]> wrote: > Hi, > > In one pipeline I have multiple PCollections. If I have an error on > one then the whole pipline is canceled, is there a way to catch the > error and log it, and for all other PCollections to continue? > > > chaim >
