Hi all,

I am wondering if there is there a way to make Beam skip certain failures -
for example I am using BigQueryIO to write to a table, where the table name
is chosen dynamically:


```

.apply(BigQueryIO.<TableRow>write()

.to(new ExtractTableName()))

```


I want to make it so that, if for some reason my ExtractTableName instance
(which is a SerializableFunction<ValueInSingleWindow<TableRow>,
TableDestination>) throws an exception, then the exception is logged and
the write is skipped.


Is it possible to achieve this behaviour without modifying the Beam
codebase/BigQueryIO retry logic?

At the moment if my function throws an exception, the write is retried
indefinitely.


Thanks,

Josh

Reply via email to