All "sources" in portability will use splittable DoFns for execution.
Specifically, runners will need to be able to checkpoint unbounded sources to get a minimum viable pipeline working. For bounded pipelines, a DoFn can read the contents of a bounded source. On Fri, Mar 23, 2018 at 10:52 AM Thomas Weise <t...@apache.org> wrote: > Hi, > > I'm looking at the portable pipeline translation for streaming. I > understand that for batch pipelines, it is sufficient to translate Impulse. > > What is the intended path to support unbounded sources? > > The goal here is to get a minimum translation working that will allow > streaming wordcount execution. > > Thanks, > Thomas > >
