I agree with the sentiment here. Please note that runner specific sources continue to work as they do now. The original question was about '.useNative()' which requires generic to Beam sources to interact with the specific routers (on those lines).
On Fri, Apr 29, 2016 at 2:11 AM, Maximilian Michels <m...@apache.org> wrote: > 1) Improving the integration of Runners with the Beam sink/source API > 2) Providing interfaces to implement new connectors (i.e. still no > existing UnboundedSink) > 3) Extending existing interfaces to ease implementation of connectors > and provide a uniform API (i.e. on top of UnboundedSource) > 4) Working on a more complete set of connectors in Beam > > Looking at the KafkaIO implementation, I wonder shouldn't we extract > the custom Watermark and Timestamp function into an extra interface? > All connectors are going to have methods these methods. It would be > nice to have a uniform API among the connectors. > +1. It would be simpler both for source developers and users if these timestamps could be set outside the sources (sources could still provide timestamps if it makes sense). will comment on <key, value> separately. Raghu.
