Re: Recommendation of using StreamSinkProvider for a custom KairosDB Sink

2018-06-25 Thread Girish Subramanian
Thanks Tathagata Das Currently in my use case I am planning to collect() all the data in the driver and publish it into KairosDB something like this I am not worried about the size of the data. If I am doing something simple like this do I still need to bother about the un-stability of the API ?

Re: Recommendation of using StreamSinkProvider for a custom KairosDB Sink

2018-06-25 Thread Tathagata Das
This is interface is actually unstable. The v2 of DataSource APIs is being designed right now which will be public and stable in a release or two. So unfortunately there is no stable interface right now that I can officially recommend. That said, you could always use the ForeachWriter interface