Exactly once semantics for hdfs sink

2020-02-10 Thread Vishwas Siravara
Hi all, I want to use the StreamingFile sink for writing data to hdfs. Can I achieve exactly once semantics with this sink ? Best, HW.

Re: Exactly once semantics for hdfs sink

2020-02-10 Thread Khachatryan Roman
Hi Vishwas, Yes, Streaming File Sink does support exactly-once semantics and can be used with HDFS. Regards, Roman On Mon, Feb 10, 2020 at 5:20 PM Vishwas Siravara wrote: > Hi all, > I want to use the StreamingFile sink for writing data to hdfs. Can I > achieve exactly once semantics with thi

Re: Exactly once semantics for hdfs sink

2020-02-11 Thread Vishwas Siravara
Hi Khachatryan, Thanks for your reply. Can you help me understand how it works with hdfs specifically , even a link to a document will help. Best, Vishwas On Mon, Feb 10, 2020 at 10:32 AM Khachatryan Roman < khachatryan.ro...@gmail.com> wrote: > Hi Vishwas, > > Yes, Streaming File Sink does sup

Re: Exactly once semantics for hdfs sink

2020-02-11 Thread Zhijiang
-- From:Vishwas Siravara Send Time:2020 Feb. 12 (Wed.) 05:19 To:Khachatryan Roman Cc:user Subject:Re: Exactly once semantics for hdfs sink Hi Khachatryan, Thanks for your reply. Can you help me understand how it works with hdfs specifically , even a link to a document will help. Best

Re: Exactly once semantics for hdfs sink

2020-02-12 Thread Khachatryan Roman
.) 05:19 > To:Khachatryan Roman > Cc:user > Subject:Re: Exactly once semantics for hdfs sink > > Hi Khachatryan, > Thanks for your reply. Can you help me understand how it works with hdfs > specifically , even a link to a document will help. > > > Best, > Vishwas > > O