Re: write into hdfs using avro

Hi Gordeon, Thx for your reply, already implemented ;) > On 27 Jul 2017, at 12:57, Tzu-Li (Gordon) Tai wrote: > > Hi! > > Yes, you can provide a custom writer for the BucketingSink via > BucketingSink#setWriter(…). > The AvroKeyValueSinkWriter is a simple example of a

Re: write into hdfs using avro

Hi! Yes, you can provide a custom writer for the BucketingSink via BucketingSink#setWriter(…). The AvroKeyValueSinkWriter is a simple example of a writer that uses Avro for serialization, and takes as input KV 2-tuples. If you want to have a writer that takes as input your own event types,

write into hdfs using avro

Hi, folks ! I’ve got a little question, I’m trying to save stream of events from Kafka into HDSF using org.apache.flink.streaming.connectors.fs.bucketing.BucketingSink with AVRO serialization. If I properly understood, I should use some implementation of