: user@flume.apache.org,
Datum: 08.09.2015 15:35
Betreff:Re: Re: How to customize the key in a HDFS SequenceFile
sink
Looking at the code, I guess this sink is a bit different and the
"serializer" property doesn't seem to be used.
I see two options:
E
ber 2015 at 13:14,
wrote:
>
>
>
> Von:Gonzalo Herreros
> An:user@flume.apache.org,
> Datum: 08.09.2015 09:29
> Betreff: Re: How to customize the key in a HDFS SequenceFile sink
> --
>
> Thanks for your prompt reply. May
Von:Gonzalo Herreros
An: user@flume.apache.org,
Datum: 08.09.2015 09:29
Betreff:Re: How to customize the key in a HDFS SequenceFile sink
Thanks for your prompt reply. May I ask you to give me some more details.
I'm a little confused as I've read that the "
The way Gonzalo said is how we always do it too.
2015-09-08 15:29 GMT+08:00 Gonzalo Herreros :
> I would implement a custom serializer and configure it in the standard
> Hdfs sink.
> That way you control how you build the key for each event.
>
> Regards,
> Gonzalo
>
> On 8 September 2015 at 06:42
I would implement a custom serializer and configure it in the standard Hdfs
sink.
That way you control how you build the key for each event.
Regards,
Gonzalo
On 8 September 2015 at 06:42,
wrote:
>
> Hello,
>
> I'm using Flume's HDFS SequenceFile sink for writing data to HDFS. I'm
> looking for
Hello,
I'm using Flume's HDFS SequenceFile sink for writing data to HDFS. I'm
looking for a possibility to create "custom keys". Per default, Flume is
using the Timestamp as key within a SequenceFile. However, in my usecase I
would like to use a customized string as key (instead of the timestamp)
