I have a custom HDFS Sink which takes events, parse them (convert binary data
to .avro files) and then writes these files to different directories in hdfs.
Trying to do so I get a strange error - Only the last avro file gets written
and to hdfs and rest of the files show a size of 0 kbs untill I kill my flume
agent (Ctrl + C). As soon as I kill the script, I can see the data in rest of
the .avro files. I am using flume 1.4 cdh 4.0.0 with hdfs 2.0.0.Can anyone
please suggest some solution?
Thanks,Himanshu