Hello, What are you experiences with file sizes in HDFS when using HDFS sink? The default settings seem very small. Do you keep the files small and combine them later or do you keep them large e.g. block size?
I am a bit unsure about keeping large files open for long time (dealing with expiration lease) and whether flume can correctly close them (and deal with tmp files) in case of a crash. thank you
