Hi, all
I am using hdfs sink to store logs, I saw lots of tmp files(more than
10 ) in hdfs , Can anybody know why ?
Below is my hdfs configurations
Our hadoop version is : Hadoop 2.3.0-cdh5.0.2
Flume version is : 1.4.0
a1.sinks.sinks1.type = hdfs
a1.sinks.sinks1.channel = ch1
a1.sinks.sinks1.hdfs.path = hdfs://xxxxxxx
a1.sinks.sinks1.hdfs.filePrefix = events
a1.sinks.sinks1.hdfs.batchSize = 1000
a1.sinks.sinks1.hdfs.rollCount = 0
a1.sinks.sinks1.hdfs.rollSize = 0
a1.sinks.sinks1.hdfs.rollInterval = 300
a1.sinks.sinks1.hdfs.idleTimeout = 1800000
a1.sinks.sinks1.hdfs.callTimeout = 180000
a1.sinks.sinks1.hdfs.threadsPoolSize = 250
a1.sinks.sinks1.hdfs.writeFormat = Text
a1.sinks.sinks1.hdfs.fileType = DataStream
Best Regards
Wayne Wan
Best Regards
万毅(Wayne Wan)
Dev@个性精准化&无线部
[说明: ad-dolphin]
________________________________
* Email: [email protected]<mailto:[email protected]>
* Cell: +86.1387.1388.731
* Addr: 8/F, Building F6, Optics Valley Software Park, Guanshan Avenue, Wuhan,
China. 430074
________________________________
