Re: hdfs-bolt write/sync problems

Problems may be in the hadoop, like wrong permission. 2015-04-29 20:51 GMT+08:00 Volker Janz : > Hi, > > we are using the storm-hdfs bolt (0.9.4) to write data from Kafka to > Hadoop (Hadoop 2.5.0-cdh5.2.0). > > This works fine for us but we discovered some unexpected

hdfs-bolt write/sync problems

Hi, we are using the storm-hdfs bolt (0.9.4) to write data from Kafka to Hadoop (Hadoop 2.5.0-cdh5.2.0). This works fine for us but we discovered some unexpected behavior: Our bolt uses the TimedRotationPolicy to rotate finished files from one location within HDFS to another. Unfortunately,