Raja Chattopadhyay created FLUME-2724:
-----------------------------------------
Summary: Flume Config - weird character on top of each HDFS file
Key: FLUME-2724
URL: https://issues.apache.org/jira/browse/FLUME-2724
Project: Flume
Issue Type: Question
Reporter: Raja Chattopadhyay
Priority: Minor
Hi,
when logging into HDFS from flume I am getting the following at the top
of each file.
SEQ
!org.apache.hadoop.io.LongWritable"org.apache.hadoop.io.BytesWritable������o�w9�]?�<+���F
��� a��� �� ;���c�� U
How do I stop this being entered into the file. I want file to have only text
My Flume Config is like below:
# Define a memory channel called ch1 on agent1
agent1.channels.ch1.type = memory
# Define an Avro source called avro-source1 on agent1 and tell it
# to bind to 0.0.0.0:41414. Connect it to channel ch1.
agent1.sources.avro-source1.type = avro
agent1.sources.avro-source1.bind = 0.0.0.0
agent1.sources.avro-source1.port = 41414
# Define a logger sink that simply logs all events it receives
# and connect it to the other end of the same channel.
agent1.sinks.hdfs-sink1.type = hdfs
agent1.sinks.hdfs-sink1.hdfs.path =
hdfs://localhost:8020/usr/flume/processeddata
agent1.sinks.hdfs.hdfs.writeFormat=Text
agent1.sinks.hdfs.hdfs.fileType=DataStream
# Finally, now that we've defined all of our components, tell
# agent1 which ones we want to activate.
agent1.channels = ch1
agent1.sources = avro-source1
agent1.sinks = hdfs-sink1
#chain the different components together
agent1.sinks.hdfs-sink1.channel = ch1
agent1.sources.avro-source1.channels = ch1
Regards,
Raja
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
