Hello Team, Facing the below error very alternatively even though worked with different port numbers. I have pasted my flume config file along with the error.
Thanks in advance. Below is my flume configuration ################################################# # Please paste flume.conf here. Example: # Sources, channels, and sinks are defined per # agent name, in this case 'pnmtest2'. pnmtest2.sources = SPOOL pnmtest2.channels = MemChanneltest2 pnmtest2.sinks = AVRO # For each source, channel, and sink, set # standard properties. pnmtest2.sources.SPOOL.type = spooldir pnmtest2.sources.SPOOL.spoolDir = /home/a.nikhill/pnm pnmtest2.sources.SPOOL.ignorePattern = \.*tmp$ pnmtest2.sources.SPOOL.channels = MemChanneltest2 pnmtest2.sources.SPOOL.fileHeader = true pnmtest2.sources.SPOOL.deletePolicy = immediate pnmtest2.sources.SPOOL.consumeOrder = oldest pnmtest2.sources.SPOOL.batchSize = 100 pnmtest2.sources.SPOOL.interceptors = time pnmtest2.sources.SPOOL.interceptors.time.type = org.apache.flume.interceptor.TimestampInterceptor$Builder pnmtest2.sources.SPOOL.deserializer = com.sudnline.flume.WholeFileDeserializer$Builder pnmtest2.sinks.AVRO.type = avro pnmtest2.sinks.AVRO.channel = MemChanneltest2 pnmtest2.sinks.AVRO.hostname = sdldalplhdw02.sudnline.cequel3.com <http://sdldalplhdw02.suddenlink.cequel3.com/> pnmtest2.sinks.AVRO.port = 40002 pnmtest2.sinks.AVRO.batch-size = 100 pnmtest2.sinks.AVRO.connect-timeout = 40000 # pnmtest2.sinks.HDFS.type = hdfs # pnmtest2.sinks.HDFS.channel = MemChannel2 # pnmtest2.sinks.HDFS.hdfs.path = /user/flume/poll/%Y/%m/%d/%H/ # pnmtest2.sinks.HDFS.hdfs.fileType = DataStream # pnmtest2.sinks.HDFS.hdfs.writeFormat = Text # pnmtest2.sinks.HDFS.hdfs.batchSize = 100 # pnmtest2.sinks.HDFS.hdfs.rollSize = 0 # pnmtest2.sinks.HDFS.hdfs.rollCount = 1000 # pnmtest2.sinks.HDFS.hdfs.rollInterval = 600 # Other properties are specific to each type of # source, channel, or sink. In this case, we # specify the capacity of the memory channel. #pnmtest2.channels.MemChanneltest1.capacity = 10000 #pnmtest2.channels.MemChanneltest1.type = memory pnmtest2.channels.MemChanneltest2.capacity = 1000000 pnmtest2.channels.MemChanneltest2.type = memory Below is my error. > ERRORorg.apache.flume.SinkRunner >> >> Unable to deliver event. Exception follows. >> org.apache.flume.EventDeliveryException: Failed to send events >> at >> org.apache.flume.sink.AbstractRpcSink.process(AbstractRpcSink.java:392) >> at >> org.apache.flume.sink.DefaultSinkProcessor.process(DefaultSinkProcessor.java:68) >> at org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:147) >> at java.lang.Thread.run(Thread.java:745) >> Caused by: org.apache.flume.FlumeException: NettyAvroRpcClient { host: >> sdldalplhdw02.suddenlink.cequel3.com, port: 40002 }: RPC connection error >> at >> org.apache.flume.api.NettyAvroRpcClient.connect(NettyAvroRpcClient.java:182) >> at >> org.apache.flume.api.NettyAvroRpcClient.connect(NettyAvroRpcClient.java:121) >> at >> org.apache.flume.api.NettyAvroRpcClient.configure(NettyAvroRpcClient.java:638) >> at >> org.apache.flume.api.RpcClientFactory.getInstance(RpcClientFactory.java:89) >> at org.apache.flume.sink.AvroSink.initializeRpcClient(AvroSink.java:127) >> at >> org.apache.flume.sink.AbstractRpcSink.createConnection(AbstractRpcSink.java:211) >> at >> org.apache.flume.sink.AbstractRpcSink.verifyConnection(AbstractRpcSink.java:272) >> at >> org.apache.flume.sink.AbstractRpcSink.process(AbstractRpcSink.java:349) >> ... 3 more >> Caused by: java.io.IOException: Error connecting to >> sdldalplhdw02.suddenlink.cequel3.com/10.48.210.244:40002 >> at >> org.apache.avro.ipc.NettyTransceiver.getChannel(NettyTransceiver.java:292) >> at >> org.apache.avro.ipc.NettyTransceiver.<init>(NettyTransceiver.java:206) >> at >> org.apache.avro.ipc.NettyTransceiver.<init>(NettyTransceiver.java:155) >> at >> org.apache.flume.api.NettyAvroRpcClient.connect(NettyAvroRpcClient.java:168) >> ... 10 more >> Caused by: java.net.ConnectException: Connection refused >> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) >> at >> sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) >> at >> org.jboss.netty.channel.socket.nio.NioClientBoss.connect(NioClientBoss.java:148) >> at >> org.jboss.netty.channel.socket.nio.NioClientBoss.processSelectedKeys(NioClientBoss.java:104) >> at >> org.jboss.netty.channel.socket.nio.NioClientBoss.process(NioClientBoss.java:78) >> at >> org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:312) >> at >> org.jboss.netty.channel.socket.nio.NioClientBoss.run(NioClientBoss.java:41) >> at >> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) >> at >> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) >> >> >> >> Regards, Nik.
