Hi,
Could you send the git log or svn info? This seems to be a bug which was fixed.
I have not seen this issue since then.
Thanks
Hari
--
Hari Shreedharan
On Tuesday, June 26, 2012 at 8:13 PM, Kamal Bahadur wrote:
> Thanks Mike and Hari for the response. I am starting fresh so I don't have
> to worry about the data. Here is what I did:
>
> 1. Deleted the source code
> 2. Downloaded latest code from trunk
> 3. Copied flume-conf.properties.template and created flume-conf.properties.
> 4. Changed the channel type to file. (also commented memoryChannel.capacity
> line)
> 5. Modified log4j.properties to log to console
> 6. Started using this command: *bin/flume-ng agent -n agent -f
> conf/flume-conf.properties -c conf*
> 6. Got exact same error as before:
>
> [kamal@localhost flume]$ bin/flume-ng agent -n agent -f
> conf/flume-conf.properties -c conf
> + exec /usr/local/jdk/bin/java -Xmx20m -cp
> '/home/kamal/flume/flume/conf:/home/kamal/flume/flume/lib/*'
> -Djava.library.path= org.apache.flume.node.Application -n agent -f
> conf/flume-conf.properties
> 2012-06-26 20:12:01,556 (main) [INFO -
> org.apache.flume.lifecycle.LifecycleSupervisor.start(LifecycleSupervisor.java:67)]
> Starting lifecycle supervisor 1
> 2012-06-26 20:12:01,559 (main) [INFO -
> org.apache.flume.node.FlumeNode.start(FlumeNode.java:54)] Flume node
> starting - agent
> 2012-06-26 20:12:01,562 (lifecycleSupervisor-1-0) [INFO -
> org.apache.flume.node.nodemanager.DefaultLogicalNodeManager.start(DefaultLogicalNodeManager.java:187)]
> Node manager starting
> 2012-06-26 20:12:01,564 (lifecycleSupervisor-1-0) [INFO -
> org.apache.flume.lifecycle.LifecycleSupervisor.start(LifecycleSupervisor.java:67)]
> Starting lifecycle supervisor 10
> 2012-06-26 20:12:01,562 (lifecycleSupervisor-1-2) [INFO -
> org.apache.flume.conf.file.AbstractFileConfigurationProvider.start(AbstractFileConfigurationProvider.java:67)]
> Configuration provider starting
> 2012-06-26 20:12:01,564 (lifecycleSupervisor-1-0) [DEBUG -
> org.apache.flume.node.nodemanager.DefaultLogicalNodeManager.start(DefaultLogicalNodeManager.java:191)]
> Node manager started
> 2012-06-26 20:12:01,567 (lifecycleSupervisor-1-2) [DEBUG -
> org.apache.flume.conf.file.AbstractFileConfigurationProvider.start(AbstractFileConfigurationProvider.java:86)]
> Configuration provider started
> 2012-06-26 20:12:01,567 (conf-file-poller-0) [DEBUG -
> org.apache.flume.conf.file.AbstractFileConfigurationProvider$FileWatcherRunnable.run(AbstractFileConfigurationProvider.java:188)]
> Checking file:conf/flume-conf.properties for changes
> 2012-06-26 20:12:01,567 (conf-file-poller-0) [INFO -
> org.apache.flume.conf.file.AbstractFileConfigurationProvider$FileWatcherRunnable.run(AbstractFileConfigurationProvider.java:195)]
> Reloading configuration file:conf/flume-conf.properties
> 2012-06-26 20:12:01,578 (conf-file-poller-0) [INFO -
> org.apache.flume.conf.FlumeConfiguration$AgentConfiguration.addProperty(FlumeConfiguration.java:988)]
> Processing:loggerSink
> 2012-06-26 20:12:01,578 (conf-file-poller-0) [DEBUG -
> org.apache.flume.conf.FlumeConfiguration$AgentConfiguration.addProperty(FlumeConfiguration.java:992)]
> Created context for loggerSink: channel
> 2012-06-26 20:12:01,578 (conf-file-poller-0) [INFO -
> org.apache.flume.conf.FlumeConfiguration$AgentConfiguration.addProperty(FlumeConfiguration.java:902)]
> Added sinks: loggerSink Agent: agent
> 2012-06-26 20:12:01,578 (conf-file-poller-0) [INFO -
> org.apache.flume.conf.FlumeConfiguration$AgentConfiguration.addProperty(FlumeConfiguration.java:988)]
> Processing:loggerSink
> 2012-06-26 20:12:01,579 (conf-file-poller-0) [DEBUG -
> org.apache.flume.conf.FlumeConfiguration$AgentConfiguration.isValid(FlumeConfiguration.java:295)]
> Starting validation of configuration for agent: agent,
> initial-configuration: AgentConfiguration[agent]
> SOURCES: {seqGenSrc={ parameters:{channels=memoryChannel, type=seq} }}
> CHANNELS: {memoryChannel={ parameters:{type=file} }}
> SINKS: {loggerSink={ parameters:{type=logger, channel=memoryChannel} }}
>
> 2012-06-26 20:12:01,582 (conf-file-poller-0) [DEBUG -
> org.apache.flume.conf.FlumeConfiguration$AgentConfiguration.validateChannels(FlumeConfiguration.java:450)]
> Created channel memoryChannel
> 2012-06-26 20:12:01,597 (conf-file-poller-0) [DEBUG -
> org.apache.flume.conf.FlumeConfiguration$AgentConfiguration.validateSinks(FlumeConfiguration.java:649)]
> Creating sink: loggerSink using LOGGER
> 2012-06-26 20:12:01,600 (conf-file-poller-0) [DEBUG -
> org.apache.flume.conf.FlumeConfiguration$AgentConfiguration.isValid(FlumeConfiguration.java:353)]
> Post validation configuration for agent
> AgentConfiguration created without Configuration stubs for which only basic
> syntactical validation was performed[agent]
> SOURCES: {seqGenSrc={ parameters:{channels=memoryChannel, type=seq} }}
> CHANNELS: {memoryChannel={ parameters:{type=file} }}
> AgentConfiguration created with Configuration stubs for which full
> validation was performed[agent]
> SINKS: {loggerSink=ComponentConfiguration[loggerSink]
> CONFIG:
> CHANNEL:memoryChannel
> }
>
> 2012-06-26 20:12:01,600 (conf-file-poller-0) [DEBUG -
> org.apache.flume.conf.FlumeConfiguration.validateConfiguration(FlumeConfiguration.java:117)]
> Channels:memoryChannel
>
> 2012-06-26 20:12:01,601 (conf-file-poller-0) [DEBUG -
> org.apache.flume.conf.FlumeConfiguration.validateConfiguration(FlumeConfiguration.java:118)]
> Sinks loggerSink
>
> 2012-06-26 20:12:01,601 (conf-file-poller-0) [DEBUG -
> org.apache.flume.conf.FlumeConfiguration.validateConfiguration(FlumeConfiguration.java:119)]
> Sources seqGenSrc
>
> 2012-06-26 20:12:01,601 (conf-file-poller-0) [INFO -
> org.apache.flume.conf.FlumeConfiguration.validateConfiguration(FlumeConfiguration.java:122)]
> Post-validation flume configuration contains configuration for agents:
> [agent]
> 2012-06-26 20:12:01,601 (conf-file-poller-0) [INFO -
> org.apache.flume.conf.properties.PropertiesFileConfigurationProvider.loadChannels(PropertiesFileConfigurationProvider.java:249)]
> Creating channels
> 2012-06-26 20:12:01,601 (conf-file-poller-0) [DEBUG -
> org.apache.flume.channel.DefaultChannelFactory.create(DefaultChannelFactory.java:68)]
> Creating instance of channel memoryChannel type file
> 2012-06-26 20:12:01,608 (conf-file-poller-0) [INFO -
> org.apache.flume.conf.properties.PropertiesFileConfigurationProvider.loadChannels(PropertiesFileConfigurationProvider.java:273)]
> created channel memoryChannel
> 2012-06-26 20:12:01,608 (conf-file-poller-0) [DEBUG -
> org.apache.flume.source.DefaultSourceFactory.create(DefaultSourceFactory.java:74)]
> Creating instance of source seqGenSrc, type seq
> 2012-06-26 20:12:01,620 (conf-file-poller-0) [INFO -
> org.apache.flume.sink.DefaultSinkFactory.create(DefaultSinkFactory.java:70)]
> Creating instance of sink loggerSink typelogger
> 2012-06-26 20:12:01,624 (conf-file-poller-0) [INFO -
> org.apache.flume.node.nodemanager.DefaultLogicalNodeManager.startAllComponents(DefaultLogicalNodeManager.java:93)]
> Starting new configuration:{ sourceRunners:{seqGenSrc=PollableSourceRunner:
> { source:org.apache.flume.source.SequenceGeneratorSource@7c4c51counterGroup:{
> name:null counters:{} } }}
> sinkRunners:{loggerSink=SinkRunner: {
> policy:org.apache.flume.sink.DefaultSinkProcessor@60765a16 counterGroup:{
> name:null counters:{} } }}
> channels:{memoryChannel=org.apache.flume.channel.file.FileChannel@7a148bd3}
> }
> 2012-06-26 20:12:01,625 (conf-file-poller-0) [INFO -
> org.apache.flume.node.nodemanager.DefaultLogicalNodeManager.startAllComponents(DefaultLogicalNodeManager.java:100)]
> Starting Channel memoryChannel
> 2012-06-26 20:12:01,625 (lifecycleSupervisor-1-1) [INFO -
> org.apache.flume.channel.file.FileChannel.start(FileChannel.java:197)]
> Starting FileChannel with dataDir [/home/kamal/.flume/file-channel/data]
> 2012-06-26 20:12:01,628 (conf-file-poller-0) [INFO -
> org.apache.flume.node.nodemanager.DefaultLogicalNodeManager.startAllComponents(DefaultLogicalNodeManager.java:114)]
> Waiting for channel: memoryChannel to start. Sleeping for 500 ms
> 2012-06-26 20:12:02,128 (conf-file-poller-0) [INFO -
> org.apache.flume.node.nodemanager.DefaultLogicalNodeManager.startAllComponents(DefaultLogicalNodeManager.java:114)]
> Waiting for channel: memoryChannel to start. Sleeping for 500 ms
> 2012-06-26 20:12:02,629 (conf-file-poller-0) [INFO -
> org.apache.flume.node.nodemanager.DefaultLogicalNodeManager.startAllComponents(DefaultLogicalNodeManager.java:114)]
> Waiting for channel: memoryChannel to start. Sleeping for 500 ms
> 2012-06-26 20:12:03,129 (conf-file-poller-0) [INFO -
> org.apache.flume.node.nodemanager.DefaultLogicalNodeManager.startAllComponents(DefaultLogicalNodeManager.java:114)]
> Waiting for channel: memoryChannel to start. Sleeping for 500 ms
> 2012-06-26 20:12:03,630 (conf-file-poller-0) [INFO -
> org.apache.flume.node.nodemanager.DefaultLogicalNodeManager.startAllComponents(DefaultLogicalNodeManager.java:114)]
> Waiting for channel: memoryChannel to start. Sleeping for 500 ms
> 2012-06-26 20:12:04,131 (conf-file-poller-0) [INFO -
> org.apache.flume.node.nodemanager.DefaultLogicalNodeManager.startAllComponents(DefaultLogicalNodeManager.java:114)]
> Waiting for channel: memoryChannel to start. Sleeping for 500 ms
> 2012-06-26 20:12:04,631 (conf-file-poller-0) [INFO -
> org.apache.flume.node.nodemanager.DefaultLogicalNodeManager.startAllComponents(DefaultLogicalNodeManager.java:114)]
> Waiting for channel: memoryChannel to start. Sleeping for 500 ms
> 2012-06-26 20:12:05,132 (conf-file-poller-0) [INFO -
> org.apache.flume.node.nodemanager.DefaultLogicalNodeManager.startAllComponents(DefaultLogicalNodeManager.java:114)]
> Waiting for channel: memoryChannel to start. Sleeping for 500 ms
> 2012-06-26 20:12:05,633 (conf-file-poller-0) [INFO -
> org.apache.flume.node.nodemanager.DefaultLogicalNodeManager.startAllComponents(DefaultLogicalNodeManager.java:114)]
> Waiting for channel: memoryChannel to start. Sleeping for 500 ms
> 2012-06-26 20:12:06,133 (conf-file-poller-0) [INFO -
> org.apache.flume.node.nodemanager.DefaultLogicalNodeManager.startAllComponents(DefaultLogicalNodeManager.java:114)]
> Waiting for channel: memoryChannel to start. Sleeping for 500 ms
> 2012-06-26 20:12:06,634 (conf-file-poller-0) [INFO -
> org.apache.flume.node.nodemanager.DefaultLogicalNodeManager.startAllComponents(DefaultLogicalNodeManager.java:114)]
> Waiting for channel: memoryChannel to start. Sleeping for 500 ms
>
> On Tue, Jun 26, 2012 at 6:57 PM, Mike Percy <[email protected]
> (mailto:[email protected])> wrote:
>
> > Try enabling debug logging. Also yes, use latest trunk. And make sure the
> > directory contents for the checkpoint and data dirs are empty… the format
> > changed on trunk last night. So if you need to keep data around that is in
> > existing file channels make sure to start up without a source and drain the
> > channel to another agent or file before shutting it down and deleting the
> > file channel data directories.
> >
> > Side note: not sure putting the file channel data dirs on /tmp is safe for
> > production, but it depends on your setup. Some operating systems purge /tmp
> > on startup.
> >
> > Regards,
> > Mike
> >
> >
> > On Tuesday, June 26, 2012 at 6:30 PM, Hari Shreedharan wrote:
> >
> > > Is this on trunk? If you rebase on trunk, you should be ok.
> > >
> > > Thanks
> > > Hari
> > >
> > > --
> > > Hari Shreedharan
> > >
> > >
> > > On Tuesday, June 26, 2012 at 6:08 PM, Kamal Bahadur wrote:
> > >
> > > > Hi,
> > > >
> > > > I am using the latest code from the HEAD. Following is my
> > configuration: I
> > > > am using file channel and it looks like flume-ng gets stuck during
> > >
> >
> > startup
> > > > of file-channel. No errors found in the log as usual.
> > > >
> > > > I have already checked for permissions on the directories and they
> > look ok.
> > > >
> > > > Thanks,
> > > >
> > > > Kamal
> > > >
> > > > agent.sources = avroSrc
> > > > agent.channels = fileChannel
> > > > agent.sinks = cassandraSink
> > > >
> > > > agent.sources.avroSrc.type = avro
> > > > agent.sources.avroSrc.bind = 0.0.0.0
> > > > agent.sources.avroSrc.port = 8800
> > > >
> > > > agent.sources.avroSrc.channels = fileChannel
> > > >
> > > > agent.sinks.cassandraSink.type = com.glsink.cassandra.CassandraSink
> > > > agent.sinks.cassandraSink.nodes = host1:9160,host2:9160,host3:9160
> > > > agent.sinks.cassandraSink.cluster = GL CLuster
> > > > agent.sinks.cassandraSink.keyspace = Global_Logging
> > > > agent.sinks.cassandraSink.columnFamily = Audit_Log
> > > > agent.sinks.cassandraSink.loadBalancingPolicy =
> > > > me.prettyprint.cassandra.connection.RoundRobinBalancingPolicy
> > > > agent.sinks.cassandraSink.username = USERDEV
> > > > agent.sinks.cassandraSink.password = pwd152==
> > > > agent.sinks.cassandraSink.batch-size = 100
> > > >
> > > > agent.sinks.cassandraSink.channel = fileChannel
> > > >
> > > > agent.channels.fileChannel.type = file
> > > >
> > > > agent.channels.fileChannel.checkpointDir = /tmp/checkpoint
> > > > agent.channels.fileChannel.dataDirs = /tmp/data
> > > >
> > > >
> > > >
> > > > Debug message:
> > > >
> > > > 2012-06-25 16:12:18,588 DEBUG conf.FlumeConfiguration: Starting
> > validation
> > > > of configuration for agent: agent, initial-configuration:
> > > > AgentConfiguration[agent]
> > > > SOURCES: {avroSrc={ parameters:{port=8800, channels=fileChannel,
> > > >
> > >
> >
> > type=avro,
> > > > bind=0.0.0.0} }}
> > > > CHANNELS: {fileChannel={ parameters:{checkpointDir=/tmp/checkpoint,
> > > > dataDirs=/tmp/data, type=FILE} }}
> > > > SINKS: {cassandraSink={
> > > >
> > >
> >
> > parameters:{loadBalancingPolicy=me.prettyprint.cassandra.connection.RoundRobinBalancingPolicy,
> > > > username=USERDEV , batch-size=100, nodes= <http://10.136.239.61:9160
> > >
> > > <removed>,
> > > > keyspace=Global_Logging, cluster=GL CLuster, columnFamily=Audit_Log,
> > > > type=com.glsink.cassandra.CassandraSink, channel=fileChannel,
> > > > password=pwd152==} }}
> > > >
> > > >
> > > > 2012-06-25 16:12:18,594 DEBUG conf.FlumeConfiguration: Created channel
> > > > fileChannel
> > > > 2012-06-25 16:12:18,608 DEBUG conf.FlumeConfiguration: Creating sink:
> > > > cassandraSink using OTHER
> > > > 2012-06-25 16:12:18,610 DEBUG conf.FlumeConfiguration: Post validation
> > > > configuration for agent
> > > > AgentConfiguration created without Configuration stubs for which only
> > > >
> > >
> > >
> >
> > basic
> > > > syntactical validation was performed[agent]
> > > > SOURCES: {avroSrc={ parameters:{port=8800, channels=fileChannel,
> > > >
> > >
> >
> > type=avro,
> > > > bind=0.0.0.0} }}
> > > > CHANNELS: {fileChannel={ parameters:{checkpointDir=/tmp/checkpoint,
> > > > dataDirs=/tmp/data, type=FILE} }}
> > > > SINKS: {cassandraSink={
> > > >
> > >
> >
> > parameters:{loadBalancingPolicy=me.prettyprint.cassandra.connection.RoundRobinBalancingPolicy,
> > > > username=USERDEV , batch-size=100, nodes= <http://10.136.239.61:9160
> > >
> > > <removed>,
> > > > keyspace=Global_Logging, cluster=GL CLuster, columnFamily=Audit_Log,
> > > > type=com.glsink.cassandra.CassandraSink, channel=fileChannel,
> > > > password=pwd152==} }}
> > > >
> > > > 2012-06-25 16:12:18,610 DEBUG conf.FlumeConfiguration:
> > Channels:fileChannel
> > > >
> > > > 2012-06-25 16:12:18,610 DEBUG conf.FlumeConfiguration: Sinks
> > cassandraSink
> > > >
> > > > 2012-06-25 16:12:18,610 DEBUG conf.FlumeConfiguration: Sources avroSrc
> > > >
> > > > 2012-06-25 16:12:18,610 INFO conf.FlumeConfiguration: Post-validation
> > flume
> > > > configuration contains configuration for agents: [agent]
> > > > 2012-06-25 16:12:18,610 INFO
> > > > properties.PropertiesFileConfigurationProvider: Creating channels
> > > > 2012-06-25 16:12:18,610 DEBUG channel.DefaultChannelFactory: Creating
> > > > instance of channel fileChannel type FILE
> > > > 2012-06-25 16:12:18,624 INFO
> > > > properties.PropertiesFileConfigurationProvider: created channel
> > > >
> > >
> >
> > fileChannel
> > > > 2012-06-25 16:12:18,624 DEBUG source.DefaultSourceFactory: Creating
> > > > instance of source avroSrc, type avro
> > > > 2012-06-25 16:12:18,646 INFO sink.DefaultSinkFactory: Creating
> > > >
> > >
> >
> > instance of
> > > > sink cassandraSink
> > > > typecom.intuit.ifs.globallogging.glsink.cassandra.CassandraSink
> > > > 2012-06-25 16:12:18,647 DEBUG sink.DefaultSinkFactory: Sink type
> > > > com.intuit.ifs.globallogging.glsink.cassandra.CassandraSink is a custom
> > > > type
> > > > 2012-06-25 16:12:18,665 DEBUG cassandra.CassandraSink:
> > > > 2012-06-25 16:12:18,665 INFO cassandra.CassandraSink: Configiring
> > > >
> > >
> >
> > Cassandra
> > > > sink
> > > > 2012-06-25 16:12:18,665 INFO cassandra.CassandraSink: Configured
> > > >
> > >
> >
> > Cassandra
> > > > sink
> > > > 2012-06-25 16:12:18,667 INFO nodemanager.DefaultLogicalNodeManager:
> > > > Starting new configuration:{
> > > > sourceRunners:{avroSrc=EventDrivenSourceRunner: { source:AvroSource: {
> > > > bindAddress:0.0.0.0 port:8800 } }}
> > > >
> > >
> >
> > sinkRunners:{cassandraSink=SinkRunner: {
> > > > policy:org.apache.flume.sink.DefaultSinkProcessor@7a148bd3counterGroup:{
> > > > name:null counters:{} } }}
> > > >
> > >
> >
> > channels:{fileChannel=org.apache.flume.channel.file.FileChannel@5ae80842}
> > }
> > > > 2012-06-25 16:12:18,667 INFO nodemanager.DefaultLogicalNodeManager:
> > > > Starting Channel fileChannel
> > > > 2012-06-25 16:12:18,667 INFO nodemanager.DefaultLogicalNodeManager:
> > > >
> > >
> >
> > Waiting
> > > > for channel: fileChannel to start. Sleeping for 500 ms
> > > > 2012-06-25 16:12:18,668 INFO file.FileChannel: Starting FileChannel
> > > >
> > >
> >
> > with
> > > > dataDir [/tmp/data]
> > > > 2012-06-25 16:12:19,170 INFO nodemanager.DefaultLogicalNodeManager:
> > > >
> > >
> >
> > Waiting
> > > > for channel: fileChannel to start. Sleeping for 500 ms
> > > > 2012-06-25 16:12:19,672 INFO nodemanager.DefaultLogicalNodeManager:
> > > >
> > >
> >
> > Waiting
> > > > for channel: fileChannel to start. Sleeping for 500 ms
> > > > 2012-06-25 16:12:20,175 INFO nodemanager.DefaultLogicalNodeManager:
> > > >
> > >
> >
> > Waiting
> > > > for channel: fileChannel to start. Sleeping for 500 ms
> > > > 2012-06-25 16:12:20,678 INFO nodemanager.DefaultLogicalNodeManager:
> > > >
> > >
> >
> > Waiting
> > > > for channel: fileChannel to start. Sleeping for 500 ms
> > > > 2012-06-25 16:12:21,180 INFO nodemanager.DefaultLogicalNodeManager:
> > > >
> > >
> >
> > Waiting
> > > > for channel: fileChannel to start. Sleeping for 500 ms
> > >
> >
> >
>
>
>
