[ https://issues.apache.org/jira/browse/FLUME-2961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16034316#comment-16034316 ]
tinawenqiao commented on FLUME-2961: ------------------------------------ 1. Do you set the parameter "multilineEventTimeoutSeconds" ? The default value 0 means the event will never time out. If set to non-zero value, the last multiline will be sent when time out. 2. The parameter "multilinePatternBelong" must be used with the parameter "multilineMatched". a. When multilineMatched=true and multilinePatternBelong=previous, it means the matched line will be part of the previous message. b. When multilineMatched=true and multilinePatternBelong=next, it means the matched line will be part of the next message. c. When multilineMatched=false and multilinePatternBelong=previous, it means the not matched line will be part of the previous message. d. When multilineMatched=false and multilinePatternBelong=next, it means the not matched line will be part of the next message. > Make TaildirSource work with multiline > -------------------------------------- > > Key: FLUME-2961 > URL: https://issues.apache.org/jira/browse/FLUME-2961 > Project: Flume > Issue Type: Improvement > Components: Sinks+Sources > Affects Versions: 1.7.0 > Reporter: tinawenqiao > Assignee: tinawenqiao > Fix For: 1.8.0 > > Attachments: FLUME-2961_1.patch, FLUME-2961_2.patch, > FLUME-2961_4.patch > > > TaidirSource defaults to LINE, this has issue when multiline log events like > stack traces and have request/responses. Following part is Java traceback > logs. We expect to have log line start regex Key to aggregate all the log > lines till the next regex key is found. > 2016-07-16 14:59:43,956 ERROR lifecycleSupervisor-1-7 LifecycleSupervisor.run > - Unable to start EventDrivenSourceRunner: { > source:cn.yottabyte.flume.source.http.HTTPSource{name:sourceHttp,state:IDLE} > } - Exception follows. > java.lang.IllegalStateException: Running HTTP Server found in source: > sourceHttp before I started one. Will not attempt to start. > at com.google.common.base.Preconditions.checkState(Preconditions.java:145) > at > cn.yottabyte.flume.source.http.HTTPSource.startHttpSourceServer(HTTPSource.java:170) > at cn.yottabyte.flume.source.http.HTTPSource.start(HTTPSource.java:166) > at > org.apache.flume.source.EventDrivenSourceRunner.start(EventDrivenSourceRunner.java:44) > at > org.apache.flume.lifecycle.LifecycleSupervisor$MonitorRunnable.run(LifecycleSupervisor.java:251) > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) > at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304) > at > java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178) > at > java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > at java.lang.Thread.run(Thread.java:745) -- This message was sent by Atlassian JIRA (v6.3.15#6346)