[
https://issues.apache.org/jira/browse/FLUME-3069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Adam Wang updated FLUME-3069:
-----------------------------
Description:
when I use KafkaSource of flume 1.7，I find that the CPU up to very high
kafka version is Kafka 0.10
# Configure source
wzfw1.sources.r1.type = org.apache.flume.source.kafka.KafkaSource
wzfw1.sources.r1.channels = c1
wzfw1.sources.r1.batchSize = 10000
wzfw1.sources.r1.kafka.bootstrap.servers =
NM-304-SA5212M4-BIGDATA-531:9092,NM-304-SA5212M4-BIGDATA-532:9092,NM-304-SA5212M4-BIGDATA-533:9092,NM-304-SA5212M4-BIGDATA-534:9092,NM-304-SA5212M4-BIGDATA-535:9092,NM-304-SA5212M4-BIGDATA-536:9092,NM-304-SA5212M4-BIGDATA-537:9092,NM-304-SA5212M4-BIGDATA-538:9092,NM-304-SA5212M4-BIGDATA-539:9092,NM-304-SA5212M4-BIGDATA-540:9092,NM-304-SA5212M4-BIGDATA-541:9092,NM-304-SA5212M4-BIGDATA-542:9092,NM-304-SA5212M4-BIGDATA-543:9092,NM-304-SA5212M4-BIGDATA-544:9092,NM-304-SA5212M4-BIGDATA-545:9092,NM-304-SA5212M4-BIGDATA-546:9092,NM-304-SA5212M4-BIGDATA-547:9092,NM-304-SA5212M4-BIGDATA-548:9092,NM-304-SA5212M4-BIGDATA-549:9092,NM-304-SA5212M4-BIGDATA-550:9092
wzfw1.sources.r1.kafka.topics = wzfw1-position
wzfw1.sources.r1.kafka.consumer.group.id = flume1
was:when I use KafkaSource of flume 1.7，I find that the CPU up to very high
> KafkaSource high CPU
> --------------------
>
> Key: FLUME-3069
> URL: https://issues.apache.org/jira/browse/FLUME-3069
> Project: Flume
> Issue Type: Bug
> Components: Sinks+Sources
> Affects Versions: v1.7.0
> Reporter: Adam Wang
>
> when I use KafkaSource of flume 1.7，I find that the CPU up to very high
> kafka version is Kafka 0.10
> # Configure source
> wzfw1.sources.r1.type = org.apache.flume.source.kafka.KafkaSource
> wzfw1.sources.r1.channels = c1
> wzfw1.sources.r1.batchSize = 10000
> wzfw1.sources.r1.kafka.bootstrap.servers =
> NM-304-SA5212M4-BIGDATA-531:9092,NM-304-SA5212M4-BIGDATA-532:9092,NM-304-SA5212M4-BIGDATA-533:9092,NM-304-SA5212M4-BIGDATA-534:9092,NM-304-SA5212M4-BIGDATA-535:9092,NM-304-SA5212M4-BIGDATA-536:9092,NM-304-SA5212M4-BIGDATA-537:9092,NM-304-SA5212M4-BIGDATA-538:9092,NM-304-SA5212M4-BIGDATA-539:9092,NM-304-SA5212M4-BIGDATA-540:9092,NM-304-SA5212M4-BIGDATA-541:9092,NM-304-SA5212M4-BIGDATA-542:9092,NM-304-SA5212M4-BIGDATA-543:9092,NM-304-SA5212M4-BIGDATA-544:9092,NM-304-SA5212M4-BIGDATA-545:9092,NM-304-SA5212M4-BIGDATA-546:9092,NM-304-SA5212M4-BIGDATA-547:9092,NM-304-SA5212M4-BIGDATA-548:9092,NM-304-SA5212M4-BIGDATA-549:9092,NM-304-SA5212M4-BIGDATA-550:9092
> wzfw1.sources.r1.kafka.topics = wzfw1-position
> wzfw1.sources.r1.kafka.consumer.group.id = flume1
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
