----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/26820/#review57638 -----------------------------------------------------------
Still reviewing... will update the review in parts :) flume-ng-channels/flume-kafka-channel/src/main/java/org/apache/flume/channel/kafka/KafkaChannel.java <https://reviews.apache.org/r/26820/#comment98440> Producers don't need to access ZK directly, so the error should be "Check whether Kafka broker is up..." flume-ng-channels/flume-kafka-channel/src/main/java/org/apache/flume/channel/kafka/KafkaChannel.java <https://reviews.apache.org/r/26820/#comment98441> Are you sure we want "smallest"? This will cause the channel to read everything in the topic when we first start. I can see why this would be good when Flume Source is the only one writing to the topic, but it can be a disaster if we attach the channel to a pre-existing topic. Perhaps make it user-configurable with "smallest" as the default and explain when to change it? - Gwen Shapira On Oct. 16, 2014, 8:22 p.m., Hari Shreedharan wrote: > > ----------------------------------------------------------- > This is an automatically generated e-mail. To reply, visit: > https://reviews.apache.org/r/26820/ > ----------------------------------------------------------- > > (Updated Oct. 16, 2014, 8:22 p.m.) > > > Review request for Flume. > > > Bugs: FLUME-2500 > https://issues.apache.org/jira/browse/FLUME-2500 > > > Repository: flume-git > > > Description > ------- > > Add a channel that uses Kafka > > > Diffs > ----- > > flume-ng-channels/flume-kafka-channel/pom.xml PRE-CREATION > > flume-ng-channels/flume-kafka-channel/src/main/java/org/apache/flume/channel/kafka/KafkaChannel.java > PRE-CREATION > > flume-ng-channels/flume-kafka-channel/src/main/java/org/apache/flume/channel/kafka/KafkaChannelConfiguration.java > PRE-CREATION > > flume-ng-channels/flume-kafka-channel/src/test/java/org/apache/flume/channel/kafka/TestKafkaChannel.java > PRE-CREATION > > flume-ng-channels/flume-kafka-channel/src/test/resources/kafka-server.properties > PRE-CREATION > flume-ng-channels/flume-kafka-channel/src/test/resources/log4j.properties > PRE-CREATION > > flume-ng-channels/flume-kafka-channel/src/test/resources/zookeeper.properties > PRE-CREATION > flume-ng-channels/pom.xml dc8dbc6 > flume-ng-sinks/flume-ng-kafka-sink/pom.xml 746a395 > > flume-ng-sinks/flume-ng-kafka-sink/src/test/java/org/apache/flume/sink/kafka/util/KafkaConsumer.java > 1c98922 > > flume-ng-sinks/flume-ng-kafka-sink/src/test/java/org/apache/flume/sink/kafka/util/TestUtil.java > 8855c53 > pom.xml 4f550d3 > > Diff: https://reviews.apache.org/r/26820/diff/ > > > Testing > ------- > > Added tests that simulate a Kafka cluster. > > > Thanks, > > Hari Shreedharan > >
