Re: production ready for zookeeper to kraft migration

Matthieu, There are a few things to look out for during the migration. 1) Migration not starting. This is pretty much always going to be due to mis-configuration. Controller KRaftMigrationDriver logs should reveal what its waiting for 2) Migration of metadata fails. If some poison record in ZK

Re: Kraft Multi Cluster (chroot equivalent)

Omer, Thanks for the email. This is an interesting thing to consider. Conceptually, there is no reason why the controllers couldn't manage the metadata for multiple brokers. The main counter-argument I can think of is essentially the same as the motivation -- less isolation. With a shared

Re: In Kafka KRaft can controllers participate as bootstrap servers

Only brokers can be specified as --bootstrap-servers for AdminClient (the bin/kafka-* scripts). In 3.7, we are adding the ability to bootstrap from KRaft controllers for certain scripts. In this case, the scripts will use --bootstrap-controllers (the details are in

Re: How to migrate single node Kafka with zookeeper to Kraft without ending up with additional Kraft controller node

Pengcheng, Right now, migrating to a combined broker+controller is not supported. The main reason for this is we don't have a way to change a KRaft broker into a combined KRaft broker + controller. It is probably possible, and may be supported at some point, but for now we're focusing on getting

Re: Kafka Node Shutting Down Automatically

Akshay, this was recently fixed by Luke Chen. It will be a part of the 3.5 and 3.4.1 releases. For reference, here is the bug https://issues.apache.org/jira/browse/KAFKA-14946 and the fix https://github.com/apache/kafka/pull/13653 Cheers, David On Tue, Apr 25, 2023 at 1:23 PM wrote: > On

Re: Kafka Node Shutting Down Automatically

Akshay, this looks a lot like https://issues.apache.org/jira/browse/KAFKA-14035 which was fixed for 3.3.0. Can you upload complete controller logs to that JIRA (or a new one if you prefer)? Thanks! David On Sat, Apr 22, 2023 at 2:54 AM Luke Chen wrote: > Hi Akshay, > > Thanks for reporting the

Re: Kafka Cluster WITHOUT Zookeeper

Paul, thanks for the articles. It's great to see someone digging into KRaft! It would be interesting to see your experiments against a newer version of KRaft, such as 3.4.0. Also, we hope to improve on the maximum number of partitions with the addition of

Re: Question about KRaft

t; > > > knowledge > > > > > > learned in future) > > > > > > > > > > > > When I read KIP-866, ZK to KRaft migration, from section Migration > > > > > > Overview, seems like the document is for multi-nodes with no or > > > almost > > > > no > > > > > > downtime, enable KRaft node by node; however my case accepts > > downtime > > > > > (one > > > > > > node -_-!!), just want to have Kafka upgrade to 3.4 then start > > > service > > > > > > under KRaft mode, make sure everything works well and no log lost > > > > > > > > > > > > Should I simply > > > > > > 1. download 3.4 binary > > > > > > 2. stop ZK & Kafka service > > > > > > 3. upgrade Kafka to 3.4 > > > > > > 4. start only Kafka service with KRaft server.properties > > > > > > > > > > > > Or any other thing I need to pay attention to? > > > > > > > > > > > > If there is a documentation as guide that would be quite helpful > > > > > > > > > > > > Really appreciate > > > > > > > > > > > > > > > > > > > > -- David Arthur

[ANNOUNCE] Apache Kafka 3.4.0

, Dalibor Plavcic, Dan Stelljes, Daniel Fonai, David Arthur, David Jacot, David Karlsson, David Mao, dengziming, Derek Troy-West, Divij Vaidya, Edoardo Comar, Elkhan Eminov, Eugene Tolbakov, Federico Valeri, Francesco Nigro, FUNKYE, Greg Harris, Guozhang Wang, Hao Li, Himani Arora, Huilin Shi, Igor

Re: [VOTE] 3.4.0 RC2

to all who voted and a big thanks to Sophie who did a vast majority of the work to prepare this release. We will continue the release process and get the announcement sent out this week. Cheers, David Arthur On Fri, Feb 3, 2023 at 12:25 PM Federico Valeri wrote: > +1 (non binding) > &

[VOTE] 3.4.0 RC2

I do not expect that any of these test failures are blockers for the release. Thanks! David Arthur

[VOTE] 3.4.0 RC0

Hello Kafka users, developers and client-developers, This is the first candidate for release of Apache Kafka 3.4.0. Some of the major features include: * KIP-881: Rack-aware Partition Assignment for Kafka Consumers

Re: [VOTE] 3.3.0 RC2

For those interested, here's a PR to fix the HTML rendering issue: https://github.com/apache/kafka-site/pull/446 -David On Wed, Sep 28, 2022 at 9:45 AM David Arthur wrote: > > Thanks Divij, we made a bunch of documentation changes at the last minute for > this release, so we’

Re: [VOTE] 3.3.0 RC2

gt; > 4. Observe that the current website does not have this bug. > > > > > > Divij Vaidya > > > > > > > > On Tue, Sep 27, 2022 at 8:35 PM David Arthur > > wrote: > > > >> I re-ran the failing system tests last night and got passin

Re: [VOTE] 3.3.0 RC2

Scholz No -1 votes The vote for Apache Kafka 3.3 passes! Thanks to everyone who voted and helped verify this release! A special thanks to José who has driven the release up to this point. Best, David Arthur On Tue, Sep 27, 2022 at 6:50 AM Mickael Maison wrote: > > +1 (binding) >

Re: [VOTE] 3.3.0 RC2

ease. I noticed a non-blocker issue with the KRaft readme > and submitted a PR: > > https://github.com/apache/kafka/pull/12688 > > Ismael > > On Tue, Sep 20, 2022 at 4:17 PM David Arthur wrote: > > > Hello Kafka users, developers and client-developers, > > > > Th

Re: [kafka-clients] Re: [VOTE] 3.3.0 RC2

I'd like to close out the vote by the end of day today, so please take a look. Thanks! David On Thu, Sep 22, 2022 at 9:06 AM David Arthur wrote: > > Josep, thanks for the note. We will mention the CVEs fixed in this release > in the announcement email. I believe we can also update the r

Re: [kafka-clients] Re: [VOTE] 3.3.0 RC2

nk it could be mentioned for this release. > What do you think? > > Best, > > On Wed, Sep 21, 2022 at 1:17 AM David Arthur > wrote: > >> Hello Kafka users, developers and client-developers, >> >> This is the second release candidate for Apache Kafka 3.3.0. Many n

[VOTE] 3.3.0 RC2

a/releases/tag/3.3.0-rc2 * Documentation: https://kafka.apache.org/33/documentation.html * Protocol: https://kafka.apache.org/33/protocol.html Successful Jenkins builds to follow in a future update to this email. Thanks! David Arthur

[ANNOUNCE] Apache Kafka 3.2.1

to this release! Akhilesh Chaganti, Bruno Cadonna, Christopher L. Shannon, David Arthur, Divij Vaidya, Eugene Tolbakov, Guozhang Wang, Ismael Juma, James Hughes, Jason Gustafson, Kirk True, Lucas Bradstreet, Luke Chen, Nicolas Guyomar, Niket Goel, Okada Haruki, Shawn Wang, Viktor Somogyi-Vass, Walker Carlson

[RESULTS] [VOTE] Release Kafka version 3.2.1

: None -1 Votes: None Vote Thread: https://lists.apache.org/thread/kcr2xncr762sqy79rbl83w0hzw85w775 I'll continue with the release process and send out the release announcement over the next few days. Thanks! David Arthur

Re: [VOTE] 3.2.1 RC3

I'm closing out the vote now. Thanks to everyone who voted. The RC passed with the required number of votes. I'll send out the results thread shortly. Cheers, David Arthur On Wed, Jul 27, 2022 at 11:54 AM Bill Bejeck wrote: > Hi David, > > Thanks for running the release!

[VOTE] 3.2.1 RC3

-kafka/job/3.2/ Thanks! David Arthur

Re: [ANNOUNCE] Apache Kafka 2.5.0

I've just published a blog post highlighting many of the improvements that landed with 2.5.0. https://blogs.apache.org/kafka/entry/what-s-new-in-apache2 -David On Wed, Apr 15, 2020 at 4:15 PM David Arthur wrote: > The Apache Kafka community is pleased to announce the release for Apa

Re: [RESULTS] [VOTE] 2.5.0 RC3

5.0 is in maven central (since yesterday). > > Can I assume it is officially released? > > Thanks. > > On Tue, Apr 14, 2020 at 11:15 AM David Arthur wrote: > > > Thanks everyone! The vote passes with 7 +1 votes (4 of which are binding) > > and no 0 or -1 votes. > &g

[ANNOUNCE] Apache Kafka 2.5.0

Stromberger, Colin P. Mccabe, Colin Patrick McCabe, commandini, Cyrus Vafadari, Dae-Ho Kim, David Arthur, David Jacot, David Kim, David Mao, dengziming, Dhruvil Shah, Edoardo Comar, Eduardo Pinto, Fábio Silva, gkomissarov, Grant Henke, Greg Harris, Gunnar Morling, Guozhang Wang, Harsha Laxman

[RESULTS] [VOTE] 2.5.0 RC3

>> ran unitTest >> ran check >> >> best, >> Colin >> >> On Tue, Apr 7, 2020, at 21:03, David Arthur wrote: >> > Hello Kafka users, developers and client-developers, >> > >> > This is the forth candidate for release of Apache Kafka 2

Re: [VOTE] 2.5.0 RC3

Passing Jenkins build on 2.5 branch: https://builds.apache.org/job/kafka-2.5-jdk8/90/ On Wed, Apr 8, 2020 at 12:03 AM David Arthur wrote: > Hello Kafka users, developers and client-developers, > > This is the forth candidate for release of Apache Kafka 2.5.0. > > * TLS 1.3 supp

[VOTE] 2.5.0 RC3

Hello Kafka users, developers and client-developers, This is the forth candidate for release of Apache Kafka 2.5.0. * TLS 1.3 support (1.2 is now the default) * Co-groups for Kafka Streams * Incremental rebalance for Kafka Consumer * New metrics for better operational insight * Upgrade Zookeeper

[VOTE] 2.5.0 RC2

/system-test-kafka/job/2.5/42/ -- David Arthur

Re: [kafka-clients] Re: [VOTE] 2.5.0 RC1

gt; > > figure out why the tests are not working/running > > > > > > > > > > > > Thanks. > > > > > > > > > > > > On Thu, Mar 12, 2020 at 11:21 AM Bill Bejeck < bbejeck@ gmail. com ( > > > bbej...@gmail.com )

Re: [VOTE] 2.5.0 RC1

vadoc/ > > > > * Tag to be voted upon (off 2.5 branch) is the 2.5.0 tag: > > https://github.com/apache/kafka/releases/tag/2.5.0-rc1 > > > > * Documentation: > > https://kafka.apache.org/25/documentation.html > > > > * Protocol: > > https://kafka.apache.org/25/protocol.html > > > > * Links to successful Jenkins builds for the 2.5 branch to follow > > > > Thanks, > > David Arthur > > > -- -David

[VOTE] 2.5.0 RC1

://github.com/apache/kafka/releases/tag/2.5.0-rc1 * Documentation: https://kafka.apache.org/25/documentation.html * Protocol: https://kafka.apache.org/25/protocol.html * Links to successful Jenkins builds for the 2.5 branch to follow Thanks, David Arthur

Re: Subject: [VOTE] 2.4.1 RC0

* Documentation: > > > https://kafka.apache.org/24/documentation.html > > > > > > * Protocol: > > > https://kafka.apache.org/24/protocol.html > > > > > > * Successful Jenkins builds for the 2.4 branch: > > > Unit/integration tests: Links to successful unit/integration test > build to > > > follow > > > System tests: > > > https://jenkins.confluent.io/job/system-test-kafka/job/2.4/152/ > > > > > > > > > Thanks, > > > Bill Bejeck > > > -- David Arthur

[VOTE] 2.5.0 RC0

/documentation.html * Protocol: https://kafka.apache.org/25/protocol.html * Links to successful Jenkins builds for the 2.5 branch to follow Thanks, David Arthur

Re: Subject: [VOTE] 2.2.2 RC2

ache.org/~rhauch/kafka-2.2.2-rc2/javadoc/ > >>> > >>> * Tag to be voted upon (off 2.2 branch) is the 2.2.2 tag: > >>> https://github.com/apache/kafka/releases/tag/2.2.2-rc2 > >>> > >>> * Documentation: > >>> https://kafka.apache.org/22/documentation.html > >>> > >>> * Protocol: > >>> https://kafka.apache.org/22/protocol.html > >>> > >>> * Successful Jenkins builds for the 2.2 branch: > >>> Unit/integration tests: > https://builds.apache.org/job/kafka-2.2-jdk8/1/ > >>> System tests: > >>> https://jenkins.confluent.io/job/system-test-kafka/job/2.2/216/ > >>> > >>> /** > >>> > >>> Thanks, > >>> > >>> Randall Hauch > >> > > -- David Arthur

[ANNOUNCE] Apache Kafka 2.3.1

contributors to this release! A. Sophie Blee-Goldman, Arjun Satish, Bill Bejeck, Bob Barrett, Boyang Chen, Bruno Cadonna, Cheng Pan, Chia-Ping Tsai, Chris Egerton, Chris Stromberger, Colin P. Mccabe, Colin Patrick McCabe, cpettitt-confluent, cwildman, David Arthur, Dhruvil Shah, Greg Harris, Gunnar

Re: [VOTE] 2.3.1 RC2

cCabe wrote: > > >> +1. I ran the broker, producer, consumer, etc. > > >> > > >> best, > > >> Colin > > >> > > >> On Tue, Oct 22, 2019, at 13:32, Guozhang Wang wrote: > > >>> +1. I've ra

Re: [VOTE] 2.3.1 RC2

> I also looked over the release notes. I see that KAFKA-8950 is included, so > maybe they just need to be refreshed. > > Thanks for running the release! > > -Jason > > On Fri, Oct 18, 2019 at 5:23 AM David Arthur wrote: > > > We found a few more critical issues and

[VOTE] 2.3.1 RC2

We found a few more critical issues and so have decided to do one more RC for 2.3.1. Please review the release notes: https://home.apache.org/~davidarthur/kafka-2.3.1-rc2/RELEASE_NOTES.html *** Please download, test and vote by Tuesday, October 22, 9pm PDT Kafka's KEYS file containing PGP keys

Re: [VOTE] 2.3.1 RC1

Passing builds: Unit/integration tests https://builds.apache.org/job/kafka-2.3-jdk8/122/ System tests https://jenkins.confluent.io/job/system-test-kafka/job/2.3/142/ On Fri, Oct 4, 2019 at 9:52 PM David Arthur wrote: > Hello all, we identified a few bugs and a dependency update we wan

Re: [kafka-clients] Re: [VOTE] 2.3.1 RC0

-- it seems to be a > > critical issue because it affects upgrading of Kafka Streams > > applications. We plan to do a PR asap and hope we can include it in > 2.3.1. > > > > > > -Matthias > > > > On 9/25/19 11:57 AM, David Arthur wrote: &g

[VOTE] 2.3.1 RC1

/job/system-test-kafka/job/2.3/ Thanks! David Arthur

Re: [VOTE] 2.3.1 RC0

/jira/browse/KAFKA-8896. The impact of > this > bug is that consumer groups cannot commit offsets or rebalance. The patch > should be ready shortly. > > Thanks, > Jason > > > > On Fri, Sep 13, 2019 at 3:53 PM David Arthur > wrote: > > &g

Re: Delivery Status Notification (Failure)

And here's a passing build for the 2.3 branch https://builds.apache.org/view/All/job/kafka-2.3-jdk8/108/ On Mon, Sep 16, 2019 at 3:46 PM David Arthur wrote: > And here's a passing build for the 2.3 branch > https://builds.apache.org/view/All/job/kafka-2.3-jdk8/108/ > > On Fri, Sep 1

[VOTE] 2.3.1 RC0

Hello Kafka users, developers and client-developers, This is the first candidate for release of Apache Kafka 2.3.1 which includes many bug fixes for Apache Kafka 2.3. Release notes for the 2.3.1 release: https://home.apache.org/~davidarthur/kafka-2.3.1-rc0/RELEASE_NOTES.html *** Please

Re: [VOTE] 2.2.0 RC2

+1 Validated signatures, and ran through quick-start. Thanks! On Mon, Mar 18, 2019 at 4:00 AM Jakub Scholz wrote: > +1 (non-binding). I used the staged binaries and run some of my tests > against them. All seems to look good to me. > > On Sat, Mar 9, 2019 at 11:56 PM Matthias J. Sax > wrote:

IRC logs now available on botbot.me

https://botbot.me/freenode/apache-kafka/ Just FYI, wasn't sure if we had any logging in place Cheers, David

Re: C++ Producer = Broker = Java Consumer?

If you're working with more complex messages than strings, any of the dearth of cross-language serialization frameworks will work. On 1/31/14 5:51 PM, Otis Gospodnetic wrote: Beautiful then! I thought this cause problems with Java consumer not knowing how to deserialize, but sounds like I

Re: python and kafka - how to use as a queue

jsh, Please open an issue at https://github.com/mumrah/kafka-python so other users/devs of this library have visibility Thanks! -David On 1/16/14 9:18 PM, Jagbir Hooda wrote: Hi Arthur, I'm running into a very similar issue even with the latest version ( kafka-python @ V. 0.8.1_1 used

Re: New Producer Public API

On 1/24/14 7:41 PM, Jay Kreps wrote: Yeah I'll fix that name. Hmm, yeah, I agree that often you want to be able delay network connectivity until you have started everything up. But at the same time I kind of loath special init() methods because you always forget to call them and get one round

IRC channel has moved to #apache-kafka

We have created and registered a new IRC channel for the project. Freenode has setup a forward from #kafka to #apache-kafka for us, but people already in this channel will need to /join #apache-kafka Sorry for the inconvenience. -David

Re: as i understand rebalance happens on client side

Kane, I'm the creator of kafka-python, just thought I'd give some insight. Consumer rebalancing is actually pretty tricky to get right. It requires interaction with ZooKeeper which (though possible via kazoo) is something I've tried to avoid in kafka-python. It also seems a little strange to

Reading Kafka directly from Pig?

I've thrown together a Pig LoadFunc to read data from Kafka, so you could load data like: QUERY_LOGS = load 'kafka://localhost:9092/logs.query#8' using com.mycompany.pig.KafkaAvroLoader('com.mycompany.Query'); The path part of the uri is the Kafka topic, and the fragment is the number of

Re: Reading Kafka directly from Pig?

the mismatch? Thanks, Jun On Wed, Aug 7, 2013 at 7:41 AM, David Arthur mum...@gmail.com wrote: I've thrown together a Pig LoadFunc to read data from Kafka, so you could load data like: QUERY_LOGS = load 'kafka://localhost:9092/logs.**query#8' using com.mycompany.pig.**KafkaAvroLoader('com

Re: Reading Kafka directly from Pig?

jun...@gmail.com wrote: David, That's interesting. Kafka provides an infinite stream of data whereas Pig works on a finite amount of data. How did you solve the mismatch? Thanks, Jun On Wed, Aug 7, 2013 at 7:41 AM, David Arthur mum...@gmail.com wrote: I've thrown together a Pig LoadFunc

Re: Meetup in Raleigh/Durham, NC

. On 7/22/13 1:07 AM, Jun Rao wrote: David, Thanks for sharing this. Jun On Thu, Jul 18, 2013 at 9:19 PM, David Arthur mum...@gmail.com wrote: There is a Hadoop meetup happening in Durham next week. I'm presenting an intro to Kafka. I don't suspect there are any Kafka users in the area who

Re: Logo

I actually did this the last time a logo was discussed :) https://docs.google.com/drawings/d/11WHfjkRGbSiZK6rRkedCrgmgFoP_vQ-QuWNENd4u7UY/edit As it turns out, it was a dung beetle in the book (I thought it was a roach as well). -David On 7/22/13 2:59

Re: Retrieve most-recent-n messages from kafka topic

There is not index-based access to messages in 0.7 like there is in 0.8. You have to start from a known good offset and iterate through the messages. What's your use case? Running a job periodically that reads the latest N message from the queue? Is it impractical to run from the last known

Meetup in Raleigh/Durham, NC

There is a Hadoop meetup happening in Durham next week. I'm presenting an intro to Kafka. I don't suspect there are any Kafka users in the area who are not already members of TriHUG, but sending this email out just in case :) http://www.meetup.com/TriHUG/events/129831822/ -David

Re: Versioning Schema's

I've done this in the past, and it worked out well. Stored Avro schema in ZooKeeper with an integer id and prefixed each message with the id. You have to make sure when you register a new schema that it resolves with the current version (ResolvingDecoder helps with this). -David On 6/13/13

Re: message order, guarenteed?

Simple example of how to take advantage of this behavior: Suppose you're sending document updates through Kafka. If you use the document ID as the message key and the default hash partitioner, the updates for a given document will exist on the same partition and come into the consumer in

Re: key used by producer

Yes, I'm pretty sure keys are now retained with the message and returned in the consumer. In the Java/Scala client, ConsumerIterator returns a MessageAndMetadata which includes key, message, topic, partition, and offset -David On 5/9/13 10:44 AM, Yu, Libo wrote: Hi, I am looking at the

Re: Kafka message order

Message order is guaranteed for a given partition, messages are read by the consumer in a FIFO manner. You say partitioning based on topic. Do you mean you are using the default HashPartitioner with the topic name as the routing key? If this is the case, then all of your messages will be

Re: Analysis of producer performance -- and Producer-Kafka reliability

It seems there are two underlying things here: storing messages to stable storage, and making messages available to consumers (i.e., storing messages on the broker). One can be achieved simply and reliably by spooling to local disk, the other requires network and is inherently less reliable.

Lucene Revolution

Anyone going this year? Probably nothing to do with Kafka, but lots of interesting talks on Solr/Lucene and some big data stuff (I think there's a Storm talk?) http://www.lucenerevolution.org/ -David

Re: .net (c#) kafka client

Ruchovets oruchov...@gmail.com wrote: Yes , I agree. So there is no way to use C# client or Rest API with current version of Kafka. Thanks Oleg, On Wed, Apr 3, 2013 at 10:29 PM, David Arthur mum...@gmail.com wrote: What is the bridge between C# and Node.js? If you're writing some custom

Re: .net (c#) kafka client

What is the bridge between C# and Node.js? If you're writing some custom middle man, why not write it in Java or Scala so you can then use the official clients? -David On 4/3/13 3:22 PM, Oleg Ruchovets wrote: I see , Is it a good Idea to use Node.js client? C# will produce messages to

0.8 Python client

Hello all, I've been working on updating (i.e., rewriting) my Python client for the impending 0.8 release. Check it out: https://github.com/mumrah/kafka-python/tree/0.8 In addition to 0.8 protocol support, the new client supports the broker-aware request routing required for replication in

Re: Hardware profile

How many brokers are you (LinkedIn) running? What kind of network topology? On 3/29/13 2:45 PM, Neha Narkhede wrote: 1. We never share zookeeper and broker on the same hardware. Both need significant memory to operate efficiently. 2. 14 drive setup is just for Kafka. We have a separate disk for

Re: Hardware profile

brokers right now. Not sure about the network topology. What kind of info do you want to know? Thanks, Jun On Fri, Mar 29, 2013 at 11:47 AM, David Arthur mum...@gmail.com wrote: How many brokers are you (LinkedIn) running? What kind of network topology? On 3/29/13 2:45 PM, Neha Narkhede

Re: log.file.size limit?

at 3:14 PM, David Arthur mum...@gmail.com wrote: FileChannel#map docs indicate the max size is Integer.MAX_VALUE, so yea 2gb http://docs.oracle.com/javase/**6/docs/api/java/nio/channels/** FileChannel.html#map(java.nio.**channels.FileChannel.MapModehttp://docs.oracle.com/javase/6/docs/api/java/nio

Re: Consume from X messages ago

Using the Offsets API, you can get the latest offset by setting time to -1. Then you subtract 1 There is no guarantee that 10k prior messages exist of course, so you'd need to handle that case. -David On 3/19/13 11:04 AM, James Englert wrote: Hi, I'm using Kafka 0.8. I would like to

Re: Consume from X messages ago

/kafka/blob/trunk/core/src/main/scala/kafka/tools/GetOffsetShell.scala -David On 3/19/13 11:25 AM, James Englert wrote: I'm still a bit lost. Where is the offsets API? I.e. which class? On Tue, Mar 19, 2013 at 11:16 AM, David Arthur mum...@gmail.com wrote: Using the Offsets API, you can

0.8 build problems

I'm having trouble building the project with sbt, specifically I am unable to run package and have the kafka-server-start.sh script work git clone git://github.com/apache/kafka.git ./sbt update ./sbt ++2.8.0 package ./bin/kafka-server-start.sh config/server.properties Exception in thread main

Re: where can I see the latest commits?

On 2/13/13 8:26 PM, S Ahmed wrote: On the dev list I read how things are committed etc., but I don't see any of the updates here: https://github.com/apache/kafka/commits/trunk Github is just a mirror of the official Apache git repository located at http://git.apache.org/kafka.git/ Also, when

Re: Consumer re-design and Python

On 1/31/13 3:30 PM, Marc Labbe wrote: Hi, I am fairly new to Kafka and Scala, I am trying to see through the consumer re-design changes, proposed and implemented for 0.8 and after, which will affect other languages implementations. There are documentation pages on the wiki, JIRA issues but I

Re: ETL with Kafka

of such a tool? Thanks Guy -- David Arthur

Re: Kafka Node.js Integration Questions/Advice

FWIW, message production is quite simpler than consumption. It does not require the same complex coordination as the consumers. Producers only use ZooKeeper to locate available brokers Sent from my phone On Dec 22, 2012, at 1:00 PM, Apoorva Gaurav apoorvagau...@gmail.com wrote: Thanks Radek,