Re: [DISCUSS] KIP-944 Support async runtimes in consumer
Hi Colin, Philip, Kirk, As far as I am aware all concerns about KIP-944 have been addressed. Including those about dirty reads between threads and green threads because of missing memory barriers. If you agree, I would like to open the vote again. If not, please let me know. I'll open another KIP with a proposal on how to improve the consumer API so that we don't need any thread trickery anymore. I would rather not wait for that one because there will be a lot work before that can even be implemented. Once KIP-944 has been accepted, I'll work on adding the unit tests that are described in the KIP. Kind regards, Erik. Op 30-06-2023 om 07:56 schreef Erik van Oosten: [This is a resend with the correct KIP number.] Hello developers of the Java based consumer, I submitted https://github.com/apache/kafka/pull/13914 to fix a long standing problem that the Kafka consumer on the JVM is not usable from asynchronous runtimes such as Kotlin co-routines and ZIO. However, since it extends the public API I was requested to create a KIP. So here it is: KIP-944 Support async runtimes in consumer https://cwiki.apache.org/confluence/x/chw0Dw Any questions, comments, ideas and other additions are welcome! The KIP should be complete except for the testing section. As far as I am aware there are no tests for the current behavior. Any help in this area would be appreciated. Kind regards, Erik. -- Erik van Oosten e.vanoos...@grons.nl https://day-to-day-stuff.blogspot.com
[DISCUSS] KIP-944 Support async runtimes in consumer
[This is a resend with the correct KIP number.] Hello developers of the Java based consumer, I submitted https://github.com/apache/kafka/pull/13914 to fix a long standing problem that the Kafka consumer on the JVM is not usable from asynchronous runtimes such as Kotlin co-routines and ZIO. However, since it extends the public API I was requested to create a KIP. So here it is: KIP-944 Support async runtimes in consumer https://cwiki.apache.org/confluence/x/chw0Dw Any questions, comments, ideas and other additions are welcome! The KIP should be complete except for the testing section. As far as I am aware there are no tests for the current behavior. Any help in this area would be appreciated. Kind regards, Erik. -- Erik van Oosten e.vanoos...@grons.nl https://day-to-day-stuff.blogspot.com
Re: [DISCUSS] KIP-944 Support async runtimes in consumer
It seems KIP-941 was already taken. Updated to: KIP-944. Op 28-06-2023 om 10:11 schreef Erik van Oosten: Hello developers of the Java based consumer, I submitted https://github.com/apache/kafka/pull/13914 to fix a long standing problem that the Kafka consumer on the JVM is not usable from asynchronous runtimes such as Kotlin co-routines and ZIO. However, since it extends the public API I was requested to create a KIP. So here it is: KIP-944 Support async runtimes in consumer https://cwiki.apache.org/confluence/x/chw0Dw Any questions, comments, ideas and other additions are welcome! The KIP should be complete except for the testing section. As far as I am aware there are no tests for the current behavior. Any help in this area would be appreciated. Kind regards, Erik. -- Erik van Oosten e.vanoos...@grons.nl https://day-to-day-stuff.blogspot.com
