Re: Kafka Meetup hosted Online, Wednesday 5:00pm, Sep 2nd, 2020

2020-09-01 Thread AJ Chen
Thanks Guozhang. Great meetup. -aj On Tue, Sep 1, 2020 at 1:30 PM Guozhang Wang wrote: > Hello folks, > > The Bay Area Kafka meetup will continue to be hosted online this month, > tomorrow (Sep 2nd) at 5:00pm. This time we will have guest speakers from > Twitter to talk about their journey to

Re: [ANNOUNCE] New committer: Xi Hu

2020-06-24 Thread AJ Chen
Congratulations, Xi. -aj On Wed, Jun 24, 2020 at 9:27 AM Guozhang Wang wrote: > The PMC for Apache Kafka has invited Xi Hu as a committer and we are > pleased to announce that he has accepted! > > Xi Hu has been actively contributing to Kafka since 2016, and is well > recognized especially for

Re: [ANNOUNCE] New committer: Boyang Chen

2020-06-22 Thread AJ Chen
Congrats, Boyang! -aj On Mon, Jun 22, 2020 at 4:26 PM Guozhang Wang wrote: > The PMC for Apache Kafka has invited Boyang Chen as a committer and we are > pleased to announce that he has accepted! > > Boyang has been active in the Kafka community more than two years ago. > Since then he has p

Re: dynamic produce and consume new topics

2020-06-13 Thread AJ Chen
On Fri, Jun 12, 2020 at 3:25 PM AJ Chen wrote: > I figured out this approach to consume new topics that become available at > runtime: > 1. create ConcurrentMessageListenerContainer for each new topic, call > start() to start listening. > 2. track all containers in a map, which lis

Re: dynamic produce and consume new topics

2020-06-12 Thread AJ Chen
() when shutdown. Is there anything important I should add to make it more robust? Appreciate any suggestions. -aj On Fri, Jun 12, 2020 at 12:55 PM AJ Chen wrote: > Thanks, Boyang. > > Spring''s KafkaTemplate can easily create new topic on the flight > already. > >

Re: dynamic produce and consume new topics

2020-06-12 Thread AJ Chen
ker side setting you could use to allow topic > creation based of produced records: > > https://stackoverflow.com/questions/36441768/how-to-create-topics-in-apache-kafka > > On Fri, Jun 12, 2020 at 9:01 AM AJ Chen wrote: > > > I'm working on a data streaming system where use

dynamic produce and consume new topics

2020-06-12 Thread AJ Chen
I'm working on a data streaming system where users will publish to different new topics and subscribe to different new topics without restarting the system. A large number of topics will be created over time. Uer will choose different new topics to publish and subscribe dynamically at runtime. Can

Re: Avro schema registry error

2020-05-21 Thread AJ Chen
Liam Clarke-Hutchinson > > On Thu, May 21, 2020 at 11:56 AM AJ Chen wrote: > > > I use avro for kafka message. When producing avro message, it fails to > > access schema registry, > > ERROR io.confluent.kafka.schemaregistry.client.rest.RestService - Failed > to

Avro schema registry error

2020-05-20 Thread AJ Chen
I use avro for kafka message. When producing avro message, it fails to access schema registry, ERROR io.confluent.kafka.schemaregistry.client.rest.RestService - Failed to send HTTP request to endpoint: http://localhost:8081/subjects/avro_emp-value/versions When using confluent schema registry, dos