Re: Kafka streams parallelism - why not separate stream task per partition per input topic

2020-10-08 Thread Pushkar Deole
I looked at the task assignment and it looked random for some threads: e.g. i have 3 topics 24 partitions each and have 3 instances of application. So, each instance assigned 8 partitions per topic, i.e. total 24 partitions for 3 topics. When I set 8 stream threads, I expected each thread to be as

Re: Reverse-Proxy and Kafka

2020-10-08 Thread Naveen D
Hi guys We are using debezium sql connector and Kafka, we figured out debezium eating up space as part of loggging, how can we make sure the topic do not out grow, for 500 mb table log consumes 12 GB Space. Any alternative to reduce space?. Regards, Navin On Thu, Oct 8, 2020, 4:48 PM Mario Lafl

Reverse-Proxy and Kafka

2020-10-08 Thread Mario Lafleur
Hi, we want to route Kafka producer connection thru a reverse-proxy. Is this possible? M< [http://images.logibec.com/LogoLogibec.png] Mario Lafleur Analyste-programmeur Solutions administratives Programmer Analyst Administrative Solutions T (438) 315-5301 | T +1 800 361-9659 mario.lafl...@logib

kafka schema registry - some queries and questions

2020-10-08 Thread Manoj.Agrawal2
Hi All, Wanted to understand a bit more on the schema registry 1. With Apache kafka , can we use schema registry 2. Amazon MSK , can we use Schema registry ? Thanks Manoj A This e-mail and any files transmitted with it are for the sole use of the intended recipient(s) and may contain confiden