Re: Magic v1 Does not Support Record Headers

2019-11-25 Thread Shalom Sagges
e message format but I > would highly recommend to try it out first in a non-production > environment first. > > -Matthias > > On 11/25/19 4:51 AM, Shalom Sagges wrote: > > Thanks a lot Matthias! > > > > This problematic topic is actually a topic that's

Re: Magic v1 Does not Support Record Headers

2019-11-25 Thread Shalom Sagges
rtion would succeed if record > headers would not be used). > > > > org.apache.kafka.common.record.FileRecords.downConvert(FileRecords.java:245) > > Thus, the client must either stop using records headers, or you need to > upgrade the message format to 0.11. See the docs for details about > upgrading the message form

Magic v1 Does not Support Record Headers

2019-11-21 Thread Shalom Sagges
Hi Experts, I use Kafka 0.11.2 I have an issue where the Kafka logs are bombarded with the following error: ERROR [KafkaApi-14733] Error when handling request {replica_id=-1,max_wait_time=0,min_bytes=0,max_bytes=2147483647,topics=[{topic=my_topic,partitions=[{partition=22,fetch_offset=1297798,max

Re: KSQL Question

2019-05-01 Thread shalom sagges
the Confluent images are fantastic for > experimentation and prototyping. > > https://docs.confluent.io/current/ksql/docs/installation/install-ksql-with-docker.html > > On Wed, May 1, 2019 at 7:04 PM Liam Clarke > wrote: > > > > > > > On Wed, May 1, 2019 at 7:

Re: KSQL Question

2019-05-01 Thread shalom sagges
ew libraries > KSQL depends on. And you'll need Kafka. > For the sake of experimentation you are probably better off using the > all-in-one Confluent Platform. It will save you some time. > > I hope that helps. > --Vahid > > On Tue, Apr 30, 2019 at 7:38 AM shalom sagges

KSQL Question

2019-04-30 Thread shalom sagges
Hi All, I'm new to Kafka and wanted to experience with KSQL. However, I can't find a place to download it without downloading the entire Confluent Platform package. Please correct me if I'm wrong, but I understand that KSQL is free, so there must be a place where I can download only KSQL. Can some

Re: Partition Count Dilemma

2019-03-21 Thread shalom sagges
gt; most number of consumer is 10. So you need to assume the throughput a > > consumer can provide is C, and the target throughput is T. Then the > minimum > > number of partitions, that is, the number of consumers, is T/C. > > > > > > > > 1095193...@qq.com >

Partition Count Dilemma

2019-03-20 Thread shalom sagges
Hi All, I'm really new to Kafka and wanted to know if anyone can help me better understand partition count in relation to the Kafka cluster (apologies in advance for noob questions). I was requested to increase a topic's partition count from 30 to 100 in order to increase workers' parallelism (th