Hi,
I use Kafka 0.11.3
I delete topics from Kafka using the command *kafka-topic.sh *and after a
while, I observer Kafka just mark topics for deletion while the
property *delete.topic.enable
*was true! So I stop Kafka cluster and delete the data log directory of
Kafka using the command *rm -r /da
Hi,
I want to use s3 connect by portioning with FieldPartitioner and
partition.field.name set to a non timestamp based field. I want to commit and
flush based on both size and time. I am getting an exception when I use the
option "rotate.schedule.interval.ms". Is it possible to rotate it with
Hi Manu,
can you share your s3 connector config as well the exception you are
getting? with only this info, I do need more details to understand your
issue. Keep in mind the option you are using "rotate.schedule.interval.ms"
from the docs says:
> This configuration is useful when you have to com
Hi Pere,
Following is my configuration. In this test, I want to flush 1000 records
and/or 5 minutes.
{"connector.class":"io.confluent.connect.s3.S3SinkConnector","s3.region":"us-east-1","topics.dir":"test_topics","flush.size":"1000","schema.compatibility":"NONE","topics":"sinmaj-test","tasks.ma
Hi,
from the confluent docs,
> Offset Management: The two main settings affecting offset management are
whether auto-commit is enabled and the offset reset policy. First, if you
set enable.auto.commit (which is the default), then the consumer will
automatically commit offsets periodically at the
Can you please try with 3 zookeeper nodes? I guess the leader election is
not happening correctly due to even number of servers.
Thanks,
Anji.
On Sun, 3 Feb 2019, 17:27 Soheil Pourbafrani Hi,
>
> I use Kafka 0.11.3
>
> I delete topics from Kafka using the command *kafka-topic.sh *and after a
> w
I'll try it
For your information, I connect another single node Kafka to the same
Zookeeper cluster and it got data without any error.
In addition, I turned off one of the Kafka nodes and the single remaining
node did the same thing, it created topics but in less than one minutes the
log dir direct
