You can use AdminClient.createTopics with the necessary configuration.
On Wed, May 8, 2019 at 12:08 PM SenthilKumar K
wrote:
> Hello Experts , We have a requirement to create topic dynamically with two
> different config(s). Is this possible in Kafka ?
>
> Kafka Version : 2.2.0
>
> Topics with d
Hi Alessandro,
Apologies for the late reply.
I tried the code from your repository under
https://github.com/alex88/kafka-test/tree/master and I run into a
`ClassCastException`. I think this is a bug that is described here
https://issues.apache.org/jira/browse/KAFKA-8317 .
Should I have tried one
Hi Bruno,
no worries.
No that was an old problem, the latest code is on the gist from the last
email.
Anyway I've pushed the master branch with the same code, I'm not sure I've
done the right thing with the jars but the code should be there.
The gist https://gist.github.com/alex88/43b72e23bda9e156
I have an architectural question.
I am planning to create a data transformation pipeline for document
transformation. Each component will send processing events to the Kafka
'events' topic.
It will have the following steps:
1) Upload data to the repository (S3 or other storage). Get public URL t
Hi John,
Thank you for your reply. Indeed, your explanation makes sense to me. Thank
you again for taking the time to reply.
Regards,
Jose
On Tue, 30 Apr 2019 at 22:22, John Roesler wrote:
> Hi Ashok,
>
> I think some people may be able to give you advice, but please start a new
> thread inste
Pavel, one thing I'd recommend: don't jam multiple event types into a
single topic. You are better served with multiple topics, each with a
single schema and event type. In your case, you might have a received topic
and a transformed topic, with an app consuming received and producing
transformed.
Hello Kafka users, developers and client-developers,
This is the first candidate for release of Apache Kafka 2.2.1, which
includes many bug fixes for Apache Kafka 2.2.
Release notes for the 2.2.1 release:
https://home.apache.org/~vahid/kafka-2.2.1-rc0/RELEASE_NOTES.html
*** Please download, test
If ordering of these events is important, then putting them in the
same topic is not only desired, it's necessary. See
https://www.confluent.io/blog/put-several-event-types-kafka-topic/.
However, think hard about whether ordering is actually important in
your use case or not, as things are certainl
Ryanne,
Thank you for the advice. It's exactly what we have now. Different topics
for different processing steps.
However, I would like to make extensible architecture with multiple
processing steps.
We will introduce other transformers later on. I was thinking that if all
of them will send even
Hi,
I created a simple Spring Boot Application with Kafka and added a
dependency from Kafka Streams. The application can send and receive
messages and works fine.
In the same app, I want to use Kafka Streams to calculate statistic about
the topic.
I wrote the following code from the word count e
10 matches
Mail list logo