Re: [VOTE] 3.1.0 RC0

2021-12-30 Thread Israel Ekpo
I have ran some initial validations using the steps here https://github.com/izzyacademy/apache-kafka-release-party - Validation of Hashes looks good - Validation of GPG Keys looks good - Validation of Source Code was skipped since the build for the 3.1 branch already passed - Vali

Re: Kafka Topics

2021-12-30 Thread Suresh Chidambaram
Hi Ola, I would suggest you can go with single Topic with multiple partitions. Once the data gets received from the Topic, you can do a DB update kind of a stuff to store the data , then use the data for analysing. Also, the below URL can be used to do the Topic sizing. eventsizer.io Thanks C

Re: Kafka-Real Time Update

2021-12-30 Thread Dave Klein
That really was a helpful overview, Israel. Might make a good blog post! 😀 Ola, C# would make it so that you can’t use Kafka Streams, but you may not need it. The Kafka Consumer API, which is available in C#, might be enough for you. For a good explanation of topics, partitions, and pretty m

RE: Kafka-Real Time Update

2021-12-30 Thread Ola Bissani
Dear Israel, Thank you so much for your support, I will check the links you sent in your email to start my service. As for your question, yes the events generated by the devices are similar in data structures. I would also like to state that my service will be either done in java or C#. Would

Re: Kafka-Real Time Update

2021-12-30 Thread Israel Ekpo
Ola, Let's review the Apache Kafka ecosystem briefly, and then I will make an attempt to address your concerns: In the Kafka Ecosystem, we have the following components: - Brokers (stores events in logical containers called Topics. Topics are analogous to Tables in relational databases like MySQ

Kafka-Real Time Update

2021-12-30 Thread Ola Bissani
Dears, I'm looking for a way to get real-time updates using my service, I believe kafka is the way to go but I still have an issue on how to use it. My system gets data from devices using GPRS, I then read this data and analyze it to check what action I should do afterwards. I need the anal

RE: Kafka Topics

2021-12-30 Thread Ola Bissani
Dears, I'm looking for a way to get real-time updates using my service, I believe kafka is the way to go but I still have an issue on how to use it. My system gets data from devices using GPRS, I then read this data and analyze it to check what action I should do afterwards. I need the analyzin