https://www.confluent.io/blog/how-choose-number-topics-partitions-kafka-cluster
This might be useful for you.
On Sat 26 Oct, 2019, 12:40 PM Jungyeol Lee,
wrote:
> I'm running a kafka cluster running only one broker with GCP n1-standard-2
> instance.
> I configured the number of partitions to 10
Here's a toy project - analyzing twitter stream.
1) Create dev. account on twitter
2) Using your dev credentials, connect to twitter stream api to retrieve
stream of tweets
3) Store tweets in Kafka (using Kafka producer)
4) Retrieve tweets (using Kafka consumer)
5) For each tweet (or group of twee